2023-10-14T12:11:38.502 INFO:root:teuthology version: 0.0.1.dev197+g8cdab07 2023-10-14T12:11:38.503 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_rishabh@teuthology --name rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi --archive /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313 -- /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313/orig.config.yaml 2023-10-14T12:11:38.547 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-14T12:11:38.627 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313 branch: rishabh-2023oct13 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7425313' kernel: flavor: default kdb: true sha1: 47672119149b103ec7cec2cc65c063ccbb001ac7 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023oct13 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023oct13 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6006 sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 sleep_before_teardown: 0 subset: 402/512 suite: fs suite_branch: rishabh-2023oct13 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi064.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLttCEeCAE/ysK/osVaJ8GI737XDqgW+5039hgU/ytayy8VOUD0CjOJLVIZ8EEy6IJofUAyLaaODKEW1pPee0w8= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwC2Q6TC+2vwkI9aqBnQh06SHUmt7dhsYNBJd7qqAPCVNyYZ2UMCBpQXmG/n55AFYS835L3eze/QWWeJyOmblc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 8cdab074dcca9a68965bc5a50e9c30b691949723 timestamp: 2023-10-13_18:04:14 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-14T12:11:38.627 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa; will attempt to use it 2023-10-14T12:11:38.628 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks 2023-10-14T12:11:38.629 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-14T12:11:38.631 INFO:teuthology.task.internal:Checking packages... 2023-10-14T12:11:38.653 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0' 2023-10-14T12:11:38.654 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-14T12:11:38.654 INFO:teuthology.packaging:ref: None 2023-10-14T12:11:38.654 INFO:teuthology.packaging:tag: None 2023-10-14T12:11:38.655 INFO:teuthology.packaging:branch: rishabh-2023oct13 2023-10-14T12:11:38.655 INFO:teuthology.packaging:sha1: 4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:11:38.655 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023oct13 2023-10-14T12:11:38.803 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6730.g4ba8a190 2023-10-14T12:11:38.804 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-14T12:11:38.810 INFO:teuthology.task.internal:no buildpackages task found 2023-10-14T12:11:38.810 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-14T12:11:38.820 INFO:teuthology.task.internal:Saving configuration 2023-10-14T12:11:38.837 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-14T12:11:38.843 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-14T12:11:38.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi064.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:06:56.947244', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLttCEeCAE/ysK/osVaJ8GI737XDqgW+5039hgU/ytayy8VOUD0CjOJLVIZ8EEy6IJofUAyLaaODKEW1pPee0w8='} 2023-10-14T12:11:38.892 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-14 12:06:56.948763', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwC2Q6TC+2vwkI9aqBnQh06SHUmt7dhsYNBJd7qqAPCVNyYZ2UMCBpQXmG/n55AFYS835L3eze/QWWeJyOmblc='} 2023-10-14T12:11:38.892 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-14T12:11:38.898 INFO:teuthology.task.internal:roles: ubuntu@smithi064.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-14T12:11:38.898 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-14T12:11:38.899 INFO:teuthology.run_tasks:Running task console_log... 2023-10-14T12:11:38.971 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4038414b80>, signals=[15]) 2023-10-14T12:11:38.973 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-14T12:11:38.979 INFO:teuthology.task.internal:Opening connections... 2023-10-14T12:11:38.979 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:11:38.981 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:11:39.079 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:11:39.080 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:11:39.161 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-14T12:11:39.167 DEBUG:teuthology.orchestra.run.smithi064:> uname -m 2023-10-14T12:11:39.187 INFO:teuthology.orchestra.run.smithi064.stdout:x86_64 2023-10-14T12:11:39.187 DEBUG:teuthology.orchestra.run.smithi064:> cat /etc/os-release 2023-10-14T12:11:39.245 INFO:teuthology.orchestra.run.smithi064.stdout:NAME="CentOS Stream" 2023-10-14T12:11:39.245 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION="9" 2023-10-14T12:11:39.245 INFO:teuthology.orchestra.run.smithi064.stdout:ID="centos" 2023-10-14T12:11:39.246 INFO:teuthology.orchestra.run.smithi064.stdout:ID_LIKE="rhel fedora" 2023-10-14T12:11:39.246 INFO:teuthology.orchestra.run.smithi064.stdout:VERSION_ID="9" 2023-10-14T12:11:39.246 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM_ID="platform:el9" 2023-10-14T12:11:39.246 INFO:teuthology.orchestra.run.smithi064.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T12:11:39.247 INFO:teuthology.orchestra.run.smithi064.stdout:ANSI_COLOR="0;31" 2023-10-14T12:11:39.247 INFO:teuthology.orchestra.run.smithi064.stdout:LOGO="fedora-logo-icon" 2023-10-14T12:11:39.247 INFO:teuthology.orchestra.run.smithi064.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T12:11:39.247 INFO:teuthology.orchestra.run.smithi064.stdout:HOME_URL="https://centos.org/" 2023-10-14T12:11:39.248 INFO:teuthology.orchestra.run.smithi064.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T12:11:39.248 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T12:11:39.248 INFO:teuthology.orchestra.run.smithi064.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T12:11:39.249 INFO:teuthology.lock.ops:Updating smithi064.front.sepia.ceph.com on lock server 2023-10-14T12:11:39.269 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2023-10-14T12:11:39.287 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2023-10-14T12:11:39.287 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2023-10-14T12:11:39.343 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2023-10-14T12:11:39.344 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2023-10-14T12:11:39.344 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2023-10-14T12:11:39.344 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2023-10-14T12:11:39.344 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2023-10-14T12:11:39.344 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2023-10-14T12:11:39.345 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2023-10-14T12:11:39.345 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2023-10-14T12:11:39.345 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2023-10-14T12:11:39.345 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-10-14T12:11:39.345 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2023-10-14T12:11:39.346 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-14T12:11:39.346 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-10-14T12:11:39.346 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-10-14T12:11:39.346 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2023-10-14T12:11:39.369 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-14T12:11:39.380 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-14T12:11:39.386 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-14T12:11:39.386 DEBUG:teuthology.orchestra.run.smithi064:> test '!' -e /home/ubuntu/cephtest 2023-10-14T12:11:39.389 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2023-10-14T12:11:39.405 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-14T12:11:39.412 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-14T12:11:39.412 DEBUG:teuthology.orchestra.run.smithi064:> test -z $(ls -A /var/lib/ceph) 2023-10-14T12:11:39.446 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2023-10-14T12:11:39.474 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-14T12:11:39.527 INFO:teuthology.run_tasks:Running task kernel... 2023-10-14T12:11:39.543 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'} 2023-10-14T12:11:39.544 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, timeout 300 2023-10-14T12:11:39.544 DEBUG:teuthology.orchestra.run.smithi064:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T12:11:39.545 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-14T12:11:39.561 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:11:39.562 DEBUG:teuthology.task.kernel:sha1 for mon.b is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:11:39.562 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T12:11:39.562 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2023-10-14T12:11:39.563 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:11:39.564 DEBUG:teuthology.task.kernel:sha1 for mon.a is 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:11:39.564 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "47672119149b103ec7cec2cc65c063ccbb001ac7"... 2023-10-14T12:11:39.564 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2023-10-14T12:11:39.619 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-361.el9.x86_64 2023-10-14T12:11:39.619 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:11:39.620 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T12:11:39.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:11:39.624 INFO:teuthology.orchestra.run.smithi064.stdout:5.14.0-361.el9.x86_64 2023-10-14T12:11:39.624 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:11:39.624 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-10-14T12:11:39.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:11:39.763 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum upgrade -y linux-firmware 2023-10-14T12:11:39.835 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum upgrade -y linux-firmware 2023-10-14T12:11:42.152 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - AppStream 8.3 MB/s | 6.3 MB 00:00 2023-10-14T12:11:42.231 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - AppStream 7.3 MB/s | 6.3 MB 00:00 2023-10-14T12:11:43.519 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - BaseOS 5.9 MB/s | 2.0 MB 00:00 2023-10-14T12:11:43.598 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2023-10-14T12:11:44.530 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-10-14T12:11:44.651 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 7.9 MB 00:00 2023-10-14T12:11:46.344 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 26 MB/s | 18 MB 00:00 2023-10-14T12:11:50.930 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 5.7 MB 00:01 2023-10-14T12:11:52.362 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 14 kB 00:00 2023-10-14T12:11:53.363 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 21 MB/s | 19 MB 00:00 2023-10-14T12:11:53.731 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 2.2 MB/s | 18 MB 00:08 2023-10-14T12:11:57.863 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 47 kB/s | 1.7 kB 00:00 2023-10-14T12:11:58.558 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 4.2 MB/s | 5.7 MB 00:01 2023-10-14T12:11:59.948 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 56 kB/s | 14 kB 00:00 2023-10-14T12:11:59.967 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2023-10-14T12:11:59.979 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2023-10-14T12:11:59.979 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2023-10-14T12:11:59.980 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2023-10-14T12:11:59.980 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2023-10-14T12:11:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-14T12:11:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:11:59.981 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2023-10-14T12:11:59.981 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2023-10-14T12:11:59.981 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 1 Package 2023-10-14T12:11:59.981 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:11:59.981 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 326 M 2023-10-14T12:11:59.982 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2023-10-14T12:12:01.075 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 19 MB/s | 19 MB 00:01 2023-10-14T12:12:05.733 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2023-10-14T12:12:06.889 INFO:teuthology.orchestra.run.smithi177.stdout:linux-firmware-20230926-140.el9.noarch.rpm 47 MB/s | 326 MB 00:06 2023-10-14T12:12:06.890 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:12:06.890 INFO:teuthology.orchestra.run.smithi177.stdout:Total 47 MB/s | 326 MB 00:06 2023-10-14T12:12:06.891 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2023-10-14T12:12:06.978 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2023-10-14T12:12:06.979 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2023-10-14T12:12:07.959 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-10-14T12:12:07.975 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-10-14T12:12:07.975 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-10-14T12:12:07.975 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-10-14T12:12:07.975 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2023-10-14T12:12:07.976 INFO:teuthology.orchestra.run.smithi064.stdout: linux-firmware noarch 20230926-140.el9 CentOS-BaseOS 326 M 2023-10-14T12:12:07.976 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:12:07.976 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-10-14T12:12:07.976 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-10-14T12:12:07.977 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 1 Package 2023-10-14T12:12:07.977 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:12:07.977 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 326 M 2023-10-14T12:12:07.977 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-10-14T12:12:09.045 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2023-10-14T12:12:09.045 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2023-10-14T12:12:14.434 INFO:teuthology.orchestra.run.smithi064.stdout:linux-firmware-20230926-140.el9.noarch.rpm 50 MB/s | 326 MB 00:06 2023-10-14T12:12:14.435 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:12:14.435 INFO:teuthology.orchestra.run.smithi064.stdout:Total 50 MB/s | 326 MB 00:06 2023-10-14T12:12:14.436 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-10-14T12:12:14.518 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-10-14T12:12:14.518 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-10-14T12:12:14.622 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2023-10-14T12:12:14.972 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T12:12:15.053 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T12:12:16.072 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T12:12:16.072 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T12:12:16.474 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T12:12:16.474 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:12:16.474 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2023-10-14T12:12:16.474 INFO:teuthology.orchestra.run.smithi177.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-14T12:12:16.475 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:12:16.475 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2023-10-14T12:12:16.685 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-10-14T12:12:16.685 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-10-14T12:12:16.760 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-14T12:12:16.761 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:12:16.910 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-14T12:12:16.910 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-14T12:12:16.913 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi177.front.sepia.ceph.com to complete... 2023-10-14T12:12:22.606 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-10-14T12:12:22.888 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T12:12:22.966 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T12:12:23.910 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T12:12:23.910 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : linux-firmware-20230926-140.el9.noarch 1/2 2023-10-14T12:12:24.259 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-10-14T12:12:24.260 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:12:24.260 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2023-10-14T12:12:24.260 INFO:teuthology.orchestra.run.smithi064.stdout: linux-firmware-20230926-140.el9.noarch 2023-10-14T12:12:24.260 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:12:24.261 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-10-14T12:12:24.555 INFO:teuthology.task.kernel:Downloading kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-14T12:12:24.555 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=47672119149b103ec7cec2cc65c063ccbb001ac7 2023-10-14T12:12:24.693 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ 2023-10-14T12:12:24.694 DEBUG:teuthology.orchestra.run.smithi064:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/ --input-file=- 2023-10-14T12:12:24.696 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi064.front.sepia.ceph.com to complete... 2023-10-14T12:12:28.453 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14 12:12:28 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-14T12:12:28.453 INFO:teuthology.orchestra.run.smithi177.stderr:FINISHED --2023-10-14 12:12:28-- 2023-10-14T12:12:28.453 INFO:teuthology.orchestra.run.smithi177.stderr:Total wall clock time: 12s 2023-10-14T12:12:28.454 INFO:teuthology.orchestra.run.smithi177.stderr:Downloaded: 1 files, 306M in 11s (27.6 MB/s) 2023-10-14T12:12:28.455 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.b... 2023-10-14T12:12:28.455 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-14T12:12:30.302 INFO:teuthology.orchestra.run.smithi177.stdout:Verifying... ######################################## 2023-10-14T12:12:30.383 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing... ######################################## 2023-10-14T12:12:30.464 INFO:teuthology.orchestra.run.smithi177.stdout:Updating / installing... 2023-10-14T12:12:37.576 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-14T12:12:43.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14 12:12:43 URL:https://2.chacra.ceph.com/r/kernel/testing/47672119149b103ec7cec2cc65c063ccbb001ac7/centos/9/flavors/default/x86_64/kernel-6.6.0_rc5_g47672119149b-1.x86_64.rpm [320683515/320683515] -> "/tmp/kernel.x86_64.rpm" [1] 2023-10-14T12:12:43.579 INFO:teuthology.orchestra.run.smithi064.stderr:FINISHED --2023-10-14 12:12:43-- 2023-10-14T12:12:43.579 INFO:teuthology.orchestra.run.smithi064.stderr:Total wall clock time: 19s 2023-10-14T12:12:43.580 INFO:teuthology.orchestra.run.smithi064.stderr:Downloaded: 1 files, 306M in 18s (16.7 MB/s) 2023-10-14T12:12:43.581 INFO:teuthology.task.kernel:Installing kernel 47672119149b103ec7cec2cc65c063ccbb001ac7 on mon.a... 2023-10-14T12:12:43.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-10-14T12:12:45.523 INFO:teuthology.orchestra.run.smithi064.stdout:Verifying... ######################################## 2023-10-14T12:12:45.587 INFO:teuthology.orchestra.run.smithi064.stdout:Preparing... ######################################## 2023-10-14T12:12:45.671 INFO:teuthology.orchestra.run.smithi064.stdout:Updating / installing... 2023-10-14T12:12:52.244 INFO:teuthology.orchestra.run.smithi177.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-14T12:12:53.095 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-6.6.0_rc5_g47672119149b-1 ######################################## 2023-10-14T12:13:08.070 INFO:teuthology.orchestra.run.smithi064.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-10-14T12:13:13.510 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-14T12:13:13.511 DEBUG:teuthology.orchestra.run.smithi177:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-14T12:13:13.615 INFO:teuthology.orchestra.run.smithi177.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T12:13:13.615 INFO:teuthology.orchestra.run.smithi177.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-14T12:13:13.616 INFO:teuthology.orchestra.run.smithi177.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T12:13:13.616 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-14T12:13:13.616 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-14T12:13:13.616 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-14T12:13:13.617 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-14T12:13:13.617 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-14T12:13:13.617 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T12:13:13.617 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T12:13:13.617 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T12:13:13.618 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T12:13:13.618 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T12:13:13.618 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T12:13:13.618 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T12:13:13.619 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-14T12:13:13.619 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T12:13:13.619 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T12:13:13.619 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T12:13:13.619 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T12:13:13.620 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T12:13:13.620 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T12:13:13.620 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T12:13:13.620 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T12:13:13.620 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T12:13:13.621 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T12:13:13.621 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T12:13:13.621 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T12:13:13.621 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-14T12:13:13.621 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-14T12:13:13.622 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-14T12:13:13.622 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T12:13:13.622 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-14T12:13:13.622 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T12:13:13.622 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T12:13:13.623 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T12:13:13.623 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-14T12:13:13.623 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T12:13:13.623 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T12:13:13.624 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T12:13:13.624 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-14T12:13:13.624 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T12:13:13.624 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T12:13:13.625 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T12:13:13.625 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T12:13:13.625 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T12:13:13.625 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T12:13:13.625 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T12:13:13.626 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T12:13:13.626 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T12:13:13.626 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T12:13:13.626 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T12:13:13.626 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T12:13:13.627 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T12:13:13.627 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T12:13:13.627 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T12:13:13.627 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T12:13:13.628 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T12:13:13.628 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T12:13:13.628 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T12:13:13.628 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T12:13:13.628 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T12:13:13.628 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T12:13:13.629 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T12:13:13.629 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T12:13:13.629 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T12:13:13.629 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T12:13:13.629 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T12:13:13.630 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T12:13:13.630 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T12:13:13.630 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T12:13:13.630 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T12:13:13.630 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T12:13:13.631 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T12:13:13.631 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T12:13:13.631 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T12:13:13.631 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T12:13:13.631 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T12:13:13.632 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T12:13:13.632 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T12:13:13.632 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T12:13:13.632 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T12:13:13.632 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T12:13:13.633 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T12:13:13.633 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T12:13:13.633 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T12:13:13.633 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-14T12:13:13.633 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-14T12:13:13.634 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T12:13:13.634 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T12:13:13.634 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-14T12:13:13.634 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T12:13:13.634 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T12:13:13.635 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T12:13:13.635 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T12:13:13.635 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T12:13:13.635 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-14T12:13:13.635 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T12:13:13.635 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T12:13:13.636 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-14T12:13:13.636 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T12:13:13.636 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T12:13:13.636 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T12:13:13.636 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T12:13:13.637 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T12:13:13.637 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T12:13:13.637 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T12:13:13.637 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T12:13:13.637 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T12:13:13.637 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T12:13:13.638 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T12:13:13.638 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T12:13:13.638 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T12:13:13.638 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T12:13:13.638 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T12:13:13.639 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T12:13:13.639 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T12:13:13.639 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T12:13:13.639 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T12:13:13.639 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T12:13:13.640 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T12:13:13.640 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T12:13:13.640 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T12:13:13.640 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T12:13:13.640 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T12:13:13.641 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T12:13:13.641 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T12:13:13.641 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T12:13:13.641 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T12:13:13.641 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T12:13:13.642 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T12:13:13.642 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T12:13:13.642 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T12:13:13.642 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T12:13:13.642 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T12:13:13.643 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-14T12:13:13.643 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T12:13:13.643 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T12:13:13.643 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T12:13:13.643 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T12:13:13.644 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T12:13:13.644 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T12:13:13.644 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T12:13:13.644 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T12:13:13.644 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T12:13:13.645 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T12:13:13.645 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T12:13:13.645 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T12:13:13.645 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T12:13:13.645 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T12:13:13.645 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T12:13:13.646 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T12:13:13.646 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T12:13:13.646 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-14T12:13:13.646 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T12:13:13.646 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-14T12:13:13.647 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-14T12:13:13.647 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-14T12:13:13.647 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-14T12:13:13.647 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-14T12:13:13.647 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T12:13:13.648 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-14T12:13:13.648 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-14T12:13:13.648 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T12:13:13.648 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-14T12:13:13.648 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-14T12:13:13.649 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T12:13:13.649 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T12:13:13.649 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-14T12:13:13.649 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-14T12:13:13.650 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T12:13:13.650 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T12:13:13.650 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-14T12:13:13.650 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T12:13:13.650 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T12:13:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T12:13:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-14T12:13:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-14T12:13:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T12:13:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-14T12:13:13.652 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-14T12:13:13.652 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T12:13:13.652 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-14T12:13:13.652 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T12:13:13.652 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-14T12:13:13.653 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T12:13:13.653 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T12:13:13.653 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T12:13:13.653 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T12:13:13.653 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T12:13:13.654 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-14T12:13:13.654 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T12:13:13.654 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T12:13:13.654 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T12:13:13.654 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T12:13:13.655 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T12:13:13.655 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T12:13:13.655 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T12:13:13.655 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-14T12:13:13.656 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T12:13:13.656 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T12:13:13.656 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T12:13:13.656 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-14T12:13:13.656 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-14T12:13:13.657 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T12:13:13.657 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T12:13:13.657 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T12:13:13.657 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-14T12:13:13.658 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-14T12:13:13.658 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-14T12:13:13.658 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-14T12:13:13.658 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-14T12:13:13.658 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-14T12:13:13.659 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T12:13:13.659 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T12:13:13.659 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-14T12:13:13.660 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-14T12:13:13.660 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T12:13:13.660 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-14T12:13:13.660 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-14T12:13:13.660 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T12:13:13.661 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T12:13:13.661 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-14T12:13:13.661 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-14T12:13:13.661 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-14T12:13:13.661 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T12:13:13.662 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-14T12:13:13.662 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T12:13:13.662 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T12:13:13.662 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T12:13:13.662 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-14T12:13:13.663 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T12:13:13.663 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-14T12:13:13.663 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T12:13:13.663 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-14T12:13:13.663 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-14T12:13:13.664 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-14T12:13:13.664 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-14T12:13:13.664 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T12:13:13.664 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-14T12:13:13.665 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T12:13:13.665 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-14T12:13:13.665 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T12:13:13.665 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T12:13:13.665 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T12:13:13.666 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T12:13:13.666 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T12:13:13.666 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T12:13:13.667 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T12:13:13.667 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T12:13:13.667 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T12:13:13.667 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T12:13:13.667 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T12:13:13.668 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T12:13:13.668 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T12:13:13.668 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-14T12:13:13.668 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-14T12:13:13.668 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T12:13:13.669 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-14T12:13:13.669 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T12:13:13.669 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T12:13:13.669 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-14T12:13:13.669 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T12:13:13.670 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T12:13:13.670 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T12:13:13.670 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T12:13:13.670 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T12:13:13.670 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T12:13:13.671 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T12:13:13.671 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T12:13:13.671 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T12:13:13.671 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T12:13:13.672 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T12:13:13.672 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T12:13:13.672 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T12:13:13.672 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T12:13:13.672 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T12:13:13.673 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T12:13:13.673 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T12:13:13.673 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T12:13:13.674 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T12:13:13.674 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T12:13:13.674 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T12:13:13.674 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T12:13:13.674 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T12:13:13.675 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T12:13:13.675 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T12:13:13.675 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T12:13:13.675 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T12:13:13.675 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T12:13:13.676 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T12:13:13.676 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T12:13:13.676 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T12:13:13.676 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T12:13:13.676 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T12:13:13.677 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T12:13:13.677 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T12:13:13.677 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T12:13:13.678 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T12:13:13.678 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T12:13:13.678 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T12:13:13.678 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T12:13:13.679 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T12:13:13.679 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T12:13:13.679 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T12:13:13.679 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T12:13:13.679 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T12:13:13.679 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T12:13:13.680 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T12:13:13.680 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T12:13:13.680 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T12:13:13.680 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T12:13:13.681 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T12:13:13.681 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T12:13:13.681 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T12:13:13.681 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T12:13:13.682 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T12:13:13.682 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T12:13:13.682 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T12:13:13.682 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T12:13:13.682 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T12:13:13.683 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T12:13:13.683 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T12:13:13.683 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T12:13:13.683 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T12:13:13.683 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T12:13:13.684 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-14T12:13:13.684 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T12:13:13.684 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T12:13:13.684 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T12:13:13.684 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-14T12:13:13.685 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T12:13:13.685 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T12:13:13.685 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T12:13:13.685 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T12:13:13.685 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T12:13:13.686 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T12:13:13.686 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T12:13:13.686 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T12:13:13.686 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T12:13:13.686 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T12:13:13.687 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T12:13:13.687 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T12:13:13.687 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T12:13:13.687 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T12:13:13.687 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T12:13:13.687 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T12:13:13.688 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T12:13:13.688 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T12:13:13.688 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T12:13:13.688 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T12:13:13.688 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T12:13:13.689 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T12:13:13.689 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T12:13:13.689 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T12:13:13.689 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T12:13:13.689 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T12:13:13.689 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T12:13:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T12:13:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T12:13:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T12:13:13.690 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T12:13:13.691 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T12:13:13.691 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T12:13:13.691 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T12:13:13.691 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T12:13:13.691 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T12:13:13.692 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T12:13:13.692 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T12:13:13.692 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T12:13:13.692 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T12:13:13.692 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T12:13:13.692 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T12:13:13.693 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T12:13:13.693 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T12:13:13.693 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T12:13:13.693 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T12:13:13.693 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T12:13:13.694 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T12:13:13.694 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T12:13:13.694 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T12:13:13.694 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T12:13:13.694 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T12:13:13.695 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T12:13:13.695 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T12:13:13.695 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T12:13:13.695 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T12:13:13.695 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T12:13:13.696 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T12:13:13.696 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T12:13:13.696 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T12:13:13.696 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T12:13:13.696 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T12:13:13.697 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T12:13:13.697 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T12:13:13.697 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T12:13:13.697 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T12:13:13.697 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T12:13:13.698 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T12:13:13.698 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T12:13:13.698 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T12:13:13.698 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T12:13:13.698 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T12:13:13.699 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T12:13:13.699 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T12:13:13.699 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T12:13:13.699 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T12:13:13.699 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T12:13:13.700 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T12:13:13.700 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T12:13:13.700 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T12:13:13.700 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T12:13:13.700 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T12:13:13.700 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T12:13:13.701 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T12:13:13.701 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T12:13:13.701 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T12:13:13.701 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T12:13:13.701 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T12:13:13.702 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-14T12:13:13.702 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T12:13:13.702 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T12:13:13.702 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T12:13:13.702 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T12:13:13.703 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T12:13:13.703 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T12:13:13.703 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T12:13:13.703 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T12:13:13.703 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T12:13:13.704 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T12:13:13.704 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T12:13:13.704 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T12:13:13.704 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T12:13:13.704 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T12:13:13.704 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T12:13:13.705 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T12:13:13.705 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T12:13:13.705 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T12:13:13.705 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T12:13:13.705 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T12:13:13.706 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T12:13:13.706 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T12:13:13.706 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T12:13:13.706 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T12:13:13.706 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T12:13:13.707 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T12:13:13.707 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T12:13:13.707 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T12:13:13.707 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T12:13:13.707 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T12:13:13.708 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T12:13:13.708 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T12:13:13.708 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T12:13:13.708 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T12:13:13.708 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T12:13:13.709 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T12:13:13.709 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T12:13:13.709 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T12:13:13.709 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T12:13:13.709 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T12:13:13.709 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T12:13:13.710 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-14T12:13:13.710 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-14T12:13:13.710 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T12:13:13.710 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T12:13:13.710 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-14T12:13:13.711 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T12:13:13.711 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T12:13:13.711 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T12:13:13.711 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T12:13:13.711 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T12:13:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T12:13:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T12:13:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T12:13:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T12:13:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T12:13:13.713 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T12:13:13.713 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T12:13:13.713 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T12:13:13.713 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T12:13:13.713 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T12:13:13.714 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T12:13:13.714 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T12:13:13.714 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T12:13:13.714 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T12:13:13.714 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T12:13:13.715 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T12:13:13.715 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T12:13:13.715 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T12:13:13.715 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-14T12:13:13.715 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T12:13:13.716 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-14T12:13:13.716 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T12:13:13.716 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T12:13:13.716 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-14T12:13:13.716 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-14T12:13:13.717 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T12:13:13.717 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T12:13:13.717 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T12:13:13.717 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T12:13:13.718 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T12:13:13.718 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T12:13:13.718 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T12:13:13.718 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-14T12:13:13.718 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-14T12:13:13.719 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T12:13:13.719 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-14T12:13:13.719 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T12:13:13.719 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-14T12:13:13.719 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T12:13:13.719 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-14T12:13:13.720 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T12:13:13.720 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-14T12:13:13.720 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-14T12:13:13.720 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T12:13:13.720 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-14T12:13:13.721 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T12:13:13.721 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-14T12:13:13.721 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T12:13:13.721 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-14T12:13:13.721 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T12:13:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-14T12:13:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T12:13:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-14T12:13:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-14T12:13:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T12:13:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T12:13:13.723 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T12:13:13.723 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T12:13:13.723 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-14T12:13:13.723 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T12:13:13.723 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-14T12:13:13.724 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T12:13:13.724 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T12:13:13.724 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T12:13:13.724 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T12:13:13.724 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T12:13:13.725 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T12:13:13.725 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T12:13:13.725 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T12:13:13.725 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-14T12:13:13.725 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T12:13:13.725 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-14T12:13:13.726 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T12:13:13.726 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T12:13:13.726 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T12:13:13.726 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T12:13:13.726 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T12:13:13.727 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-14T12:13:13.727 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-14T12:13:13.727 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T12:13:13.727 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-14T12:13:13.727 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T12:13:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T12:13:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T12:13:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T12:13:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-14T12:13:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T12:13:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T12:13:13.729 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T12:13:13.729 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T12:13:13.729 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T12:13:13.729 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T12:13:13.729 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T12:13:13.730 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T12:13:13.730 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-14T12:13:13.730 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-14T12:13:13.730 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T12:13:13.730 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T12:13:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T12:13:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T12:13:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T12:13:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T12:13:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T12:13:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T12:13:13.732 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T12:13:13.732 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T12:13:13.732 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T12:13:13.732 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T12:13:13.732 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T12:13:13.733 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T12:13:13.733 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T12:13:13.733 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T12:13:13.733 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T12:13:13.733 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T12:13:13.734 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T12:13:13.734 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-14T12:13:13.734 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T12:13:13.734 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T12:13:13.734 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T12:13:13.735 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T12:13:13.735 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T12:13:13.735 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-14T12:13:13.735 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-14T12:13:13.736 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T12:13:13.736 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T12:13:13.736 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T12:13:13.736 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T12:13:13.736 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T12:13:13.736 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T12:13:13.737 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T12:13:13.737 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-14T12:13:13.737 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T12:13:13.737 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T12:13:13.737 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-14T12:13:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T12:13:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T12:13:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T12:13:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T12:13:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-14T12:13:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-14T12:13:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T12:13:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T12:13:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T12:13:13.739 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T12:13:13.740 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-14T12:13:13.740 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T12:13:13.740 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-14T12:13:13.740 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T12:13:13.740 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T12:13:13.741 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T12:13:13.741 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T12:13:13.741 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T12:13:13.741 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T12:13:13.741 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T12:13:13.742 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T12:13:13.742 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-14T12:13:13.742 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T12:13:13.742 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T12:13:13.742 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-14T12:13:13.743 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T12:13:13.743 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T12:13:13.743 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T12:13:13.743 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-14T12:13:13.743 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-14T12:13:13.744 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-14T12:13:13.744 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-14T12:13:13.744 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-14T12:13:13.744 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-14T12:13:13.744 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T12:13:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T12:13:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T12:13:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T12:13:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-14T12:13:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T12:13:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-14T12:13:13.746 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-14T12:13:13.746 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T12:13:13.746 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-14T12:13:13.746 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-14T12:13:13.746 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T12:13:13.747 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T12:13:13.747 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T12:13:13.747 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-14T12:13:13.747 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T12:13:13.747 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T12:13:13.748 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T12:13:13.748 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-14T12:13:13.748 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-14T12:13:13.748 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T12:13:13.748 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T12:13:13.748 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T12:13:13.749 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T12:13:13.749 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-14T12:13:13.749 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T12:13:13.749 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T12:13:13.749 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T12:13:13.750 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T12:13:13.750 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-14T12:13:13.750 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T12:13:13.750 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-14T12:13:13.750 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T12:13:13.751 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-14T12:13:13.751 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T12:13:13.751 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-14T12:13:13.751 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T12:13:13.751 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-14T12:13:13.752 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T12:13:13.752 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T12:13:13.752 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T12:13:13.752 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-14T12:13:13.752 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-14T12:13:13.753 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T12:13:13.753 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-14T12:13:13.753 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T12:13:13.753 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-14T12:13:13.753 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T12:13:13.754 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-14T12:13:13.754 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T12:13:13.754 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T12:13:13.754 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-14T12:13:13.754 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T12:13:13.755 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T12:13:13.755 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-14T12:13:13.755 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T12:13:13.755 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T12:13:13.755 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-14T12:13:13.756 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T12:13:13.756 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T12:13:13.756 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-14T12:13:13.756 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-14T12:13:13.756 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T12:13:13.756 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-14T12:13:13.757 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-14T12:13:13.757 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T12:13:13.757 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-14T12:13:13.757 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T12:13:13.757 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-14T12:13:13.758 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T12:13:13.758 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-14T12:13:13.758 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T12:13:13.758 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-14T12:13:13.759 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T12:13:13.759 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-14T12:13:13.759 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-14T12:13:13.759 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T12:13:13.760 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-14T12:13:13.760 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-14T12:13:13.760 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T12:13:13.760 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T12:13:13.760 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T12:13:13.760 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T12:13:13.761 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T12:13:13.761 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T12:13:13.761 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-14T12:13:13.761 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T12:13:13.761 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T12:13:13.762 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T12:13:13.762 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-14T12:13:13.762 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-14T12:13:13.762 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T12:13:13.762 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T12:13:13.763 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T12:13:13.763 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-14T12:13:13.763 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T12:13:13.763 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-14T12:13:13.763 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T12:13:13.763 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-14T12:13:13.764 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T12:13:13.764 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-14T12:13:13.764 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T12:13:13.764 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-14T12:13:13.764 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T12:13:13.765 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-14T12:13:13.765 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T12:13:13.765 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-14T12:13:13.765 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T12:13:13.765 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-14T12:13:13.765 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T12:13:13.766 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-14T12:13:13.766 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T12:13:13.766 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-14T12:13:13.766 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T12:13:13.766 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T12:13:13.767 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-14T12:13:13.767 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T12:13:13.767 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T12:13:13.767 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T12:13:13.767 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-14T12:13:13.768 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-14T12:13:13.768 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T12:13:13.768 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T12:13:13.768 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-14T12:13:13.768 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-14T12:13:13.769 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T12:13:13.769 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-14T12:13:13.769 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T12:13:13.769 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-14T12:13:13.769 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-14T12:13:13.770 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T12:13:13.770 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-14T12:13:13.770 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T12:13:13.770 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T12:13:13.770 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-14T12:13:13.771 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T12:13:13.771 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-14T12:13:13.771 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T12:13:13.771 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-14T12:13:13.771 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T12:13:13.772 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T12:13:13.772 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-14T12:13:13.772 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-14T12:13:13.772 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T12:13:13.772 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T12:13:13.773 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-14T12:13:13.773 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T12:13:13.773 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-14T12:13:13.773 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T12:13:13.773 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-14T12:13:13.773 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T12:13:13.774 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T12:13:13.774 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T12:13:13.774 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T12:13:13.774 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-14T12:13:13.774 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-14T12:13:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-14T12:13:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T12:13:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-14T12:13:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T12:13:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-14T12:13:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T12:13:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T12:13:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-14T12:13:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T12:13:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T12:13:13.777 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T12:13:13.777 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T12:13:13.777 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-14T12:13:13.777 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-14T12:13:13.777 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T12:13:13.777 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T12:13:13.778 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-14T12:13:13.778 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T12:13:13.778 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T12:13:13.778 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T12:13:13.778 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T12:13:13.779 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-14T12:13:13.779 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T12:13:13.779 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-14T12:13:13.779 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T12:13:13.779 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-14T12:13:13.780 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T12:13:13.780 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T12:13:13.780 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-14T12:13:13.780 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T12:13:13.780 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T12:13:13.780 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-14T12:13:13.781 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T12:13:13.781 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T12:13:13.781 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-14T12:13:13.781 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T12:13:13.781 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-14T12:13:13.782 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T12:13:13.782 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T12:13:13.782 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-14T12:13:13.782 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T12:13:13.782 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T12:13:13.783 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T12:13:13.783 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-14T12:13:13.783 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T12:13:13.783 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T12:13:13.783 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T12:13:13.784 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T12:13:13.784 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T12:13:13.784 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-14T12:13:13.784 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T12:13:13.784 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T12:13:13.784 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-14T12:13:13.785 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T12:13:13.785 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T12:13:13.785 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-14T12:13:13.785 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T12:13:13.785 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T12:13:13.786 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-14T12:13:13.786 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T12:13:13.786 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T12:13:13.786 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T12:13:13.786 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T12:13:13.787 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T12:13:13.787 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-14T12:13:13.787 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T12:13:13.787 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T12:13:13.787 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T12:13:13.788 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T12:13:13.788 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T12:13:13.788 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T12:13:13.788 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T12:13:13.788 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T12:13:13.789 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T12:13:13.789 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T12:13:13.789 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T12:13:13.789 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T12:13:13.789 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-14T12:13:13.790 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T12:13:13.790 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T12:13:13.790 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T12:13:13.790 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-14T12:13:13.790 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T12:13:13.791 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T12:13:13.791 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T12:13:13.791 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T12:13:13.791 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T12:13:13.791 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-14T12:13:13.792 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-14T12:13:13.792 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T12:13:13.792 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T12:13:13.792 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T12:13:13.792 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-14T12:13:13.793 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T12:13:13.793 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T12:13:13.793 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T12:13:13.793 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T12:13:13.793 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T12:13:13.794 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T12:13:13.794 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-14T12:13:13.794 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T12:13:13.794 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-14T12:13:13.794 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-14T12:13:13.795 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T12:13:13.795 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-14T12:13:13.795 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T12:13:13.795 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-14T12:13:13.795 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T12:13:13.796 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-14T12:13:13.796 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-14T12:13:13.796 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T12:13:13.796 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-14T12:13:13.796 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-14T12:13:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T12:13:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T12:13:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-14T12:13:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T12:13:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T12:13:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T12:13:13.798 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T12:13:13.798 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-14T12:13:13.798 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-14T12:13:13.798 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T12:13:13.798 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-14T12:13:13.799 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-14T12:13:13.799 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T12:13:13.799 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-14T12:13:13.799 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T12:13:13.799 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T12:13:13.800 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T12:13:13.800 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-14T12:13:13.800 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-14T12:13:13.800 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T12:13:13.800 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-14T12:13:13.800 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-14T12:13:13.801 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T12:13:13.801 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T12:13:13.801 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T12:13:13.801 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T12:13:13.801 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T12:13:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T12:13:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T12:13:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T12:13:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T12:13:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T12:13:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T12:13:13.803 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T12:13:13.803 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-14T12:13:13.803 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T12:13:13.803 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T12:13:13.803 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T12:13:13.804 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T12:13:13.804 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T12:13:13.804 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T12:13:13.804 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T12:13:13.804 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T12:13:13.804 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T12:13:13.805 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T12:13:13.805 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T12:13:13.805 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T12:13:13.805 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-14T12:13:13.805 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T12:13:13.806 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T12:13:13.806 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-14T12:13:13.806 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-14T12:13:13.806 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T12:13:13.806 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T12:13:13.807 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T12:13:13.807 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T12:13:13.807 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-14T12:13:13.807 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T12:13:13.807 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T12:13:13.807 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-14T12:13:13.808 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T12:13:13.808 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T12:13:13.808 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T12:13:13.808 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T12:13:13.808 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T12:13:13.809 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T12:13:13.809 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T12:13:13.809 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T12:13:13.809 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T12:13:13.809 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T12:13:13.809 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T12:13:13.810 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T12:13:13.810 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T12:13:13.810 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T12:13:13.810 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T12:13:13.810 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T12:13:13.811 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T12:13:13.811 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T12:13:13.811 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T12:13:13.811 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T12:13:13.811 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T12:13:13.812 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T12:13:13.812 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T12:13:13.812 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T12:13:13.812 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T12:13:13.812 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T12:13:13.813 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T12:13:13.813 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T12:13:13.813 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T12:13:13.813 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T12:13:13.813 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T12:13:13.813 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-14T12:13:13.814 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T12:13:13.814 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T12:13:13.814 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T12:13:13.814 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T12:13:13.814 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T12:13:13.815 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-14T12:13:13.815 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T12:13:13.815 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T12:13:13.815 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-14T12:13:13.815 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T12:13:13.815 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T12:13:13.816 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T12:13:13.816 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-14T12:13:13.816 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T12:13:13.816 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T12:13:13.816 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-14T12:13:13.817 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T12:13:13.817 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-14T12:13:13.817 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T12:13:13.817 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-14T12:13:13.817 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T12:13:13.818 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-14T12:13:13.818 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T12:13:13.818 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T12:13:13.818 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-14T12:13:13.818 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T12:13:13.819 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-14T12:13:13.819 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-14T12:13:13.819 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T12:13:13.819 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-14T12:13:13.819 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T12:13:13.819 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T12:13:13.820 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T12:13:13.820 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-14T12:13:13.820 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-14T12:13:13.820 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-14T12:13:13.820 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-14T12:13:13.821 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-14T12:13:13.821 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T12:13:13.821 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-14T12:13:13.821 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T12:13:13.821 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T12:13:13.822 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-14T12:13:13.822 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T12:13:13.822 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T12:13:13.822 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-14T12:13:13.822 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T12:13:13.822 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T12:13:13.823 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T12:13:13.823 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T12:13:13.823 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T12:13:13.823 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T12:13:13.823 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T12:13:13.824 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-14T12:13:13.824 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T12:13:13.824 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T12:13:13.824 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T12:13:13.824 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-14T12:13:13.824 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T12:13:13.825 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T12:13:13.825 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T12:13:13.825 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-14T12:13:13.825 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T12:13:13.825 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-14T12:13:13.826 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T12:13:13.826 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-14T12:13:13.826 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T12:13:13.826 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T12:13:13.826 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T12:13:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T12:13:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-14T12:13:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T12:13:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-14T12:13:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T12:13:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T12:13:13.828 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-14T12:13:13.828 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T12:13:13.828 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T12:13:13.828 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T12:13:13.828 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-14T12:13:13.829 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T12:13:13.829 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T12:13:13.829 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-14T12:13:13.829 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T12:13:13.829 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T12:13:13.830 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T12:13:13.830 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T12:13:13.830 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T12:13:13.830 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T12:13:13.830 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T12:13:13.831 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T12:13:13.831 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T12:13:13.831 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T12:13:13.831 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T12:13:13.831 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-14T12:13:13.832 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T12:13:13.832 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T12:13:13.832 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T12:13:13.832 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T12:13:13.832 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-14T12:13:13.833 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T12:13:13.833 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-14T12:13:13.833 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-14T12:13:13.833 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T12:13:13.833 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-14T12:13:13.834 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T12:13:13.834 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T12:13:13.834 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T12:13:13.834 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T12:13:13.834 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T12:13:13.835 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T12:13:13.835 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-14T12:13:13.835 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T12:13:13.835 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-14T12:13:13.835 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-14T12:13:13.836 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-14T12:13:13.836 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T12:13:13.836 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T12:13:13.836 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T12:13:13.836 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T12:13:13.837 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T12:13:13.837 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T12:13:13.837 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T12:13:13.837 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T12:13:13.837 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T12:13:13.838 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T12:13:13.838 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T12:13:13.838 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T12:13:13.838 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T12:13:13.838 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T12:13:13.839 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T12:13:13.839 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-14T12:13:13.839 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-14T12:13:13.839 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T12:13:13.839 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T12:13:13.840 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T12:13:13.840 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T12:13:13.840 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-14T12:13:13.840 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-14T12:13:13.840 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T12:13:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T12:13:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-14T12:13:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T12:13:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-14T12:13:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-14T12:13:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T12:13:13.842 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-14T12:13:13.842 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T12:13:13.842 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-14T12:13:13.842 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T12:13:13.842 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T12:13:13.843 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T12:13:13.843 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T12:13:13.843 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T12:13:13.843 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-14T12:13:13.843 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-14T12:13:13.843 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T12:13:13.844 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T12:13:13.844 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T12:13:13.844 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T12:13:13.844 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-14T12:13:13.844 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T12:13:13.845 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-14T12:13:13.845 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T12:13:13.845 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T12:13:13.845 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-14T12:13:13.846 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T12:13:13.846 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T12:13:13.846 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T12:13:13.846 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T12:13:13.846 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T12:13:13.846 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T12:13:13.847 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T12:13:13.847 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T12:13:13.847 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T12:13:13.847 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T12:13:13.847 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-14T12:13:13.848 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T12:13:13.848 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T12:13:13.848 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T12:13:13.848 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T12:13:13.848 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T12:13:13.849 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T12:13:13.849 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T12:13:13.849 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-14T12:13:13.849 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T12:13:13.849 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-14T12:13:13.849 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T12:13:13.850 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T12:13:13.850 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T12:13:13.850 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T12:13:13.850 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T12:13:13.850 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T12:13:13.851 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T12:13:13.851 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T12:13:13.851 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T12:13:13.851 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T12:13:13.851 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T12:13:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T12:13:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T12:13:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T12:13:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T12:13:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T12:13:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T12:13:13.853 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T12:13:13.853 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T12:13:13.853 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T12:13:13.853 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T12:13:13.853 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T12:13:13.854 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T12:13:13.854 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T12:13:13.854 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T12:13:13.854 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T12:13:13.854 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T12:13:13.855 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T12:13:13.855 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T12:13:13.855 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T12:13:13.855 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T12:13:13.855 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T12:13:13.855 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T12:13:13.856 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T12:13:13.856 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T12:13:13.856 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T12:13:13.856 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T12:13:13.856 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T12:13:13.857 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T12:13:13.857 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T12:13:13.857 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T12:13:13.857 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T12:13:13.857 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T12:13:13.858 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T12:13:13.858 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T12:13:13.858 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-14T12:13:13.858 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T12:13:13.858 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T12:13:13.858 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T12:13:13.859 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T12:13:13.859 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T12:13:13.859 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T12:13:13.859 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T12:13:13.859 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T12:13:13.860 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T12:13:13.860 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T12:13:13.860 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T12:13:13.860 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T12:13:13.860 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T12:13:13.860 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T12:13:13.861 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T12:13:13.861 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-14T12:13:13.861 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T12:13:13.861 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T12:13:13.861 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T12:13:13.862 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-14T12:13:13.862 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-14T12:13:13.862 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T12:13:13.862 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T12:13:13.862 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T12:13:13.862 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T12:13:13.863 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-14T12:13:13.863 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T12:13:13.863 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T12:13:13.863 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T12:13:13.863 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T12:13:13.864 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-14T12:13:13.864 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-14T12:13:13.864 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T12:13:13.864 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T12:13:13.864 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T12:13:13.865 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-14T12:13:13.865 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-14T12:13:13.865 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-14T12:13:13.865 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-14T12:13:13.865 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-14T12:13:13.865 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-14T12:13:13.866 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-14T12:13:13.866 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-14T12:13:13.866 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-14T12:13:13.866 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-14T12:13:13.866 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T12:13:13.867 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T12:13:13.867 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-14T12:13:13.867 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T12:13:13.867 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T12:13:13.867 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T12:13:13.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T12:13:13.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T12:13:13.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T12:13:13.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T12:13:13.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T12:13:13.868 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T12:13:13.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T12:13:13.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T12:13:13.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T12:13:13.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-14T12:13:13.869 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T12:13:13.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T12:13:13.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T12:13:13.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T12:13:13.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T12:13:13.870 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T12:13:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T12:13:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T12:13:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T12:13:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T12:13:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T12:13:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T12:13:13.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T12:13:13.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T12:13:13.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T12:13:13.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T12:13:13.872 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T12:13:13.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T12:13:13.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T12:13:13.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T12:13:13.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T12:13:13.873 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T12:13:13.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T12:13:13.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T12:13:13.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T12:13:13.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T12:13:13.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-14T12:13:13.874 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-14T12:13:13.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T12:13:13.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T12:13:13.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T12:13:13.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-14T12:13:13.875 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T12:13:13.876 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T12:13:13.876 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-14T12:13:13.876 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T12:13:13.876 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-14T12:13:13.876 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-14T12:13:13.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T12:13:13.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-14T12:13:13.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T12:13:13.877 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-14T12:13:13.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T12:13:13.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T12:13:13.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-14T12:13:13.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T12:13:13.878 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-14T12:13:13.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T12:13:13.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-14T12:13:13.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T12:13:13.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-14T12:13:13.879 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T12:13:13.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-14T12:13:13.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T12:13:13.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-14T12:13:13.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T12:13:13.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-14T12:13:13.880 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-14T12:13:13.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-14T12:13:13.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T12:13:13.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-14T12:13:13.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-14T12:13:13.881 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T12:13:13.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-14T12:13:13.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-14T12:13:13.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T12:13:13.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-14T12:13:13.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T12:13:13.882 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-14T12:13:13.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-14T12:13:13.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T12:13:13.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-14T12:13:13.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T12:13:13.883 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-14T12:13:13.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T12:13:13.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-14T12:13:13.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T12:13:13.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-14T12:13:13.884 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T12:13:13.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-14T12:13:13.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T12:13:13.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-14T12:13:13.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T12:13:13.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-14T12:13:13.885 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T12:13:13.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-14T12:13:13.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-14T12:13:13.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T12:13:13.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-14T12:13:13.886 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T12:13:13.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-14T12:13:13.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T12:13:13.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T12:13:13.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T12:13:13.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T12:13:13.887 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-14T12:13:13.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T12:13:13.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T12:13:13.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-14T12:13:13.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T12:13:13.888 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-14T12:13:13.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T12:13:13.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-14T12:13:13.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T12:13:13.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T12:13:13.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T12:13:13.889 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T12:13:13.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T12:13:13.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T12:13:13.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T12:13:13.890 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T12:13:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T12:13:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T12:13:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T12:13:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T12:13:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T12:13:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T12:13:13.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T12:13:13.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T12:13:13.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T12:13:13.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T12:13:13.892 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T12:13:13.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T12:13:13.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T12:13:13.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T12:13:13.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T12:13:13.893 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T12:13:13.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T12:13:13.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T12:13:13.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T12:13:13.894 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T12:13:13.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T12:13:13.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T12:13:13.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T12:13:13.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T12:13:13.895 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T12:13:13.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T12:13:13.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T12:13:13.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T12:13:13.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T12:13:13.896 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T12:13:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T12:13:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T12:13:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T12:13:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T12:13:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T12:13:13.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T12:13:13.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T12:13:13.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T12:13:13.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T12:13:13.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T12:13:13.898 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T12:13:13.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T12:13:13.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-14T12:13:13.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-14T12:13:13.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T12:13:13.899 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-14T12:13:13.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T12:13:13.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-14T12:13:13.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T12:13:13.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T12:13:13.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T12:13:13.900 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T12:13:13.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T12:13:13.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-14T12:13:13.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T12:13:13.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-14T12:13:13.901 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T12:13:13.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-14T12:13:13.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T12:13:13.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-14T12:13:13.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T12:13:13.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-14T12:13:13.902 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-14T12:13:13.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T12:13:13.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-14T12:13:13.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T12:13:13.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T12:13:13.903 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-14T12:13:13.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T12:13:13.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-14T12:13:13.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T12:13:13.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-14T12:13:13.904 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T12:13:13.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-14T12:13:13.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T12:13:13.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-14T12:13:13.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T12:13:13.905 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-14T12:13:13.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-14T12:13:13.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-14T12:13:13.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T12:13:13.906 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-14T12:13:13.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-14T12:13:13.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-14T12:13:13.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-14T12:13:13.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T12:13:13.907 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T12:13:13.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-14T12:13:13.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T12:13:13.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T12:13:13.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T12:13:13.908 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T12:13:13.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-14T12:13:13.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T12:13:13.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T12:13:13.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-14T12:13:13.909 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T12:13:13.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-14T12:13:13.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T12:13:13.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-14T12:13:13.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T12:13:13.910 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T12:13:13.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T12:13:13.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T12:13:13.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-14T12:13:13.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-14T12:13:13.911 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-14T12:13:13.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T12:13:13.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-14T12:13:13.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-14T12:13:13.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T12:13:13.912 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T12:13:13.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T12:13:13.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T12:13:13.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T12:13:13.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T12:13:13.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T12:13:13.913 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T12:13:13.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-14T12:13:13.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T12:13:13.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T12:13:13.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T12:13:13.914 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T12:13:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T12:13:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-14T12:13:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T12:13:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-14T12:13:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T12:13:13.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T12:13:13.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T12:13:13.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T12:13:13.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-14T12:13:13.916 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T12:13:13.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-14T12:13:13.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T12:13:13.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T12:13:13.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-14T12:13:13.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T12:13:13.917 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T12:13:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T12:13:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T12:13:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T12:13:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T12:13:13.918 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T12:13:13.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T12:13:13.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T12:13:13.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T12:13:13.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T12:13:13.919 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T12:13:13.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T12:13:13.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T12:13:13.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T12:13:13.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T12:13:13.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T12:13:13.920 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T12:13:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T12:13:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T12:13:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T12:13:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-14T12:13:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T12:13:13.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T12:13:13.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-14T12:13:13.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T12:13:13.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-14T12:13:13.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-14T12:13:13.922 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T12:13:13.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-14T12:13:13.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T12:13:13.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T12:13:13.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T12:13:13.923 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T12:13:13.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-14T12:13:13.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-14T12:13:13.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-14T12:13:13.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T12:13:13.924 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T12:13:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T12:13:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T12:13:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T12:13:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-14T12:13:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-14T12:13:13.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T12:13:13.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T12:13:13.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T12:13:13.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-14T12:13:13.926 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T12:13:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T12:13:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T12:13:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T12:13:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T12:13:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T12:13:13.927 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T12:13:13.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T12:13:13.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T12:13:13.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T12:13:13.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-14T12:13:13.928 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T12:13:13.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T12:13:13.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T12:13:13.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T12:13:13.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T12:13:13.929 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T12:13:13.930 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T12:13:13.930 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T12:13:13.930 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T12:13:13.930 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T12:13:13.930 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T12:13:13.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T12:13:13.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T12:13:13.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T12:13:13.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T12:13:13.931 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T12:13:13.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T12:13:13.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T12:13:13.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T12:13:13.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T12:13:13.932 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T12:13:13.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T12:13:13.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T12:13:13.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T12:13:13.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T12:13:13.933 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T12:13:13.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T12:13:13.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T12:13:13.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T12:13:13.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T12:13:13.934 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T12:13:13.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T12:13:13.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T12:13:13.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T12:13:13.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T12:13:13.935 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T12:13:13.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T12:13:13.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T12:13:13.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-14T12:13:13.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T12:13:13.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T12:13:13.936 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T12:13:13.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T12:13:13.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T12:13:13.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T12:13:13.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T12:13:13.937 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-14T12:13:13.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T12:13:13.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T12:13:13.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T12:13:13.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T12:13:13.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T12:13:13.938 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T12:13:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T12:13:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T12:13:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T12:13:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T12:13:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T12:13:13.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T12:13:13.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T12:13:13.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T12:13:13.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T12:13:13.940 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T12:13:13.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T12:13:13.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T12:13:13.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T12:13:13.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T12:13:13.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T12:13:13.941 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T12:13:13.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T12:13:13.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T12:13:13.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T12:13:13.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T12:13:13.942 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T12:13:13.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-14T12:13:13.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T12:13:13.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-14T12:13:13.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T12:13:13.943 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T12:13:13.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T12:13:13.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T12:13:13.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T12:13:13.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T12:13:13.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T12:13:13.944 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-14T12:13:13.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T12:13:13.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-14T12:13:13.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T12:13:13.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-14T12:13:13.945 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T12:13:13.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-14T12:13:13.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-14T12:13:13.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T12:13:13.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T12:13:13.946 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T12:13:13.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T12:13:13.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T12:13:13.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T12:13:13.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T12:13:13.947 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T12:13:13.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T12:13:13.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T12:13:13.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T12:13:13.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T12:13:13.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T12:13:13.948 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T12:13:13.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T12:13:13.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T12:13:13.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-14T12:13:13.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T12:13:13.949 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T12:13:13.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T12:13:13.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T12:13:13.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T12:13:13.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T12:13:13.950 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T12:13:13.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T12:13:13.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T12:13:13.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T12:13:13.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T12:13:13.951 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T12:13:13.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T12:13:13.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T12:13:13.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T12:13:13.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T12:13:13.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T12:13:13.952 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T12:13:13.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T12:13:13.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T12:13:13.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T12:13:13.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T12:13:13.953 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T12:13:13.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T12:13:13.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T12:13:13.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T12:13:13.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T12:13:13.954 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T12:13:13.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T12:13:13.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T12:13:13.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T12:13:13.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T12:13:13.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T12:13:13.955 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T12:13:13.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T12:13:13.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T12:13:13.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T12:13:13.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T12:13:13.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T12:13:13.956 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T12:13:13.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T12:13:13.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T12:13:13.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T12:13:13.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T12:13:13.957 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T12:13:13.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T12:13:13.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T12:13:13.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T12:13:13.958 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T12:13:13.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T12:13:13.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T12:13:13.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T12:13:13.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T12:13:13.959 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T12:13:13.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T12:13:13.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T12:13:13.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T12:13:13.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T12:13:13.960 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-14T12:13:13.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T12:13:13.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T12:13:13.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T12:13:13.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T12:13:13.961 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-14T12:13:13.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T12:13:13.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T12:13:13.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T12:13:13.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T12:13:13.962 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T12:13:13.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T12:13:13.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T12:13:13.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T12:13:13.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T12:13:13.963 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T12:13:13.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T12:13:13.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T12:13:13.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T12:13:13.965 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T12:13:13.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T12:13:13.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T12:13:13.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T12:13:13.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T12:13:13.966 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T12:13:13.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T12:13:13.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T12:13:13.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T12:13:13.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T12:13:13.967 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T12:13:13.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T12:13:13.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T12:13:13.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T12:13:13.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T12:13:13.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T12:13:13.968 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T12:13:13.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T12:13:13.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T12:13:13.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T12:13:13.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T12:13:13.969 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T12:13:13.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T12:13:13.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T12:13:13.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T12:13:13.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T12:13:13.970 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T12:13:13.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T12:13:13.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T12:13:13.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T12:13:13.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T12:13:13.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T12:13:13.971 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T12:13:13.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T12:13:13.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T12:13:13.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T12:13:13.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T12:13:13.972 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T12:13:13.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T12:13:13.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T12:13:13.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T12:13:13.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T12:13:13.973 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T12:13:13.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T12:13:13.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T12:13:13.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T12:13:13.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T12:13:13.974 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T12:13:13.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T12:13:13.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T12:13:13.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T12:13:13.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T12:13:13.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T12:13:13.975 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T12:13:13.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T12:13:13.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T12:13:13.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T12:13:13.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T12:13:13.976 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-14T12:13:13.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T12:13:13.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-14T12:13:13.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T12:13:13.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-14T12:13:13.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T12:13:13.977 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T12:13:13.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T12:13:13.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T12:13:13.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-14T12:13:13.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T12:13:13.978 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-14T12:13:13.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T12:13:13.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T12:13:13.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T12:13:13.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-14T12:13:13.979 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T12:13:13.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T12:13:13.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T12:13:13.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T12:13:13.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T12:13:13.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T12:13:13.980 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T12:13:13.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T12:13:13.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T12:13:13.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T12:13:13.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T12:13:13.981 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T12:13:13.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T12:13:13.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T12:13:13.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T12:13:13.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T12:13:13.982 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T12:13:13.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T12:13:13.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T12:13:13.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T12:13:13.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T12:13:13.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T12:13:13.983 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T12:13:13.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T12:13:13.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T12:13:13.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T12:13:13.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T12:13:13.984 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T12:13:13.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T12:13:13.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T12:13:13.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T12:13:13.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T12:13:13.985 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T12:13:13.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T12:13:13.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T12:13:13.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T12:13:13.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T12:13:13.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T12:13:13.986 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T12:13:13.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T12:13:13.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T12:13:13.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T12:13:13.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T12:13:13.987 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T12:13:13.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-14T12:13:13.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T12:13:13.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T12:13:13.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-14T12:13:13.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-14T12:13:13.988 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T12:13:13.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T12:13:13.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T12:13:13.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-14T12:13:13.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T12:13:13.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-14T12:13:13.989 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T12:13:13.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T12:13:13.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-14T12:13:13.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T12:13:13.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-14T12:13:13.990 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T12:13:13.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T12:13:13.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T12:13:13.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T12:13:13.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T12:13:13.991 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-14T12:13:13.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T12:13:13.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-14T12:13:13.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-14T12:13:13.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-14T12:13:13.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-14T12:13:13.992 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-14T12:13:13.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-14T12:13:13.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-14T12:13:13.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-14T12:13:13.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T12:13:13.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T12:13:13.993 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T12:13:13.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T12:13:13.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T12:13:13.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T12:13:13.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T12:13:13.994 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T12:13:13.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T12:13:13.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T12:13:13.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T12:13:13.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T12:13:13.995 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T12:13:13.996 INFO:teuthology.orchestra.run.smithi177.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T12:13:13.996 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T12:13:13.997 DEBUG:teuthology.orchestra.run.smithi177:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-14T12:13:14.022 INFO:teuthology.orchestra.run.smithi177.stdout:postinstall scriptlet (using /bin/sh): 2023-10-14T12:13:14.022 INFO:teuthology.orchestra.run.smithi177.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-14T12:13:14.022 INFO:teuthology.orchestra.run.smithi177.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:14.022 INFO:teuthology.orchestra.run.smithi177.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:14.023 INFO:teuthology.orchestra.run.smithi177.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T12:13:14.023 INFO:teuthology.orchestra.run.smithi177.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:14.023 INFO:teuthology.orchestra.run.smithi177.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:14.023 INFO:teuthology.orchestra.run.smithi177.stdout:fi 2023-10-14T12:13:14.023 INFO:teuthology.orchestra.run.smithi177.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-14T12:13:14.024 INFO:teuthology.orchestra.run.smithi177.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-14T12:13:14.024 INFO:teuthology.orchestra.run.smithi177.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-14T12:13:14.024 INFO:teuthology.orchestra.run.smithi177.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-14T12:13:14.024 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-14T12:13:14.024 INFO:teuthology.orchestra.run.smithi177.stdout:fi 2023-10-14T12:13:14.025 INFO:teuthology.orchestra.run.smithi177.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-14T12:13:14.025 INFO:teuthology.orchestra.run.smithi177.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-14T12:13:14.025 INFO:teuthology.orchestra.run.smithi177.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-14T12:13:14.025 INFO:teuthology.orchestra.run.smithi177.stdout:fi 2023-10-14T12:13:14.026 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -qi grub2-tools 2023-10-14T12:13:14.104 INFO:teuthology.orchestra.run.smithi177.stdout:Name : grub2-tools 2023-10-14T12:13:14.104 INFO:teuthology.orchestra.run.smithi177.stdout:Epoch : 1 2023-10-14T12:13:14.105 INFO:teuthology.orchestra.run.smithi177.stdout:Version : 2.06 2023-10-14T12:13:14.105 INFO:teuthology.orchestra.run.smithi177.stdout:Release : 68.el9 2023-10-14T12:13:14.105 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: x86_64 2023-10-14T12:13:14.105 INFO:teuthology.orchestra.run.smithi177.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-14T12:13:14.106 INFO:teuthology.orchestra.run.smithi177.stdout:Group : Unspecified 2023-10-14T12:13:14.106 INFO:teuthology.orchestra.run.smithi177.stdout:Size : 8264254 2023-10-14T12:13:14.106 INFO:teuthology.orchestra.run.smithi177.stdout:License : GPLv3+ 2023-10-14T12:13:14.106 INFO:teuthology.orchestra.run.smithi177.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-14T12:13:14.106 INFO:teuthology.orchestra.run.smithi177.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-14T12:13:14.107 INFO:teuthology.orchestra.run.smithi177.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-14T12:13:14.107 INFO:teuthology.orchestra.run.smithi177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-14T12:13:14.107 INFO:teuthology.orchestra.run.smithi177.stdout:Packager : builder@centos.org 2023-10-14T12:13:14.107 INFO:teuthology.orchestra.run.smithi177.stdout:Vendor : CentOS 2023-10-14T12:13:14.108 INFO:teuthology.orchestra.run.smithi177.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T12:13:14.108 INFO:teuthology.orchestra.run.smithi177.stdout:Summary : Support tools for GRUB. 2023-10-14T12:13:14.108 INFO:teuthology.orchestra.run.smithi177.stdout:Description : 2023-10-14T12:13:14.108 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:13:14.108 INFO:teuthology.orchestra.run.smithi177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T12:13:14.108 INFO:teuthology.orchestra.run.smithi177.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T12:13:14.109 INFO:teuthology.orchestra.run.smithi177.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T12:13:14.109 INFO:teuthology.orchestra.run.smithi177.stdout:hardware devices. 2023-10-14T12:13:14.109 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:13:14.109 INFO:teuthology.orchestra.run.smithi177.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T12:13:14.110 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T12:13:14.110 INFO:teuthology.task.kernel:Updating grub on smithi177 to boot 6.6.0-rc5-g47672119149b 2023-10-14T12:13:14.111 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T12:13:14.764 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2023-10-14T12:13:16.167 INFO:teuthology.orchestra.run.smithi177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-14T12:13:16.194 INFO:teuthology.orchestra.run.smithi177.stderr:done 2023-10-14T12:13:16.197 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2023-10-14T12:13:16.213 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.cE4bdfIx0n 2023-10-14T12:13:16.213 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.cE4bdfIx0n 2023-10-14T12:13:16.286 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.cE4bdfIx0n 2023-10-14T12:13:16.423 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.cE4bdfIx0n is 6KB 2023-10-14T12:13:16.474 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.cE4bdfIx0n 2023-10-14T12:13:16.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T12:13:16.553 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-14T12:13:16.553 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-14T12:13:16.554 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-14T12:13:16.554 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-14T12:13:16.555 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-14T12:13:16.735 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2023-10-14T12:13:29.937 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi064.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-10-14T12:13:29.938 DEBUG:teuthology.orchestra.run.smithi064:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-10-14T12:13:30.012 INFO:teuthology.orchestra.run.smithi064.stdout:/boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.012 INFO:teuthology.orchestra.run.smithi064.stdout:/boot/config-6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.012 INFO:teuthology.orchestra.run.smithi064.stdout:/boot/vmlinuz-6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.012 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.013 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel 2023-10-14T12:13:30.013 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch 2023-10-14T12:13:30.013 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86 2023-10-14T12:13:30.013 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto 2023-10-14T12:13:30.013 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-10-14T12:13:30.014 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-10-14T12:13:30.014 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-10-14T12:13:30.014 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-10-14T12:13:30.014 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-10-14T12:13:30.014 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-10-14T12:13:30.015 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-10-14T12:13:30.015 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crc32c-intel.ko 2023-10-14T12:13:30.015 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-10-14T12:13:30.015 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-10-14T12:13:30.015 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-10-14T12:13:30.016 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-10-14T12:13:30.016 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-avx2.ko 2023-10-14T12:13:30.016 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-10-14T12:13:30.016 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-10-14T12:13:30.016 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-10-14T12:13:30.017 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-10-14T12:13:30.017 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-10-14T12:13:30.017 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-10-14T12:13:30.017 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-10-14T12:13:30.017 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel 2023-10-14T12:13:30.017 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu 2023-10-14T12:13:30.018 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce 2023-10-14T12:13:30.018 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-10-14T12:13:30.018 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm 2023-10-14T12:13:30.018 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-amd.ko 2023-10-14T12:13:30.018 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm-intel.ko 2023-10-14T12:13:30.019 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/arch/x86/kvm/kvm.ko 2023-10-14T12:13:30.019 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto 2023-10-14T12:13:30.019 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ansi_cprng.ko 2023-10-14T12:13:30.019 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/anubis.ko 2023-10-14T12:13:30.019 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/arc4.ko 2023-10-14T12:13:30.020 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx 2023-10-14T12:13:30.020 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_memcpy.ko 2023-10-14T12:13:30.020 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_pq.ko 2023-10-14T12:13:30.020 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_raid6_recov.ko 2023-10-14T12:13:30.020 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_tx.ko 2023-10-14T12:13:30.020 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/async_xor.ko 2023-10-14T12:13:30.021 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/async_tx/raid6test.ko 2023-10-14T12:13:30.021 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authenc.ko 2023-10-14T12:13:30.021 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/authencesn.ko 2023-10-14T12:13:30.021 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blake2b_generic.ko 2023-10-14T12:13:30.021 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_common.ko 2023-10-14T12:13:30.022 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/blowfish_generic.ko 2023-10-14T12:13:30.022 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/camellia_generic.ko 2023-10-14T12:13:30.022 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast5_generic.ko 2023-10-14T12:13:30.022 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast6_generic.ko 2023-10-14T12:13:30.022 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cast_common.ko 2023-10-14T12:13:30.023 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/ccm.ko 2023-10-14T12:13:30.023 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cmac.ko 2023-10-14T12:13:30.023 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crc32_generic.ko 2023-10-14T12:13:30.023 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_engine.ko 2023-10-14T12:13:30.023 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/crypto_user.ko 2023-10-14T12:13:30.023 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/cts.ko 2023-10-14T12:13:30.024 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/des_generic.ko 2023-10-14T12:13:30.024 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/dh_generic.ko 2023-10-14T12:13:30.024 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/echainiv.ko 2023-10-14T12:13:30.025 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/essiv.ko 2023-10-14T12:13:30.025 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/fcrypt.ko 2023-10-14T12:13:30.025 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/khazad.ko 2023-10-14T12:13:30.025 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4.ko 2023-10-14T12:13:30.025 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/lz4hc.ko 2023-10-14T12:13:30.025 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/md4.ko 2023-10-14T12:13:30.026 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/michael_mic.ko 2023-10-14T12:13:30.026 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcbc.ko 2023-10-14T12:13:30.026 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/pcrypt.ko 2023-10-14T12:13:30.026 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/rmd160.ko 2023-10-14T12:13:30.026 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/seed.ko 2023-10-14T12:13:30.027 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/serpent_generic.ko 2023-10-14T12:13:30.027 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tcrypt.ko 2023-10-14T12:13:30.027 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/tea.ko 2023-10-14T12:13:30.027 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_common.ko 2023-10-14T12:13:30.027 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/twofish_generic.ko 2023-10-14T12:13:30.028 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/vmac.ko 2023-10-14T12:13:30.028 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/wp512.ko 2023-10-14T12:13:30.028 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xcbc.ko 2023-10-14T12:13:30.028 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xor.ko 2023-10-14T12:13:30.028 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/crypto/xxhash_generic.ko 2023-10-14T12:13:30.029 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers 2023-10-14T12:13:30.029 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi 2023-10-14T12:13:30.029 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_ipmi.ko 2023-10-14T12:13:30.029 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/acpi_pad.ko 2023-10-14T12:13:30.029 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/custom_method.ko 2023-10-14T12:13:30.030 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/ec_sys.ko 2023-10-14T12:13:30.030 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/platform_profile.ko 2023-10-14T12:13:30.030 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbs.ko 2023-10-14T12:13:30.030 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/sbshc.ko 2023-10-14T12:13:30.030 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/acpi/video.ko 2023-10-14T12:13:30.031 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata 2023-10-14T12:13:30.031 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/acard-ahci.ko 2023-10-14T12:13:30.031 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ahci_platform.ko 2023-10-14T12:13:30.031 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/ata_generic.ko 2023-10-14T12:13:30.031 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/libahci_platform.ko 2023-10-14T12:13:30.031 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_acpi.ko 2023-10-14T12:13:30.032 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ali.ko 2023-10-14T12:13:30.032 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_amd.ko 2023-10-14T12:13:30.032 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_artop.ko 2023-10-14T12:13:30.032 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atiixp.ko 2023-10-14T12:13:30.032 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_atp867x.ko 2023-10-14T12:13:30.033 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd640.ko 2023-10-14T12:13:30.033 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cmd64x.ko 2023-10-14T12:13:30.033 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_cypress.ko 2023-10-14T12:13:30.033 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_efar.ko 2023-10-14T12:13:30.033 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt366.ko 2023-10-14T12:13:30.034 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt37x.ko 2023-10-14T12:13:30.034 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x2n.ko 2023-10-14T12:13:30.034 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_hpt3x3.ko 2023-10-14T12:13:30.034 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it8213.ko 2023-10-14T12:13:30.034 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_it821x.ko 2023-10-14T12:13:30.035 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_jmicron.ko 2023-10-14T12:13:30.035 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_marvell.ko 2023-10-14T12:13:30.035 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_mpiix.ko 2023-10-14T12:13:30.035 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_netcell.ko 2023-10-14T12:13:30.035 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ninja32.ko 2023-10-14T12:13:30.036 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87410.ko 2023-10-14T12:13:30.036 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_ns87415.ko 2023-10-14T12:13:30.036 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_oldpiix.ko 2023-10-14T12:13:30.036 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_opti.ko 2023-10-14T12:13:30.036 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_optidma.ko 2023-10-14T12:13:30.037 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pcmcia.ko 2023-10-14T12:13:30.037 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc2027x.ko 2023-10-14T12:13:30.037 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-10-14T12:13:30.037 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_piccolo.ko 2023-10-14T12:13:30.037 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_rdc.ko 2023-10-14T12:13:30.038 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sch.ko 2023-10-14T12:13:30.038 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_serverworks.ko 2023-10-14T12:13:30.038 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sil680.ko 2023-10-14T12:13:30.038 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sis.ko 2023-10-14T12:13:30.038 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_sl82c105.ko 2023-10-14T12:13:30.039 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_triflex.ko 2023-10-14T12:13:30.039 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pata_via.ko 2023-10-14T12:13:30.039 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/pdc_adma.ko 2023-10-14T12:13:30.039 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_inic162x.ko 2023-10-14T12:13:30.039 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_mv.ko 2023-10-14T12:13:30.039 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_nv.ko 2023-10-14T12:13:30.040 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_promise.ko 2023-10-14T12:13:30.040 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_qstor.ko 2023-10-14T12:13:30.040 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil.ko 2023-10-14T12:13:30.040 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sil24.ko 2023-10-14T12:13:30.040 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sis.ko 2023-10-14T12:13:30.041 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_svw.ko 2023-10-14T12:13:30.041 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_sx4.ko 2023-10-14T12:13:30.041 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_uli.ko 2023-10-14T12:13:30.041 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_via.ko 2023-10-14T12:13:30.041 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ata/sata_vsc.ko 2023-10-14T12:13:30.042 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay 2023-10-14T12:13:30.042 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/auxdisplay/ks0108.ko 2023-10-14T12:13:30.042 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base 2023-10-14T12:13:30.042 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap 2023-10-14T12:13:30.042 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-i2c.ko 2023-10-14T12:13:30.043 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/base/regmap/regmap-mmio.ko 2023-10-14T12:13:30.043 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma 2023-10-14T12:13:30.043 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/bcma/bcma.ko 2023-10-14T12:13:30.043 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block 2023-10-14T12:13:30.043 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe 2023-10-14T12:13:30.043 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/aoe/aoe.ko 2023-10-14T12:13:30.044 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/brd.ko 2023-10-14T12:13:30.044 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd 2023-10-14T12:13:30.044 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/drbd/drbd.ko 2023-10-14T12:13:30.044 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/floppy.ko 2023-10-14T12:13:30.044 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/loop.ko 2023-10-14T12:13:30.045 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx 2023-10-14T12:13:30.045 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-10-14T12:13:30.045 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/nbd.ko 2023-10-14T12:13:30.045 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk 2023-10-14T12:13:30.045 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/null_blk/null_blk.ko 2023-10-14T12:13:30.046 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/pktcdvd.ko 2023-10-14T12:13:30.046 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/rbd.ko 2023-10-14T12:13:30.046 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/virtio_blk.ko 2023-10-14T12:13:30.046 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback 2023-10-14T12:13:30.046 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-10-14T12:13:30.046 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/xen-blkfront.ko 2023-10-14T12:13:30.047 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram 2023-10-14T12:13:30.047 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/block/zram/zram.ko 2023-10-14T12:13:30.047 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char 2023-10-14T12:13:30.047 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hangcheck-timer.ko 2023-10-14T12:13:30.047 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random 2023-10-14T12:13:30.048 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/amd-rng.ko 2023-10-14T12:13:30.048 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/intel-rng.ko 2023-10-14T12:13:30.048 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-10-14T12:13:30.048 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/via-rng.ko 2023-10-14T12:13:30.048 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/hw_random/virtio-rng.ko 2023-10-14T12:13:30.049 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi 2023-10-14T12:13:30.049 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-10-14T12:13:30.049 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-10-14T12:13:30.049 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-10-14T12:13:30.049 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_si.ko 2023-10-14T12:13:30.050 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-10-14T12:13:30.050 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-10-14T12:13:30.050 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/lp.ko 2023-10-14T12:13:30.050 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave 2023-10-14T12:13:30.050 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/mwave/mwave.ko 2023-10-14T12:13:30.051 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/ppdev.ko 2023-10-14T12:13:30.051 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tlclk.ko 2023-10-14T12:13:30.051 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm 2023-10-14T12:13:30.051 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm.ko 2023-10-14T12:13:30.051 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_atmel.ko 2023-10-14T12:13:30.051 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_infineon.ko 2023-10-14T12:13:30.052 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_nsc.ko 2023-10-14T12:13:30.052 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis.ko 2023-10-14T12:13:30.052 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-10-14T12:13:30.052 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/uv_mmtimer.ko 2023-10-14T12:13:30.052 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/char/virtio_console.ko 2023-10-14T12:13:30.053 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq 2023-10-14T12:13:30.053 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-10-14T12:13:30.053 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-10-14T12:13:30.053 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/p4-clockmod.ko 2023-10-14T12:13:30.053 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-10-14T12:13:30.053 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/powernow-k8.ko 2023-10-14T12:13:30.054 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/cpufreq/speedstep-lib.ko 2023-10-14T12:13:30.054 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto 2023-10-14T12:13:30.054 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp 2023-10-14T12:13:30.054 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-10-14T12:13:30.054 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/ccp/ccp.ko 2023-10-14T12:13:30.055 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel 2023-10-14T12:13:30.055 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat 2023-10-14T12:13:30.055 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common 2023-10-14T12:13:30.055 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-10-14T12:13:30.055 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-10-14T12:13:30.056 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-10-14T12:13:30.056 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-aes.ko 2023-10-14T12:13:30.056 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/padlock-sha.ko 2023-10-14T12:13:30.056 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio 2023-10-14T12:13:30.056 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-10-14T12:13:30.057 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca 2023-10-14T12:13:30.057 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dca/dca.ko 2023-10-14T12:13:30.057 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq 2023-10-14T12:13:30.057 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-10-14T12:13:30.057 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma 2023-10-14T12:13:30.058 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw 2023-10-14T12:13:30.058 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/dw/dw_dmac.ko 2023-10-14T12:13:30.058 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat 2023-10-14T12:13:30.058 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/dma/ioat/ioatdma.ko 2023-10-14T12:13:30.058 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac 2023-10-14T12:13:30.059 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/amd64_edac.ko 2023-10-14T12:13:30.059 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/e752x_edac.ko 2023-10-14T12:13:30.059 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/edac_mce_amd.ko 2023-10-14T12:13:30.059 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3000_edac.ko 2023-10-14T12:13:30.059 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i3200_edac.ko 2023-10-14T12:13:30.059 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5100_edac.ko 2023-10-14T12:13:30.060 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i5400_edac.ko 2023-10-14T12:13:30.060 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7300_edac.ko 2023-10-14T12:13:30.060 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i7core_edac.ko 2023-10-14T12:13:30.060 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/i82975x_edac.ko 2023-10-14T12:13:30.060 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/ie31200_edac.ko 2023-10-14T12:13:30.061 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/sb_edac.ko 2023-10-14T12:13:30.061 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/edac/x38_edac.ko 2023-10-14T12:13:30.061 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware 2023-10-14T12:13:30.061 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/edd.ko 2023-10-14T12:13:30.061 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/firmware/iscsi_ibft.ko 2023-10-14T12:13:30.062 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio 2023-10-14T12:13:30.062 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-ich.ko 2023-10-14T12:13:30.062 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/gpio/gpio-viperboard.ko 2023-10-14T12:13:30.063 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid 2023-10-14T12:13:30.063 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-appleir.ko 2023-10-14T12:13:30.063 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-aureal.ko 2023-10-14T12:13:30.063 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-axff.ko 2023-10-14T12:13:30.063 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-dr.ko 2023-10-14T12:13:30.063 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elecom.ko 2023-10-14T12:13:30.064 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-elo.ko 2023-10-14T12:13:30.064 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-emsff.ko 2023-10-14T12:13:30.064 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gaff.ko 2023-10-14T12:13:30.064 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gt683r.ko 2023-10-14T12:13:30.064 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-gyration.ko 2023-10-14T12:13:30.065 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-kbd.ko 2023-10-14T12:13:30.065 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtek-mouse.ko 2023-10-14T12:13:30.065 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-holtekff.ko 2023-10-14T12:13:30.065 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-hyperv.ko 2023-10-14T12:13:30.065 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-icade.ko 2023-10-14T12:13:30.066 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-keytouch.ko 2023-10-14T12:13:30.066 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-kye.ko 2023-10-14T12:13:30.066 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lcpower.ko 2023-10-14T12:13:30.066 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-led.ko 2023-10-14T12:13:30.066 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-lenovo.ko 2023-10-14T12:13:30.067 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-dj.ko 2023-10-14T12:13:30.067 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-10-14T12:13:30.067 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-multitouch.ko 2023-10-14T12:13:30.067 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-ortek.ko 2023-10-14T12:13:30.067 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-penmount.ko 2023-10-14T12:13:30.068 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-petalynx.ko 2023-10-14T12:13:30.068 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-picolcd.ko 2023-10-14T12:13:30.068 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-pl.ko 2023-10-14T12:13:30.068 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-plantronics.ko 2023-10-14T12:13:30.068 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-primax.ko 2023-10-14T12:13:30.069 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-rmi.ko 2023-10-14T12:13:30.069 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-arvo.ko 2023-10-14T12:13:30.069 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-common.ko 2023-10-14T12:13:30.069 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-isku.ko 2023-10-14T12:13:30.069 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kone.ko 2023-10-14T12:13:30.069 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-10-14T12:13:30.070 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-konepure.ko 2023-10-14T12:13:30.070 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-10-14T12:13:30.070 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-lua.ko 2023-10-14T12:13:30.070 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-pyra.ko 2023-10-14T12:13:30.070 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-ryos.ko 2023-10-14T12:13:30.071 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat-savu.ko 2023-10-14T12:13:30.071 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-roccat.ko 2023-10-14T12:13:30.071 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-saitek.ko 2023-10-14T12:13:30.071 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-samsung.ko 2023-10-14T12:13:30.071 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sensor-hub.ko 2023-10-14T12:13:30.072 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sjoy.ko 2023-10-14T12:13:30.072 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sony.ko 2023-10-14T12:13:30.072 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-speedlink.ko 2023-10-14T12:13:30.072 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-steelseries.ko 2023-10-14T12:13:30.072 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-sunplus.ko 2023-10-14T12:13:30.073 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-thrustmaster.ko 2023-10-14T12:13:30.073 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tivo.ko 2023-10-14T12:13:30.073 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-tmff.ko 2023-10-14T12:13:30.073 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-topseed.ko 2023-10-14T12:13:30.073 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-twinhan.ko 2023-10-14T12:13:30.074 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-uclogic.ko 2023-10-14T12:13:30.074 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-waltop.ko 2023-10-14T12:13:30.074 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-wiimote.ko 2023-10-14T12:13:30.074 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-xinmo.ko 2023-10-14T12:13:30.074 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zpff.ko 2023-10-14T12:13:30.075 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/hid-zydacron.ko 2023-10-14T12:13:30.075 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/uhid.ko 2023-10-14T12:13:30.075 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hid/wacom.ko 2023-10-14T12:13:30.075 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv 2023-10-14T12:13:30.075 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_balloon.ko 2023-10-14T12:13:30.076 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_utils.ko 2023-10-14T12:13:30.076 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hv/hv_vmbus.ko 2023-10-14T12:13:30.076 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon 2023-10-14T12:13:30.076 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru.ko 2023-10-14T12:13:30.076 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/abituguru3.ko 2023-10-14T12:13:30.076 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/acpi_power_meter.ko 2023-10-14T12:13:30.077 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7414.ko 2023-10-14T12:13:30.077 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ad7418.ko 2023-10-14T12:13:30.077 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adc128d818.ko 2023-10-14T12:13:30.077 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1025.ko 2023-10-14T12:13:30.077 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1026.ko 2023-10-14T12:13:30.078 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1029.ko 2023-10-14T12:13:30.078 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm1031.ko 2023-10-14T12:13:30.078 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adm9240.ko 2023-10-14T12:13:30.078 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ads7828.ko 2023-10-14T12:13:30.078 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7410.ko 2023-10-14T12:13:30.079 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7411.ko 2023-10-14T12:13:30.079 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7462.ko 2023-10-14T12:13:30.079 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7470.ko 2023-10-14T12:13:30.079 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7475.ko 2023-10-14T12:13:30.079 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/adt7x10.ko 2023-10-14T12:13:30.080 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/amc6821.ko 2023-10-14T12:13:30.080 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/applesmc.ko 2023-10-14T12:13:30.080 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asb100.ko 2023-10-14T12:13:30.080 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asc7621.ko 2023-10-14T12:13:30.080 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/asus_atk0110.ko 2023-10-14T12:13:30.081 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/atxp1.ko 2023-10-14T12:13:30.081 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/coretemp.ko 2023-10-14T12:13:30.081 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-10-14T12:13:30.081 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/dme1737.ko 2023-10-14T12:13:30.081 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds1621.ko 2023-10-14T12:13:30.081 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ds620.ko 2023-10-14T12:13:30.082 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc1403.ko 2023-10-14T12:13:30.082 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/emc6w201.ko 2023-10-14T12:13:30.082 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71805f.ko 2023-10-14T12:13:30.082 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f71882fg.ko 2023-10-14T12:13:30.082 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/f75375s.ko 2023-10-14T12:13:30.083 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fam15h_power.ko 2023-10-14T12:13:30.083 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/fschmd.ko 2023-10-14T12:13:30.083 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g760a.ko 2023-10-14T12:13:30.083 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/g762.ko 2023-10-14T12:13:30.083 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl518sm.ko 2023-10-14T12:13:30.084 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/gl520sm.ko 2023-10-14T12:13:30.084 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/hwmon-vid.ko 2023-10-14T12:13:30.084 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5500_temp.ko 2023-10-14T12:13:30.084 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/i5k_amb.ko 2023-10-14T12:13:30.084 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmaem.ko 2023-10-14T12:13:30.084 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ibmpex.ko 2023-10-14T12:13:30.085 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina209.ko 2023-10-14T12:13:30.085 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ina2xx.ko 2023-10-14T12:13:30.085 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/it87.ko 2023-10-14T12:13:30.085 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k10temp.ko 2023-10-14T12:13:30.085 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/k8temp.ko 2023-10-14T12:13:30.086 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lineage-pem.ko 2023-10-14T12:13:30.086 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm63.ko 2023-10-14T12:13:30.086 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm73.ko 2023-10-14T12:13:30.086 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm75.ko 2023-10-14T12:13:30.086 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm77.ko 2023-10-14T12:13:30.087 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm78.ko 2023-10-14T12:13:30.087 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm80.ko 2023-10-14T12:13:30.087 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm83.ko 2023-10-14T12:13:30.087 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm85.ko 2023-10-14T12:13:30.087 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm87.ko 2023-10-14T12:13:30.087 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm90.ko 2023-10-14T12:13:30.088 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm92.ko 2023-10-14T12:13:30.088 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm93.ko 2023-10-14T12:13:30.088 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95234.ko 2023-10-14T12:13:30.088 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95241.ko 2023-10-14T12:13:30.088 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/lm95245.ko 2023-10-14T12:13:30.089 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc2945.ko 2023-10-14T12:13:30.089 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4151.ko 2023-10-14T12:13:30.089 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4215.ko 2023-10-14T12:13:30.089 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4222.ko 2023-10-14T12:13:30.089 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4245.ko 2023-10-14T12:13:30.089 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4260.ko 2023-10-14T12:13:30.090 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/ltc4261.ko 2023-10-14T12:13:30.090 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max16065.ko 2023-10-14T12:13:30.090 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1619.ko 2023-10-14T12:13:30.090 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max1668.ko 2023-10-14T12:13:30.090 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max197.ko 2023-10-14T12:13:30.091 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6639.ko 2023-10-14T12:13:30.091 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6650.ko 2023-10-14T12:13:30.091 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/max6697.ko 2023-10-14T12:13:30.091 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/mcp3021.ko 2023-10-14T12:13:30.091 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6683.ko 2023-10-14T12:13:30.092 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775-core.ko 2023-10-14T12:13:30.092 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct6775.ko 2023-10-14T12:13:30.092 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/nct7802.ko 2023-10-14T12:13:30.092 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87360.ko 2023-10-14T12:13:30.092 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pc87427.ko 2023-10-14T12:13:30.092 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pcf8591.ko 2023-10-14T12:13:30.093 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus 2023-10-14T12:13:30.093 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-10-14T12:13:30.093 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-10-14T12:13:30.093 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-10-14T12:13:30.093 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max16064.ko 2023-10-14T12:13:30.094 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max34440.ko 2023-10-14T12:13:30.094 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/max8688.ko 2023-10-14T12:13:30.094 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-10-14T12:13:30.094 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-10-14T12:13:30.094 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-10-14T12:13:30.095 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-10-14T12:13:30.095 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-10-14T12:13:30.095 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-10-14T12:13:30.095 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/powr1220.ko 2023-10-14T12:13:30.095 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5627.ko 2023-10-14T12:13:30.095 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch5636.ko 2023-10-14T12:13:30.096 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sch56xx-common.ko 2023-10-14T12:13:30.096 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht15.ko 2023-10-14T12:13:30.096 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sht21.ko 2023-10-14T12:13:30.096 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/shtc1.ko 2023-10-14T12:13:30.096 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/sis5595.ko 2023-10-14T12:13:30.097 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47b397.ko 2023-10-14T12:13:30.097 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m1.ko 2023-10-14T12:13:30.097 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/smsc47m192.ko 2023-10-14T12:13:30.097 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/thmc50.ko 2023-10-14T12:13:30.097 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp102.ko 2023-10-14T12:13:30.097 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp103.ko 2023-10-14T12:13:30.098 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp401.ko 2023-10-14T12:13:30.098 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/tmp421.ko 2023-10-14T12:13:30.098 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via-cputemp.ko 2023-10-14T12:13:30.098 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/via686a.ko 2023-10-14T12:13:30.098 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt1211.ko 2023-10-14T12:13:30.099 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/vt8231.ko 2023-10-14T12:13:30.099 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627ehf.ko 2023-10-14T12:13:30.099 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83627hf.ko 2023-10-14T12:13:30.099 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83781d.ko 2023-10-14T12:13:30.099 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83791d.ko 2023-10-14T12:13:30.100 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83792d.ko 2023-10-14T12:13:30.100 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83793.ko 2023-10-14T12:13:30.100 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83795.ko 2023-10-14T12:13:30.100 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l785ts.ko 2023-10-14T12:13:30.100 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/hwmon/w83l786ng.ko 2023-10-14T12:13:30.100 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c 2023-10-14T12:13:30.101 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos 2023-10-14T12:13:30.101 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-10-14T12:13:30.101 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-10-14T12:13:30.101 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses 2023-10-14T12:13:30.101 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-10-14T12:13:30.102 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-10-14T12:13:30.102 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-10-14T12:13:30.102 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-10-14T12:13:30.102 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-10-14T12:13:30.102 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-10-14T12:13:30.103 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-10-14T12:13:30.103 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-10-14T12:13:30.103 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-i801.ko 2023-10-14T12:13:30.103 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-isch.ko 2023-10-14T12:13:30.103 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-10-14T12:13:30.103 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-10-14T12:13:30.104 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-10-14T12:13:30.104 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-parport.ko 2023-10-14T12:13:30.104 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-10-14T12:13:30.104 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-10-14T12:13:30.104 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-10-14T12:13:30.105 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-10-14T12:13:30.105 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-10-14T12:13:30.105 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-10-14T12:13:30.105 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-via.ko 2023-10-14T12:13:30.105 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-10-14T12:13:30.105 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-10-14T12:13:30.106 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-dev.ko 2023-10-14T12:13:30.106 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-mux.ko 2023-10-14T12:13:30.106 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-10-14T12:13:30.106 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-smbus.ko 2023-10-14T12:13:30.106 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/i2c/i2c-stub.ko 2023-10-14T12:13:30.107 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband 2023-10-14T12:13:30.107 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core 2023-10-14T12:13:30.107 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_cm.ko 2023-10-14T12:13:30.107 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_core.ko 2023-10-14T12:13:30.107 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_umad.ko 2023-10-14T12:13:30.108 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-10-14T12:13:30.108 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/iw_cm.ko 2023-10-14T12:13:30.108 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_cm.ko 2023-10-14T12:13:30.108 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-10-14T12:13:30.108 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw 2023-10-14T12:13:30.108 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4 2023-10-14T12:13:30.109 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-10-14T12:13:30.109 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4 2023-10-14T12:13:30.109 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-10-14T12:13:30.109 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5 2023-10-14T12:13:30.109 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-10-14T12:13:30.110 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca 2023-10-14T12:13:30.110 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-10-14T12:13:30.110 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp 2023-10-14T12:13:30.110 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib 2023-10-14T12:13:30.110 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-10-14T12:13:30.111 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser 2023-10-14T12:13:30.111 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-10-14T12:13:30.111 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert 2023-10-14T12:13:30.111 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-10-14T12:13:30.111 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp 2023-10-14T12:13:30.112 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-10-14T12:13:30.112 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt 2023-10-14T12:13:30.112 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-10-14T12:13:30.112 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input 2023-10-14T12:13:30.112 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport 2023-10-14T12:13:30.112 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-10-14T12:13:30.113 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/fm801-gp.ko 2023-10-14T12:13:30.113 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/gameport/gameport.ko 2023-10-14T12:13:30.113 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/joydev.ko 2023-10-14T12:13:30.113 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard 2023-10-14T12:13:30.113 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/keyboard/gpio_keys.ko 2023-10-14T12:13:30.114 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse 2023-10-14T12:13:30.114 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/appletouch.ko 2023-10-14T12:13:30.114 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/bcm5974.ko 2023-10-14T12:13:30.114 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/cyapatp.ko 2023-10-14T12:13:30.114 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/elan_i2c.ko 2023-10-14T12:13:30.114 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/sermouse.ko 2023-10-14T12:13:30.115 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-10-14T12:13:30.115 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/synaptics_usb.ko 2023-10-14T12:13:30.115 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/mouse/vsxxxaa.ko 2023-10-14T12:13:30.115 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4 2023-10-14T12:13:30.115 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/rmi4/rmi_core.ko 2023-10-14T12:13:30.116 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio 2023-10-14T12:13:30.116 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/altera_ps2.ko 2023-10-14T12:13:30.116 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/arc_ps2.ko 2023-10-14T12:13:30.116 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-10-14T12:13:30.116 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/serio/serio_raw.ko 2023-10-14T12:13:30.116 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/input/sparse-keymap.ko 2023-10-14T12:13:30.117 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu 2023-10-14T12:13:30.117 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd 2023-10-14T12:13:30.117 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/iommu/amd/iommu_v2.ko 2023-10-14T12:13:30.117 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds 2023-10-14T12:13:30.117 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-blinkm.ko 2023-10-14T12:13:30.118 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lm3530.ko 2023-10-14T12:13:30.118 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-lp3944.ko 2023-10-14T12:13:30.118 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/leds-ss4200.ko 2023-10-14T12:13:30.118 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger 2023-10-14T12:13:30.118 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-10-14T12:13:30.119 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-10-14T12:13:30.119 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-10-14T12:13:30.119 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-10-14T12:13:30.119 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-10-14T12:13:30.119 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-10-14T12:13:30.119 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-10-14T12:13:30.120 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-10-14T12:13:30.120 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md 2023-10-14T12:13:30.120 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache 2023-10-14T12:13:30.120 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/bcache/bcache.ko 2023-10-14T12:13:30.120 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-bio-prison.ko 2023-10-14T12:13:30.121 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache-smq.ko 2023-10-14T12:13:30.121 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-cache.ko 2023-10-14T12:13:30.121 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-crypt.ko 2023-10-14T12:13:30.121 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-delay.ko 2023-10-14T12:13:30.121 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-flakey.ko 2023-10-14T12:13:30.122 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-log-userspace.ko 2023-10-14T12:13:30.122 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-multipath.ko 2023-10-14T12:13:30.122 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-queue-length.ko 2023-10-14T12:13:30.122 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-raid.ko 2023-10-14T12:13:30.122 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-round-robin.ko 2023-10-14T12:13:30.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-service-time.ko 2023-10-14T12:13:30.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-switch.ko 2023-10-14T12:13:30.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-thin-pool.ko 2023-10-14T12:13:30.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/dm-verity.ko 2023-10-14T12:13:30.123 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/faulty.ko 2023-10-14T12:13:30.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/linear.ko 2023-10-14T12:13:30.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/multipath.ko 2023-10-14T12:13:30.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data 2023-10-14T12:13:30.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-10-14T12:13:30.124 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid0.ko 2023-10-14T12:13:30.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid1.ko 2023-10-14T12:13:30.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid10.ko 2023-10-14T12:13:30.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/md/raid456.ko 2023-10-14T12:13:30.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message 2023-10-14T12:13:30.125 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion 2023-10-14T12:13:30.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptbase.ko 2023-10-14T12:13:30.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptctl.ko 2023-10-14T12:13:30.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptfc.ko 2023-10-14T12:13:30.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptlan.ko 2023-10-14T12:13:30.126 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptsas.ko 2023-10-14T12:13:30.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptscsih.ko 2023-10-14T12:13:30.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/message/fusion/mptspi.ko 2023-10-14T12:13:30.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd 2023-10-14T12:13:30.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_ich.ko 2023-10-14T12:13:30.127 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/lpc_sch.ko 2023-10-14T12:13:30.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/mfd-core.ko 2023-10-14T12:13:30.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/sm501.ko 2023-10-14T12:13:30.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/viperboard.ko 2023-10-14T12:13:30.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/vx855.ko 2023-10-14T12:13:30.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/mfd/wl1273-core.ko 2023-10-14T12:13:30.128 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc 2023-10-14T12:13:30.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl 2023-10-14T12:13:30.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-10-14T12:13:30.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds9802als.ko 2023-10-14T12:13:30.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/apds990x.ko 2023-10-14T12:13:30.129 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/bh1770glc.ko 2023-10-14T12:13:30.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710 2023-10-14T12:13:30.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/cb710/cb710.ko 2023-10-14T12:13:30.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom 2023-10-14T12:13:30.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/at24.ko 2023-10-14T12:13:30.130 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom.ko 2023-10-14T12:13:30.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-10-14T12:13:30.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/eeprom/max6875.ko 2023-10-14T12:13:30.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/enclosure.ko 2023-10-14T12:13:30.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/hpilo.ko 2023-10-14T12:13:30.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29003.ko 2023-10-14T12:13:30.131 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/isl29020.ko 2023-10-14T12:13:30.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d 2023-10-14T12:13:30.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-10-14T12:13:30.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-10-14T12:13:30.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei 2023-10-14T12:13:30.132 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-me.ko 2023-10-14T12:13:30.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei-txe.ko 2023-10-14T12:13:30.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/mei/mei.ko 2023-10-14T12:13:30.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru 2023-10-14T12:13:30.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-gru/gru.ko 2023-10-14T12:13:30.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp 2023-10-14T12:13:30.133 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xp.ko 2023-10-14T12:13:30.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpc.ko 2023-10-14T12:13:30.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-10-14T12:13:30.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_7xx1.ko 2023-10-14T12:13:30.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tifm_core.ko 2023-10-14T12:13:30.134 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/tsl2550.ko 2023-10-14T12:13:30.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_balloon.ko 2023-10-14T12:13:30.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci 2023-10-14T12:13:30.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-10-14T12:13:30.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net 2023-10-14T12:13:30.135 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding 2023-10-14T12:13:30.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/bonding/bonding.ko 2023-10-14T12:13:30.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa 2023-10-14T12:13:30.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53 2023-10-14T12:13:30.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/b53/b53_common.ko 2023-10-14T12:13:30.136 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/bcm-sf2.ko 2023-10-14T12:13:30.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6060.ko 2023-10-14T12:13:30.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx 2023-10-14T12:13:30.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-10-14T12:13:30.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/dummy.ko 2023-10-14T12:13:30.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/eql.ko 2023-10-14T12:13:30.137 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet 2023-10-14T12:13:30.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com 2023-10-14T12:13:30.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-10-14T12:13:30.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-10-14T12:13:30.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-10-14T12:13:30.138 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-10-14T12:13:30.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390 2023-10-14T12:13:30.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/8390.ko 2023-10-14T12:13:30.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-10-14T12:13:30.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-10-14T12:13:30.139 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-10-14T12:13:30.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec 2023-10-14T12:13:30.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-10-14T12:13:30.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere 2023-10-14T12:13:30.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/agere/et131x.ko 2023-10-14T12:13:30.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon 2023-10-14T12:13:30.140 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-10-14T12:13:30.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera 2023-10-14T12:13:30.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-10-14T12:13:30.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd 2023-10-14T12:13:30.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-10-14T12:13:30.141 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-10-14T12:13:30.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-10-14T12:13:30.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros 2023-10-14T12:13:30.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx 2023-10-14T12:13:30.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-10-14T12:13:30.142 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c 2023-10-14T12:13:30.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-10-14T12:13:30.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e 2023-10-14T12:13:30.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-10-14T12:13:30.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx 2023-10-14T12:13:30.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-10-14T12:13:30.143 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-10-14T12:13:30.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom 2023-10-14T12:13:30.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-10-14T12:13:30.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-10-14T12:13:30.144 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-10-14T12:13:30.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-10-14T12:13:30.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-10-14T12:13:30.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet 2023-10-14T12:13:30.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-10-14T12:13:30.145 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-10-14T12:13:30.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade 2023-10-14T12:13:30.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna 2023-10-14T12:13:30.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-10-14T12:13:30.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio 2023-10-14T12:13:30.146 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb 2023-10-14T12:13:30.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-10-14T12:13:30.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-10-14T12:13:30.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-10-14T12:13:30.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-10-14T12:13:30.147 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-10-14T12:13:30.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-10-14T12:13:30.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-10-14T12:13:30.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-10-14T12:13:30.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-10-14T12:13:30.148 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco 2023-10-14T12:13:30.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic 2023-10-14T12:13:30.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-10-14T12:13:30.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec 2023-10-14T12:13:30.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip 2023-10-14T12:13:30.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-10-14T12:13:30.149 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-10-14T12:13:30.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-10-14T12:13:30.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-10-14T12:13:30.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-10-14T12:13:30.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-10-14T12:13:30.150 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink 2023-10-14T12:13:30.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-10-14T12:13:30.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-10-14T12:13:30.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/dnet.ko 2023-10-14T12:13:30.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex 2023-10-14T12:13:30.151 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet 2023-10-14T12:13:30.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-10-14T12:13:30.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ethoc.ko 2023-10-14T12:13:30.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/fealnx.ko 2023-10-14T12:13:30.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel 2023-10-14T12:13:30.152 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e100.ko 2023-10-14T12:13:30.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000 2023-10-14T12:13:30.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-10-14T12:13:30.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e 2023-10-14T12:13:30.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-10-14T12:13:30.153 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k 2023-10-14T12:13:30.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-10-14T12:13:30.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e 2023-10-14T12:13:30.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-10-14T12:13:30.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf 2023-10-14T12:13:30.154 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-10-14T12:13:30.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb 2023-10-14T12:13:30.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-10-14T12:13:30.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf 2023-10-14T12:13:30.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-10-14T12:13:30.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe 2023-10-14T12:13:30.155 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-10-14T12:13:30.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf 2023-10-14T12:13:30.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-10-14T12:13:30.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/jme.ko 2023-10-14T12:13:30.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell 2023-10-14T12:13:30.156 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-10-14T12:13:30.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/skge.ko 2023-10-14T12:13:30.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-10-14T12:13:30.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox 2023-10-14T12:13:30.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4 2023-10-14T12:13:30.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-10-14T12:13:30.157 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-10-14T12:13:30.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5 2023-10-14T12:13:30.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-10-14T12:13:30.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-10-14T12:13:30.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel 2023-10-14T12:13:30.158 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-10-14T12:13:30.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom 2023-10-14T12:13:30.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge 2023-10-14T12:13:30.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-10-14T12:13:30.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi 2023-10-14T12:13:30.159 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-10-14T12:13:30.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-10-14T12:13:30.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion 2023-10-14T12:13:30.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-10-14T12:13:30.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia 2023-10-14T12:13:30.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-10-14T12:13:30.160 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines 2023-10-14T12:13:30.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-10-14T12:13:30.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-10-14T12:13:30.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic 2023-10-14T12:13:30.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen 2023-10-14T12:13:30.161 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-10-14T12:13:30.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-10-14T12:13:30.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-10-14T12:13:30.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-10-14T12:13:30.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc 2023-10-14T12:13:30.162 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-10-14T12:13:30.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek 2023-10-14T12:13:30.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-10-14T12:13:30.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-10-14T12:13:30.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/atp.ko 2023-10-14T12:13:30.163 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-10-14T12:13:30.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker 2023-10-14T12:13:30.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-10-14T12:13:30.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc 2023-10-14T12:13:30.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-10-14T12:13:30.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan 2023-10-14T12:13:30.164 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-10-14T12:13:30.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis 2023-10-14T12:13:30.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis190.ko 2023-10-14T12:13:30.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sis/sis900.ko 2023-10-14T12:13:30.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc 2023-10-14T12:13:30.165 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-10-14T12:13:30.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-10-14T12:13:30.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-10-14T12:13:30.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-10-14T12:13:30.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro 2023-10-14T12:13:30.166 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac 2023-10-14T12:13:30.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-10-14T12:13:30.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-10-14T12:13:30.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun 2023-10-14T12:13:30.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/cassini.ko 2023-10-14T12:13:30.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/niu.ko 2023-10-14T12:13:30.167 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sungem.ko 2023-10-14T12:13:30.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-10-14T12:13:30.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti 2023-10-14T12:13:30.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-10-14T12:13:30.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti 2023-10-14T12:13:30.168 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/ti/tlan.ko 2023-10-14T12:13:30.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via 2023-10-14T12:13:30.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-10-14T12:13:30.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-10-14T12:13:30.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet 2023-10-14T12:13:30.169 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-10-14T12:13:30.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-10-14T12:13:30.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom 2023-10-14T12:13:30.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-10-14T12:13:30.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/geneve.ko 2023-10-14T12:13:30.170 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv 2023-10-14T12:13:30.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-10-14T12:13:30.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154 2023-10-14T12:13:30.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ieee802154/fakelb.ko 2023-10-14T12:13:30.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ifb.ko 2023-10-14T12:13:30.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan 2023-10-14T12:13:30.171 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ipvlan/ipvlan.ko 2023-10-14T12:13:30.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvlan.ko 2023-10-14T12:13:30.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/macvtap.ko 2023-10-14T12:13:30.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio 2023-10-14T12:13:30.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio.ko 2023-10-14T12:13:30.172 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-10-14T12:13:30.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-10-14T12:13:30.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mdio/mdio-regmap.ko 2023-10-14T12:13:30.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/mii.ko 2023-10-14T12:13:30.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/net_failover.ko 2023-10-14T12:13:30.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/netconsole.ko 2023-10-14T12:13:30.173 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/nlmon.ko 2023-10-14T12:13:30.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs 2023-10-14T12:13:30.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs-lynx.ko 2023-10-14T12:13:30.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-10-14T12:13:30.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy 2023-10-14T12:13:30.174 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/amd.ko 2023-10-14T12:13:30.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-10-14T12:13:30.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-10-14T12:13:30.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm7xxx.ko 2023-10-14T12:13:30.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/bcm87xx.ko 2023-10-14T12:13:30.175 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/broadcom.ko 2023-10-14T12:13:30.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/cicada.ko 2023-10-14T12:13:30.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/davicom.ko 2023-10-14T12:13:30.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/dp83640.ko 2023-10-14T12:13:30.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/et1011c.ko 2023-10-14T12:13:30.176 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/icplus.ko 2023-10-14T12:13:30.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/lxt.ko 2023-10-14T12:13:30.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/marvell.ko 2023-10-14T12:13:30.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/micrel.ko 2023-10-14T12:13:30.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/national.ko 2023-10-14T12:13:30.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/phylink.ko 2023-10-14T12:13:30.177 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/qsemi.ko 2023-10-14T12:13:30.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/realtek.ko 2023-10-14T12:13:30.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/smsc.ko 2023-10-14T12:13:30.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/ste10Xp.ko 2023-10-14T12:13:30.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/phy/vitesse.ko 2023-10-14T12:13:30.178 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp 2023-10-14T12:13:30.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/bsd_comp.ko 2023-10-14T12:13:30.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_async.ko 2023-10-14T12:13:30.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_deflate.ko 2023-10-14T12:13:30.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_generic.ko 2023-10-14T12:13:30.179 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_mppe.ko 2023-10-14T12:13:30.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/ppp_synctty.ko 2023-10-14T12:13:30.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppoe.ko 2023-10-14T12:13:30.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pppox.ko 2023-10-14T12:13:30.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/ppp/pptp.ko 2023-10-14T12:13:30.180 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip 2023-10-14T12:13:30.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slhc.ko 2023-10-14T12:13:30.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/slip/slip.ko 2023-10-14T12:13:30.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/sungem_phy.ko 2023-10-14T12:13:30.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tap.ko 2023-10-14T12:13:30.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team 2023-10-14T12:13:30.181 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team.ko 2023-10-14T12:13:30.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_activebackup.ko 2023-10-14T12:13:30.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_broadcast.ko 2023-10-14T12:13:30.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-10-14T12:13:30.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_random.ko 2023-10-14T12:13:30.182 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-10-14T12:13:30.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/tun.ko 2023-10-14T12:13:30.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/veth.ko 2023-10-14T12:13:30.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/virtio_net.ko 2023-10-14T12:13:30.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3 2023-10-14T12:13:30.183 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-10-14T12:13:30.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan 2023-10-14T12:13:30.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/vxlan/vxlan.ko 2023-10-14T12:13:30.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback 2023-10-14T12:13:30.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netback/xen-netback.ko 2023-10-14T12:13:30.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/net/xen-netfront.ko 2023-10-14T12:13:30.184 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb 2023-10-14T12:13:30.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ntb/ntb.ko 2023-10-14T12:13:30.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme 2023-10-14T12:13:30.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host 2023-10-14T12:13:30.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme-core.ko 2023-10-14T12:13:30.185 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/nvme/host/nvme.ko 2023-10-14T12:13:30.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport 2023-10-14T12:13:30.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport.ko 2023-10-14T12:13:30.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_cs.ko 2023-10-14T12:13:30.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_pc.ko 2023-10-14T12:13:30.186 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/parport/parport_serial.ko 2023-10-14T12:13:30.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci 2023-10-14T12:13:30.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug 2023-10-14T12:13:30.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-10-14T12:13:30.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie 2023-10-14T12:13:30.187 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/pcie/aer_inject.ko 2023-10-14T12:13:30.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pci/xen-pcifront.ko 2023-10-14T12:13:30.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia 2023-10-14T12:13:30.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/i82092.ko 2023-10-14T12:13:30.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/pd6729.ko 2023-10-14T12:13:30.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pcmcia/yenta_socket.ko 2023-10-14T12:13:30.188 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl 2023-10-14T12:13:30.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel 2023-10-14T12:13:30.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-10-14T12:13:30.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform 2023-10-14T12:13:30.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86 2023-10-14T12:13:30.189 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acer-wmi.ko 2023-10-14T12:13:30.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/acerhdf.ko 2023-10-14T12:13:30.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/apple-gmux.ko 2023-10-14T12:13:30.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-laptop.ko 2023-10-14T12:13:30.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-10-14T12:13:30.190 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/asus-wmi.ko 2023-10-14T12:13:30.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/classmate-laptop.ko 2023-10-14T12:13:30.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-10-14T12:13:30.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-10-14T12:13:30.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-10-14T12:13:30.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-10-14T12:13:30.191 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/hdaps.ko 2023-10-14T12:13:30.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel 2023-10-14T12:13:30.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-10-14T12:13:30.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/intel_ips.ko 2023-10-14T12:13:30.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/msi-wmi.ko 2023-10-14T12:13:30.192 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/mxm-wmi.ko 2023-10-14T12:13:30.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-10-14T12:13:30.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-laptop.ko 2023-10-14T12:13:30.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/samsung-q10.ko 2023-10-14T12:13:30.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/topstar-laptop.ko 2023-10-14T12:13:30.193 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-10-14T12:13:30.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/toshiba_haps.ko 2023-10-14T12:13:30.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi-bmof.ko 2023-10-14T12:13:30.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/platform/x86/wmi.ko 2023-10-14T12:13:30.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap 2023-10-14T12:13:30.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_common.ko 2023-10-14T12:13:30.194 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/powercap/intel_rapl_msr.ko 2023-10-14T12:13:30.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps 2023-10-14T12:13:30.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients 2023-10-14T12:13:30.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-gpio.ko 2023-10-14T12:13:30.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps-ldisc.ko 2023-10-14T12:13:30.195 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/clients/pps_parport.ko 2023-10-14T12:13:30.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/pps/pps_core.ko 2023-10-14T12:13:30.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp 2023-10-14T12:13:30.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp.ko 2023-10-14T12:13:30.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ptp/ptp_kvm.ko 2023-10-14T12:13:30.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc 2023-10-14T12:13:30.196 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-bq32k.ko 2023-10-14T12:13:30.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1286.ko 2023-10-14T12:13:30.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1307.ko 2023-10-14T12:13:30.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1374.ko 2023-10-14T12:13:30.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1511.ko 2023-10-14T12:13:30.197 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1553.ko 2023-10-14T12:13:30.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1672.ko 2023-10-14T12:13:30.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds1742.ko 2023-10-14T12:13:30.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds2404.ko 2023-10-14T12:13:30.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-ds3232.ko 2023-10-14T12:13:30.198 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-em3027.ko 2023-10-14T12:13:30.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-fm3130.ko 2023-10-14T12:13:30.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl12022.ko 2023-10-14T12:13:30.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-isl1208.ko 2023-10-14T12:13:30.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m41t80.ko 2023-10-14T12:13:30.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t35.ko 2023-10-14T12:13:30.199 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-m48t59.ko 2023-10-14T12:13:30.200 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-max6900.ko 2023-10-14T12:13:30.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-msm6242.ko 2023-10-14T12:13:30.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf2127.ko 2023-10-14T12:13:30.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf85063.ko 2023-10-14T12:13:30.202 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8523.ko 2023-10-14T12:13:30.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8563.ko 2023-10-14T12:13:30.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-pcf8583.ko 2023-10-14T12:13:30.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rp5c01.ko 2023-10-14T12:13:30.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rs5c372.ko 2023-10-14T12:13:30.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-10-14T12:13:30.203 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8025.ko 2023-10-14T12:13:30.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-rx8581.ko 2023-10-14T12:13:30.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-10-14T12:13:30.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/rtc/rtc-x1205.ko 2023-10-14T12:13:30.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi 2023-10-14T12:13:30.204 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-9xxx.ko 2023-10-14T12:13:30.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-sas.ko 2023-10-14T12:13:30.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/3w-xxxx.ko 2023-10-14T12:13:30.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/BusLogic.ko 2023-10-14T12:13:30.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/a100u2w.ko 2023-10-14T12:13:30.205 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid 2023-10-14T12:13:30.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aacraid/aacraid.ko 2023-10-14T12:13:30.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/advansys.ko 2023-10-14T12:13:30.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx 2023-10-14T12:13:30.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-10-14T12:13:30.206 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-10-14T12:13:30.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/am53c974.ko 2023-10-14T12:13:30.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr 2023-10-14T12:13:30.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-10-14T12:13:30.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/atp870u.ko 2023-10-14T12:13:30.207 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi 2023-10-14T12:13:30.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-10-14T12:13:30.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa 2023-10-14T12:13:30.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bfa/bfa.ko 2023-10-14T12:13:30.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc 2023-10-14T12:13:30.208 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-10-14T12:13:30.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i 2023-10-14T12:13:30.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-10-14T12:13:30.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ch.ko 2023-10-14T12:13:30.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor 2023-10-14T12:13:30.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/csiostor/csiostor.ko 2023-10-14T12:13:30.209 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi 2023-10-14T12:13:30.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i 2023-10-14T12:13:30.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-10-14T12:13:30.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i 2023-10-14T12:13:30.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-10-14T12:13:30.210 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-10-14T12:13:30.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dc395x.ko 2023-10-14T12:13:30.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler 2023-10-14T12:13:30.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-10-14T12:13:30.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-10-14T12:13:30.211 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-10-14T12:13:30.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-10-14T12:13:30.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/dmx3191d.ko 2023-10-14T12:13:30.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r 2023-10-14T12:13:30.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esas2r/esas2r.ko 2023-10-14T12:13:30.212 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/esp_scsi.ko 2023-10-14T12:13:30.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe 2023-10-14T12:13:30.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/fcoe.ko 2023-10-14T12:13:30.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-10-14T12:13:30.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic 2023-10-14T12:13:30.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/fnic/fnic.ko 2023-10-14T12:13:30.213 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hpsa.ko 2023-10-14T12:13:30.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hptiop.ko 2023-10-14T12:13:30.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/hv_storvsc.ko 2023-10-14T12:13:30.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/initio.ko 2023-10-14T12:13:30.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ipr.ko 2023-10-14T12:13:30.214 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ips.ko 2023-10-14T12:13:30.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci 2023-10-14T12:13:30.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/isci/isci.ko 2023-10-14T12:13:30.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-10-14T12:13:30.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/iscsi_tcp.ko 2023-10-14T12:13:30.215 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc 2023-10-14T12:13:30.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libfc/libfc.ko 2023-10-14T12:13:30.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi.ko 2023-10-14T12:13:30.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libiscsi_tcp.ko 2023-10-14T12:13:30.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas 2023-10-14T12:13:30.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/libsas/libsas.ko 2023-10-14T12:13:30.216 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc 2023-10-14T12:13:30.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/lpfc/lpfc.ko 2023-10-14T12:13:30.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid 2023-10-14T12:13:30.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid.ko 2023-10-14T12:13:30.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-10-14T12:13:30.217 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-10-14T12:13:30.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-10-14T12:13:30.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas 2023-10-14T12:13:30.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-10-14T12:13:30.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas 2023-10-14T12:13:30.218 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvsas/mvsas.ko 2023-10-14T12:13:30.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/mvumi.ko 2023-10-14T12:13:30.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001 2023-10-14T12:13:30.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-10-14T12:13:30.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/pmcraid.ko 2023-10-14T12:13:30.219 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla1280.ko 2023-10-14T12:13:30.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx 2023-10-14T12:13:30.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-10-14T12:13:30.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-10-14T12:13:30.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx 2023-10-14T12:13:30.220 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-10-14T12:13:30.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/raid_class.ko 2023-10-14T12:13:30.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_debug.ko 2023-10-14T12:13:30.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_fc.ko 2023-10-14T12:13:30.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-10-14T12:13:30.221 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_sas.ko 2023-10-14T12:13:30.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_spi.ko 2023-10-14T12:13:30.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/scsi_transport_srp.ko 2023-10-14T12:13:30.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/ses.ko 2023-10-14T12:13:30.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/st.ko 2023-10-14T12:13:30.222 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/stex.ko 2023-10-14T12:13:30.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2 2023-10-14T12:13:30.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-10-14T12:13:30.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/virtio_scsi.ko 2023-10-14T12:13:30.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/vmw_pvscsi.ko 2023-10-14T12:13:30.223 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/scsi/wd719x.ko 2023-10-14T12:13:30.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb 2023-10-14T12:13:30.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ssb/ssb.ko 2023-10-14T12:13:30.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target 2023-10-14T12:13:30.224 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi 2023-10-14T12:13:30.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-10-14T12:13:30.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback 2023-10-14T12:13:30.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/loopback/tcm_loop.ko 2023-10-14T12:13:30.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_file.ko 2023-10-14T12:13:30.225 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_iblock.ko 2023-10-14T12:13:30.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_mod.ko 2023-10-14T12:13:30.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_pscsi.ko 2023-10-14T12:13:30.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/target_core_user.ko 2023-10-14T12:13:30.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc 2023-10-14T12:13:30.226 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-10-14T12:13:30.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal 2023-10-14T12:13:30.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel 2023-10-14T12:13:30.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal 2023-10-14T12:13:30.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-10-14T12:13:30.227 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-10-14T12:13:30.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-10-14T12:13:30.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-10-14T12:13:30.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-10-14T12:13:30.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-10-14T12:13:30.228 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-10-14T12:13:30.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-10-14T12:13:30.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-10-14T12:13:30.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-10-14T12:13:30.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-10-14T12:13:30.229 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-10-14T12:13:30.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-10-14T12:13:30.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-10-14T12:13:30.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-10-14T12:13:30.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty 2023-10-14T12:13:30.230 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless 2023-10-14T12:13:30.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-10-14T12:13:30.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_gsm.ko 2023-10-14T12:13:30.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/n_hdlc.ko 2023-10-14T12:13:30.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/nozomi.ko 2023-10-14T12:13:30.231 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial 2023-10-14T12:13:30.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250 2023-10-14T12:13:30.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-10-14T12:13:30.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/arc_uart.ko 2023-10-14T12:13:30.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm 2023-10-14T12:13:30.232 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/tty/serial/jsm/jsm.ko 2023-10-14T12:13:30.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs 2023-10-14T12:13:30.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core 2023-10-14T12:13:30.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/core/ufshcd-core.ko 2023-10-14T12:13:30.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host 2023-10-14T12:13:30.233 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-10-14T12:13:30.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio 2023-10-14T12:13:30.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio.ko 2023-10-14T12:13:30.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_aec.ko 2023-10-14T12:13:30.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_cif.ko 2023-10-14T12:13:30.234 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_pci_generic.ko 2023-10-14T12:13:30.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/uio/uio_sercos3.ko 2023-10-14T12:13:30.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb 2023-10-14T12:13:30.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class 2023-10-14T12:13:30.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-acm.ko 2023-10-14T12:13:30.235 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/cdc-wdm.ko 2023-10-14T12:13:30.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usblp.ko 2023-10-14T12:13:30.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/class/usbtmc.ko 2023-10-14T12:13:30.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host 2023-10-14T12:13:30.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/host/sl811-hcd.ko 2023-10-14T12:13:30.236 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image 2023-10-14T12:13:30.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/mdc800.ko 2023-10-14T12:13:30.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/image/microtek.ko 2023-10-14T12:13:30.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc 2023-10-14T12:13:30.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/adutux.ko 2023-10-14T12:13:30.237 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/appledisplay.ko 2023-10-14T12:13:30.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi26.ko 2023-10-14T12:13:30.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/emi62.ko 2023-10-14T12:13:30.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ezusb.ko 2023-10-14T12:13:30.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/idmouse.ko 2023-10-14T12:13:30.238 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/iowarrior.ko 2023-10-14T12:13:30.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/isight_firmware.ko 2023-10-14T12:13:30.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/ldusb.ko 2023-10-14T12:13:30.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/legousbtower.ko 2023-10-14T12:13:30.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga 2023-10-14T12:13:30.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-10-14T12:13:30.239 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/trancevibrator.ko 2023-10-14T12:13:30.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usb3503.ko 2023-10-14T12:13:30.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usblcd.ko 2023-10-14T12:13:30.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/usbsevseg.ko 2023-10-14T12:13:30.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/uss720.ko 2023-10-14T12:13:30.240 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/misc/yurex.ko 2023-10-14T12:13:30.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy 2023-10-14T12:13:30.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/phy/phy-generic.ko 2023-10-14T12:13:30.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial 2023-10-14T12:13:30.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/aircable.ko 2023-10-14T12:13:30.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ark3116.ko 2023-10-14T12:13:30.241 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/belkin_sa.ko 2023-10-14T12:13:30.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ch341.ko 2023-10-14T12:13:30.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cp210x.ko 2023-10-14T12:13:30.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cyberjack.ko 2023-10-14T12:13:30.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/cypress_m8.ko 2023-10-14T12:13:30.242 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/digi_acceleport.ko 2023-10-14T12:13:30.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/empeg.ko 2023-10-14T12:13:30.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ftdi_sio.ko 2023-10-14T12:13:30.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/garmin_gps.ko 2023-10-14T12:13:30.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_edgeport.ko 2023-10-14T12:13:30.243 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/io_ti.ko 2023-10-14T12:13:30.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipaq.ko 2023-10-14T12:13:30.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ipw.ko 2023-10-14T12:13:30.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ir-usb.ko 2023-10-14T12:13:30.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-10-14T12:13:30.244 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan.ko 2023-10-14T12:13:30.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/keyspan_pda.ko 2023-10-14T12:13:30.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kl5kusb105.ko 2023-10-14T12:13:30.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/kobil_sct.ko 2023-10-14T12:13:30.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mct_u232.ko 2023-10-14T12:13:30.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7720.ko 2023-10-14T12:13:30.245 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/mos7840.ko 2023-10-14T12:13:30.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/navman.ko 2023-10-14T12:13:30.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/omninet.ko 2023-10-14T12:13:30.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/opticon.ko 2023-10-14T12:13:30.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/option.ko 2023-10-14T12:13:30.246 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/oti6858.ko 2023-10-14T12:13:30.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/pl2303.ko 2023-10-14T12:13:30.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcaux.ko 2023-10-14T12:13:30.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/qcserial.ko 2023-10-14T12:13:30.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/quatech2.ko 2023-10-14T12:13:30.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/safe_serial.ko 2023-10-14T12:13:30.247 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/sierra.ko 2023-10-14T12:13:30.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/spcp8x5.ko 2023-10-14T12:13:30.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ssu100.ko 2023-10-14T12:13:30.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/symbolserial.ko 2023-10-14T12:13:30.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-10-14T12:13:30.248 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-10-14T12:13:30.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_debug.ko 2023-10-14T12:13:30.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/usb_wwan.ko 2023-10-14T12:13:30.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/visor.ko 2023-10-14T12:13:30.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/whiteheat.ko 2023-10-14T12:13:30.249 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/serial/xsens_mt.ko 2023-10-14T12:13:30.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage 2023-10-14T12:13:30.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/uas.ko 2023-10-14T12:13:30.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-alauda.ko 2023-10-14T12:13:30.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-cypress.ko 2023-10-14T12:13:30.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-datafab.ko 2023-10-14T12:13:30.250 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-10-14T12:13:30.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-freecom.ko 2023-10-14T12:13:30.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-isd200.ko 2023-10-14T12:13:30.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-10-14T12:13:30.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-karma.ko 2023-10-14T12:13:30.251 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-onetouch.ko 2023-10-14T12:13:30.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-realtek.ko 2023-10-14T12:13:30.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr09.ko 2023-10-14T12:13:30.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-sddr55.ko 2023-10-14T12:13:30.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/ums-usbat.ko 2023-10-14T12:13:30.252 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/storage/usb-storage.ko 2023-10-14T12:13:30.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip 2023-10-14T12:13:30.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-core.ko 2023-10-14T12:13:30.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/usbip-host.ko 2023-10-14T12:13:30.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-10-14T12:13:30.253 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio 2023-10-14T12:13:30.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci 2023-10-14T12:13:30.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-10-14T12:13:30.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/pci/vfio-pci.ko 2023-10-14T12:13:30.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio.ko 2023-10-14T12:13:30.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-10-14T12:13:30.254 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost 2023-10-14T12:13:30.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost.ko 2023-10-14T12:13:30.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_iotlb.ko 2023-10-14T12:13:30.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_net.ko 2023-10-14T12:13:30.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/vhost/vhost_scsi.ko 2023-10-14T12:13:30.255 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video 2023-10-14T12:13:30.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight 2023-10-14T12:13:30.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/apple_bl.ko 2023-10-14T12:13:30.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/lcd.ko 2023-10-14T12:13:30.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/video/backlight/platform_lcd.ko 2023-10-14T12:13:30.256 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio 2023-10-14T12:13:30.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio.ko 2023-10-14T12:13:30.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_balloon.ko 2023-10-14T12:13:30.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_mmio.ko 2023-10-14T12:13:30.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci.ko 2023-10-14T12:13:30.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-10-14T12:13:30.257 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-10-14T12:13:30.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/virtio/virtio_ring.ko 2023-10-14T12:13:30.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1 2023-10-14T12:13:30.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters 2023-10-14T12:13:30.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2482.ko 2023-10-14T12:13:30.258 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/masters/ds2490.ko 2023-10-14T12:13:30.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves 2023-10-14T12:13:30.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-10-14T12:13:30.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-10-14T12:13:30.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-10-14T12:13:30.259 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-10-14T12:13:30.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-10-14T12:13:30.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-10-14T12:13:30.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-10-14T12:13:30.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-10-14T12:13:30.260 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-10-14T12:13:30.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_smem.ko 2023-10-14T12:13:30.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/slaves/w1_therm.ko 2023-10-14T12:13:30.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/w1/wire.ko 2023-10-14T12:13:30.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog 2023-10-14T12:13:30.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim1535_wdt.ko 2023-10-14T12:13:30.261 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/alim7101_wdt.ko 2023-10-14T12:13:30.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/f71808e_wdt.ko 2023-10-14T12:13:30.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/hpwdt.ko 2023-10-14T12:13:30.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/i6300esb.ko 2023-10-14T12:13:30.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-10-14T12:13:30.262 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/iTCO_wdt.ko 2023-10-14T12:13:30.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ib700wdt.ko 2023-10-14T12:13:30.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ibmasr.ko 2023-10-14T12:13:30.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-10-14T12:13:30.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it8712f_wdt.ko 2023-10-14T12:13:30.263 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/it87_wdt.ko 2023-10-14T12:13:30.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/machzwd.ko 2023-10-14T12:13:30.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/nv_tco.ko 2023-10-14T12:13:30.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_pci.ko 2023-10-14T12:13:30.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/pcwd_usb.ko 2023-10-14T12:13:30.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-10-14T12:13:30.264 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sch311x_wdt.ko 2023-10-14T12:13:30.265 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/softdog.ko 2023-10-14T12:13:30.265 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/sp5100_tco.ko 2023-10-14T12:13:30.265 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/via_wdt.ko 2023-10-14T12:13:30.265 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-10-14T12:13:30.265 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83877f_wdt.ko 2023-10-14T12:13:30.266 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/w83977f_wdt.ko 2023-10-14T12:13:30.266 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/wdt_pci.ko 2023-10-14T12:13:30.266 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/watchdog/xen_wdt.ko 2023-10-14T12:13:30.266 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen 2023-10-14T12:13:30.266 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-acpi-processor.ko 2023-10-14T12:13:30.267 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-evtchn.ko 2023-10-14T12:13:30.267 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntalloc.ko 2023-10-14T12:13:30.267 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-gntdev.ko 2023-10-14T12:13:30.267 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback 2023-10-14T12:13:30.267 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-10-14T12:13:30.268 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xen-privcmd.ko 2023-10-14T12:13:30.268 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs 2023-10-14T12:13:30.268 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/drivers/xen/xenfs/xenfs.ko 2023-10-14T12:13:30.268 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs 2023-10-14T12:13:30.268 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p 2023-10-14T12:13:30.268 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/9p/9p.ko 2023-10-14T12:13:30.269 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs 2023-10-14T12:13:30.269 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/affs/affs.ko 2023-10-14T12:13:30.269 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs 2023-10-14T12:13:30.269 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/befs/befs.ko 2023-10-14T12:13:30.269 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/binfmt_misc.ko 2023-10-14T12:13:30.270 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs 2023-10-14T12:13:30.270 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/btrfs/btrfs.ko 2023-10-14T12:13:30.270 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles 2023-10-14T12:13:30.270 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cachefiles/cachefiles.ko 2023-10-14T12:13:30.270 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph 2023-10-14T12:13:30.271 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ceph/ceph.ko 2023-10-14T12:13:30.271 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda 2023-10-14T12:13:30.271 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/coda/coda.ko 2023-10-14T12:13:30.271 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs 2023-10-14T12:13:30.271 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/cramfs/cramfs.ko 2023-10-14T12:13:30.271 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm 2023-10-14T12:13:30.272 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/dlm/dlm.ko 2023-10-14T12:13:30.272 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs 2023-10-14T12:13:30.272 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ecryptfs/ecryptfs.ko 2023-10-14T12:13:30.272 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs 2023-10-14T12:13:30.272 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/f2fs/f2fs.ko 2023-10-14T12:13:30.273 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat 2023-10-14T12:13:30.273 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/fat.ko 2023-10-14T12:13:30.273 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/msdos.ko 2023-10-14T12:13:30.273 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fat/vfat.ko 2023-10-14T12:13:30.273 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache 2023-10-14T12:13:30.273 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fscache/fscache.ko 2023-10-14T12:13:30.274 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse 2023-10-14T12:13:30.274 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/cuse.ko 2023-10-14T12:13:30.274 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/fuse/fuse.ko 2023-10-14T12:13:30.274 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2 2023-10-14T12:13:30.274 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/gfs2/gfs2.ko 2023-10-14T12:13:30.275 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs 2023-10-14T12:13:30.275 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfs/hfs.ko 2023-10-14T12:13:30.275 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus 2023-10-14T12:13:30.275 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/hfsplus/hfsplus.ko 2023-10-14T12:13:30.275 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs 2023-10-14T12:13:30.276 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/isofs/isofs.ko 2023-10-14T12:13:30.276 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs 2023-10-14T12:13:30.276 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/jfs/jfs.ko 2023-10-14T12:13:30.276 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd 2023-10-14T12:13:30.276 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/lockd/lockd.ko 2023-10-14T12:13:30.277 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix 2023-10-14T12:13:30.277 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/minix/minix.ko 2023-10-14T12:13:30.277 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs 2023-10-14T12:13:30.277 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/netfs/netfs.ko 2023-10-14T12:13:30.277 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs 2023-10-14T12:13:30.277 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout 2023-10-14T12:13:30.278 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-10-14T12:13:30.278 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout 2023-10-14T12:13:30.278 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-10-14T12:13:30.278 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout 2023-10-14T12:13:30.278 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-10-14T12:13:30.279 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfs.ko 2023-10-14T12:13:30.279 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv3.ko 2023-10-14T12:13:30.279 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs/nfsv4.ko 2023-10-14T12:13:30.279 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common 2023-10-14T12:13:30.279 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/grace.ko 2023-10-14T12:13:30.280 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfs_common/nfs_acl.ko 2023-10-14T12:13:30.280 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd 2023-10-14T12:13:30.280 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nfsd/nfsd.ko 2023-10-14T12:13:30.280 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2 2023-10-14T12:13:30.280 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nilfs2/nilfs2.ko 2023-10-14T12:13:30.280 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls 2023-10-14T12:13:30.281 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-celtic.ko 2023-10-14T12:13:30.281 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-centeuro.ko 2023-10-14T12:13:30.281 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-croatian.ko 2023-10-14T12:13:30.281 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-cyrillic.ko 2023-10-14T12:13:30.281 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-gaelic.ko 2023-10-14T12:13:30.282 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-greek.ko 2023-10-14T12:13:30.282 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-iceland.ko 2023-10-14T12:13:30.282 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-inuit.ko 2023-10-14T12:13:30.282 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-roman.ko 2023-10-14T12:13:30.282 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-romanian.ko 2023-10-14T12:13:30.283 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/mac-turkish.ko 2023-10-14T12:13:30.283 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1250.ko 2023-10-14T12:13:30.283 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1251.ko 2023-10-14T12:13:30.283 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp1255.ko 2023-10-14T12:13:30.283 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp737.ko 2023-10-14T12:13:30.284 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp775.ko 2023-10-14T12:13:30.284 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp850.ko 2023-10-14T12:13:30.284 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp852.ko 2023-10-14T12:13:30.284 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp855.ko 2023-10-14T12:13:30.284 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp857.ko 2023-10-14T12:13:30.284 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp860.ko 2023-10-14T12:13:30.285 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp861.ko 2023-10-14T12:13:30.285 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp862.ko 2023-10-14T12:13:30.285 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp863.ko 2023-10-14T12:13:30.285 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp864.ko 2023-10-14T12:13:30.285 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp865.ko 2023-10-14T12:13:30.286 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp866.ko 2023-10-14T12:13:30.286 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp869.ko 2023-10-14T12:13:30.286 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp874.ko 2023-10-14T12:13:30.286 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp932.ko 2023-10-14T12:13:30.286 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp936.ko 2023-10-14T12:13:30.287 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp949.ko 2023-10-14T12:13:30.287 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_cp950.ko 2023-10-14T12:13:30.287 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_euc-jp.ko 2023-10-14T12:13:30.287 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-1.ko 2023-10-14T12:13:30.287 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-13.ko 2023-10-14T12:13:30.288 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-14.ko 2023-10-14T12:13:30.288 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-15.ko 2023-10-14T12:13:30.288 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-2.ko 2023-10-14T12:13:30.288 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-3.ko 2023-10-14T12:13:30.288 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-4.ko 2023-10-14T12:13:30.288 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-5.ko 2023-10-14T12:13:30.289 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-6.ko 2023-10-14T12:13:30.289 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-7.ko 2023-10-14T12:13:30.289 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_iso8859-9.ko 2023-10-14T12:13:30.289 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-r.ko 2023-10-14T12:13:30.289 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-ru.ko 2023-10-14T12:13:30.290 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_koi8-u.ko 2023-10-14T12:13:30.290 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_ucs2_utils.ko 2023-10-14T12:13:30.290 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/nls/nls_utf8.ko 2023-10-14T12:13:30.290 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2 2023-10-14T12:13:30.290 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster 2023-10-14T12:13:30.291 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-10-14T12:13:30.291 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm 2023-10-14T12:13:30.291 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-10-14T12:13:30.291 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs 2023-10-14T12:13:30.291 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-10-14T12:13:30.292 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2.ko 2023-10-14T12:13:30.292 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-10-14T12:13:30.292 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-10-14T12:13:30.292 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-10-14T12:13:30.292 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs 2023-10-14T12:13:30.293 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/overlayfs/overlay.ko 2023-10-14T12:13:30.293 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore 2023-10-14T12:13:30.293 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/pstore/ramoops.ko 2023-10-14T12:13:30.293 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs 2023-10-14T12:13:30.293 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/reiserfs/reiserfs.ko 2023-10-14T12:13:30.293 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs 2023-10-14T12:13:30.294 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/romfs/romfs.ko 2023-10-14T12:13:30.294 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb 2023-10-14T12:13:30.294 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client 2023-10-14T12:13:30.294 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/client/cifs.ko 2023-10-14T12:13:30.294 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common 2023-10-14T12:13:30.295 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_arc4.ko 2023-10-14T12:13:30.295 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/smb/common/cifs_md4.ko 2023-10-14T12:13:30.295 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs 2023-10-14T12:13:30.295 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/squashfs/squashfs.ko 2023-10-14T12:13:30.295 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv 2023-10-14T12:13:30.296 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/sysv/sysv.ko 2023-10-14T12:13:30.296 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf 2023-10-14T12:13:30.296 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/udf/udf.ko 2023-10-14T12:13:30.296 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs 2023-10-14T12:13:30.296 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/ufs/ufs.ko 2023-10-14T12:13:30.297 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs 2023-10-14T12:13:30.297 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/fs/xfs/xfs.ko 2023-10-14T12:13:30.297 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel 2023-10-14T12:13:30.297 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu 2023-10-14T12:13:30.297 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/rcu/rcutorture.ko 2023-10-14T12:13:30.297 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/torture.ko 2023-10-14T12:13:30.298 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace 2023-10-14T12:13:30.298 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-10-14T12:13:30.298 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib 2023-10-14T12:13:30.298 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/asn1_encoder.ko 2023-10-14T12:13:30.298 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc-itu-t.ko 2023-10-14T12:13:30.299 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crc8.ko 2023-10-14T12:13:30.299 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto 2023-10-14T12:13:30.299 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libarc4.ko 2023-10-14T12:13:30.299 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/crypto/libdes.ko 2023-10-14T12:13:30.299 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/libcrc32c.ko 2023-10-14T12:13:30.300 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lru_cache.ko 2023-10-14T12:13:30.300 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4 2023-10-14T12:13:30.300 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4_compress.ko 2023-10-14T12:13:30.300 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/lz4/lz4hc_compress.ko 2023-10-14T12:13:30.300 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math 2023-10-14T12:13:30.301 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/math/cordic.ko 2023-10-14T12:13:30.301 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6 2023-10-14T12:13:30.301 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/raid6/raid6_pq.ko 2023-10-14T12:13:30.301 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon 2023-10-14T12:13:30.301 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/reed_solomon/reed_solomon.ko 2023-10-14T12:13:30.301 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_bm.ko 2023-10-14T12:13:30.302 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_fsm.ko 2023-10-14T12:13:30.302 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/ts_kmp.ko 2023-10-14T12:13:30.302 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd 2023-10-14T12:13:30.302 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/lib/zstd/zstd_compress.ko 2023-10-14T12:13:30.302 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm 2023-10-14T12:13:30.303 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/mm/hwpoison-inject.ko 2023-10-14T12:13:30.303 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net 2023-10-14T12:13:30.303 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan 2023-10-14T12:13:30.303 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/6lowpan.ko 2023-10-14T12:13:30.303 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_dest.ko 2023-10-14T12:13:30.304 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_fragment.ko 2023-10-14T12:13:30.304 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_hop.ko 2023-10-14T12:13:30.304 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_ipv6.ko 2023-10-14T12:13:30.304 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_mobility.ko 2023-10-14T12:13:30.304 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_routing.ko 2023-10-14T12:13:30.305 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/6lowpan/nhc_udp.ko 2023-10-14T12:13:30.305 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802 2023-10-14T12:13:30.305 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/garp.ko 2023-10-14T12:13:30.305 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/mrp.ko 2023-10-14T12:13:30.305 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/p8022.ko 2023-10-14T12:13:30.306 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/psnap.ko 2023-10-14T12:13:30.306 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/802/stp.ko 2023-10-14T12:13:30.306 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q 2023-10-14T12:13:30.306 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/8021q/8021q.ko 2023-10-14T12:13:30.306 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p 2023-10-14T12:13:30.306 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet.ko 2023-10-14T12:13:30.307 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_fd.ko 2023-10-14T12:13:30.307 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_rdma.ko 2023-10-14T12:13:30.307 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/9p/9pnet_virtio.ko 2023-10-14T12:13:30.307 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv 2023-10-14T12:13:30.307 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/batman-adv/batman-adv.ko 2023-10-14T12:13:30.308 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge 2023-10-14T12:13:30.308 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/br_netfilter.ko 2023-10-14T12:13:30.308 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/bridge.ko 2023-10-14T12:13:30.308 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter 2023-10-14T12:13:30.308 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-10-14T12:13:30.309 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_among.ko 2023-10-14T12:13:30.309 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arp.ko 2023-10-14T12:13:30.309 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-10-14T12:13:30.309 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-10-14T12:13:30.309 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip.ko 2023-10-14T12:13:30.310 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-10-14T12:13:30.310 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_limit.ko 2023-10-14T12:13:30.310 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_log.ko 2023-10-14T12:13:30.310 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark.ko 2023-10-14T12:13:30.310 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-10-14T12:13:30.311 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-10-14T12:13:30.311 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-10-14T12:13:30.311 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-10-14T12:13:30.311 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_snat.ko 2023-10-14T12:13:30.311 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_stp.ko 2023-10-14T12:13:30.312 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-10-14T12:13:30.312 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-10-14T12:13:30.312 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-10-14T12:13:30.312 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-10-14T12:13:30.312 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/ebtables.ko 2023-10-14T12:13:30.313 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-10-14T12:13:30.313 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-10-14T12:13:30.313 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-10-14T12:13:30.313 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph 2023-10-14T12:13:30.313 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ceph/libceph.ko 2023-10-14T12:13:30.314 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core 2023-10-14T12:13:30.314 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/failover.ko 2023-10-14T12:13:30.314 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/core/pktgen.ko 2023-10-14T12:13:30.314 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp 2023-10-14T12:13:30.314 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp.ko 2023-10-14T12:13:30.314 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_diag.ko 2023-10-14T12:13:30.315 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv4.ko 2023-10-14T12:13:30.315 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dccp/dccp_ipv6.ko 2023-10-14T12:13:30.315 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver 2023-10-14T12:13:30.315 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dns_resolver/dns_resolver.ko 2023-10-14T12:13:30.315 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa 2023-10-14T12:13:30.316 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/dsa_core.ko 2023-10-14T12:13:30.316 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_brcm.ko 2023-10-14T12:13:30.316 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_dsa.ko 2023-10-14T12:13:30.316 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_none.ko 2023-10-14T12:13:30.316 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/dsa/tag_trailer.ko 2023-10-14T12:13:30.317 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154 2023-10-14T12:13:30.317 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan 2023-10-14T12:13:30.317 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-10-14T12:13:30.317 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154.ko 2023-10-14T12:13:30.317 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ieee802154/ieee802154_socket.ko 2023-10-14T12:13:30.318 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4 2023-10-14T12:13:30.318 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ah4.ko 2023-10-14T12:13:30.318 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/esp4.ko 2023-10-14T12:13:30.318 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/fou.ko 2023-10-14T12:13:30.318 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/gre.ko 2023-10-14T12:13:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/inet_diag.ko 2023-10-14T12:13:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_gre.ko 2023-10-14T12:13:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_tunnel.ko 2023-10-14T12:13:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ip_vti.ko 2023-10-14T12:13:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipcomp.ko 2023-10-14T12:13:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/ipip.ko 2023-10-14T12:13:30.320 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter 2023-10-14T12:13:30.320 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arp_tables.ko 2023-10-14T12:13:30.320 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-10-14T12:13:30.320 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-10-14T12:13:30.320 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-10-14T12:13:30.321 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-10-14T12:13:30.321 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-10-14T12:13:30.321 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-10-14T12:13:30.321 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-10-14T12:13:30.321 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-10-14T12:13:30.322 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-10-14T12:13:30.322 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/iptable_security.ko 2023-10-14T12:13:30.322 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-10-14T12:13:30.322 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-10-14T12:13:30.322 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-10-14T12:13:30.323 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-10-14T12:13:30.323 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-10-14T12:13:30.323 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-10-14T12:13:30.323 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-10-14T12:13:30.323 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-10-14T12:13:30.324 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-10-14T12:13:30.324 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-10-14T12:13:30.324 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_bic.ko 2023-10-14T12:13:30.324 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_dctcp.ko 2023-10-14T12:13:30.324 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_diag.ko 2023-10-14T12:13:30.325 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_highspeed.ko 2023-10-14T12:13:30.325 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_htcp.ko 2023-10-14T12:13:30.325 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_hybla.ko 2023-10-14T12:13:30.325 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_illinois.ko 2023-10-14T12:13:30.325 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_lp.ko 2023-10-14T12:13:30.325 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_scalable.ko 2023-10-14T12:13:30.326 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_vegas.ko 2023-10-14T12:13:30.326 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_veno.ko 2023-10-14T12:13:30.326 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_westwood.ko 2023-10-14T12:13:30.326 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tcp_yeah.ko 2023-10-14T12:13:30.326 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/tunnel4.ko 2023-10-14T12:13:30.327 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_diag.ko 2023-10-14T12:13:30.327 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/udp_tunnel.ko 2023-10-14T12:13:30.327 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv4/xfrm4_tunnel.ko 2023-10-14T12:13:30.327 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6 2023-10-14T12:13:30.327 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ah6.ko 2023-10-14T12:13:30.328 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/esp6.ko 2023-10-14T12:13:30.328 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/fou6.ko 2023-10-14T12:13:30.328 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_tunnel.ko 2023-10-14T12:13:30.328 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-10-14T12:13:30.328 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ip6_vti.ko 2023-10-14T12:13:30.329 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/ipcomp6.ko 2023-10-14T12:13:30.329 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter 2023-10-14T12:13:30.329 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-10-14T12:13:30.329 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-10-14T12:13:30.329 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-10-14T12:13:30.329 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-10-14T12:13:30.330 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-10-14T12:13:30.330 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-10-14T12:13:30.330 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-10-14T12:13:30.330 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-10-14T12:13:30.330 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-10-14T12:13:30.331 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-10-14T12:13:30.331 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-10-14T12:13:30.331 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-10-14T12:13:30.331 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-10-14T12:13:30.331 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-10-14T12:13:30.332 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-10-14T12:13:30.332 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-10-14T12:13:30.332 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-10-14T12:13:30.332 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-10-14T12:13:30.332 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-10-14T12:13:30.333 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-10-14T12:13:30.333 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-10-14T12:13:30.333 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-10-14T12:13:30.333 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-10-14T12:13:30.333 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-10-14T12:13:30.333 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/sit.ko 2023-10-14T12:13:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/tunnel6.ko 2023-10-14T12:13:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/ipv6/xfrm6_tunnel.ko 2023-10-14T12:13:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key 2023-10-14T12:13:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/key/af_key.ko 2023-10-14T12:13:30.334 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp 2023-10-14T12:13:30.335 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_core.ko 2023-10-14T12:13:30.335 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_debugfs.ko 2023-10-14T12:13:30.335 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_eth.ko 2023-10-14T12:13:30.335 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip.ko 2023-10-14T12:13:30.335 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ip6.ko 2023-10-14T12:13:30.336 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_netlink.ko 2023-10-14T12:13:30.336 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/l2tp/l2tp_ppp.ko 2023-10-14T12:13:30.336 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc 2023-10-14T12:13:30.336 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/llc/llc.ko 2023-10-14T12:13:30.336 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154 2023-10-14T12:13:30.336 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mac802154/mac802154.ko 2023-10-14T12:13:30.337 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls 2023-10-14T12:13:30.337 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/mpls/mpls_gso.ko 2023-10-14T12:13:30.337 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter 2023-10-14T12:13:30.337 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset 2023-10-14T12:13:30.337 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set.ko 2023-10-14T12:13:30.338 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-10-14T12:13:30.338 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-10-14T12:13:30.338 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-10-14T12:13:30.338 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-10-14T12:13:30.338 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-10-14T12:13:30.339 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-10-14T12:13:30.339 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-10-14T12:13:30.339 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-10-14T12:13:30.339 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-10-14T12:13:30.339 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-10-14T12:13:30.340 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-10-14T12:13:30.340 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-10-14T12:13:30.340 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-10-14T12:13:30.340 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-10-14T12:13:30.340 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-10-14T12:13:30.341 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs 2023-10-14T12:13:30.341 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs.ko 2023-10-14T12:13:30.341 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-10-14T12:13:30.341 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-10-14T12:13:30.341 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-10-14T12:13:30.341 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-10-14T12:13:30.342 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-10-14T12:13:30.342 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-10-14T12:13:30.342 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-10-14T12:13:30.342 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-10-14T12:13:30.342 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-10-14T12:13:30.343 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-10-14T12:13:30.343 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-10-14T12:13:30.343 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-10-14T12:13:30.343 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-10-14T12:13:30.343 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conncount.ko 2023-10-14T12:13:30.344 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack.ko 2023-10-14T12:13:30.344 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-10-14T12:13:30.344 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-10-14T12:13:30.344 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-10-14T12:13:30.344 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_h323.ko 2023-10-14T12:13:30.345 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_irc.ko 2023-10-14T12:13:30.345 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-10-14T12:13:30.345 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-10-14T12:13:30.345 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-10-14T12:13:30.345 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sane.ko 2023-10-14T12:13:30.346 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_sip.ko 2023-10-14T12:13:30.346 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-10-14T12:13:30.346 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-10-14T12:13:30.346 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_dup_netdev.ko 2023-10-14T12:13:30.346 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table.ko 2023-10-14T12:13:30.346 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_flow_table_inet.ko 2023-10-14T12:13:30.347 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_log_syslog.ko 2023-10-14T12:13:30.347 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat.ko 2023-10-14T12:13:30.347 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_amanda.ko 2023-10-14T12:13:30.347 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_ftp.ko 2023-10-14T12:13:30.347 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_irc.ko 2023-10-14T12:13:30.348 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_sip.ko 2023-10-14T12:13:30.348 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_nat_tftp.ko 2023-10-14T12:13:30.348 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_synproxy_core.ko 2023-10-14T12:13:30.348 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nf_tables.ko 2023-10-14T12:13:30.348 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink.ko 2023-10-14T12:13:30.348 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_acct.ko 2023-10-14T12:13:30.349 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_log.ko 2023-10-14T12:13:30.349 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_osf.ko 2023-10-14T12:13:30.349 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nfnetlink_queue.ko 2023-10-14T12:13:30.349 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_chain_nat.ko 2023-10-14T12:13:30.349 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_compat.ko 2023-10-14T12:13:30.350 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_ct.ko 2023-10-14T12:13:30.350 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_dup_netdev.ko 2023-10-14T12:13:30.350 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fib.ko 2023-10-14T12:13:30.350 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_fwd_netdev.ko 2023-10-14T12:13:30.350 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_hash.ko 2023-10-14T12:13:30.351 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_limit.ko 2023-10-14T12:13:30.351 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_log.ko 2023-10-14T12:13:30.351 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_masq.ko 2023-10-14T12:13:30.351 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_nat.ko 2023-10-14T12:13:30.351 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_numgen.ko 2023-10-14T12:13:30.351 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_queue.ko 2023-10-14T12:13:30.352 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_quota.ko 2023-10-14T12:13:30.352 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_redir.ko 2023-10-14T12:13:30.352 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject.ko 2023-10-14T12:13:30.352 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_reject_inet.ko 2023-10-14T12:13:30.352 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_socket.ko 2023-10-14T12:13:30.353 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/nft_tunnel.ko 2023-10-14T12:13:30.353 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_AUDIT.ko 2023-10-14T12:13:30.353 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CHECKSUM.ko 2023-10-14T12:13:30.353 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CLASSIFY.ko 2023-10-14T12:13:30.353 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-10-14T12:13:30.354 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_CT.ko 2023-10-14T12:13:30.354 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_DSCP.ko 2023-10-14T12:13:30.354 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HL.ko 2023-10-14T12:13:30.354 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_HMARK.ko 2023-10-14T12:13:30.354 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_IDLETIMER.ko 2023-10-14T12:13:30.354 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LED.ko 2023-10-14T12:13:30.355 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_LOG.ko 2023-10-14T12:13:30.355 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_MASQUERADE.ko 2023-10-14T12:13:30.355 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NETMAP.ko 2023-10-14T12:13:30.355 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFLOG.ko 2023-10-14T12:13:30.355 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_NFQUEUE.ko 2023-10-14T12:13:30.356 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_RATEEST.ko 2023-10-14T12:13:30.356 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_REDIRECT.ko 2023-10-14T12:13:30.356 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_SECMARK.ko 2023-10-14T12:13:30.356 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPMSS.ko 2023-10-14T12:13:30.356 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-10-14T12:13:30.357 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TEE.ko 2023-10-14T12:13:30.357 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TPROXY.ko 2023-10-14T12:13:30.357 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_TRACE.ko 2023-10-14T12:13:30.357 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_addrtype.ko 2023-10-14T12:13:30.357 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_bpf.ko 2023-10-14T12:13:30.357 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cgroup.ko 2023-10-14T12:13:30.358 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cluster.ko 2023-10-14T12:13:30.358 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_comment.ko 2023-10-14T12:13:30.358 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connbytes.ko 2023-10-14T12:13:30.358 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlabel.ko 2023-10-14T12:13:30.358 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connlimit.ko 2023-10-14T12:13:30.359 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_connmark.ko 2023-10-14T12:13:30.359 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_conntrack.ko 2023-10-14T12:13:30.359 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_cpu.ko 2023-10-14T12:13:30.359 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dccp.ko 2023-10-14T12:13:30.359 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_devgroup.ko 2023-10-14T12:13:30.360 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_dscp.ko 2023-10-14T12:13:30.360 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ecn.ko 2023-10-14T12:13:30.360 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_esp.ko 2023-10-14T12:13:30.360 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hashlimit.ko 2023-10-14T12:13:30.360 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_helper.ko 2023-10-14T12:13:30.360 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_hl.ko 2023-10-14T12:13:30.361 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipcomp.ko 2023-10-14T12:13:30.361 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_iprange.ko 2023-10-14T12:13:30.361 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_ipvs.ko 2023-10-14T12:13:30.361 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_l2tp.ko 2023-10-14T12:13:30.361 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_length.ko 2023-10-14T12:13:30.362 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_limit.ko 2023-10-14T12:13:30.362 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mac.ko 2023-10-14T12:13:30.362 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_mark.ko 2023-10-14T12:13:30.362 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_multiport.ko 2023-10-14T12:13:30.362 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nat.ko 2023-10-14T12:13:30.362 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_nfacct.ko 2023-10-14T12:13:30.363 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_osf.ko 2023-10-14T12:13:30.363 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_owner.ko 2023-10-14T12:13:30.363 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_physdev.ko 2023-10-14T12:13:30.363 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_pkttype.ko 2023-10-14T12:13:30.363 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_policy.ko 2023-10-14T12:13:30.364 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_quota.ko 2023-10-14T12:13:30.364 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_rateest.ko 2023-10-14T12:13:30.364 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_realm.ko 2023-10-14T12:13:30.364 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_recent.ko 2023-10-14T12:13:30.364 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_sctp.ko 2023-10-14T12:13:30.364 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_set.ko 2023-10-14T12:13:30.365 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_socket.ko 2023-10-14T12:13:30.365 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_state.ko 2023-10-14T12:13:30.365 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_statistic.ko 2023-10-14T12:13:30.365 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_string.ko 2023-10-14T12:13:30.365 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_tcpmss.ko 2023-10-14T12:13:30.366 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_time.ko 2023-10-14T12:13:30.366 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netfilter/xt_u32.ko 2023-10-14T12:13:30.366 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink 2023-10-14T12:13:30.366 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/netlink/netlink_diag.ko 2023-10-14T12:13:30.366 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh 2023-10-14T12:13:30.367 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/nsh/nsh.ko 2023-10-14T12:13:30.367 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch 2023-10-14T12:13:30.367 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/openvswitch.ko 2023-10-14T12:13:30.367 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-geneve.ko 2023-10-14T12:13:30.367 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-gre.ko 2023-10-14T12:13:30.368 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/openvswitch/vport-vxlan.ko 2023-10-14T12:13:30.368 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet 2023-10-14T12:13:30.368 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/packet/af_packet_diag.ko 2023-10-14T12:13:30.368 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds 2023-10-14T12:13:30.369 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds.ko 2023-10-14T12:13:30.369 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_rdma.ko 2023-10-14T12:13:30.369 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/rds/rds_tcp.ko 2023-10-14T12:13:30.369 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched 2023-10-14T12:13:30.369 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_csum.ko 2023-10-14T12:13:30.369 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_gact.ko 2023-10-14T12:13:30.370 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_ipt.ko 2023-10-14T12:13:30.370 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_mirred.ko 2023-10-14T12:13:30.370 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_nat.ko 2023-10-14T12:13:30.370 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_pedit.ko 2023-10-14T12:13:30.370 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_police.ko 2023-10-14T12:13:30.371 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_simple.ko 2023-10-14T12:13:30.371 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_skbedit.ko 2023-10-14T12:13:30.371 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/act_vlan.ko 2023-10-14T12:13:30.371 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_basic.ko 2023-10-14T12:13:30.371 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_bpf.ko 2023-10-14T12:13:30.372 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_flow.ko 2023-10-14T12:13:30.372 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_fw.ko 2023-10-14T12:13:30.372 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_route.ko 2023-10-14T12:13:30.372 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/cls_u32.ko 2023-10-14T12:13:30.372 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_cmp.ko 2023-10-14T12:13:30.373 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_ipset.ko 2023-10-14T12:13:30.373 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_meta.ko 2023-10-14T12:13:30.373 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_nbyte.ko 2023-10-14T12:13:30.373 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_text.ko 2023-10-14T12:13:30.373 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/em_u32.ko 2023-10-14T12:13:30.374 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_choke.ko 2023-10-14T12:13:30.374 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_codel.ko 2023-10-14T12:13:30.374 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_drr.ko 2023-10-14T12:13:30.374 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_fq.ko 2023-10-14T12:13:30.374 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_gred.ko 2023-10-14T12:13:30.375 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hfsc.ko 2023-10-14T12:13:30.375 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_hhf.ko 2023-10-14T12:13:30.375 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_htb.ko 2023-10-14T12:13:30.375 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_ingress.ko 2023-10-14T12:13:30.375 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio.ko 2023-10-14T12:13:30.376 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_mqprio_lib.ko 2023-10-14T12:13:30.376 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_multiq.ko 2023-10-14T12:13:30.376 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_netem.ko 2023-10-14T12:13:30.376 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_pie.ko 2023-10-14T12:13:30.376 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_plug.ko 2023-10-14T12:13:30.377 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_prio.ko 2023-10-14T12:13:30.377 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_qfq.ko 2023-10-14T12:13:30.377 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_red.ko 2023-10-14T12:13:30.377 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfb.ko 2023-10-14T12:13:30.377 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_sfq.ko 2023-10-14T12:13:30.378 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_tbf.ko 2023-10-14T12:13:30.378 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sched/sch_teql.ko 2023-10-14T12:13:30.378 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp 2023-10-14T12:13:30.378 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp.ko 2023-10-14T12:13:30.378 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sctp/sctp_diag.ko 2023-10-14T12:13:30.379 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc 2023-10-14T12:13:30.379 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss 2023-10-14T12:13:30.379 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-10-14T12:13:30.379 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-10-14T12:13:30.379 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/sunrpc.ko 2023-10-14T12:13:30.380 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma 2023-10-14T12:13:30.380 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-10-14T12:13:30.380 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc 2023-10-14T12:13:30.380 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/diag.ko 2023-10-14T12:13:30.380 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/tipc/tipc.ko 2023-10-14T12:13:30.380 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix 2023-10-14T12:13:30.381 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/unix/unix_diag.ko 2023-10-14T12:13:30.381 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock 2023-10-14T12:13:30.381 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-10-14T12:13:30.381 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-10-14T12:13:30.381 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock.ko 2023-10-14T12:13:30.382 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_diag.ko 2023-10-14T12:13:30.382 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/vmw_vsock/vsock_loopback.ko 2023-10-14T12:13:30.382 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm 2023-10-14T12:13:30.382 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/net/xfrm/xfrm_ipcomp.ko 2023-10-14T12:13:30.382 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security 2023-10-14T12:13:30.383 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys 2023-10-14T12:13:30.383 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys 2023-10-14T12:13:30.383 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-10-14T12:13:30.383 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys 2023-10-14T12:13:30.383 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/security/keys/trusted-keys/trusted.ko 2023-10-14T12:13:30.384 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt 2023-10-14T12:13:30.384 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib 2023-10-14T12:13:30.384 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/kernel/virt/lib/irqbypass.ko 2023-10-14T12:13:30.384 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias 2023-10-14T12:13:30.384 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.alias.bin 2023-10-14T12:13:30.384 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin 2023-10-14T12:13:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.alias.bin 2023-10-14T12:13:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.bin 2023-10-14T12:13:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.builtin.modinfo 2023-10-14T12:13:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep 2023-10-14T12:13:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.dep.bin 2023-10-14T12:13:30.386 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.devname 2023-10-14T12:13:30.386 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.order 2023-10-14T12:13:30.386 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.softdep 2023-10-14T12:13:30.386 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols 2023-10-14T12:13:30.386 INFO:teuthology.orchestra.run.smithi064.stdout:/lib/modules/6.6.0-rc5-g47672119149b/modules.symbols.bin 2023-10-14T12:13:30.387 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.387 DEBUG:teuthology.orchestra.run.smithi064:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-10-14T12:13:30.411 INFO:teuthology.orchestra.run.smithi064.stdout:postinstall scriptlet (using /bin/sh): 2023-10-14T12:13:30.411 INFO:teuthology.orchestra.run.smithi064.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-rc5-g47672119149b -a -r /boot/System.map-6.6.0-rc5-g47672119149b ]; then 2023-10-14T12:13:30.411 INFO:teuthology.orchestra.run.smithi064.stdout:cp /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:30.411 INFO:teuthology.orchestra.run.smithi064.stdout:cp /boot/System.map-6.6.0-rc5-g47672119149b /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:30.412 INFO:teuthology.orchestra.run.smithi064.stdout:rm -f /boot/vmlinuz-6.6.0-rc5-g47672119149b /boot/System.map-6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.412 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/installkernel 6.6.0-rc5-g47672119149b /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:30.412 INFO:teuthology.orchestra.run.smithi064.stdout:rm -f /boot/.vmlinuz-6.6.0-rc5-g47672119149b-rpm /boot/.System.map-6.6.0-rc5-g47672119149b-rpm 2023-10-14T12:13:30.412 INFO:teuthology.orchestra.run.smithi064.stdout:fi 2023-10-14T12:13:30.412 INFO:teuthology.orchestra.run.smithi064.stdout:preuninstall scriptlet (using /bin/sh): 2023-10-14T12:13:30.413 INFO:teuthology.orchestra.run.smithi064.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-10-14T12:13:30.413 INFO:teuthology.orchestra.run.smithi064.stdout:new-kernel-pkg --remove 6.6.0-rc5-g47672119149b --rminitrd --initrdfile=/boot/initramfs-6.6.0-rc5-g47672119149b.img 2023-10-14T12:13:30.413 INFO:teuthology.orchestra.run.smithi064.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-10-14T12:13:30.413 INFO:teuthology.orchestra.run.smithi064.stdout:kernel-install remove 6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.413 INFO:teuthology.orchestra.run.smithi064.stdout:fi 2023-10-14T12:13:30.414 INFO:teuthology.orchestra.run.smithi064.stdout:postuninstall scriptlet (using /bin/sh): 2023-10-14T12:13:30.414 INFO:teuthology.orchestra.run.smithi064.stdout:if [ -x /sbin/update-bootloader ]; then 2023-10-14T12:13:30.414 INFO:teuthology.orchestra.run.smithi064.stdout:/sbin/update-bootloader --remove 6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.414 INFO:teuthology.orchestra.run.smithi064.stdout:fi 2023-10-14T12:13:30.415 DEBUG:teuthology.orchestra.run.smithi064:> sudo rpm -qi grub2-tools 2023-10-14T12:13:30.494 INFO:teuthology.orchestra.run.smithi064.stdout:Name : grub2-tools 2023-10-14T12:13:30.494 INFO:teuthology.orchestra.run.smithi064.stdout:Epoch : 1 2023-10-14T12:13:30.495 INFO:teuthology.orchestra.run.smithi064.stdout:Version : 2.06 2023-10-14T12:13:30.495 INFO:teuthology.orchestra.run.smithi064.stdout:Release : 68.el9 2023-10-14T12:13:30.495 INFO:teuthology.orchestra.run.smithi064.stdout:Architecture: x86_64 2023-10-14T12:13:30.495 INFO:teuthology.orchestra.run.smithi064.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-10-14T12:13:30.495 INFO:teuthology.orchestra.run.smithi064.stdout:Group : Unspecified 2023-10-14T12:13:30.496 INFO:teuthology.orchestra.run.smithi064.stdout:Size : 8264254 2023-10-14T12:13:30.496 INFO:teuthology.orchestra.run.smithi064.stdout:License : GPLv3+ 2023-10-14T12:13:30.496 INFO:teuthology.orchestra.run.smithi064.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-10-14T12:13:30.496 INFO:teuthology.orchestra.run.smithi064.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-10-14T12:13:30.496 INFO:teuthology.orchestra.run.smithi064.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-10-14T12:13:30.497 INFO:teuthology.orchestra.run.smithi064.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-10-14T12:13:30.497 INFO:teuthology.orchestra.run.smithi064.stdout:Packager : builder@centos.org 2023-10-14T12:13:30.497 INFO:teuthology.orchestra.run.smithi064.stdout:Vendor : CentOS 2023-10-14T12:13:30.497 INFO:teuthology.orchestra.run.smithi064.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-14T12:13:30.497 INFO:teuthology.orchestra.run.smithi064.stdout:Summary : Support tools for GRUB. 2023-10-14T12:13:30.498 INFO:teuthology.orchestra.run.smithi064.stdout:Description : 2023-10-14T12:13:30.498 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:13:30.498 INFO:teuthology.orchestra.run.smithi064.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-14T12:13:30.498 INFO:teuthology.orchestra.run.smithi064.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-14T12:13:30.498 INFO:teuthology.orchestra.run.smithi064.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-14T12:13:30.499 INFO:teuthology.orchestra.run.smithi064.stdout:hardware devices. 2023-10-14T12:13:30.499 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:13:30.499 INFO:teuthology.orchestra.run.smithi064.stdout:This subpackage provides tools for support of all platforms. 2023-10-14T12:13:30.500 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-14T12:13:30.500 INFO:teuthology.task.kernel:Updating grub on smithi064 to boot 6.6.0-rc5-g47672119149b 2023-10-14T12:13:30.500 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-14T12:13:31.168 INFO:teuthology.orchestra.run.smithi064.stderr:Generating grub configuration file ... 2023-10-14T12:13:32.602 INFO:teuthology.orchestra.run.smithi064.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-10-14T12:13:32.640 INFO:teuthology.orchestra.run.smithi064.stderr:done 2023-10-14T12:13:32.642 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2023-10-14T12:13:32.697 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.tSUKfswNfG 2023-10-14T12:13:32.697 DEBUG:teuthology.orchestra.run.smithi064:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tSUKfswNfG 2023-10-14T12:13:32.769 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.tSUKfswNfG 2023-10-14T12:13:32.917 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.tSUKfswNfG is 6KB 2023-10-14T12:13:32.966 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.tSUKfswNfG 2023-10-14T12:13:32.982 DEBUG:teuthology.orchestra.run.smithi064:> sudo /bin/ls /boot/loader/entries || true 2023-10-14T12:13:33.050 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-10-14T12:13:33.050 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-10-14T12:13:33.051 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-10-14T12:13:33.051 INFO:teuthology.orchestra.run.smithi064.stdout:15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b.conf 2023-10-14T12:13:33.052 DEBUG:teuthology.orchestra.run.smithi064:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-rc5-g47672119149b 2023-10-14T12:13:33.212 DEBUG:teuthology.orchestra.run.smithi064:> sudo shutdown -r now 2023-10-14T12:13:46.750 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-10-14T12:13:46.751 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-14T12:13:46.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:14:03.230 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-10-14T12:14:03.231 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-14T12:14:03.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:14:05.178 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-14T12:14:14.186 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-14T12:14:14.187 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:14:17.242 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2023-10-14T12:14:21.562 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-14T12:14:29.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-14T12:14:29.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:14:30.564 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-14T12:14:30.565 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:14:33.626 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.64 2023-10-14T12:14:45.638 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-14T12:14:45.639 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:15:01.091 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-10-14T12:15:01.779 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-14T12:15:01.779 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-rc5-g47672119149b"... 2023-10-14T12:15:01.780 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2023-10-14T12:15:01.824 INFO:teuthology.orchestra.run.smithi177.stdout:6.6.0-rc5-g47672119149b 2023-10-14T12:15:01.824 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T12:15:01.824 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T12:15:01.825 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-14T12:15:02.826 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-10-14T12:15:02.827 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T12:15:02.945 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2023-10-14T12:15:03.000 DEBUG:teuthology.parallel:result is None 2023-10-14T12:15:17.527 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-10-14T12:15:18.157 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-14T12:15:18.157 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-rc5-g47672119149b"... 2023-10-14T12:15:18.158 DEBUG:teuthology.orchestra.run.smithi064:> uname -r 2023-10-14T12:15:18.202 INFO:teuthology.orchestra.run.smithi064.stdout:6.6.0-rc5-g47672119149b 2023-10-14T12:15:18.206 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-rc5-g47672119149b vs 6.6.0-rc5-g47672119149b 2023-10-14T12:15:18.206 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-14T12:15:18.206 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-10-14T12:15:19.208 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-10-14T12:15:19.208 DEBUG:teuthology.orchestra.run.smithi064:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-10-14T12:15:19.363 INFO:teuthology.orchestra.run.smithi064.stdout:ttyS1 2023-10-14T12:15:19.404 DEBUG:teuthology.parallel:result is None 2023-10-14T12:15:19.404 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-14T12:15:19.411 INFO:teuthology.task.internal:Creating test directory... 2023-10-14T12:15:19.412 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T12:15:19.417 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-14T12:15:19.481 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-14T12:15:19.489 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-14T12:15:19.497 INFO:teuthology.task.internal:Creating archive directory... 2023-10-14T12:15:19.497 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T12:15:19.503 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-14T12:15:19.579 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-14T12:15:19.586 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-14T12:15:19.586 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T12:15:19.592 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-14T12:15:19.721 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:15:19.730 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:15:19.768 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:15:19.777 INFO:teuthology.orchestra.run.smithi064.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-14T12:15:19.782 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-14T12:15:19.789 INFO:teuthology.task.internal:Configuring sudo... 2023-10-14T12:15:19.790 DEBUG:teuthology.orchestra.run.smithi064:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T12:15:19.796 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-14T12:15:19.893 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-14T12:15:19.903 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-14T12:15:19.903 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T12:15:19.910 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-14T12:15:19.968 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:15:20.053 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:15:20.132 DEBUG:teuthology.orchestra.run.smithi064:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:15:20.210 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:15:20.301 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:15:20.301 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T12:15:20.379 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:15:20.470 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-14T12:15:20.581 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:15:20.669 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-14T12:15:20.771 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:15:20.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-14T12:15:20.866 DEBUG:teuthology.orchestra.run.smithi064:> sudo service rsyslog restart 2023-10-14T12:15:20.876 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2023-10-14T12:15:21.003 INFO:teuthology.orchestra.run.smithi064.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:15:21.044 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-14T12:15:21.319 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-14T12:15:21.327 INFO:teuthology.task.internal:Starting timer... 2023-10-14T12:15:21.327 INFO:teuthology.run_tasks:Running task pcp... 2023-10-14T12:15:21.428 INFO:teuthology.run_tasks:Running task selinux... 2023-10-14T12:15:21.437 DEBUG:teuthology.orchestra.run.smithi064:> sudo service auditd rotate 2023-10-14T12:15:21.557 INFO:teuthology.orchestra.run.smithi064.stdout:Rotating logs: 2023-10-14T12:15:21.560 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2023-10-14T12:15:21.704 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2023-10-14T12:15:21.709 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-14T12:15:21.709 DEBUG:teuthology.orchestra.run.smithi064:> /usr/sbin/getenforce 2023-10-14T12:15:21.767 INFO:teuthology.orchestra.run.smithi064.stdout:Permissive 2023-10-14T12:15:21.767 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2023-10-14T12:15:21.830 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2023-10-14T12:15:21.830 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi064.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2023-10-14T12:15:21.831 DEBUG:teuthology.orchestra.run.smithi064:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:15:21.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:15:21.919 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-14T12:15:22.020 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:15:22.021 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-14T12:15:22.021 DEBUG:teuthology.orchestra.run.smithi064:> sudo /usr/sbin/setenforce permissive 2023-10-14T12:15:22.121 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2023-10-14T12:15:22.227 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-14T12:15:22.237 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-14T12:15:22.244 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-14T12:15:22.373 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-14T12:15:22.392 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-14T12:15:22.393 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi064.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-14T12:25:38.042 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi064.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2023-10-14T12:25:38.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-14T12:25:38.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi064.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:25:38.192 DEBUG:teuthology.orchestra.run.smithi064:> true 2023-10-14T12:25:38.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi064.front.sepia.ceph.com' 2023-10-14T12:25:38.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-14T12:25:38.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-14T12:25:38.488 DEBUG:teuthology.orchestra.run.smithi177:> true 2023-10-14T12:25:38.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2023-10-14T12:25:38.638 INFO:teuthology.run_tasks:Running task clock... 2023-10-14T12:25:38.649 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-14T12:25:38.650 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T12:25:38.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:25:38.659 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-14T12:25:38.660 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-14T12:25:38.764 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T12:25:38.765 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-14T12:25:38.818 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T12:25:38.822 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-14T12:25:38.910 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2023-10-14T12:25:38.922 INFO:teuthology.orchestra.run.smithi064.stderr:sudo: ntpd: command not found 2023-10-14T12:25:38.949 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2023-10-14T12:25:38.966 INFO:teuthology.orchestra.run.smithi064.stdout:506 Cannot talk to daemon 2023-10-14T12:25:39.001 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T12:25:39.023 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-14T12:25:39.055 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T12:25:39.079 INFO:teuthology.orchestra.run.smithi064.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-14T12:25:39.184 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2023-10-14T12:25:39.192 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:25:39.192 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2023-10-14T12:25:39.192 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.193 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.193 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.193 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.215 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: ntpq: command not found 2023-10-14T12:25:39.224 INFO:teuthology.orchestra.run.smithi064.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-14T12:25:39.224 INFO:teuthology.orchestra.run.smithi064.stdout:=============================================================================== 2023-10-14T12:25:39.224 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.224 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.225 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.225 INFO:teuthology.orchestra.run.smithi064.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-14T12:25:39.226 INFO:teuthology.run_tasks:Running task install... 2023-10-14T12:25:39.236 DEBUG:teuthology.task.install:project ceph 2023-10-14T12:25:39.237 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}} 2023-10-14T12:25:39.237 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'} 2023-10-14T12:25:39.237 INFO:teuthology.task.install:Using flavor: default 2023-10-14T12:25:39.243 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-14T12:25:39.244 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-14T12:25:39.244 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T12:25:39.245 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:25:39.247 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'tag': None, 'wait_for_package': False} 2023-10-14T12:25:39.248 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:25:39.473 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-14T12:25:39.474 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T12:25:39.491 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/ 2023-10-14T12:25:39.491 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6730.g4ba8a190 2023-10-14T12:25:39.595 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T12:25:39.596 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:25:39.596 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T12:25:39.662 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023oct13/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-14T12:25:39.663 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:25:39.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-14T12:25:39.699 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T12:25:39.700 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T12:25:39.774 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-10-14T12:25:39.774 DEBUG:teuthology.orchestra.run.smithi064:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-14T12:25:39.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T12:25:39.926 DEBUG:teuthology.orchestra.run.smithi064:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-14T12:25:39.976 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T12:25:40.063 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2023-10-14T12:25:40.067 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2023-10-14T12:25:40.068 DEBUG:teuthology.orchestra.run.smithi064:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-14T12:25:40.166 INFO:teuthology.orchestra.run.smithi064.stdout:check_obsoletes = 1 2023-10-14T12:25:40.171 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum clean all 2023-10-14T12:25:40.408 INFO:teuthology.orchestra.run.smithi177.stdout:70 files removed 2023-10-14T12:25:40.448 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T12:25:40.553 INFO:teuthology.orchestra.run.smithi064.stdout:70 files removed 2023-10-14T12:25:40.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-10-14T12:25:41.427 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 165 kB/s | 78 kB 00:00 2023-10-14T12:25:41.577 INFO:teuthology.orchestra.run.smithi064.stdout:ceph packages for x86_64 172 kB/s | 78 kB 00:00 2023-10-14T12:25:41.985 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 20 kB/s | 9.4 kB 00:00 2023-10-14T12:25:42.194 INFO:teuthology.orchestra.run.smithi064.stdout:ceph noarch packages 18 kB/s | 9.4 kB 00:00 2023-10-14T12:25:42.552 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 3.8 kB/s | 1.9 kB 00:00 2023-10-14T12:25:42.686 INFO:teuthology.orchestra.run.smithi064.stdout:ceph source packages 4.5 kB/s | 1.9 kB 00:00 2023-10-14T12:25:43.347 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - AppStream 8.7 MB/s | 6.3 MB 00:00 2023-10-14T12:25:43.582 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - AppStream 7.7 MB/s | 6.3 MB 00:00 2023-10-14T12:25:45.148 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS-9 - BaseOS 5.7 MB/s | 2.0 MB 00:00 2023-10-14T12:25:45.273 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - BaseOS 3.0 MB/s | 2.0 MB 00:00 2023-10-14T12:25:46.336 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 7.9 MB 00:00 2023-10-14T12:25:47.277 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 7.9 MB 00:01 2023-10-14T12:25:48.729 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - AppStream 15 MB/s | 18 MB 00:01 2023-10-14T12:25:53.138 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - CRB 7.4 MB/s | 5.7 MB 00:00 2023-10-14T12:25:54.680 INFO:teuthology.orchestra.run.smithi064.stdout:CentOS Stream 9 - Extras packages 49 kB/s | 14 kB 00:00 2023-10-14T12:25:55.974 INFO:teuthology.orchestra.run.smithi064.stdout:Extra Packages for Enterprise Linux 17 MB/s | 19 MB 00:01 2023-10-14T12:26:01.265 INFO:teuthology.orchestra.run.smithi064.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2023-10-14T12:26:03.837 INFO:teuthology.orchestra.run.smithi064.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T12:26:03.838 INFO:teuthology.orchestra.run.smithi064.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T12:26:03.858 INFO:teuthology.orchestra.run.smithi064.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-14T12:26:03.859 INFO:teuthology.orchestra.run.smithi064.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-14T12:26:03.860 INFO:teuthology.orchestra.run.smithi064.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-14T12:26:03.862 INFO:teuthology.orchestra.run.smithi064.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-14T12:26:03.864 INFO:teuthology.orchestra.run.smithi064.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T12:26:03.868 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-14T12:26:03.869 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T12:26:03.950 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-10-14T12:26:03.965 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2023-10-14T12:26:03.965 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-10-14T12:26:03.965 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2023-10-14T12:26:03.965 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-10-14T12:26:03.966 INFO:teuthology.orchestra.run.smithi064.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-14T12:26:03.966 INFO:teuthology.orchestra.run.smithi064.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-14T12:26:03.966 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-14T12:26:03.966 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-14T12:26:03.967 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-14T12:26:03.967 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-14T12:26:03.967 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-14T12:26:03.968 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-14T12:26:03.968 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-14T12:26:03.968 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-14T12:26:03.968 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-14T12:26:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-14T12:26:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-14T12:26:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-14T12:26:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-14T12:26:03.969 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-14T12:26:03.970 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-14T12:26:03.970 INFO:teuthology.orchestra.run.smithi064.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-14T12:26:03.970 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-14T12:26:03.970 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-14T12:26:03.971 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-14T12:26:03.971 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T12:26:03.971 INFO:teuthology.orchestra.run.smithi064.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-14T12:26:03.971 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-14T12:26:03.971 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-14T12:26:03.972 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-14T12:26:03.972 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-14T12:26:03.972 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-14T12:26:03.972 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-14T12:26:03.972 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-14T12:26:03.973 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-14T12:26:03.973 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-14T12:26:03.973 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-14T12:26:03.973 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T12:26:03.974 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-14T12:26:03.974 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-14T12:26:03.974 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2023-10-14T12:26:03.974 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-14T12:26:03.974 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-14T12:26:03.975 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-14T12:26:03.975 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-14T12:26:03.975 INFO:teuthology.orchestra.run.smithi064.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-14T12:26:03.975 INFO:teuthology.orchestra.run.smithi064.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-14T12:26:03.975 INFO:teuthology.orchestra.run.smithi064.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-14T12:26:03.976 INFO:teuthology.orchestra.run.smithi064.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-14T12:26:03.976 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T12:26:03.976 INFO:teuthology.orchestra.run.smithi064.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-14T12:26:03.976 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-10-14T12:26:03.976 INFO:teuthology.orchestra.run.smithi064.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-14T12:26:03.977 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-14T12:26:03.977 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-14T12:26:03.977 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-14T12:26:03.977 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-14T12:26:03.978 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-14T12:26:03.978 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-14T12:26:03.978 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-14T12:26:03.978 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-14T12:26:03.978 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-14T12:26:03.979 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-14T12:26:03.979 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-14T12:26:03.979 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-14T12:26:03.979 INFO:teuthology.orchestra.run.smithi064.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-14T12:26:03.979 INFO:teuthology.orchestra.run.smithi064.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-14T12:26:03.980 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-14T12:26:03.980 INFO:teuthology.orchestra.run.smithi064.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-14T12:26:03.980 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-14T12:26:03.980 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-14T12:26:03.980 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-14T12:26:03.981 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-14T12:26:03.981 INFO:teuthology.orchestra.run.smithi064.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-14T12:26:03.981 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-14T12:26:03.981 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-14T12:26:03.981 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-14T12:26:03.981 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-14T12:26:03.982 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-14T12:26:03.982 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-14T12:26:03.982 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-14T12:26:03.982 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-14T12:26:03.983 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-14T12:26:03.983 INFO:teuthology.orchestra.run.smithi064.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-14T12:26:03.983 INFO:teuthology.orchestra.run.smithi064.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-14T12:26:03.983 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-14T12:26:03.983 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-14T12:26:03.984 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-14T12:26:03.984 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-14T12:26:03.984 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-14T12:26:03.984 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-14T12:26:03.984 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-14T12:26:03.984 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-14T12:26:03.985 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T12:26:03.985 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-14T12:26:03.985 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-14T12:26:03.985 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-14T12:26:03.985 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-14T12:26:03.986 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-14T12:26:03.986 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-14T12:26:03.986 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-14T12:26:03.986 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-14T12:26:03.986 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-14T12:26:03.987 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-14T12:26:03.987 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-14T12:26:03.987 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-14T12:26:03.987 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-14T12:26:03.988 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-14T12:26:03.988 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-14T12:26:03.988 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-14T12:26:03.988 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-14T12:26:03.988 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-14T12:26:03.989 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-14T12:26:03.989 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-14T12:26:03.989 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-14T12:26:03.989 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-14T12:26:03.989 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-14T12:26:03.990 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-14T12:26:03.990 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-14T12:26:03.990 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-14T12:26:03.990 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-14T12:26:03.991 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-14T12:26:03.991 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-14T12:26:03.991 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-14T12:26:03.991 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-14T12:26:03.991 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-14T12:26:03.992 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-14T12:26:03.992 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-14T12:26:03.992 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-14T12:26:03.992 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-14T12:26:03.992 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-14T12:26:03.993 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-14T12:26:03.993 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-14T12:26:03.993 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-14T12:26:03.993 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-14T12:26:03.993 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-14T12:26:03.994 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-14T12:26:03.994 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-14T12:26:03.994 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-14T12:26:03.994 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-14T12:26:03.995 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-14T12:26:03.995 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-14T12:26:03.995 INFO:teuthology.orchestra.run.smithi064.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-14T12:26:03.995 INFO:teuthology.orchestra.run.smithi064.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-14T12:26:03.995 INFO:teuthology.orchestra.run.smithi064.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-14T12:26:03.996 INFO:teuthology.orchestra.run.smithi064.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-14T12:26:03.996 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-14T12:26:03.996 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-14T12:26:03.996 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2023-10-14T12:26:03.996 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-14T12:26:03.997 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:03.997 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-10-14T12:26:03.997 INFO:teuthology.orchestra.run.smithi064.stdout:============================================================================================ 2023-10-14T12:26:03.997 INFO:teuthology.orchestra.run.smithi064.stdout:Install 133 Packages 2023-10-14T12:26:03.997 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 10 Packages 2023-10-14T12:26:03.998 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:03.998 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 199 M 2023-10-14T12:26:03.999 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-10-14T12:26:04.750 INFO:teuthology.orchestra.run.smithi064.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 20 kB/s | 6.5 kB 00:00 2023-10-14T12:26:04.784 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 1.1 MB/s | 18 MB 00:16 2023-10-14T12:26:05.109 INFO:teuthology.orchestra.run.smithi064.stdout:(2/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 7.7 MB/s | 5.2 MB 00:00 2023-10-14T12:26:05.151 INFO:teuthology.orchestra.run.smithi064.stdout:(3/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 2.1 MB/s | 855 kB 00:00 2023-10-14T12:26:05.184 INFO:teuthology.orchestra.run.smithi064.stdout:(4/143): ceph-immutable-object-cache-18.0.0-673 1.9 MB/s | 141 kB 00:00 2023-10-14T12:26:05.335 INFO:teuthology.orchestra.run.smithi064.stdout:(5/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 9.8 MB/s | 1.5 MB 00:00 2023-10-14T12:26:05.735 INFO:teuthology.orchestra.run.smithi064.stdout:(6/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 11 MB/s | 4.4 MB 00:00 2023-10-14T12:26:05.793 INFO:teuthology.orchestra.run.smithi064.stdout:(7/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 3.2 MB/s | 2.1 MB 00:00 2023-10-14T12:26:06.571 INFO:teuthology.orchestra.run.smithi064.stdout:(8/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 8.9 MB/s | 19 MB 00:02 2023-10-14T12:26:06.638 INFO:teuthology.orchestra.run.smithi064.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 366 kB/s | 24 kB 00:00 2023-10-14T12:26:07.172 INFO:teuthology.orchestra.run.smithi064.stdout:(10/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 12 MB/s | 18 MB 00:01 2023-10-14T12:26:07.239 INFO:teuthology.orchestra.run.smithi064.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 3.3 MB/s | 218 kB 00:00 2023-10-14T12:26:07.298 INFO:teuthology.orchestra.run.smithi064.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 540 kB/s | 31 kB 00:00 2023-10-14T12:26:07.431 INFO:teuthology.orchestra.run.smithi064.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 5.3 MB/s | 715 kB 00:00 2023-10-14T12:26:07.498 INFO:teuthology.orchestra.run.smithi064.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.4 MB/s | 163 kB 00:00 2023-10-14T12:26:07.564 INFO:teuthology.orchestra.run.smithi064.stdout:(15/143): librados-devel-18.0.0-6730.g4ba8a190. 1.9 MB/s | 127 kB 00:00 2023-10-14T12:26:07.657 INFO:teuthology.orchestra.run.smithi064.stdout:(16/143): libradosstriper1-18.0.0-6730.g4ba8a19 5.1 MB/s | 472 kB 00:00 2023-10-14T12:26:08.140 INFO:teuthology.orchestra.run.smithi064.stdout:(17/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 9.9 MB/s | 4.8 MB 00:00 2023-10-14T12:26:08.199 INFO:teuthology.orchestra.run.smithi064.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 790 kB/s | 45 kB 00:00 2023-10-14T12:26:08.332 INFO:teuthology.orchestra.run.smithi064.stdout:(19/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 3.4 MB/s | 8.6 MB 00:02 2023-10-14T12:26:08.366 INFO:teuthology.orchestra.run.smithi064.stdout:(20/143): python3-ceph-common-18.0.0-6730.g4ba8 764 kB/s | 127 kB 00:00 2023-10-14T12:26:08.416 INFO:teuthology.orchestra.run.smithi064.stdout:(21/143): python3-cephfs-18.0.0-6730.g4ba8a190. 1.9 MB/s | 162 kB 00:00 2023-10-14T12:26:08.458 INFO:teuthology.orchestra.run.smithi064.stdout:(22/143): python3-rados-18.0.0-6730.g4ba8a190.e 3.4 MB/s | 321 kB 00:00 2023-10-14T12:26:08.508 INFO:teuthology.orchestra.run.smithi064.stdout:(23/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 2.0 MB/s | 99 kB 00:00 2023-10-14T12:26:08.542 INFO:teuthology.orchestra.run.smithi064.stdout:(24/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 2.3 MB/s | 298 kB 00:00 2023-10-14T12:26:08.559 INFO:teuthology.orchestra.run.smithi064.stdout:(25/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 1.7 MB/s | 85 kB 00:00 2023-10-14T12:26:08.617 INFO:teuthology.orchestra.run.smithi064.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.9 MB/s | 169 kB 00:00 2023-10-14T12:26:08.668 INFO:teuthology.orchestra.run.smithi064.stdout:(27/143): ceph-grafana-dashboards-18.0.0-6730.g 470 kB/s | 23 kB 00:00 2023-10-14T12:26:08.752 INFO:teuthology.orchestra.run.smithi064.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.6 MB/s | 132 kB 00:00 2023-10-14T12:26:08.952 INFO:teuthology.orchestra.run.smithi064.stdout:(29/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 8.9 MB/s | 1.8 MB 00:00 2023-10-14T12:26:09.184 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 10 MB/s | 5.7 MB 00:00 2023-10-14T12:26:09.369 INFO:teuthology.orchestra.run.smithi064.stdout:(30/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 3.7 MB/s | 3.0 MB 00:00 2023-10-14T12:26:09.844 INFO:teuthology.orchestra.run.smithi064.stdout:(31/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 13 MB/s | 41 MB 00:03 2023-10-14T12:26:09.894 INFO:teuthology.orchestra.run.smithi064.stdout:(32/143): ceph-mgr-modules-core-18.0.0-6730.g4b 462 kB/s | 242 kB 00:00 2023-10-14T12:26:09.920 INFO:teuthology.orchestra.run.smithi064.stdout:(33/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 635 kB/s | 47 kB 00:00 2023-10-14T12:26:09.953 INFO:teuthology.orchestra.run.smithi064.stdout:(34/143): ceph-prometheus-alerts-18.0.0-6730.g4 262 kB/s | 15 kB 00:00 2023-10-14T12:26:09.995 INFO:teuthology.orchestra.run.smithi064.stdout:(35/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 3.4 MB/s | 262 kB 00:00 2023-10-14T12:26:10.137 INFO:teuthology.orchestra.run.smithi064.stdout:(36/143): ceph-mgr-diskprediction-local-18.0.0- 6.3 MB/s | 7.4 MB 00:01 2023-10-14T12:26:10.162 INFO:teuthology.orchestra.run.smithi064.stdout:(37/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 110 kB/s | 18 kB 00:00 2023-10-14T12:26:10.196 INFO:teuthology.orchestra.run.smithi064.stdout:(38/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 1.1 MB/s | 269 kB 00:00 2023-10-14T12:26:10.430 INFO:teuthology.orchestra.run.smithi064.stdout:(39/143): boost-program-options-1.75.0-8.el9.x8 398 kB/s | 106 kB 00:00 2023-10-14T12:26:10.463 INFO:teuthology.orchestra.run.smithi064.stdout:(40/143): flex-2.6.4-9.el9.x86_64.rpm 2.1 MB/s | 307 kB 00:00 2023-10-14T12:26:10.530 INFO:teuthology.orchestra.run.smithi064.stdout:(41/143): bison-3.7.4-5.el9.x86_64.rpm 2.3 MB/s | 920 kB 00:00 2023-10-14T12:26:10.564 INFO:teuthology.orchestra.run.smithi064.stdout:(42/143): flexiblas-3.0.4-8.el9.x86_64.rpm 243 kB/s | 32 kB 00:00 2023-10-14T12:26:10.656 INFO:teuthology.orchestra.run.smithi064.stdout:(43/143): flexiblas-openblas-openmp-3.0.4-8.el9 147 kB/s | 17 kB 00:00 2023-10-14T12:26:10.731 INFO:teuthology.orchestra.run.smithi064.stdout:(44/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2023-10-14T12:26:10.756 INFO:teuthology.orchestra.run.smithi064.stdout:(45/143): libaio-devel-0.3.111-13.el9.x86_64.rp 54 kB/s | 10 kB 00:00 2023-10-14T12:26:10.790 INFO:teuthology.orchestra.run.smithi064.stdout:(46/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 159 kB 00:00 2023-10-14T12:26:10.831 INFO:teuthology.orchestra.run.smithi064.stdout:(47/143): librdkafka-1.6.1-102.el9.x86_64.rpm 8.9 MB/s | 661 kB 00:00 2023-10-14T12:26:10.866 INFO:teuthology.orchestra.run.smithi064.stdout:(48/143): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 578 kB 00:00 2023-10-14T12:26:10.890 INFO:teuthology.orchestra.run.smithi064.stdout:(49/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 517 kB/s | 46 kB 00:00 2023-10-14T12:26:10.924 INFO:teuthology.orchestra.run.smithi064.stdout:(50/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 282 kB 00:00 2023-10-14T12:26:10.971 INFO:teuthology.orchestra.run.smithi064.stdout:(51/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.7 MB/s | 217 kB 00:00 2023-10-14T12:26:10.999 INFO:teuthology.orchestra.run.smithi064.stdout:(52/143): openblas-0.3.21-2.el9.x86_64.rpm 324 kB/s | 34 kB 00:00 2023-10-14T12:26:11.175 INFO:teuthology.orchestra.run.smithi064.stdout:(53/143): openblas-openmp-0.3.21-2.el9.x86_64.r 19 MB/s | 4.7 MB 00:00 2023-10-14T12:26:11.241 INFO:teuthology.orchestra.run.smithi064.stdout:(54/143): postgresql-13.11-1.el9.x86_64.rpm 6.7 MB/s | 1.5 MB 00:00 2023-10-14T12:26:11.275 INFO:teuthology.orchestra.run.smithi064.stdout:(55/143): postgresql-contrib-13.11-1.el9.x86_64 3.1 MB/s | 811 kB 00:00 2023-10-14T12:26:11.301 INFO:teuthology.orchestra.run.smithi064.stdout:(56/143): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2023-10-14T12:26:11.404 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 15 kB/s | 14 kB 00:00 2023-10-14T12:26:11.576 INFO:teuthology.orchestra.run.smithi064.stdout:(57/143): postgresql-server-13.11-1.el9.x86_64. 19 MB/s | 5.7 MB 00:00 2023-10-14T12:26:11.692 INFO:teuthology.orchestra.run.smithi064.stdout:(58/143): python3-babel-2.9.1-2.el9.noarch.rpm 14 MB/s | 5.8 MB 00:00 2023-10-14T12:26:11.717 INFO:teuthology.orchestra.run.smithi064.stdout:(59/143): python3-devel-3.9.17-2.el9.x86_64.rpm 501 kB/s | 205 kB 00:00 2023-10-14T12:26:11.751 INFO:teuthology.orchestra.run.smithi064.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-10-14T12:26:11.776 INFO:teuthology.orchestra.run.smithi064.stdout:(61/143): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 24 kB 00:00 2023-10-14T12:26:11.802 INFO:teuthology.orchestra.run.smithi064.stdout:(62/143): python3-jsonpointer-2.0-4.el9.noarch. 225 kB/s | 18 kB 00:00 2023-10-14T12:26:11.819 INFO:teuthology.orchestra.run.smithi064.stdout:(63/143): python3-mako-1.1.4-6.el9.noarch.rpm 2.1 MB/s | 144 kB 00:00 2023-10-14T12:26:11.869 INFO:teuthology.orchestra.run.smithi064.stdout:(64/143): python3-markupsafe-1.1.1-12.el9.x86_6 486 kB/s | 32 kB 00:00 2023-10-14T12:26:11.995 INFO:teuthology.orchestra.run.smithi064.stdout:(65/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 4.8 MB 00:00 2023-10-14T12:26:12.020 INFO:teuthology.orchestra.run.smithi064.stdout:(66/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2023-10-14T12:26:12.070 INFO:teuthology.orchestra.run.smithi064.stdout:(67/143): python3-oauthlib-3.1.1-5.el9.noarch.r 941 kB/s | 174 kB 00:00 2023-10-14T12:26:12.112 INFO:teuthology.orchestra.run.smithi064.stdout:(68/143): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2023-10-14T12:26:12.137 INFO:teuthology.orchestra.run.smithi064.stdout:(69/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2023-10-14T12:26:12.162 INFO:teuthology.orchestra.run.smithi064.stdout:(70/143): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2023-10-14T12:26:12.204 INFO:teuthology.orchestra.run.smithi064.stdout:(71/143): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2023-10-14T12:26:12.271 INFO:teuthology.orchestra.run.smithi064.stdout:(72/143): python3-toml-0.10.2-6.el9.noarch.rpm 362 kB/s | 39 kB 00:00 2023-10-14T12:26:12.532 INFO:teuthology.orchestra.run.smithi064.stdout:(73/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2023-10-14T12:26:12.555 INFO:teuthology.orchestra.run.smithi064.stdout:(74/143): socat-1.7.4.1-5.el9.x86_64.rpm 900 kB/s | 300 kB 00:00 2023-10-14T12:26:12.580 INFO:teuthology.orchestra.run.smithi064.stdout:(75/143): uuid-1.6.2-55.el9.x86_64.rpm 192 kB/s | 56 kB 00:00 2023-10-14T12:26:12.631 INFO:teuthology.orchestra.run.smithi064.stdout:(76/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-10-14T12:26:12.653 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 18 MB/s | 19 MB 00:01 2023-10-14T12:26:12.655 INFO:teuthology.orchestra.run.smithi064.stdout:(77/143): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-10-14T12:26:12.689 INFO:teuthology.orchestra.run.smithi064.stdout:(78/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.4 MB/s | 803 kB 00:00 2023-10-14T12:26:12.731 INFO:teuthology.orchestra.run.smithi064.stdout:(79/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 4.7 MB/s | 195 kB 00:00 2023-10-14T12:26:12.756 INFO:teuthology.orchestra.run.smithi064.stdout:(80/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2023-10-14T12:26:12.773 INFO:teuthology.orchestra.run.smithi064.stdout:(81/143): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-10-14T12:26:12.815 INFO:teuthology.orchestra.run.smithi064.stdout:(82/143): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2023-10-14T12:26:12.840 INFO:teuthology.orchestra.run.smithi064.stdout:(83/143): python3-requests-2.25.1-7.el9.noarch. 1.7 MB/s | 113 kB 00:00 2023-10-14T12:26:12.865 INFO:teuthology.orchestra.run.smithi064.stdout:(84/143): python3-urllib3-1.26.5-3.el9.noarch.r 2.0 MB/s | 188 kB 00:00 2023-10-14T12:26:12.949 INFO:teuthology.orchestra.run.smithi064.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 275 kB/s | 22 kB 00:00 2023-10-14T12:26:13.099 INFO:teuthology.orchestra.run.smithi064.stdout:(86/143): python3-cryptography-36.0.1-4.el9.x86 5.3 MB/s | 1.2 MB 00:00 2023-10-14T12:26:13.150 INFO:teuthology.orchestra.run.smithi064.stdout:(87/143): jq-1.6-15.el9.x86_64.rpm 937 kB/s | 187 kB 00:00 2023-10-14T12:26:13.183 INFO:teuthology.orchestra.run.smithi064.stdout:(88/143): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2023-10-14T12:26:13.208 INFO:teuthology.orchestra.run.smithi064.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 442 kB/s | 26 kB 00:00 2023-10-14T12:26:13.233 INFO:teuthology.orchestra.run.smithi064.stdout:(90/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 340 kB/s | 45 kB 00:00 2023-10-14T12:26:13.259 INFO:teuthology.orchestra.run.smithi064.stdout:(91/143): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2023-10-14T12:26:13.317 INFO:teuthology.orchestra.run.smithi064.stdout:(92/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 784 kB/s | 45 kB 00:00 2023-10-14T12:26:13.351 INFO:teuthology.orchestra.run.smithi064.stdout:(93/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 739 kB/s | 86 kB 00:00 2023-10-14T12:26:13.510 INFO:teuthology.orchestra.run.smithi064.stdout:(94/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 13 MB/s | 4.1 MB 00:00 2023-10-14T12:26:13.651 INFO:teuthology.orchestra.run.smithi064.stdout:(95/143): fmt-8.1.1-5.el9.x86_64.rpm 333 kB/s | 111 kB 00:00 2023-10-14T12:26:13.738 INFO:teuthology.orchestra.run.smithi064.stdout:(96/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 307 kB/s | 24 kB 00:00 2023-10-14T12:26:13.785 INFO:teuthology.orchestra.run.smithi064.stdout:(97/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 848 kB/s | 309 kB 00:00 2023-10-14T12:26:13.894 INFO:teuthology.orchestra.run.smithi064.stdout:(98/143): libarrow-9.0.0-9.el9.x86_64.rpm 14 MB/s | 4.4 MB 00:00 2023-10-14T12:26:13.919 INFO:teuthology.orchestra.run.smithi064.stdout:(99/143): liboath-2.6.7-2.el9.x86_64.rpm 293 kB/s | 49 kB 00:00 2023-10-14T12:26:13.945 INFO:teuthology.orchestra.run.smithi064.stdout:(100/143): libunwind-1.6.2-1.el9.x86_64.rpm 468 kB/s | 67 kB 00:00 2023-10-14T12:26:13.994 INFO:teuthology.orchestra.run.smithi064.stdout:(101/143): python3-asyncssh-2.13.2-3.el9.noarch 7.3 MB/s | 548 kB 00:00 2023-10-14T12:26:14.045 INFO:teuthology.orchestra.run.smithi064.stdout:(102/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 6.6 MB/s | 837 kB 00:00 2023-10-14T12:26:14.070 INFO:teuthology.orchestra.run.smithi064.stdout:(103/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 352 kB/s | 43 kB 00:00 2023-10-14T12:26:14.095 INFO:teuthology.orchestra.run.smithi064.stdout:(104/143): python3-cachetools-4.2.4-1.el9.noarc 330 kB/s | 32 kB 00:00 2023-10-14T12:26:14.112 INFO:teuthology.orchestra.run.smithi064.stdout:(105/143): python3-certifi-2021.10.8-2.el9.noar 371 kB/s | 15 kB 00:00 2023-10-14T12:26:14.137 INFO:teuthology.orchestra.run.smithi064.stdout:(106/143): python3-cheroot-8.6.0-4.el9.noarch.r 2.6 MB/s | 172 kB 00:00 2023-10-14T12:26:14.179 INFO:teuthology.orchestra.run.smithi064.stdout:(107/143): python3-cherrypy-18.6.1-2.el9.noarch 4.3 MB/s | 358 kB 00:00 2023-10-14T12:26:14.196 INFO:teuthology.orchestra.run.smithi064.stdout:(108/143): python3-jaraco-8.2.1-3.el9.noarch.rp 198 kB/s | 11 kB 00:00 2023-10-14T12:26:14.263 INFO:teuthology.orchestra.run.smithi064.stdout:(109/143): python3-google-auth-2.23.2-1.el9.noa 1.6 MB/s | 196 kB 00:00 2023-10-14T12:26:14.288 INFO:teuthology.orchestra.run.smithi064.stdout:(110/143): python3-jaraco-classes-3.2.1-5.el9.n 164 kB/s | 18 kB 00:00 2023-10-14T12:26:14.314 INFO:teuthology.orchestra.run.smithi064.stdout:(111/143): python3-jaraco-collections-3.0.0-8.e 201 kB/s | 23 kB 00:00 2023-10-14T12:26:14.339 INFO:teuthology.orchestra.run.smithi064.stdout:(112/143): python3-jaraco-functools-3.5.0-2.el9 262 kB/s | 19 kB 00:00 2023-10-14T12:26:14.364 INFO:teuthology.orchestra.run.smithi064.stdout:(113/143): python3-jwt+crypto-2.4.0-1.el9.noarc 186 kB/s | 9.0 kB 00:00 2023-10-14T12:26:14.389 INFO:teuthology.orchestra.run.smithi064.stdout:(114/143): python3-jaraco-text-3.2.0-6.el9.noar 265 kB/s | 20 kB 00:00 2023-10-14T12:26:14.414 INFO:teuthology.orchestra.run.smithi064.stdout:(115/143): python3-jwt-2.4.0-1.el9.noarch.rpm 551 kB/s | 41 kB 00:00 2023-10-14T12:26:14.465 INFO:teuthology.orchestra.run.smithi064.stdout:(116/143): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2023-10-14T12:26:14.490 INFO:teuthology.orchestra.run.smithi064.stdout:(117/143): python3-logutils-0.3.5-21.el9.noarch 712 kB/s | 46 kB 00:00 2023-10-14T12:26:14.515 INFO:teuthology.orchestra.run.smithi064.stdout:(118/143): python3-more-itertools-8.12.0-2.el9. 878 kB/s | 79 kB 00:00 2023-10-14T12:26:14.540 INFO:teuthology.orchestra.run.smithi064.stdout:(119/143): python3-natsort-7.1.1-5.el9.noarch.r 778 kB/s | 58 kB 00:00 2023-10-14T12:26:14.566 INFO:teuthology.orchestra.run.smithi064.stdout:(120/143): python3-portend-3.1.0-2.el9.noarch.r 338 kB/s | 16 kB 00:00 2023-10-14T12:26:14.599 INFO:teuthology.orchestra.run.smithi064.stdout:(121/143): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2023-10-14T12:26:14.624 INFO:teuthology.orchestra.run.smithi064.stdout:(122/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2023-10-14T12:26:14.650 INFO:teuthology.orchestra.run.smithi064.stdout:(123/143): python3-repoze-lru-0.7-16.el9.noarch 384 kB/s | 31 kB 00:00 2023-10-14T12:26:14.675 INFO:teuthology.orchestra.run.smithi064.stdout:(124/143): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2023-10-14T12:26:14.709 INFO:teuthology.orchestra.run.smithi064.stdout:(125/143): python3-routes-2.5.1-5.el9.noarch.rp 2.2 MB/s | 188 kB 00:00 2023-10-14T12:26:14.734 INFO:teuthology.orchestra.run.smithi064.stdout:(126/143): python3-tempora-5.0.0-2.el9.noarch.r 433 kB/s | 36 kB 00:00 2023-10-14T12:26:14.762 INFO:teuthology.orchestra.run.smithi064.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 627 kB/s | 51 kB 00:00 2023-10-14T12:26:14.784 INFO:teuthology.orchestra.run.smithi064.stdout:(128/143): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2023-10-14T12:26:14.818 INFO:teuthology.orchestra.run.smithi064.stdout:(129/143): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2023-10-14T12:26:14.851 INFO:teuthology.orchestra.run.smithi064.stdout:(130/143): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2023-10-14T12:26:14.877 INFO:teuthology.orchestra.run.smithi064.stdout:(131/143): python3-zc-lockfile-2.0-10.el9.noarc 230 kB/s | 20 kB 00:00 2023-10-14T12:26:14.927 INFO:teuthology.orchestra.run.smithi064.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 2.5 MB/s | 192 kB 00:00 2023-10-14T12:26:14.977 INFO:teuthology.orchestra.run.smithi064.stdout:(133/143): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2023-10-14T12:26:15.011 INFO:teuthology.orchestra.run.smithi064.stdout:(134/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-10-14T12:26:15.103 INFO:teuthology.orchestra.run.smithi064.stdout:(135/143): NetworkManager-1.45.4-1.el9.x86_64.r 25 MB/s | 2.2 MB 00:00 2023-10-14T12:26:15.186 INFO:teuthology.orchestra.run.smithi064.stdout:(136/143): NetworkManager-libnm-1.45.4-1.el9.x8 22 MB/s | 1.8 MB 00:00 2023-10-14T12:26:15.220 INFO:teuthology.orchestra.run.smithi064.stdout:(137/143): NetworkManager-team-1.45.4-1.el9.x86 1.3 MB/s | 41 kB 00:00 2023-10-14T12:26:15.262 INFO:teuthology.orchestra.run.smithi064.stdout:(138/143): NetworkManager-tui-1.45.4-1.el9.x86_ 5.9 MB/s | 244 kB 00:00 2023-10-14T12:26:15.314 INFO:teuthology.orchestra.run.smithi064.stdout:(139/143): acl-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 69 kB 00:00 2023-10-14T12:26:15.354 INFO:teuthology.orchestra.run.smithi064.stdout:(140/143): libacl-2.3.1-4.el9.x86_64.rpm 560 kB/s | 22 kB 00:00 2023-10-14T12:26:15.396 INFO:teuthology.orchestra.run.smithi064.stdout:(141/143): xfsdump-3.1.12-4.el9.x86_64.rpm 7.7 MB/s | 321 kB 00:00 2023-10-14T12:26:15.480 INFO:teuthology.orchestra.run.smithi064.stdout:(142/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 6.0 MB/s | 3.0 MB 00:00 2023-10-14T12:26:15.588 INFO:teuthology.orchestra.run.smithi064.stdout:(143/143): librados2-18.0.0-6730.g4ba8a190.el9. 4.7 MB/s | 3.3 MB 00:00 2023-10-14T12:26:15.602 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:26:15.602 INFO:teuthology.orchestra.run.smithi064.stdout:Total 17 MB/s | 199 MB 00:11 2023-10-14T12:26:16.046 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-10-14T12:26:16.267 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-10-14T12:26:16.268 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-10-14T12:26:18.169 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2023-10-14T12:26:18.545 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-10-14T12:26:18.545 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-10-14T12:26:20.646 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T12:26:20.648 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-10-14T12:26:20.668 INFO:teuthology.orchestra.run.smithi177.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-10-14T12:26:20.669 INFO:teuthology.orchestra.run.smithi177.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-10-14T12:26:20.671 INFO:teuthology.orchestra.run.smithi177.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-10-14T12:26:20.672 INFO:teuthology.orchestra.run.smithi177.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-10-14T12:26:20.675 INFO:teuthology.orchestra.run.smithi177.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T12:26:20.678 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-10-14T12:26:20.680 INFO:teuthology.orchestra.run.smithi177.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T12:26:20.755 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2023-10-14T12:26:20.786 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2023-10-14T12:26:20.786 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2023-10-14T12:26:20.787 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2023-10-14T12:26:20.787 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2023-10-14T12:26:20.787 INFO:teuthology.orchestra.run.smithi177.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-10-14T12:26:20.787 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 6.5 k 2023-10-14T12:26:20.787 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 5.2 M 2023-10-14T12:26:20.788 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 855 k 2023-10-14T12:26:20.788 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 141 k 2023-10-14T12:26:20.788 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 1.5 M 2023-10-14T12:26:20.788 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 132 k 2023-10-14T12:26:20.788 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 1.8 M 2023-10-14T12:26:20.789 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 7.4 M 2023-10-14T12:26:20.789 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 47 k 2023-10-14T12:26:20.789 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 8.6 M 2023-10-14T12:26:20.789 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 41 M 2023-10-14T12:26:20.789 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 262 k 2023-10-14T12:26:20.790 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 269 k 2023-10-14T12:26:20.790 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 218 k 2023-10-14T12:26:20.790 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 18 k 2023-10-14T12:26:20.790 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel x86_64 0.189-3.el9 appstream 22 k 2023-10-14T12:26:20.791 INFO:teuthology.orchestra.run.smithi177.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-10-14T12:26:20.791 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-10-14T12:26:20.791 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 31 k 2023-10-14T12:26:20.791 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 715 k 2023-10-14T12:26:20.791 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T12:26:20.792 INFO:teuthology.orchestra.run.smithi177.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-10-14T12:26:20.792 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel x86_64 2.37.4-15.el9 appstream 26 k 2023-10-14T12:26:20.792 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel x86_64 1:3.0.7-24.el9 appstream 4.1 M 2023-10-14T12:26:20.792 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-10-14T12:26:20.792 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-10-14T12:26:20.793 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-10-14T12:26:20.793 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 162 k 2023-10-14T12:26:20.793 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 321 k 2023-10-14T12:26:20.793 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 298 k 2023-10-14T12:26:20.793 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 99 k 2023-10-14T12:26:20.794 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 85 k 2023-10-14T12:26:20.794 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T12:26:20.794 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 169 k 2023-10-14T12:26:20.794 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 appstream 86 k 2023-10-14T12:26:20.795 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2023-10-14T12:26:20.795 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager x86_64 1:1.45.4-1.el9 CentOS-BaseOS 2.2 M 2023-10-14T12:26:20.795 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm x86_64 1:1.45.4-1.el9 CentOS-BaseOS 1.8 M 2023-10-14T12:26:20.795 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team x86_64 1:1.45.4-1.el9 CentOS-BaseOS 41 k 2023-10-14T12:26:20.795 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui x86_64 1:1.45.4-1.el9 CentOS-BaseOS 244 k 2023-10-14T12:26:20.795 INFO:teuthology.orchestra.run.smithi177.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-10-14T12:26:20.796 INFO:teuthology.orchestra.run.smithi177.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-10-14T12:26:20.796 INFO:teuthology.orchestra.run.smithi177.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-10-14T12:26:20.796 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.3 M 2023-10-14T12:26:20.796 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 3.0 M 2023-10-14T12:26:20.796 INFO:teuthology.orchestra.run.smithi177.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-10-14T12:26:20.797 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2023-10-14T12:26:20.797 INFO:teuthology.orchestra.run.smithi177.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2023-10-14T12:26:20.797 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-10-14T12:26:20.797 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 19 M 2023-10-14T12:26:20.798 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 23 k 2023-10-14T12:26:20.798 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 2.1 M 2023-10-14T12:26:20.798 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 242 k 2023-10-14T12:26:20.798 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.4 M 2023-10-14T12:26:20.798 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 18 M 2023-10-14T12:26:20.799 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6730.g4ba8a190.el9 ceph-noarch 15 k 2023-10-14T12:26:20.799 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 24 k 2023-10-14T12:26:20.799 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-10-14T12:26:20.799 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-10-14T12:26:20.799 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-10-14T12:26:20.800 INFO:teuthology.orchestra.run.smithi177.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-10-14T12:26:20.800 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-10-14T12:26:20.800 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-10-14T12:26:20.800 INFO:teuthology.orchestra.run.smithi177.stdout: jq x86_64 1.6-15.el9 appstream 187 k 2023-10-14T12:26:20.801 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-10-14T12:26:20.801 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-10-14T12:26:20.801 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 163 k 2023-10-14T12:26:20.801 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-10-14T12:26:20.801 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-10-14T12:26:20.802 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-10-14T12:26:20.802 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-10-14T12:26:20.802 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2023-10-14T12:26:20.802 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 472 k 2023-10-14T12:26:20.802 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-10-14T12:26:20.803 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 4.8 M 2023-10-14T12:26:20.803 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-10-14T12:26:20.803 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-10-14T12:26:20.803 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-10-14T12:26:20.803 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-10-14T12:26:20.803 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-10-14T12:26:20.804 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-10-14T12:26:20.804 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-10-14T12:26:20.804 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-10-14T12:26:20.804 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-10-14T12:26:20.804 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-10-14T12:26:20.805 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-10-14T12:26:20.805 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-10-14T12:26:20.805 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 45 k 2023-10-14T12:26:20.805 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:18.0.0-6730.g4ba8a190.el9 ceph 127 k 2023-10-14T12:26:20.805 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-10-14T12:26:20.806 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-10-14T12:26:20.806 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-10-14T12:26:20.806 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-10-14T12:26:20.806 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2023-10-14T12:26:20.806 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.17-2.el9 CentOS-AppStream 205 k 2023-10-14T12:26:20.807 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.23.2-1.el9 epel 196 k 2023-10-14T12:26:20.807 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-10-14T12:26:20.807 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-10-14T12:26:20.807 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-10-14T12:26:20.807 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-10-14T12:26:20.807 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-10-14T12:26:20.808 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-10-14T12:26:20.808 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-10-14T12:26:20.808 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-10-14T12:26:20.808 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-10-14T12:26:20.808 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-10-14T12:26:20.809 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-10-14T12:26:20.809 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-10-14T12:26:20.809 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-10-14T12:26:20.809 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-10-14T12:26:20.809 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-10-14T12:26:20.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-10-14T12:26:20.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-10-14T12:26:20.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-10-14T12:26:20.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-10-14T12:26:20.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-10-14T12:26:20.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-10-14T12:26:20.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-10-14T12:26:20.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-10-14T12:26:20.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-10-14T12:26:20.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-10-14T12:26:20.812 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-10-14T12:26:20.812 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2023-10-14T12:26:20.812 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-10-14T12:26:20.812 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-10-14T12:26:20.812 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-10-14T12:26:20.813 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-10-14T12:26:20.813 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-10-14T12:26:20.813 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-10-14T12:26:20.813 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-10-14T12:26:20.813 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-10-14T12:26:20.814 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-10-14T12:26:20.814 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-3.el9 CentOS-BaseOS 188 k 2023-10-14T12:26:20.814 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-10-14T12:26:20.814 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-10-14T12:26:20.814 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-10-14T12:26:20.815 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-10-14T12:26:20.815 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-10-14T12:26:20.815 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-10-14T12:26:20.815 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-10-14T12:26:20.815 INFO:teuthology.orchestra.run.smithi177.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-10-14T12:26:20.816 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-10-14T12:26:20.816 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2023-10-14T12:26:20.816 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2023-10-14T12:26:20.816 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-10-14T12:26:20.816 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:26:20.817 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2023-10-14T12:26:20.817 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2023-10-14T12:26:20.817 INFO:teuthology.orchestra.run.smithi177.stdout:Install 133 Packages 2023-10-14T12:26:20.817 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 10 Packages 2023-10-14T12:26:20.817 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:26:20.818 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 199 M 2023-10-14T12:26:20.818 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2023-10-14T12:26:21.621 INFO:teuthology.orchestra.run.smithi177.stdout:(1/143): ceph-18.0.0-6730.g4ba8a190.el9.x86_64. 28 kB/s | 6.5 kB 00:00 2023-10-14T12:26:21.830 INFO:teuthology.orchestra.run.smithi177.stdout:(2/143): ceph-fuse-18.0.0-6730.g4ba8a190.el9.x8 4.0 MB/s | 855 kB 00:00 2023-10-14T12:26:21.880 INFO:teuthology.orchestra.run.smithi177.stdout:(3/143): ceph-immutable-object-cache-18.0.0-673 2.8 MB/s | 141 kB 00:00 2023-10-14T12:26:22.205 INFO:teuthology.orchestra.run.smithi177.stdout:(4/143): ceph-mds-18.0.0-6730.g4ba8a190.el9.x86 6.4 MB/s | 2.1 MB 00:00 2023-10-14T12:26:22.313 INFO:teuthology.orchestra.run.smithi177.stdout:(5/143): ceph-base-18.0.0-6730.g4ba8a190.el9.x8 5.6 MB/s | 5.2 MB 00:00 2023-10-14T12:26:22.455 INFO:teuthology.orchestra.run.smithi177.stdout:(6/143): ceph-mgr-18.0.0-6730.g4ba8a190.el9.x86 5.9 MB/s | 1.5 MB 00:00 2023-10-14T12:26:22.839 INFO:teuthology.orchestra.run.smithi177.stdout:(7/143): ceph-mon-18.0.0-6730.g4ba8a190.el9.x86 8.3 MB/s | 4.4 MB 00:00 2023-10-14T12:26:23.573 INFO:teuthology.orchestra.run.smithi177.stdout:(8/143): ceph-common-18.0.0-6730.g4ba8a190.el9. 8.7 MB/s | 19 MB 00:02 2023-10-14T12:26:23.639 INFO:teuthology.orchestra.run.smithi177.stdout:(9/143): ceph-selinux-18.0.0-6730.g4ba8a190.el9 367 kB/s | 24 kB 00:00 2023-10-14T12:26:23.815 INFO:teuthology.orchestra.run.smithi177.stdout:(10/143): ceph-radosgw-18.0.0-6730.g4ba8a190.el 8.9 MB/s | 8.6 MB 00:00 2023-10-14T12:26:23.890 INFO:teuthology.orchestra.run.smithi177.stdout:(11/143): cephfs-mirror-18.0.0-6730.g4ba8a190.e 2.9 MB/s | 218 kB 00:00 2023-10-14T12:26:23.965 INFO:teuthology.orchestra.run.smithi177.stdout:(12/143): libcephfs-devel-18.0.0-6730.g4ba8a190 419 kB/s | 31 kB 00:00 2023-10-14T12:26:24.132 INFO:teuthology.orchestra.run.smithi177.stdout:(13/143): libcephfs2-18.0.0-6730.g4ba8a190.el9. 4.2 MB/s | 715 kB 00:00 2023-10-14T12:26:24.207 INFO:teuthology.orchestra.run.smithi177.stdout:(14/143): libcephsqlite-18.0.0-6730.g4ba8a190.e 2.2 MB/s | 163 kB 00:00 2023-10-14T12:26:24.282 INFO:teuthology.orchestra.run.smithi177.stdout:(15/143): librados-devel-18.0.0-6730.g4ba8a190. 1.7 MB/s | 127 kB 00:00 2023-10-14T12:26:24.533 INFO:teuthology.orchestra.run.smithi177.stdout:(16/143): ceph-osd-18.0.0-6730.g4ba8a190.el9.x8 8.5 MB/s | 18 MB 00:02 2023-10-14T12:26:24.536 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-10-14T12:26:24.574 INFO:teuthology.orchestra.run.smithi177.stdout:(17/143): libradosstriper1-18.0.0-6730.g4ba8a19 1.6 MB/s | 472 kB 00:00 2023-10-14T12:26:24.605 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-14T12:26:24.625 INFO:teuthology.orchestra.run.smithi177.stdout:(18/143): python3-ceph-argparse-18.0.0-6730.g4b 921 kB/s | 45 kB 00:00 2023-10-14T12:26:24.642 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-14T12:26:24.717 INFO:teuthology.orchestra.run.smithi177.stdout:(19/143): python3-ceph-common-18.0.0-6730.g4ba8 1.4 MB/s | 127 kB 00:00 2023-10-14T12:26:24.772 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-14T12:26:24.802 INFO:teuthology.orchestra.run.smithi177.stdout:(20/143): python3-cephfs-18.0.0-6730.g4ba8a190. 1.9 MB/s | 162 kB 00:00 2023-10-14T12:26:24.892 INFO:teuthology.orchestra.run.smithi177.stdout:(21/143): python3-rados-18.0.0-6730.g4ba8a190.e 3.5 MB/s | 321 kB 00:00 2023-10-14T12:26:24.973 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-14T12:26:24.976 INFO:teuthology.orchestra.run.smithi177.stdout:(22/143): python3-rbd-18.0.0-6730.g4ba8a190.el9 3.5 MB/s | 298 kB 00:00 2023-10-14T12:26:25.085 INFO:teuthology.orchestra.run.smithi177.stdout:(23/143): librgw2-18.0.0-6730.g4ba8a190.el9.x86 8.7 MB/s | 4.8 MB 00:00 2023-10-14T12:26:25.143 INFO:teuthology.orchestra.run.smithi177.stdout:(24/143): python3-rgw-18.0.0-6730.g4ba8a190.el9 602 kB/s | 99 kB 00:00 2023-10-14T12:26:25.176 INFO:teuthology.orchestra.run.smithi177.stdout:(25/143): rbd-fuse-18.0.0-6730.g4ba8a190.el9.x8 934 kB/s | 85 kB 00:00 2023-10-14T12:26:25.244 INFO:teuthology.orchestra.run.smithi177.stdout:(26/143): rbd-nbd-18.0.0-6730.g4ba8a190.el9.x86 2.5 MB/s | 169 kB 00:00 2023-10-14T12:26:25.319 INFO:teuthology.orchestra.run.smithi177.stdout:(27/143): ceph-grafana-dashboards-18.0.0-6730.g 313 kB/s | 23 kB 00:00 2023-10-14T12:26:25.403 INFO:teuthology.orchestra.run.smithi177.stdout:(28/143): ceph-mgr-cephadm-18.0.0-6730.g4ba8a19 1.6 MB/s | 132 kB 00:00 2023-10-14T12:26:25.486 INFO:teuthology.orchestra.run.smithi177.stdout:(29/143): rbd-mirror-18.0.0-6730.g4ba8a190.el9. 8.8 MB/s | 3.0 MB 00:00 2023-10-14T12:26:25.581 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-14T12:26:25.626 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T12:26:25.687 INFO:teuthology.orchestra.run.smithi177.stdout:(30/143): ceph-mgr-dashboard-18.0.0-6730.g4ba8a 6.2 MB/s | 1.8 MB 00:00 2023-10-14T12:26:25.770 INFO:teuthology.orchestra.run.smithi177.stdout:(31/143): ceph-mgr-modules-core-18.0.0-6730.g4b 2.9 MB/s | 242 kB 00:00 2023-10-14T12:26:25.775 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T12:26:25.810 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T12:26:25.854 INFO:teuthology.orchestra.run.smithi177.stdout:(32/143): ceph-mgr-rook-18.0.0-6730.g4ba8a190.e 578 kB/s | 47 kB 00:00 2023-10-14T12:26:25.934 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T12:26:25.937 INFO:teuthology.orchestra.run.smithi177.stdout:(33/143): ceph-prometheus-alerts-18.0.0-6730.g4 183 kB/s | 15 kB 00:00 2023-10-14T12:26:26.010 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T12:26:26.030 INFO:teuthology.orchestra.run.smithi177.stdout:(34/143): ceph-volume-18.0.0-6730.g4ba8a190.el9 2.8 MB/s | 262 kB 00:00 2023-10-14T12:26:26.051 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-14T12:26:26.121 INFO:teuthology.orchestra.run.smithi177.stdout:(35/143): cephadm-18.0.0-6730.g4ba8a190.el9.noa 2.9 MB/s | 269 kB 00:00 2023-10-14T12:26:26.205 INFO:teuthology.orchestra.run.smithi177.stdout:(36/143): cephfs-top-18.0.0-6730.g4ba8a190.el9. 221 kB/s | 18 kB 00:00 2023-10-14T12:26:26.315 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-14T12:26:26.339 INFO:teuthology.orchestra.run.smithi177.stdout:(37/143): ceph-mgr-diskprediction-local-18.0.0- 8.7 MB/s | 7.4 MB 00:00 2023-10-14T12:26:26.489 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-14T12:26:26.514 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T12:26:26.661 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T12:26:26.690 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T12:26:26.766 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T12:26:26.814 INFO:teuthology.orchestra.run.smithi177.stdout:(38/143): ceph-test-18.0.0-6730.g4ba8a190.el9.x 13 MB/s | 41 MB 00:03 2023-10-14T12:26:26.964 INFO:teuthology.orchestra.run.smithi177.stdout:(39/143): boost-program-options-1.75.0-8.el9.x8 190 kB/s | 106 kB 00:00 2023-10-14T12:26:27.081 INFO:teuthology.orchestra.run.smithi177.stdout:(40/143): bison-3.7.4-5.el9.x86_64.rpm 1.0 MB/s | 920 kB 00:00 2023-10-14T12:26:27.114 INFO:teuthology.orchestra.run.smithi177.stdout:(41/143): flex-2.6.4-9.el9.x86_64.rpm 1.3 MB/s | 307 kB 00:00 2023-10-14T12:26:27.139 INFO:teuthology.orchestra.run.smithi177.stdout:(42/143): flexiblas-3.0.4-8.el9.x86_64.rpm 183 kB/s | 32 kB 00:00 2023-10-14T12:26:27.145 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-14T12:26:27.270 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T12:26:27.298 INFO:teuthology.orchestra.run.smithi177.stdout:(43/143): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2023-10-14T12:26:27.323 INFO:teuthology.orchestra.run.smithi177.stdout:(44/143): flexiblas-openblas-openmp-3.0.4-8.el9 99 kB/s | 17 kB 00:00 2023-10-14T12:26:27.349 INFO:teuthology.orchestra.run.smithi177.stdout:(45/143): libaio-devel-0.3.111-13.el9.x86_64.rp 51 kB/s | 10 kB 00:00 2023-10-14T12:26:27.382 INFO:teuthology.orchestra.run.smithi177.stdout:(46/143): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2023-10-14T12:26:27.383 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T12:26:27.424 INFO:teuthology.orchestra.run.smithi177.stdout:(47/143): librdkafka-1.6.1-102.el9.x86_64.rpm 6.5 MB/s | 661 kB 00:00 2023-10-14T12:26:27.458 INFO:teuthology.orchestra.run.smithi177.stdout:(48/143): libtool-2.4.6-45.el9.x86_64.rpm 5.6 MB/s | 578 kB 00:00 2023-10-14T12:26:27.483 INFO:teuthology.orchestra.run.smithi177.stdout:(49/143): libzstd-devel-1.5.1-2.el9.x86_64.rpm 492 kB/s | 46 kB 00:00 2023-10-14T12:26:27.516 INFO:teuthology.orchestra.run.smithi177.stdout:(50/143): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-10-14T12:26:27.541 INFO:teuthology.orchestra.run.smithi177.stdout:(51/143): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2023-10-14T12:26:27.567 INFO:teuthology.orchestra.run.smithi177.stdout:(52/143): openblas-0.3.21-2.el9.x86_64.rpm 434 kB/s | 34 kB 00:00 2023-10-14T12:26:27.640 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T12:26:27.667 INFO:teuthology.orchestra.run.smithi177.stdout:(53/143): postgresql-13.11-1.el9.x86_64.rpm 12 MB/s | 1.5 MB 00:00 2023-10-14T12:26:27.698 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T12:26:27.809 INFO:teuthology.orchestra.run.smithi177.stdout:(54/143): openblas-openmp-0.3.21-2.el9.x86_64.r 18 MB/s | 4.7 MB 00:00 2023-10-14T12:26:27.859 INFO:teuthology.orchestra.run.smithi177.stdout:(55/143): postgresql-contrib-13.11-1.el9.x86_64 2.8 MB/s | 811 kB 00:00 2023-10-14T12:26:27.884 INFO:teuthology.orchestra.run.smithi177.stdout:(56/143): postgresql-private-libs-13.11-1.el9.x 660 kB/s | 134 kB 00:00 2023-10-14T12:26:28.043 INFO:teuthology.orchestra.run.smithi177.stdout:(57/143): postgresql-server-13.11-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2023-10-14T12:26:28.076 INFO:teuthology.orchestra.run.smithi177.stdout:(58/143): python3-devel-3.9.17-2.el9.x86_64.rpm 1.1 MB/s | 205 kB 00:00 2023-10-14T12:26:28.145 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T12:26:28.195 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-14T12:26:28.235 INFO:teuthology.orchestra.run.smithi177.stdout:(59/143): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-10-14T12:26:28.255 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-14T12:26:28.260 INFO:teuthology.orchestra.run.smithi177.stdout:(60/143): python3-jinja2-2.11.3-4.el9.noarch.rp 1.0 MB/s | 228 kB 00:00 2023-10-14T12:26:28.279 INFO:teuthology.orchestra.run.smithi177.stdout:(61/143): python3-jsonpatch-1.21-16.el9.noarch. 131 kB/s | 24 kB 00:00 2023-10-14T12:26:28.311 INFO:teuthology.orchestra.run.smithi177.stdout:(62/143): python3-jsonpointer-2.0-4.el9.noarch. 563 kB/s | 18 kB 00:00 2023-10-14T12:26:28.328 INFO:teuthology.orchestra.run.smithi177.stdout:(63/143): python3-markupsafe-1.1.1-12.el9.x86_6 650 kB/s | 32 kB 00:00 2023-10-14T12:26:28.371 INFO:teuthology.orchestra.run.smithi177.stdout:(64/143): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 144 kB 00:00 2023-10-14T12:26:28.376 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-14T12:26:28.404 INFO:teuthology.orchestra.run.smithi177.stdout:(65/143): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 217 kB 00:00 2023-10-14T12:26:28.482 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-14T12:26:28.530 INFO:teuthology.orchestra.run.smithi177.stdout:(66/143): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2023-10-14T12:26:28.547 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-14T12:26:28.554 INFO:teuthology.orchestra.run.smithi177.stdout:(67/143): python3-oauthlib-3.1.1-5.el9.noarch.r 966 kB/s | 174 kB 00:00 2023-10-14T12:26:28.580 INFO:teuthology.orchestra.run.smithi177.stdout:(68/143): python3-prettytable-0.7.2-27.el9.noar 255 kB/s | 41 kB 00:00 2023-10-14T12:26:28.614 INFO:teuthology.orchestra.run.smithi177.stdout:(69/143): python3-pyasn1-0.4.8-6.el9.noarch.rpm 4.0 MB/s | 132 kB 00:00 2023-10-14T12:26:28.619 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-14T12:26:28.639 INFO:teuthology.orchestra.run.smithi177.stdout:(70/143): python3-requests-oauthlib-1.3.0-12.el 752 kB/s | 43 kB 00:00 2023-10-14T12:26:28.681 INFO:teuthology.orchestra.run.smithi177.stdout:(71/143): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2023-10-14T12:26:28.707 INFO:teuthology.orchestra.run.smithi177.stdout:(72/143): python3-toml-0.10.2-6.el9.noarch.rpm 602 kB/s | 39 kB 00:00 2023-10-14T12:26:28.737 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-14T12:26:28.788 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-14T12:26:28.821 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-14T12:26:28.881 INFO:teuthology.orchestra.run.smithi177.stdout:(73/143): socat-1.7.4.1-5.el9.x86_64.rpm 1.5 MB/s | 300 kB 00:00 2023-10-14T12:26:28.936 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-14T12:26:28.984 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-14T12:26:29.044 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-14T12:26:29.090 INFO:teuthology.orchestra.run.smithi177.stdout:(74/143): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2023-10-14T12:26:29.115 INFO:teuthology.orchestra.run.smithi177.stdout:(75/143): uuid-1.6.2-55.el9.x86_64.rpm 143 kB/s | 56 kB 00:00 2023-10-14T12:26:29.140 INFO:teuthology.orchestra.run.smithi177.stdout:(76/143): xmlstarlet-1.6.1-20.el9.x86_64.rpm 253 kB/s | 63 kB 00:00 2023-10-14T12:26:29.165 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-14T12:26:29.174 INFO:teuthology.orchestra.run.smithi177.stdout:(77/143): fuse-2.9.9-15.el9.x86_64.rpm 1.4 MB/s | 79 kB 00:00 2023-10-14T12:26:29.238 INFO:teuthology.orchestra.run.smithi177.stdout:(78/143): libgfortran-11.4.1-2.3.el9.x86_64.rpm 6.5 MB/s | 803 kB 00:00 2023-10-14T12:26:29.266 INFO:teuthology.orchestra.run.smithi177.stdout:(79/143): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2023-10-14T12:26:29.304 INFO:teuthology.orchestra.run.smithi177.stdout:(80/143): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2023-10-14T12:26:29.325 INFO:teuthology.orchestra.run.smithi177.stdout:(81/143): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2023-10-14T12:26:29.350 INFO:teuthology.orchestra.run.smithi177.stdout:(82/143): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2023-10-14T12:26:29.371 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-14T12:26:29.375 INFO:teuthology.orchestra.run.smithi177.stdout:(83/143): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-10-14T12:26:29.400 INFO:teuthology.orchestra.run.smithi177.stdout:(84/143): python3-urllib3-1.26.5-3.el9.noarch.r 2.5 MB/s | 188 kB 00:00 2023-10-14T12:26:29.443 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-14T12:26:29.493 INFO:teuthology.orchestra.run.smithi177.stdout:(85/143): elfutils-libelf-devel-0.189-3.el9.x86 248 kB/s | 22 kB 00:00 2023-10-14T12:26:29.651 INFO:teuthology.orchestra.run.smithi177.stdout:(86/143): jq-1.6-15.el9.x86_64.rpm 2.1 MB/s | 187 kB 00:00 2023-10-14T12:26:29.693 INFO:teuthology.orchestra.run.smithi177.stdout:(87/143): automake-1.16.2-8.el9.noarch.rpm 2.3 MB/s | 689 kB 00:00 2023-10-14T12:26:29.718 INFO:teuthology.orchestra.run.smithi177.stdout:(88/143): librabbitmq-0.11.0-7.el9.x86_64.rpm 746 kB/s | 45 kB 00:00 2023-10-14T12:26:29.743 INFO:teuthology.orchestra.run.smithi177.stdout:(89/143): libuuid-devel-2.37.4-15.el9.x86_64.rp 517 kB/s | 26 kB 00:00 2023-10-14T12:26:29.794 INFO:teuthology.orchestra.run.smithi177.stdout:(90/143): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2023-10-14T12:26:29.844 INFO:teuthology.orchestra.run.smithi177.stdout:(91/143): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 86 kB 00:00 2023-10-14T12:26:29.894 INFO:teuthology.orchestra.run.smithi177.stdout:(92/143): zlib-devel-1.2.11-40.el9.x86_64.rpm 921 kB/s | 45 kB 00:00 2023-10-14T12:26:29.995 INFO:teuthology.orchestra.run.smithi177.stdout:(93/143): openssl-devel-3.0.7-24.el9.x86_64.rpm 15 MB/s | 4.1 MB 00:00 2023-10-14T12:26:30.184 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-14T12:26:30.288 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-14T12:26:30.311 INFO:teuthology.orchestra.run.smithi177.stdout:(94/143): fmt-8.1.1-5.el9.x86_64.rpm 266 kB/s | 111 kB 00:00 2023-10-14T12:26:30.337 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-14T12:26:30.353 INFO:teuthology.orchestra.run.smithi177.stdout:(95/143): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:00 2023-10-14T12:26:30.375 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-14T12:26:30.387 INFO:teuthology.orchestra.run.smithi177.stdout:(96/143): gperftools-libs-2.9.1-2.el9.x86_64.rp 791 kB/s | 309 kB 00:00 2023-10-14T12:26:30.415 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-14T12:26:30.530 INFO:teuthology.orchestra.run.smithi177.stdout:(97/143): liboath-2.6.7-2.el9.x86_64.rpm 343 kB/s | 49 kB 00:00 2023-10-14T12:26:30.554 INFO:teuthology.orchestra.run.smithi177.stdout:(98/143): libarrow-doc-9.0.0-9.el9.noarch.rpm 122 kB/s | 24 kB 00:00 2023-10-14T12:26:30.573 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-14T12:26:30.638 INFO:teuthology.orchestra.run.smithi177.stdout:(99/143): libunwind-1.6.2-1.el9.x86_64.rpm 624 kB/s | 67 kB 00:00 2023-10-14T12:26:30.639 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-14T12:26:30.724 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-14T12:26:30.832 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-14T12:26:30.877 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-14T12:26:30.918 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-14T12:26:30.963 INFO:teuthology.orchestra.run.smithi177.stdout:(100/143): libarrow-9.0.0-9.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2023-10-14T12:26:30.987 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-14T12:26:31.046 INFO:teuthology.orchestra.run.smithi177.stdout:(101/143): python3-asyncssh-2.13.2-3.el9.noarch 1.3 MB/s | 548 kB 00:00 2023-10-14T12:26:31.050 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-14T12:26:31.063 INFO:teuthology.orchestra.run.smithi177.stdout:(102/143): python3-bcrypt-3.2.2-1.el9.x86_64.rp 439 kB/s | 43 kB 00:00 2023-10-14T12:26:31.113 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-14T12:26:31.130 INFO:teuthology.orchestra.run.smithi177.stdout:(103/143): python3-cachetools-4.2.4-1.el9.noarc 389 kB/s | 32 kB 00:00 2023-10-14T12:26:31.156 INFO:teuthology.orchestra.run.smithi177.stdout:(104/143): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2023-10-14T12:26:31.294 INFO:teuthology.orchestra.run.smithi177.stdout:(105/143): parquet-libs-9.0.0-9.el9.x86_64.rpm 1.1 MB/s | 837 kB 00:00 2023-10-14T12:26:31.323 INFO:teuthology.orchestra.run.smithi177.stdout:(106/143): python3-cheroot-8.6.0-4.el9.noarch.r 896 kB/s | 172 kB 00:00 2023-10-14T12:26:31.325 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-14T12:26:31.356 INFO:teuthology.orchestra.run.smithi177.stdout:(107/143): python3-cherrypy-18.6.1-2.el9.noarch 1.8 MB/s | 358 kB 00:00 2023-10-14T12:26:31.384 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-14T12:26:31.398 INFO:teuthology.orchestra.run.smithi177.stdout:(108/143): python3-jaraco-8.2.1-3.el9.noarch.rp 143 kB/s | 11 kB 00:00 2023-10-14T12:26:31.440 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-14T12:26:31.440 INFO:teuthology.orchestra.run.smithi177.stdout:(109/143): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2023-10-14T12:26:31.466 INFO:teuthology.orchestra.run.smithi177.stdout:(110/143): python3-google-auth-2.23.2-1.el9.noa 1.1 MB/s | 196 kB 00:00 2023-10-14T12:26:31.491 INFO:teuthology.orchestra.run.smithi177.stdout:(111/143): python3-jaraco-collections-3.0.0-8.e 253 kB/s | 23 kB 00:00 2023-10-14T12:26:31.516 INFO:teuthology.orchestra.run.smithi177.stdout:(112/143): python3-jaraco-functools-3.5.0-2.el9 260 kB/s | 19 kB 00:00 2023-10-14T12:26:31.541 INFO:teuthology.orchestra.run.smithi177.stdout:(113/143): python3-jaraco-text-3.2.0-6.el9.noar 263 kB/s | 20 kB 00:00 2023-10-14T12:26:31.567 INFO:teuthology.orchestra.run.smithi177.stdout:(114/143): python3-jwt+crypto-2.4.0-1.el9.noarc 121 kB/s | 9.0 kB 00:00 2023-10-14T12:26:31.575 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-14T12:26:31.592 INFO:teuthology.orchestra.run.smithi177.stdout:(115/143): python3-jwt-2.4.0-1.el9.noarch.rpm 546 kB/s | 41 kB 00:00 2023-10-14T12:26:31.617 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-14T12:26:31.659 INFO:teuthology.orchestra.run.smithi177.stdout:(116/143): python3-logutils-0.3.5-21.el9.noarch 508 kB/s | 46 kB 00:00 2023-10-14T12:26:31.667 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-14T12:26:31.684 INFO:teuthology.orchestra.run.smithi177.stdout:(117/143): python3-more-itertools-8.12.0-2.el9. 865 kB/s | 79 kB 00:00 2023-10-14T12:26:31.698 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-14T12:26:31.737 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-14T12:26:31.743 INFO:teuthology.orchestra.run.smithi177.stdout:(118/143): python3-natsort-7.1.1-5.el9.noarch.r 696 kB/s | 58 kB 00:00 2023-10-14T12:26:31.806 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-14T12:26:31.826 INFO:teuthology.orchestra.run.smithi177.stdout:(119/143): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2023-10-14T12:26:31.852 INFO:teuthology.orchestra.run.smithi177.stdout:(120/143): python3-portend-3.1.0-2.el9.noarch.r 153 kB/s | 16 kB 00:00 2023-10-14T12:26:31.860 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-14T12:26:31.910 INFO:teuthology.orchestra.run.smithi177.stdout:(121/143): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.1 MB/s | 90 kB 00:00 2023-10-14T12:26:31.935 INFO:teuthology.orchestra.run.smithi177.stdout:(122/143): python3-repoze-lru-0.7-16.el9.noarch 372 kB/s | 31 kB 00:00 2023-10-14T12:26:31.994 INFO:teuthology.orchestra.run.smithi177.stdout:(123/143): python3-kubernetes-26.1.0-2.el9.noar 2.3 MB/s | 1.0 MB 00:00 2023-10-14T12:26:32.020 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-14T12:26:32.027 INFO:teuthology.orchestra.run.smithi177.stdout:(124/143): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-10-14T12:26:32.053 INFO:teuthology.orchestra.run.smithi177.stdout:(125/143): python3-rsa-4.9-2.el9.noarch.rpm 508 kB/s | 59 kB 00:00 2023-10-14T12:26:32.076 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-14T12:26:32.078 INFO:teuthology.orchestra.run.smithi177.stdout:(126/143): python3-tempora-5.0.0-2.el9.noarch.r 430 kB/s | 36 kB 00:00 2023-10-14T12:26:32.112 INFO:teuthology.orchestra.run.smithi177.stdout:(127/143): python3-typing-extensions-4.4.0-2.el 614 kB/s | 51 kB 00:00 2023-10-14T12:26:32.162 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-14T12:26:32.170 INFO:teuthology.orchestra.run.smithi177.stdout:(128/143): python3-websocket-client-1.2.3-2.el9 983 kB/s | 90 kB 00:00 2023-10-14T12:26:32.204 INFO:teuthology.orchestra.run.smithi177.stdout:(129/143): python3-werkzeug-2.0.3-3.el9.1.noarc 4.6 MB/s | 427 kB 00:00 2023-10-14T12:26:32.237 INFO:teuthology.orchestra.run.smithi177.stdout:(130/143): python3-webob-1.8.7-6.el9.noarch.rpm 1.2 MB/s | 230 kB 00:00 2023-10-14T12:26:32.255 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-14T12:26:32.262 INFO:teuthology.orchestra.run.smithi177.stdout:(131/143): python3-zc-lockfile-2.0-10.el9.noarc 219 kB/s | 20 kB 00:00 2023-10-14T12:26:32.321 INFO:teuthology.orchestra.run.smithi177.stdout:(132/143): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-10-14T12:26:32.523 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-14T12:26:32.576 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-14T12:26:32.663 INFO:teuthology.orchestra.run.smithi177.stdout:(133/143): librbd1-18.0.0-6730.g4ba8a190.el9.x8 8.9 MB/s | 3.0 MB 00:00 2023-10-14T12:26:32.746 INFO:teuthology.orchestra.run.smithi177.stdout:(134/143): librados2-18.0.0-6730.g4ba8a190.el9. 6.9 MB/s | 3.3 MB 00:00 2023-10-14T12:26:32.753 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-14T12:26:32.772 INFO:teuthology.orchestra.run.smithi177.stdout:(135/143): libacl-devel-2.3.1-4.el9.x86_64.rpm 629 kB/s | 68 kB 00:00 2023-10-14T12:26:32.812 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-14T12:26:32.856 INFO:teuthology.orchestra.run.smithi177.stdout:(136/143): NetworkManager-1.45.4-1.el9.x86_64.r 21 MB/s | 2.2 MB 00:00 2023-10-14T12:26:32.866 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-14T12:26:32.908 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-14T12:26:32.922 INFO:teuthology.orchestra.run.smithi177.stdout:(137/143): NetworkManager-libnm-1.45.4-1.el9.x8 13 MB/s | 1.8 MB 00:00 2023-10-14T12:26:32.948 INFO:teuthology.orchestra.run.smithi177.stdout:(138/143): NetworkManager-team-1.45.4-1.el9.x86 527 kB/s | 41 kB 00:00 2023-10-14T12:26:32.985 INFO:teuthology.orchestra.run.smithi177.stdout:(139/143): NetworkManager-tui-1.45.4-1.el9.x86_ 4.2 MB/s | 244 kB 00:00 2023-10-14T12:26:32.997 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-14T12:26:33.007 INFO:teuthology.orchestra.run.smithi177.stdout:(140/143): acl-2.3.1-4.el9.x86_64.rpm 1.2 MB/s | 69 kB 00:00 2023-10-14T12:26:33.032 INFO:teuthology.orchestra.run.smithi177.stdout:(141/143): libacl-2.3.1-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2023-10-14T12:26:33.061 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-14T12:26:33.065 INFO:teuthology.orchestra.run.smithi177.stdout:(142/143): xfsdump-3.1.12-4.el9.x86_64.rpm 5.5 MB/s | 321 kB 00:00 2023-10-14T12:26:33.124 INFO:teuthology.orchestra.run.smithi177.stdout:(143/143): thrift-0.15.0-2.el9.x86_64.rpm 1.8 MB/s | 1.6 MB 00:00 2023-10-14T12:26:33.125 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-14T12:26:33.137 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:26:33.137 INFO:teuthology.orchestra.run.smithi177.stdout:Total 16 MB/s | 199 MB 00:12 2023-10-14T12:26:33.213 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-14T12:26:33.264 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-14T12:26:33.306 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-14T12:26:33.439 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-14T12:26:33.484 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-14T12:26:33.519 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-14T12:26:33.573 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2023-10-14T12:26:33.601 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-14T12:26:33.648 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-14T12:26:33.778 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2023-10-14T12:26:33.778 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2023-10-14T12:26:33.801 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-14T12:26:33.845 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-14T12:26:33.993 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-14T12:26:34.070 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-14T12:26:35.115 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-14T12:26:35.202 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-14T12:26:35.237 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-14T12:26:35.378 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-14T12:26:35.419 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-14T12:26:35.672 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-14T12:26:35.698 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-14T12:26:35.797 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-14T12:26:35.970 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2023-10-14T12:26:35.971 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2023-10-14T12:26:36.657 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-14T12:26:36.782 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-14T12:26:38.451 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-14T12:26:38.556 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-14T12:26:38.593 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-14T12:26:38.624 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-14T12:26:38.665 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-14T12:26:39.049 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-14T12:26:39.078 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T12:26:39.183 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T12:26:39.218 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-14T12:26:39.274 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-14T12:26:39.797 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-14T12:26:39.823 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T12:26:39.914 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T12:26:39.941 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-14T12:26:41.821 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2023-10-14T12:26:41.897 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 1/153 2023-10-14T12:26:41.927 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 2/153 2023-10-14T12:26:41.955 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 3/153 2023-10-14T12:26:42.041 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/153 2023-10-14T12:26:42.432 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 5/153 2023-10-14T12:26:42.474 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T12:26:42.477 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T12:26:42.521 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T12:26:42.654 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T12:26:42.686 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T12:26:42.808 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T12:26:42.876 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T12:26:43.003 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 9/153 2023-10-14T12:26:43.182 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T12:26:43.232 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T12:26:43.393 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T12:26:43.394 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-14T12:26:43.394 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-14T12:26:43.394 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:43.433 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T12:26:43.448 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 10/153 2023-10-14T12:26:43.500 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-13.11-1.el9.x86_64 11/153 2023-10-14T12:26:43.536 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T12:26:43.682 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T12:26:43.717 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T12:26:43.802 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 13/153 2023-10-14T12:26:44.139 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 14/153 2023-10-14T12:26:44.289 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T12:26:44.369 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 15/153 2023-10-14T12:26:44.614 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T12:26:44.692 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T12:26:45.136 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.45.4-1.el9.x86_64 16/153 2023-10-14T12:26:45.172 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 17/153 2023-10-14T12:26:45.225 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 18/153 2023-10-14T12:26:45.338 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 19/153 2023-10-14T12:26:45.415 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-3.el9.noarch 20/153 2023-10-14T12:26:45.457 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 21/153 2023-10-14T12:26:45.519 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 22/153 2023-10-14T12:26:45.626 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 23/153 2023-10-14T12:26:45.678 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/153 2023-10-14T12:26:45.712 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 25/153 2023-10-14T12:26:45.825 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/153 2023-10-14T12:26:45.866 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 27/153 2023-10-14T12:26:45.916 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 28/153 2023-10-14T12:26:46.025 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 29/153 2023-10-14T12:26:46.205 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 30/153 2023-10-14T12:26:46.268 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 31/153 2023-10-14T12:26:46.973 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 32/153 2023-10-14T12:26:47.290 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 33/153 2023-10-14T12:26:47.344 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 34/153 2023-10-14T12:26:47.385 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 35/153 2023-10-14T12:26:47.432 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 36/153 2023-10-14T12:26:47.587 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-3.el9.x86_64 37/153 2023-10-14T12:26:47.625 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 38/153 2023-10-14T12:26:47.709 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 39/153 2023-10-14T12:26:47.808 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 40/153 2023-10-14T12:26:47.851 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 41/153 2023-10-14T12:26:47.890 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 42/153 2023-10-14T12:26:47.959 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 43/153 2023-10-14T12:26:48.015 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 44/153 2023-10-14T12:26:48.074 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 45/153 2023-10-14T12:26:48.269 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 46/153 2023-10-14T12:26:48.324 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 47/153 2023-10-14T12:26:48.381 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 48/153 2023-10-14T12:26:48.511 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 49/153 2023-10-14T12:26:48.559 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.23.2-1.el9.noarch 50/153 2023-10-14T12:26:48.610 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 51/153 2023-10-14T12:26:48.649 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 52/153 2023-10-14T12:26:48.714 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 53/153 2023-10-14T12:26:48.757 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fmt-8.1.1-5.el9.x86_64 54/153 2023-10-14T12:26:48.812 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 55/153 2023-10-14T12:26:48.967 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 56/153 2023-10-14T12:26:49.016 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : automake-1.16.2-8.el9.noarch 57/153 2023-10-14T12:26:49.098 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 58/153 2023-10-14T12:26:49.185 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 59/153 2023-10-14T12:26:49.480 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 60/153 2023-10-14T12:26:49.535 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 61/153 2023-10-14T12:26:49.709 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 62/153 2023-10-14T12:26:49.781 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 63/153 2023-10-14T12:26:49.812 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 64/153 2023-10-14T12:26:49.854 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 65/153 2023-10-14T12:26:49.903 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 66/153 2023-10-14T12:26:49.945 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-15.el9.x86_64 67/153 2023-10-14T12:26:50.000 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/153 2023-10-14T12:26:50.079 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/153 2023-10-14T12:26:50.131 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 70/153 2023-10-14T12:26:50.180 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/153 2023-10-14T12:26:50.308 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/153 2023-10-14T12:26:50.352 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 73/153 2023-10-14T12:26:50.387 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 74/153 2023-10-14T12:26:50.451 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 75/153 2023-10-14T12:26:50.490 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 76/153 2023-10-14T12:26:50.632 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 77/153 2023-10-14T12:26:50.679 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 78/153 2023-10-14T12:26:50.821 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/153 2023-10-14T12:26:50.894 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 80/153 2023-10-14T12:26:51.882 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 81/153 2023-10-14T12:26:51.934 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 82/153 2023-10-14T12:26:51.968 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 83/153 2023-10-14T12:26:52.093 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 84/153 2023-10-14T12:26:52.218 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 85/153 2023-10-14T12:26:52.450 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.21-2.el9.x86_64 86/153 2023-10-14T12:26:52.482 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 87/153 2023-10-14T12:26:52.575 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 88/153 2023-10-14T12:26:53.382 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 89/153 2023-10-14T12:26:53.510 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 90/153 2023-10-14T12:26:55.070 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 91/153 2023-10-14T12:26:55.160 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 92/153 2023-10-14T12:26:55.198 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 93/153 2023-10-14T12:26:55.237 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jq-1.6-15.el9.x86_64 94/153 2023-10-14T12:26:55.270 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 95/153 2023-10-14T12:26:55.634 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 96/153 2023-10-14T12:26:55.675 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T12:26:55.795 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 97/153 2023-10-14T12:26:55.831 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 98/153 2023-10-14T12:26:55.915 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 99/153 2023-10-14T12:26:56.376 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T12:26:56.376 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /sys 2023-10-14T12:26:56.376 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /proc 2023-10-14T12:26:56.376 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /mnt 2023-10-14T12:26:56.377 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /var/tmp 2023-10-14T12:26:56.377 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /home 2023-10-14T12:26:56.377 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /root 2023-10-14T12:26:56.377 INFO:teuthology.orchestra.run.smithi064.stdout:skipping the directory /tmp 2023-10-14T12:26:56.378 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:56.413 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 100/153 2023-10-14T12:26:56.444 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T12:26:56.536 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 101/153 2023-10-14T12:26:56.563 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 102/153 2023-10-14T12:26:56.605 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T12:26:56.652 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T12:26:56.652 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:26:56.653 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-14T12:26:56.653 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:58.424 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T12:26:58.537 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T12:26:58.538 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:26:58.538 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-14T12:26:58.538 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T12:26:58.538 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T12:26:58.539 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:58.790 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T12:26:58.896 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T12:26:58.897 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:26:58.897 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-14T12:26:58.897 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T12:26:58.897 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T12:26:58.897 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:59.059 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T12:26:59.100 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T12:26:59.425 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T12:26:59.500 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T12:26:59.500 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:26:59.501 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-14T12:26:59.501 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T12:26:59.501 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T12:26:59.501 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:26:59.738 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 103/153 2023-10-14T12:26:59.779 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T12:26:59.980 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 104/153 2023-10-14T12:26:59.980 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-10-14T12:26:59.981 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-10-14T12:26:59.981 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:00.021 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T12:27:00.165 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T12:27:00.311 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T12:27:00.363 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-14T12:27:00.480 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-14T12:27:00.514 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T12:27:00.849 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T12:27:00.889 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T12:27:02.078 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T12:27:02.106 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T12:27:02.255 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T12:27:02.430 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-14T12:27:02.458 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T12:27:02.539 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T12:27:02.539 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:02.539 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-14T12:27:02.540 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T12:27:02.540 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T12:27:02.540 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:02.592 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T12:27:02.634 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T12:27:03.558 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-14T12:27:03.593 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T12:27:03.670 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T12:27:03.670 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:03.670 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-14T12:27:03.670 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T12:27:03.671 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T12:27:03.671 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:03.719 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T12:27:03.794 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T12:27:03.794 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:03.794 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-14T12:27:03.795 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:03.870 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T12:27:03.955 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T12:27:03.955 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:03.955 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-14T12:27:03.955 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T12:27:03.956 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T12:27:03.956 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:04.337 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T12:27:04.425 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T12:27:04.426 INFO:teuthology.orchestra.run.smithi064.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:04.426 INFO:teuthology.orchestra.run.smithi064.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-14T12:27:04.426 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T12:27:04.426 INFO:teuthology.orchestra.run.smithi064.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T12:27:04.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:08.783 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-14T12:27:08.830 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-14T12:27:08.864 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-14T12:27:09.148 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-14T12:27:09.270 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-14T12:27:09.338 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-14T12:27:09.384 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-14T12:27:09.422 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-14T12:27:09.472 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-14T12:27:09.515 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-14T12:27:09.621 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-14T12:27:09.702 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-14T12:27:09.747 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-14T12:27:10.592 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T12:27:10.645 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T12:27:10.704 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T12:27:10.768 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-14T12:27:12.250 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-14T12:27:12.335 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-14T12:27:12.381 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-14T12:27:12.524 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-14T12:27:12.562 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-14T12:27:12.599 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-14T12:27:12.599 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T12:27:12.669 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 105/153 2023-10-14T12:27:12.669 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2023-10-14T12:27:12.670 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2023-10-14T12:27:12.670 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2023-10-14T12:27:12.670 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2023-10-14T12:27:12.670 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2023-10-14T12:27:12.671 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2023-10-14T12:27:12.671 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2023-10-14T12:27:12.671 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:12.718 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T12:27:12.750 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-14T12:27:12.815 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-14T12:27:12.848 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-14T12:27:12.882 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T12:27:12.889 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T12:27:12.889 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T12:27:12.928 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 106/153 2023-10-14T12:27:12.928 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:12.928 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-10-14T12:27:12.929 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:13.240 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T12:27:13.240 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T12:27:13.362 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T12:27:13.393 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T12:27:13.394 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T12:27:13.523 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T12:27:13.651 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T12:27:13.919 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T12:27:13.919 INFO:teuthology.orchestra.run.smithi064.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-14T12:27:13.920 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:14.611 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T12:27:14.705 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 107/153 2023-10-14T12:27:14.705 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:14.705 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-10-14T12:27:14.706 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T12:27:14.706 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-10-14T12:27:14.706 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:14.927 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T12:27:14.993 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 108/153 2023-10-14T12:27:14.994 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:14.994 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-10-14T12:27:14.995 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T12:27:14.995 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-10-14T12:27:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:15.486 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T12:27:15.555 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 109/153 2023-10-14T12:27:15.555 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:15.555 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-10-14T12:27:15.555 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T12:27:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-10-14T12:27:15.556 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:16.202 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T12:27:16.239 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 110/153 2023-10-14T12:27:16.285 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 111/153 2023-10-14T12:27:16.388 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 112/153 2023-10-14T12:27:16.424 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T12:27:16.749 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 113/153 2023-10-14T12:27:16.784 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T12:27:17.940 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 114/153 2023-10-14T12:27:17.975 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T12:27:18.117 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 115/153 2023-10-14T12:27:18.284 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 116/153 2023-10-14T12:27:18.311 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T12:27:18.384 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 117/153 2023-10-14T12:27:18.385 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:18.385 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-10-14T12:27:18.385 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T12:27:18.385 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-10-14T12:27:18.385 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:18.436 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T12:27:18.474 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 118/153 2023-10-14T12:27:18.515 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-14T12:27:18.515 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-14T12:27:18.515 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-14T12:27:18.516 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-14T12:27:18.516 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-14T12:27:18.516 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T12:27:18.516 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T12:27:18.516 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T12:27:18.517 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-14T12:27:18.517 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-14T12:27:18.517 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-14T12:27:18.517 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T12:27:18.517 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-14T12:27:18.518 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-14T12:27:18.518 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-14T12:27:18.518 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-14T12:27:18.518 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-14T12:27:18.518 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-14T12:27:18.519 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-14T12:27:18.519 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-14T12:27:18.519 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-14T12:27:18.519 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-14T12:27:18.519 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-14T12:27:18.520 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-14T12:27:18.520 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-14T12:27:18.520 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-14T12:27:18.520 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-14T12:27:18.520 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-14T12:27:18.520 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-14T12:27:18.531 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-14T12:27:18.531 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-14T12:27:18.531 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-14T12:27:18.532 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-14T12:27:18.532 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-14T12:27:18.532 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-14T12:27:18.532 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-14T12:27:18.532 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-14T12:27:18.532 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-14T12:27:18.533 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-14T12:27:18.533 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-14T12:27:18.533 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-14T12:27:18.533 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-14T12:27:18.533 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-14T12:27:18.534 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-14T12:27:18.534 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-14T12:27:18.534 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-14T12:27:18.534 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-14T12:27:18.534 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-14T12:27:18.535 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-14T12:27:18.535 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-14T12:27:18.535 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-14T12:27:18.535 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-14T12:27:18.535 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-14T12:27:18.536 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-14T12:27:18.536 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-14T12:27:18.536 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-14T12:27:18.536 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-14T12:27:18.536 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-14T12:27:18.536 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-14T12:27:18.537 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-14T12:27:18.537 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-14T12:27:18.537 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-14T12:27:18.537 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-14T12:27:18.537 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-14T12:27:18.538 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-14T12:27:18.538 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-14T12:27:18.538 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-14T12:27:18.538 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-14T12:27:18.538 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-14T12:27:18.539 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-14T12:27:18.539 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-14T12:27:18.539 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-14T12:27:18.539 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-14T12:27:18.539 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-14T12:27:18.539 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-14T12:27:18.540 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-14T12:27:18.540 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-14T12:27:18.540 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-14T12:27:18.540 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-14T12:27:18.540 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-14T12:27:18.541 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-14T12:27:18.541 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-14T12:27:18.541 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-14T12:27:18.541 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-14T12:27:18.541 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-14T12:27:18.542 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-14T12:27:18.542 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-14T12:27:18.542 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-14T12:27:18.542 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-14T12:27:18.542 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-14T12:27:18.543 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-14T12:27:18.543 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-14T12:27:18.543 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-14T12:27:18.543 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-14T12:27:18.543 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-14T12:27:18.543 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-14T12:27:18.544 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-14T12:27:18.544 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-14T12:27:18.544 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-14T12:27:18.544 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-14T12:27:18.544 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-14T12:27:18.545 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-14T12:27:18.545 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-14T12:27:18.545 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-14T12:27:18.545 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-14T12:27:18.545 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-14T12:27:18.545 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-14T12:27:18.546 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-14T12:27:18.546 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-14T12:27:18.546 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-14T12:27:18.546 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-14T12:27:18.546 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-14T12:27:18.547 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-14T12:27:18.547 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-14T12:27:18.547 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-14T12:27:18.547 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-14T12:27:18.547 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-14T12:27:18.548 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-14T12:27:18.548 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-14T12:27:18.548 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-14T12:27:18.548 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-14T12:27:18.548 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-14T12:27:18.548 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-14T12:27:18.549 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-14T12:27:18.549 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-14T12:27:18.549 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-14T12:27:18.549 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-14T12:27:18.549 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-14T12:27:18.550 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-14T12:27:18.550 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-14T12:27:18.550 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-14T12:27:18.550 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-14T12:27:18.550 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-14T12:27:18.551 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-14T12:27:18.551 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-14T12:27:18.551 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-14T12:27:18.551 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-14T12:27:18.551 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-14T12:27:18.552 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-14T12:27:18.552 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-14T12:27:18.552 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-14T12:27:18.552 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-14T12:27:18.552 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-14T12:27:18.552 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-14T12:27:18.553 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-14T12:27:18.553 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-14T12:27:18.553 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-14T12:27:18.553 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-14T12:27:18.553 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-14T12:27:18.553 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-14T12:27:18.554 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T12:27:18.554 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-14T12:27:19.386 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 119/153 2023-10-14T12:27:19.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T12:27:19.508 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 120/153 2023-10-14T12:27:19.509 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:19.509 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-10-14T12:27:19.509 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T12:27:19.509 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-10-14T12:27:19.510 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:19.579 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T12:27:19.657 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 121/153 2023-10-14T12:27:19.658 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:19.658 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-10-14T12:27:19.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:19.730 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T12:27:19.831 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 122/153 2023-10-14T12:27:19.831 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:19.831 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-10-14T12:27:19.831 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T12:27:19.832 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-10-14T12:27:19.832 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:20.197 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T12:27:20.268 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 123/153 2023-10-14T12:27:20.269 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-10-14T12:27:20.269 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-10-14T12:27:20.269 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T12:27:20.270 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-10-14T12:27:20.270 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:20.716 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T12:27:20.717 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:20.717 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2023-10-14T12:27:20.717 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:20.718 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:20.718 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:20.718 INFO:teuthology.orchestra.run.smithi064.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:20.718 INFO:teuthology.orchestra.run.smithi064.stdout: acl-2.3.1-4.el9.x86_64 2023-10-14T12:27:20.719 INFO:teuthology.orchestra.run.smithi064.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-14T12:27:20.719 INFO:teuthology.orchestra.run.smithi064.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-14T12:27:20.719 INFO:teuthology.orchestra.run.smithi064.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.719 INFO:teuthology.orchestra.run.smithi064.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.720 INFO:teuthology.orchestra.run.smithi064.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-14T12:27:20.720 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-10-14T12:27:20.720 INFO:teuthology.orchestra.run.smithi064.stdout: automake-1.16.2-8.el9.noarch 2023-10-14T12:27:20.720 INFO:teuthology.orchestra.run.smithi064.stdout: bison-3.7.4-5.el9.x86_64 2023-10-14T12:27:20.720 INFO:teuthology.orchestra.run.smithi064.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-14T12:27:20.721 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.721 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.721 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.722 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.722 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.722 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.722 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.723 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.723 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.723 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.724 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.724 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.724 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.724 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.725 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.725 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.725 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.725 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.725 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.726 INFO:teuthology.orchestra.run.smithi064.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.726 INFO:teuthology.orchestra.run.smithi064.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.726 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.726 INFO:teuthology.orchestra.run.smithi064.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:20.726 INFO:teuthology.orchestra.run.smithi064.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-14T12:27:20.727 INFO:teuthology.orchestra.run.smithi064.stdout: flex-2.6.4-9.el9.x86_64 2023-10-14T12:27:20.727 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-14T12:27:20.727 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-14T12:27:20.727 INFO:teuthology.orchestra.run.smithi064.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-14T12:27:20.727 INFO:teuthology.orchestra.run.smithi064.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-14T12:27:20.728 INFO:teuthology.orchestra.run.smithi064.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-14T12:27:20.728 INFO:teuthology.orchestra.run.smithi064.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-14T12:27:20.728 INFO:teuthology.orchestra.run.smithi064.stdout: jq-1.6-15.el9.x86_64 2023-10-14T12:27:20.728 INFO:teuthology.orchestra.run.smithi064.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-14T12:27:20.728 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-14T12:27:20.728 INFO:teuthology.orchestra.run.smithi064.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-14T12:27:20.729 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.729 INFO:teuthology.orchestra.run.smithi064.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.729 INFO:teuthology.orchestra.run.smithi064.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.729 INFO:teuthology.orchestra.run.smithi064.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-14T12:27:20.729 INFO:teuthology.orchestra.run.smithi064.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-14T12:27:20.730 INFO:teuthology.orchestra.run.smithi064.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-14T12:27:20.730 INFO:teuthology.orchestra.run.smithi064.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-14T12:27:20.730 INFO:teuthology.orchestra.run.smithi064.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-14T12:27:20.730 INFO:teuthology.orchestra.run.smithi064.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.730 INFO:teuthology.orchestra.run.smithi064.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.731 INFO:teuthology.orchestra.run.smithi064.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-14T12:27:20.731 INFO:teuthology.orchestra.run.smithi064.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.731 INFO:teuthology.orchestra.run.smithi064.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-14T12:27:20.731 INFO:teuthology.orchestra.run.smithi064.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-14T12:27:20.731 INFO:teuthology.orchestra.run.smithi064.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-14T12:27:20.732 INFO:teuthology.orchestra.run.smithi064.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-14T12:27:20.732 INFO:teuthology.orchestra.run.smithi064.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-14T12:27:20.732 INFO:teuthology.orchestra.run.smithi064.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-14T12:27:20.732 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-14T12:27:20.732 INFO:teuthology.orchestra.run.smithi064.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-14T12:27:20.732 INFO:teuthology.orchestra.run.smithi064.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-14T12:27:20.733 INFO:teuthology.orchestra.run.smithi064.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-14T12:27:20.733 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-13.11-1.el9.x86_64 2023-10-14T12:27:20.733 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-14T12:27:20.733 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-14T12:27:20.733 INFO:teuthology.orchestra.run.smithi064.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-14T12:27:20.734 INFO:teuthology.orchestra.run.smithi064.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-14T12:27:20.734 INFO:teuthology.orchestra.run.smithi064.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-14T12:27:20.734 INFO:teuthology.orchestra.run.smithi064.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-14T12:27:20.734 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-14T12:27:20.734 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.735 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.735 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.735 INFO:teuthology.orchestra.run.smithi064.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-14T12:27:20.735 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-14T12:27:20.735 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-14T12:27:20.736 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-14T12:27:20.736 INFO:teuthology.orchestra.run.smithi064.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-14T12:27:20.736 INFO:teuthology.orchestra.run.smithi064.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-14T12:27:20.736 INFO:teuthology.orchestra.run.smithi064.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-14T12:27:20.736 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-14T12:27:20.737 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-14T12:27:20.737 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-14T12:27:20.737 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-14T12:27:20.737 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-14T12:27:20.737 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-14T12:27:20.738 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-14T12:27:20.738 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-14T12:27:20.738 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-14T12:27:20.738 INFO:teuthology.orchestra.run.smithi064.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-14T12:27:20.738 INFO:teuthology.orchestra.run.smithi064.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-14T12:27:20.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-14T12:27:20.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-14T12:27:20.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-14T12:27:20.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-14T12:27:20.739 INFO:teuthology.orchestra.run.smithi064.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-14T12:27:20.740 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-14T12:27:20.740 INFO:teuthology.orchestra.run.smithi064.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-14T12:27:20.740 INFO:teuthology.orchestra.run.smithi064.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-14T12:27:20.740 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-14T12:27:20.740 INFO:teuthology.orchestra.run.smithi064.stdout: python3-ply-3.11-14.el9.noarch 2023-10-14T12:27:20.740 INFO:teuthology.orchestra.run.smithi064.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-14T12:27:20.741 INFO:teuthology.orchestra.run.smithi064.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-14T12:27:20.741 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-14T12:27:20.741 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-14T12:27:20.741 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-14T12:27:20.741 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-14T12:27:20.742 INFO:teuthology.orchestra.run.smithi064.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-14T12:27:20.742 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.742 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.742 INFO:teuthology.orchestra.run.smithi064.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-14T12:27:20.742 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-14T12:27:20.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-14T12:27:20.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-14T12:27:20.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-14T12:27:20.743 INFO:teuthology.orchestra.run.smithi064.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-14T12:27:20.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-14T12:27:20.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-14T12:27:20.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-14T12:27:20.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-14T12:27:20.744 INFO:teuthology.orchestra.run.smithi064.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-14T12:27:20.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-14T12:27:20.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-14T12:27:20.745 INFO:teuthology.orchestra.run.smithi064.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-14T12:27:20.745 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.746 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.746 INFO:teuthology.orchestra.run.smithi064.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:20.746 INFO:teuthology.orchestra.run.smithi064.stdout: re2-1:20211101-3.el9.x86_64 2023-10-14T12:27:20.746 INFO:teuthology.orchestra.run.smithi064.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-14T12:27:20.746 INFO:teuthology.orchestra.run.smithi064.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-14T12:27:20.747 INFO:teuthology.orchestra.run.smithi064.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-14T12:27:20.747 INFO:teuthology.orchestra.run.smithi064.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-14T12:27:20.747 INFO:teuthology.orchestra.run.smithi064.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-14T12:27:20.748 INFO:teuthology.orchestra.run.smithi064.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-14T12:27:20.748 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:20.748 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-10-14T12:27:21.240 DEBUG:teuthology.parallel:result is None 2023-10-14T12:27:24.360 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 124/153 2023-10-14T12:27:24.406 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 125/153 2023-10-14T12:27:24.441 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 126/153 2023-10-14T12:27:24.697 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : elfutils-libelf-devel-0.189-3.el9.x86_64 127/153 2023-10-14T12:27:24.825 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 128/153 2023-10-14T12:27:24.886 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 129/153 2023-10-14T12:27:24.951 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libtool-2.4.6-45.el9.x86_64 130/153 2023-10-14T12:27:24.982 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 131/153 2023-10-14T12:27:25.012 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 132/153 2023-10-14T12:27:25.057 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-team-1:1.45.4-1.el9.x86_64 133/153 2023-10-14T12:27:25.163 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : NetworkManager-tui-1:1.45.4-1.el9.x86_64 134/153 2023-10-14T12:27:25.239 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 135/153 2023-10-14T12:27:25.282 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 136/153 2023-10-14T12:27:26.208 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T12:27:26.255 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T12:27:26.312 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 137/153 2023-10-14T12:27:26.377 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 138/153 2023-10-14T12:27:27.760 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 139/153 2023-10-14T12:27:27.853 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openssl-devel-1:3.0.7-24.el9.x86_64 140/153 2023-10-14T12:27:27.900 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 141/153 2023-10-14T12:27:28.030 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flex-2.6.4-9.el9.x86_64 142/153 2023-10-14T12:27:28.063 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : bison-3.7.4-5.el9.x86_64 143/153 2023-10-14T12:27:28.099 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 144/153 2023-10-14T12:27:28.100 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T12:27:28.218 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 145/153 2023-10-14T12:27:28.260 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 146/153 2023-10-14T12:27:28.300 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 147/153 2023-10-14T12:27:28.332 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 148/153 2023-10-14T12:27:28.371 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T12:27:28.372 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T12:27:28.707 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 149/153 2023-10-14T12:27:28.708 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T12:27:28.880 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 150/153 2023-10-14T12:27:28.911 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T12:27:28.911 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T12:27:29.066 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 152/153 2023-10-14T12:27:29.189 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T12:27:29.450 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T12:27:29.450 INFO:teuthology.orchestra.run.smithi177.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-10-14T12:27:29.450 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:33.857 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 1/153 2023-10-14T12:27:33.857 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2/153 2023-10-14T12:27:33.858 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 3/153 2023-10-14T12:27:33.858 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 4/153 2023-10-14T12:27:33.858 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a 5/153 2023-10-14T12:27:33.858 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 6/153 2023-10-14T12:27:33.859 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 7/153 2023-10-14T12:27:33.859 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 8/153 2023-10-14T12:27:33.859 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 9/153 2023-10-14T12:27:33.859 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 10/153 2023-10-14T12:27:33.859 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 11/153 2023-10-14T12:27:33.860 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 12/153 2023-10-14T12:27:33.860 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 13/153 2023-10-14T12:27:33.860 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_ 14/153 2023-10-14T12:27:33.860 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 15/153 2023-10-14T12:27:33.860 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 16/153 2023-10-14T12:27:33.861 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_6 17/153 2023-10-14T12:27:33.861 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86 18/153 2023-10-14T12:27:33.861 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 19/153 2023-10-14T12:27:33.861 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el 20/153 2023-10-14T12:27:33.861 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9. 21/153 2023-10-14T12:27:33.862 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_6 22/153 2023-10-14T12:27:33.862 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 23/153 2023-10-14T12:27:33.862 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 24/153 2023-10-14T12:27:33.862 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 25/153 2023-10-14T12:27:33.862 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 26/153 2023-10-14T12:27:33.863 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 27/153 2023-10-14T12:27:33.863 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 28/153 2023-10-14T12:27:33.873 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190. 29/153 2023-10-14T12:27:33.873 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noa 30/153 2023-10-14T12:27:33.874 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.n 31/153 2023-10-14T12:27:33.874 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba 32/153 2023-10-14T12:27:33.874 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el 33/153 2023-10-14T12:27:33.874 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 34/153 2023-10-14T12:27:33.874 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.e 35/153 2023-10-14T12:27:33.875 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 36/153 2023-10-14T12:27:33.875 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 37/153 2023-10-14T12:27:33.875 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 38/153 2023-10-14T12:27:33.875 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : bison-3.7.4-5.el9.x86_64 39/153 2023-10-14T12:27:33.875 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 40/153 2023-10-14T12:27:33.876 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flex-2.6.4-9.el9.x86_64 41/153 2023-10-14T12:27:33.876 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 42/153 2023-10-14T12:27:33.876 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 43/153 2023-10-14T12:27:33.876 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 44/153 2023-10-14T12:27:33.876 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 45/153 2023-10-14T12:27:33.877 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 46/153 2023-10-14T12:27:33.877 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 47/153 2023-10-14T12:27:33.877 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 48/153 2023-10-14T12:27:33.877 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 49/153 2023-10-14T12:27:33.877 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 50/153 2023-10-14T12:27:33.878 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 51/153 2023-10-14T12:27:33.878 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 52/153 2023-10-14T12:27:33.878 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 53/153 2023-10-14T12:27:33.878 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-13.11-1.el9.x86_64 54/153 2023-10-14T12:27:33.878 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 55/153 2023-10-14T12:27:33.879 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 56/153 2023-10-14T12:27:33.879 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 57/153 2023-10-14T12:27:33.879 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 58/153 2023-10-14T12:27:33.879 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 59/153 2023-10-14T12:27:33.879 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 60/153 2023-10-14T12:27:33.879 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/153 2023-10-14T12:27:33.880 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/153 2023-10-14T12:27:33.880 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/153 2023-10-14T12:27:33.880 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/153 2023-10-14T12:27:33.880 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/153 2023-10-14T12:27:33.880 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/153 2023-10-14T12:27:33.881 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/153 2023-10-14T12:27:33.881 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 68/153 2023-10-14T12:27:33.881 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 69/153 2023-10-14T12:27:33.881 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 70/153 2023-10-14T12:27:33.881 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 71/153 2023-10-14T12:27:33.882 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 72/153 2023-10-14T12:27:33.882 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 73/153 2023-10-14T12:27:33.882 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 74/153 2023-10-14T12:27:33.882 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 75/153 2023-10-14T12:27:33.882 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 76/153 2023-10-14T12:27:33.883 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 77/153 2023-10-14T12:27:33.883 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 78/153 2023-10-14T12:27:33.883 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 79/153 2023-10-14T12:27:33.883 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 80/153 2023-10-14T12:27:33.883 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 81/153 2023-10-14T12:27:33.883 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 82/153 2023-10-14T12:27:33.884 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 83/153 2023-10-14T12:27:33.884 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-3.el9.noarch 84/153 2023-10-14T12:27:33.884 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 85/153 2023-10-14T12:27:33.884 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : automake-1.16.2-8.el9.noarch 86/153 2023-10-14T12:27:33.884 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : elfutils-libelf-devel-0.189-3.el9.x86_64 87/153 2023-10-14T12:27:33.885 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jq-1.6-15.el9.x86_64 88/153 2023-10-14T12:27:33.885 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 89/153 2023-10-14T12:27:33.885 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 90/153 2023-10-14T12:27:33.885 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openssl-devel-1:3.0.7-24.el9.x86_64 91/153 2023-10-14T12:27:33.885 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/153 2023-10-14T12:27:33.886 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 93/153 2023-10-14T12:27:33.886 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 94/153 2023-10-14T12:27:33.886 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 95/153 2023-10-14T12:27:33.886 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/153 2023-10-14T12:27:33.886 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 97/153 2023-10-14T12:27:33.886 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 98/153 2023-10-14T12:27:33.887 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/153 2023-10-14T12:27:33.887 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/153 2023-10-14T12:27:33.887 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 101/153 2023-10-14T12:27:33.887 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 102/153 2023-10-14T12:27:33.887 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 103/153 2023-10-14T12:27:33.888 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 104/153 2023-10-14T12:27:33.888 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 105/153 2023-10-14T12:27:33.888 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 106/153 2023-10-14T12:27:33.888 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 107/153 2023-10-14T12:27:33.888 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.23.2-1.el9.noarch 108/153 2023-10-14T12:27:33.889 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 109/153 2023-10-14T12:27:33.889 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 110/153 2023-10-14T12:27:33.889 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 111/153 2023-10-14T12:27:33.889 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 112/153 2023-10-14T12:27:33.889 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 113/153 2023-10-14T12:27:33.890 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 114/153 2023-10-14T12:27:33.890 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 115/153 2023-10-14T12:27:33.890 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 116/153 2023-10-14T12:27:33.890 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 117/153 2023-10-14T12:27:33.890 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 118/153 2023-10-14T12:27:33.891 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 119/153 2023-10-14T12:27:33.891 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 120/153 2023-10-14T12:27:33.891 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 121/153 2023-10-14T12:27:33.891 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/153 2023-10-14T12:27:33.891 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 123/153 2023-10-14T12:27:33.892 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 124/153 2023-10-14T12:27:33.892 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 125/153 2023-10-14T12:27:33.892 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 126/153 2023-10-14T12:27:33.892 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 127/153 2023-10-14T12:27:33.892 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 128/153 2023-10-14T12:27:33.892 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 129/153 2023-10-14T12:27:33.893 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 130/153 2023-10-14T12:27:33.893 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 131/153 2023-10-14T12:27:33.893 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-3.el9.x86_64 132/153 2023-10-14T12:27:33.893 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 133/153 2023-10-14T12:27:33.893 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 134/153 2023-10-14T12:27:33.894 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 135/153 2023-10-14T12:27:33.894 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 136/153 2023-10-14T12:27:33.894 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 137/153 2023-10-14T12:27:33.894 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 138/153 2023-10-14T12:27:33.894 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 139/153 2023-10-14T12:27:33.895 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.45.4-1.el9.x86_64 140/153 2023-10-14T12:27:33.895 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 141/153 2023-10-14T12:27:33.895 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.45.4-1.el9.x86_64 142/153 2023-10-14T12:27:33.895 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 143/153 2023-10-14T12:27:33.895 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.45.4-1.el9.x86_64 144/153 2023-10-14T12:27:33.896 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 145/153 2023-10-14T12:27:33.896 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.45.4-1.el9.x86_64 146/153 2023-10-14T12:27:33.896 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 147/153 2023-10-14T12:27:33.896 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : acl-2.3.1-4.el9.x86_64 148/153 2023-10-14T12:27:33.896 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : acl-2.3.1-3.el9.x86_64 149/153 2023-10-14T12:27:33.896 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/153 2023-10-14T12:27:33.897 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/153 2023-10-14T12:27:33.897 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/153 2023-10-14T12:27:35.963 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/153 2023-10-14T12:27:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:35.964 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2023-10-14T12:27:35.964 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:35.965 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-libnm-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:35.965 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-team-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: NetworkManager-tui-1:1.45.4-1.el9.x86_64 2023-10-14T12:27:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: acl-2.3.1-4.el9.x86_64 2023-10-14T12:27:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: libacl-2.3.1-4.el9.x86_64 2023-10-14T12:27:35.966 INFO:teuthology.orchestra.run.smithi177.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-10-14T12:27:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-10-14T12:27:35.967 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2023-10-14T12:27:35.967 INFO:teuthology.orchestra.run.smithi177.stdout: automake-1.16.2-8.el9.noarch 2023-10-14T12:27:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: bison-3.7.4-5.el9.x86_64 2023-10-14T12:27:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-10-14T12:27:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.968 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.969 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.970 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.971 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.972 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: cephfs-top-2:18.0.0-6730.g4ba8a190.el9.noarch 2023-10-14T12:27:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: elfutils-libelf-devel-0.189-3.el9.x86_64 2023-10-14T12:27:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: flex-2.6.4-9.el9.x86_64 2023-10-14T12:27:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-10-14T12:27:35.973 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-10-14T12:27:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-10-14T12:27:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: fmt-8.1.1-5.el9.x86_64 2023-10-14T12:27:35.974 INFO:teuthology.orchestra.run.smithi177.stdout: fuse-2.9.9-15.el9.x86_64 2023-10-14T12:27:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-10-14T12:27:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: jq-1.6-15.el9.x86_64 2023-10-14T12:27:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-10-14T12:27:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-9.el9.x86_64 2023-10-14T12:27:35.975 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-10-14T12:27:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-10-14T12:27:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2023-10-14T12:27:35.976 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-10-14T12:27:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-10-14T12:27:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-10-14T12:27:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.977 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-10-14T12:27:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: libtool-2.4.6-45.el9.x86_64 2023-10-14T12:27:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2023-10-14T12:27:35.978 INFO:teuthology.orchestra.run.smithi177.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-10-14T12:27:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-10-14T12:27:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-10-14T12:27:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-10-14T12:27:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.21-2.el9.x86_64 2023-10-14T12:27:35.979 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-10-14T12:27:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: openssl-devel-1:3.0.7-24.el9.x86_64 2023-10-14T12:27:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-10-14T12:27:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-13.11-1.el9.x86_64 2023-10-14T12:27:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-10-14T12:27:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-10-14T12:27:35.980 INFO:teuthology.orchestra.run.smithi177.stdout: postgresql-server-13.11-1.el9.x86_64 2023-10-14T12:27:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-10-14T12:27:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2023-10-14T12:27:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-10-14T12:27:35.981 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-10-14T12:27:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.982 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-10-14T12:27:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-10-14T12:27:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-10-14T12:27:35.983 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-10-14T12:27:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-10-14T12:27:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-10-14T12:27:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.23.2-1.el9.noarch 2023-10-14T12:27:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-10-14T12:27:35.984 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-10-14T12:27:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-10-14T12:27:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-10-14T12:27:35.985 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-10-14T12:27:35.986 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-10-14T12:27:35.986 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-10-14T12:27:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-10-14T12:27:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-10-14T12:27:35.987 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-10-14T12:27:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-10-14T12:27:35.988 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-10-14T12:27:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2023-10-14T12:27:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-10-14T12:27:35.989 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-10-14T12:27:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-10-14T12:27:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-10-14T12:27:35.990 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-10-14T12:27:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-10-14T12:27:35.991 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-10-14T12:27:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2023-10-14T12:27:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2023-10-14T12:27:35.992 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-10-14T12:27:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-10-14T12:27:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-10-14T12:27:35.993 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-10-14T12:27:35.994 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2023-10-14T12:27:35.994 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2023-10-14T12:27:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.995 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.996 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-10-14T12:27:35.996 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-7.el9.noarch 2023-10-14T12:27:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-10-14T12:27:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:35.997 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2023-10-14T12:27:35.998 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2023-10-14T12:27:35.998 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-10-14T12:27:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-10-14T12:27:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2023-10-14T12:27:35.999 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-10-14T12:27:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-3.el9.noarch 2023-10-14T12:27:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.7-6.el9.noarch 2023-10-14T12:27:36.000 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-10-14T12:27:36.001 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-10-14T12:27:36.001 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-10-14T12:27:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:36.002 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:18.0.0-6730.g4ba8a190.el9.x86_64 2023-10-14T12:27:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-3.el9.x86_64 2023-10-14T12:27:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-5.el9.x86_64 2023-10-14T12:27:36.003 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2023-10-14T12:27:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: uuid-1.6.2-55.el9.x86_64 2023-10-14T12:27:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-10-14T12:27:36.004 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-10-14T12:27:36.005 INFO:teuthology.orchestra.run.smithi177.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-10-14T12:27:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:36.006 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2023-10-14T12:27:36.470 DEBUG:teuthology.parallel:result is None 2023-10-14T12:27:36.471 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:27:36.617 DEBUG:teuthology.orchestra.run.smithi064:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T12:27:36.695 INFO:teuthology.orchestra.run.smithi064.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-14T12:27:36.696 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-14T12:27:36.696 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T12:27:36.696 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0 2023-10-14T12:27:36.926 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-14T12:27:36.985 INFO:teuthology.orchestra.run.smithi177.stdout:18.0.0-6730.g4ba8a190.el9 2023-10-14T12:27:36.986 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6730.g4ba8a190.el9 2023-10-14T12:27:36.986 INFO:teuthology.task.install:The correct ceph version 18.0.0-6730.g4ba8a190 is installed. 2023-10-14T12:27:36.986 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-14T12:27:36.987 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:36.987 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T12:27:37.102 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:37.103 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-14T12:27:37.187 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-14T12:27:37.187 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:37.188 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T12:27:37.302 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T12:27:37.410 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:37.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2023-10-14T12:27:37.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-14T12:27:37.612 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-14T12:27:37.613 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:37.613 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T12:27:37.722 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T12:27:37.871 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:37.872 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-14T12:27:37.964 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-14T12:27:38.082 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-14T12:27:38.083 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:38.083 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T12:27:38.193 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T12:27:38.297 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:38.297 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2023-10-14T12:27:38.381 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-14T12:27:38.495 INFO:teuthology.run_tasks:Running task ceph... 2023-10-14T12:27:38.559 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-14T12:27:38.560 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 777 /var/log/ceph 2023-10-14T12:27:38.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2023-10-14T12:27:38.670 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-14T12:27:38.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T12:27:38.679 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-14T12:27:38.776 INFO:tasks.ceph:Creating extra log directories... 2023-10-14T12:27:38.777 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T12:27:38.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-14T12:27:38.895 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-14T12:27:38.895 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-14T12:27:38.896 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-14T12:27:38.896 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:38.897 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T12:27:38.957 DEBUG:teuthology.orchestra.run.smithi064:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T12:27:39.245 DEBUG:teuthology.orchestra.run.smithi064:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T12:27:39.356 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:39.356 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-14T12:27:39.401 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-14T12:27:39.612 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-14T12:27:39.692 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-14T12:27:39.692 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-14T12:27:39.693 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313', 'branch': 'rishabh-2023oct13', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7425313', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023oct13'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023oct13', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6006, 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'sleep_before_teardown': 0, 'subset': '402/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023oct13', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi064.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLttCEeCAE/ysK/osVaJ8GI737XDqgW+5039hgU/ytayy8VOUD0CjOJLVIZ8EEy6IJofUAyLaaODKEW1pPee0w8=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNwC2Q6TC+2vwkI9aqBnQh06SHUmt7dhsYNBJd7qqAPCVNyYZ2UMCBpQXmG/n55AFYS835L3eze/QWWeJyOmblc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '47672119149b103ec7cec2cc65c063ccbb001ac7'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '8cdab074dcca9a68965bc5a50e9c30b691949723', 'timestamp': '2023-10-13_18:04:14', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-14T12:27:39.693 DEBUG:teuthology.orchestra.run.smithi064:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T12:27:39.702 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-14T12:27:39.758 DEBUG:teuthology.orchestra.run.smithi064:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T12:27:39.767 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2023-10-14T12:27:39.866 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:39.866 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T12:27:39.927 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T12:27:39.928 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_1 2023-10-14T12:27:39.984 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T12:27:39.985 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:39.985 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-10-14T12:27:39.985 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:39.985 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:39.985 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-10-14 12:27:14.398873485 +0000 2023-10-14T12:27:39.986 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-10-14 12:24:53.800237529 +0000 2023-10-14T12:27:39.986 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-10-14 12:24:53.800237529 +0000 2023-10-14T12:27:39.986 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-10-14 12:24:53.800237529 +0000 2023-10-14T12:27:39.986 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T12:27:40.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-10-14T12:27:40.076 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-10-14T12:27:40.076 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000343358 s, 1.5 MB/s 2023-10-14T12:27:40.079 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T12:27:40.131 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_2 2023-10-14T12:27:40.182 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T12:27:40.183 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:40.183 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-10-14T12:27:40.183 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:40.183 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:40.184 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-10-14 12:27:14.399873466 +0000 2023-10-14T12:27:40.184 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-10-14 12:24:54.859216773 +0000 2023-10-14T12:27:40.184 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-10-14 12:24:54.859216773 +0000 2023-10-14T12:27:40.184 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-10-14 12:24:54.859216773 +0000 2023-10-14T12:27:40.185 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T12:27:40.280 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-10-14T12:27:40.281 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-10-14T12:27:40.281 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000356141 s, 1.4 MB/s 2023-10-14T12:27:40.285 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T12:27:40.344 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_3 2023-10-14T12:27:40.401 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T12:27:40.401 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:40.402 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-10-14T12:27:40.402 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:40.402 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:40.403 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-10-14 12:27:14.400873446 +0000 2023-10-14T12:27:40.403 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-10-14 12:24:55.909196192 +0000 2023-10-14T12:27:40.403 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-10-14 12:24:55.909196192 +0000 2023-10-14T12:27:40.403 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-10-14 12:24:55.909196192 +0000 2023-10-14T12:27:40.404 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T12:27:40.501 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-10-14T12:27:40.502 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-10-14T12:27:40.502 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000345311 s, 1.5 MB/s 2023-10-14T12:27:40.506 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T12:27:40.571 DEBUG:teuthology.orchestra.run.smithi064:> stat /dev/vg_nvme/lv_4 2023-10-14T12:27:40.626 INFO:teuthology.orchestra.run.smithi064.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T12:27:40.627 INFO:teuthology.orchestra.run.smithi064.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:40.627 INFO:teuthology.orchestra.run.smithi064.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-10-14T12:27:40.627 INFO:teuthology.orchestra.run.smithi064.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:40.627 INFO:teuthology.orchestra.run.smithi064.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:40.627 INFO:teuthology.orchestra.run.smithi064.stdout:Access: 2023-10-14 12:27:14.401873426 +0000 2023-10-14T12:27:40.628 INFO:teuthology.orchestra.run.smithi064.stdout:Modify: 2023-10-14 12:24:56.974175317 +0000 2023-10-14T12:27:40.628 INFO:teuthology.orchestra.run.smithi064.stdout:Change: 2023-10-14 12:24:56.974175317 +0000 2023-10-14T12:27:40.628 INFO:teuthology.orchestra.run.smithi064.stdout: Birth: 2023-10-14 12:24:56.974175317 +0000 2023-10-14T12:27:40.628 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T12:27:40.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records in 2023-10-14T12:27:40.725 INFO:teuthology.orchestra.run.smithi064.stderr:1+0 records out 2023-10-14T12:27:40.725 INFO:teuthology.orchestra.run.smithi064.stderr:512 bytes copied, 0.000349108 s, 1.5 MB/s 2023-10-14T12:27:40.729 DEBUG:teuthology.orchestra.run.smithi064:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T12:27:40.794 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:27:40.794 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:40.794 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2023-10-14T12:27:40.854 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-14T12:27:40.855 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2023-10-14T12:27:40.910 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-14T12:27:40.911 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:40.911 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 633 Links: 1 2023-10-14T12:27:40.911 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:40.911 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:40.911 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-14 12:27:29.884454162 +0000 2023-10-14T12:27:40.912 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-14 12:24:30.277263939 +0000 2023-10-14T12:27:40.912 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-14 12:24:30.277263939 +0000 2023-10-14T12:27:40.912 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-10-14 12:24:30.277263939 +0000 2023-10-14T12:27:40.912 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-14T12:27:40.995 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-14T12:27:40.996 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-14T12:27:40.996 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000365043 s, 1.4 MB/s 2023-10-14T12:27:40.998 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-14T12:27:41.052 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2023-10-14T12:27:41.101 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-14T12:27:41.101 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-10-14T12:27:41.101 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-14 12:27:29.885454134 +0000 2023-10-14T12:27:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-14 12:24:31.270236035 +0000 2023-10-14T12:27:41.102 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-14 12:24:31.270236035 +0000 2023-10-14T12:27:41.102 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-10-14 12:24:31.270236035 +0000 2023-10-14T12:27:41.103 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-14T12:27:41.183 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-14T12:27:41.183 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-14T12:27:41.183 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00038045 s, 1.3 MB/s 2023-10-14T12:27:41.186 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-14T12:27:41.239 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2023-10-14T12:27:41.285 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-14T12:27:41.285 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:41.286 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 672 Links: 1 2023-10-14T12:27:41.286 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:41.286 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:41.286 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-14 12:27:29.885454134 +0000 2023-10-14T12:27:41.286 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-14 12:24:32.272207881 +0000 2023-10-14T12:27:41.287 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-14 12:24:32.272207881 +0000 2023-10-14T12:27:41.287 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-10-14 12:24:32.272207881 +0000 2023-10-14T12:27:41.287 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-14T12:27:41.421 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-14T12:27:41.421 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-14T12:27:41.421 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000515098 s, 994 kB/s 2023-10-14T12:27:41.424 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-14T12:27:41.484 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2023-10-14T12:27:41.536 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-14T12:27:41.536 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-14T12:27:41.536 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 689 Links: 1 2023-10-14T12:27:41.537 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-14T12:27:41.537 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2023-10-14T12:27:41.537 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2023-10-14 12:27:29.886454106 +0000 2023-10-14T12:27:41.537 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2023-10-14 12:24:33.237180765 +0000 2023-10-14T12:27:41.537 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2023-10-14 12:24:33.237180765 +0000 2023-10-14T12:27:41.538 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2023-10-14 12:24:33.237180765 +0000 2023-10-14T12:27:41.538 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-14T12:27:41.621 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2023-10-14T12:27:41.621 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2023-10-14T12:27:41.622 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000342914 s, 1.5 MB/s 2023-10-14T12:27:41.624 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-14T12:27:41.682 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:27:41.683 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T12:27:41.683 INFO:tasks.ceph:Generating config... 2023-10-14T12:27:41.684 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-14T12:27:41.685 INFO:tasks.ceph:[client] debug client = 20 2023-10-14T12:27:41.685 INFO:tasks.ceph:[client] debug ms = 1 2023-10-14T12:27:41.685 INFO:tasks.ceph:[client] pid file = 2023-10-14T12:27:41.685 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-14T12:27:41.686 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-14T12:27:41.686 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-14T12:27:41.686 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-10-14T12:27:41.686 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-14T12:27:41.687 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-14T12:27:41.687 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-14T12:27:41.687 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-14T12:27:41.688 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-14T12:27:41.688 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-14T12:27:41.688 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-14T12:27:41.688 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-14T12:27:41.688 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-14T12:27:41.689 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-14T12:27:41.689 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-14T12:27:41.689 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-14T12:27:41.689 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-14T12:27:41.690 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-14T12:27:41.690 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-14T12:27:41.690 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-14T12:27:41.690 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-10-14T12:27:41.691 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-10-14T12:27:41.691 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-14T12:27:41.691 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-14T12:27:41.691 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-10-14T12:27:41.692 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-14T12:27:41.692 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-14T12:27:41.692 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-14T12:27:41.692 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-14T12:27:41.693 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-14T12:27:41.693 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-14T12:27:41.693 INFO:tasks.ceph:Setting up mon.a... 2023-10-14T12:27:41.694 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-14T12:27:41.851 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.keyring 2023-10-14T12:27:41.861 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-14T12:27:42.004 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:27:42.102 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.64'), ('mon.b', '172.21.15.177'), ('mon.c', '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]')] 2023-10-14T12:27:42.103 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.64,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-14T12:27:42.104 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:42.104 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T12:27:42.159 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.64 --add b 172.21.15.177 --addv c '[v2:172.21.15.177:3301,v1:172.21.15.177:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:27:42.321 INFO:teuthology.orchestra.run.smithi064.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:27:42.321 INFO:teuthology.orchestra.run.smithi064.stdout:monmaptool: generated fsid 0b341ded-8bb8-4993-857a-677cfc30784b 2023-10-14T12:27:42.321 INFO:teuthology.orchestra.run.smithi064.stdout:setting min_mon_release = pacific 2023-10-14T12:27:42.321 INFO:teuthology.orchestra.run.smithi064.stdout:epoch 0 2023-10-14T12:27:42.322 INFO:teuthology.orchestra.run.smithi064.stdout:fsid 0b341ded-8bb8-4993-857a-677cfc30784b 2023-10-14T12:27:42.322 INFO:teuthology.orchestra.run.smithi064.stdout:last_changed 2023-10-14T12:27:42.320737+0000 2023-10-14T12:27:42.322 INFO:teuthology.orchestra.run.smithi064.stdout:created 2023-10-14T12:27:42.320737+0000 2023-10-14T12:27:42.322 INFO:teuthology.orchestra.run.smithi064.stdout:min_mon_release 16 (pacific) 2023-10-14T12:27:42.322 INFO:teuthology.orchestra.run.smithi064.stdout:election_strategy: 1 2023-10-14T12:27:42.323 INFO:teuthology.orchestra.run.smithi064.stdout:0: [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] mon.a 2023-10-14T12:27:42.323 INFO:teuthology.orchestra.run.smithi064.stdout:1: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.b 2023-10-14T12:27:42.323 INFO:teuthology.orchestra.run.smithi064.stdout:2: [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] mon.c 2023-10-14T12:27:42.323 INFO:teuthology.orchestra.run.smithi064.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-14T12:27:42.325 DEBUG:teuthology.orchestra.run.smithi064:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-14T12:27:42.379 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 0b341ded-8bb8-4993-857a-677cfc30784b... 2023-10-14T12:27:42.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T12:27:42.385 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-14T12:27:42.563 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2023-10-14T12:27:42.563 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2023-10-14T12:27:42.563 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T12:27:42.563 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2023-10-14T12:27:42.564 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.564 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2023-10-14T12:27:42.564 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.564 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2023-10-14T12:27:42.564 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.565 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2023-10-14T12:27:42.565 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2023-10-14T12:27:42.565 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.565 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2023-10-14T12:27:42.565 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2023-10-14T12:27:42.566 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.566 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T12:27:42.566 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2023-10-14T12:27:42.566 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.566 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T12:27:42.567 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T12:27:42.567 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.567 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2023-10-14T12:27:42.567 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.567 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2023-10-14T12:27:42.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2023-10-14T12:27:42.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2023-10-14T12:27:42.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2023-10-14T12:27:42.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2023-10-14T12:27:42.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2023-10-14T12:27:42.568 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2023-10-14T12:27:42.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T12:27:42.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T12:27:42.569 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2023-10-14T12:27:42.569 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.569 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T12:27:42.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.570 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2023-10-14T12:27:42.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.570 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2023-10-14T12:27:42.570 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.571 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2023-10-14T12:27:42.571 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2023-10-14T12:27:42.571 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2023-10-14T12:27:42.571 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = "172.21.15.64,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2023-10-14T12:27:42.571 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 0b341ded-8bb8-4993-857a-677cfc30784b 2023-10-14T12:27:42.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.572 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2023-10-14T12:27:42.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2023-10-14T12:27:42.572 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2023-10-14T12:27:42.572 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2023-10-14T12:27:42.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2023-10-14T12:27:42.573 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2023-10-14T12:27:42.573 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2023-10-14T12:27:42.573 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.574 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2023-10-14T12:27:42.574 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2023-10-14T12:27:42.574 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2023-10-14T12:27:42.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.574 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2023-10-14T12:27:42.575 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2023-10-14T12:27:42.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.575 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2023-10-14T12:27:42.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.575 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2023-10-14T12:27:42.576 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.576 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2023-10-14T12:27:42.576 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.576 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2023-10-14T12:27:42.576 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2023-10-14T12:27:42.577 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.577 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2023-10-14T12:27:42.577 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2023-10-14T12:27:42.577 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2023-10-14T12:27:42.577 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2023-10-14T12:27:42.578 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 20 2023-10-14T12:27:42.578 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 20 2023-10-14T12:27:42.578 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-14T12:27:42.578 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2023-10-14T12:27:42.578 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 10 2023-10-14T12:27:42.579 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T12:27:42.579 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2023-10-14T12:27:42.579 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2023-10-14T12:27:42.579 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2023-10-14T12:27:42.579 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2023-10-14T12:27:42.580 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2023-10-14T12:27:42.580 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.580 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2023-10-14T12:27:42.580 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-14T12:27:42.580 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2023-10-14T12:27:42.580 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-10-14T12:27:42.581 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-10-14T12:27:42.581 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:27:42.581 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:27:42.581 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2023-10-14T12:27:42.581 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.582 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2023-10-14T12:27:42.582 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-14T12:27:42.582 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2023-10-14T12:27:42.582 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2023-10-14T12:27:42.582 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2023-10-14T12:27:42.583 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2023-10-14T12:27:42.583 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2023-10-14T12:27:42.583 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:27:42.583 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2023-10-14T12:27:42.583 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2023-10-14T12:27:42.583 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:27:42.584 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.584 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T12:27:42.584 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T12:27:42.584 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T12:27:42.584 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.585 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T12:27:42.585 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T12:27:42.585 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T12:27:42.585 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.585 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2023-10-14T12:27:42.586 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2023-10-14T12:27:42.586 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.586 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2023-10-14T12:27:42.586 INFO:teuthology.orchestra.run.smithi177.stdout: mon op complaint time = 120 2023-10-14T12:27:42.586 INFO:teuthology.orchestra.run.smithi177.stdout: 2023-10-14T12:27:42.586 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2023-10-14T12:27:42.587 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2023-10-14T12:27:42.587 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2023-10-14T12:27:42.587 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2023-10-14T12:27:42.587 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T12:27:42.588 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T12:27:42.588 INFO:teuthology.orchestra.run.smithi177.stdout: client mount timeout = 600 2023-10-14T12:27:42.588 INFO:teuthology.orchestra.run.smithi177.stdout: debug client = 20 2023-10-14T12:27:42.588 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-14T12:27:42.588 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = "" 2023-10-14T12:27:42.589 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2023-10-14T12:27:42.589 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2023-10-14T12:27:42.589 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2023-10-14T12:27:42.589 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.b] 2023-10-14T12:27:42.589 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.c] 2023-10-14T12:27:42.590 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-10-14T12:27:42.590 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-10-14T12:27:42.590 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-10-14T12:27:42.590 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-10-14T12:27:42.590 INFO:teuthology.orchestra.run.smithi177.stdout:[mds] 2023-10-14T12:27:42.591 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds = 20 2023-10-14T12:27:42.591 INFO:teuthology.orchestra.run.smithi177.stdout: debug mds balancer = 20 2023-10-14T12:27:42.591 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2023-10-14T12:27:42.591 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug frag = True 2023-10-14T12:27:42.591 INFO:teuthology.orchestra.run.smithi177.stdout: mds debug scatterstat = True 2023-10-14T12:27:42.592 INFO:teuthology.orchestra.run.smithi177.stdout: mds op complaint time = 180 2023-10-14T12:27:42.592 INFO:teuthology.orchestra.run.smithi177.stdout: mds verify scatter = True 2023-10-14T12:27:42.592 INFO:teuthology.orchestra.run.smithi177.stdout: osd op complaint time = 180 2023-10-14T12:27:42.592 INFO:teuthology.orchestra.run.smithi177.stdout: rados mon op timeout = 900 2023-10-14T12:27:42.592 INFO:teuthology.orchestra.run.smithi177.stdout: rados osd op timeout = 900 2023-10-14T12:27:42.593 INFO:teuthology.orchestra.run.smithi064.stdout:[global] 2023-10-14T12:27:42.593 INFO:teuthology.orchestra.run.smithi064.stdout: chdir = "" 2023-10-14T12:27:42.593 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-14T12:27:42.593 INFO:teuthology.orchestra.run.smithi064.stdout: auth supported = cephx 2023-10-14T12:27:42.594 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.594 INFO:teuthology.orchestra.run.smithi064.stdout: filestore xattr use omap = true 2023-10-14T12:27:42.594 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.594 INFO:teuthology.orchestra.run.smithi064.stdout: mon clock drift allowed = 1.000 2023-10-14T12:27:42.594 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.595 INFO:teuthology.orchestra.run.smithi064.stdout: osd crush chooseleaf type = 0 2023-10-14T12:27:42.595 INFO:teuthology.orchestra.run.smithi064.stdout: auth debug = true 2023-10-14T12:27:42.595 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.595 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on old message = true 2023-10-14T12:27:42.595 INFO:teuthology.orchestra.run.smithi064.stdout: ms die on bug = true 2023-10-14T12:27:42.596 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.596 INFO:teuthology.orchestra.run.smithi064.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-14T12:27:42.596 INFO:teuthology.orchestra.run.smithi064.stdout: mon pg warn max object skew = 0 2023-10-14T12:27:42.596 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.596 INFO:teuthology.orchestra.run.smithi064.stdout: # disable pg_autoscaler by default for new pools 2023-10-14T12:27:42.597 INFO:teuthology.orchestra.run.smithi064.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-14T12:27:42.597 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.597 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default size = 2 2023-10-14T12:27:42.597 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.597 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow primary affinity = true 2023-10-14T12:27:42.598 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd allow pg remap = true 2023-10-14T12:27:42.598 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on legacy crush tunables = false 2023-10-14T12:27:42.598 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on crush straw calc version zero = false 2023-10-14T12:27:42.598 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on no sortbitwise = false 2023-10-14T12:27:42.599 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on osd down out interval zero = false 2023-10-14T12:27:42.599 INFO:teuthology.orchestra.run.smithi064.stdout: mon warn on too few osds = false 2023-10-14T12:27:42.599 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-14T12:27:42.599 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-14T12:27:42.599 INFO:teuthology.orchestra.run.smithi064.stdout: mon_allow_pool_size_one = true 2023-10-14T12:27:42.600 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.600 INFO:teuthology.orchestra.run.smithi064.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-14T12:27:42.600 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.600 INFO:teuthology.orchestra.run.smithi064.stdout: osd default data pool replay window = 5 2023-10-14T12:27:42.600 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.601 INFO:teuthology.orchestra.run.smithi064.stdout: mon allow pool delete = true 2023-10-14T12:27:42.601 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.601 INFO:teuthology.orchestra.run.smithi064.stdout: mon cluster log file level = debug 2023-10-14T12:27:42.601 INFO:teuthology.orchestra.run.smithi064.stdout: debug asserts on shutdown = true 2023-10-14T12:27:42.601 INFO:teuthology.orchestra.run.smithi064.stdout: mon health detail to clog = false 2023-10-14T12:27:42.601 INFO:teuthology.orchestra.run.smithi064.stdout: mon host = "172.21.15.64,172.21.15.177,[v2:172.21.15.177:3301,v1:172.21.15.177:6790]" 2023-10-14T12:27:42.602 INFO:teuthology.orchestra.run.smithi064.stdout: fsid = 0b341ded-8bb8-4993-857a-677cfc30784b 2023-10-14T12:27:42.602 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.602 INFO:teuthology.orchestra.run.smithi064.stdout:[osd] 2023-10-14T12:27:42.602 INFO:teuthology.orchestra.run.smithi064.stdout: osd journal size = 100 2023-10-14T12:27:42.603 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.603 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub load threshold = 5.0 2023-10-14T12:27:42.603 INFO:teuthology.orchestra.run.smithi064.stdout: osd scrub max interval = 600 2023-10-14T12:27:42.605 INFO:teuthology.orchestra.run.smithi064.stdout: osd mclock profile = high_recovery_ops 2023-10-14T12:27:42.605 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.606 INFO:teuthology.orchestra.run.smithi064.stdout: osd recover clone overlap = true 2023-10-14T12:27:42.606 INFO:teuthology.orchestra.run.smithi064.stdout: osd recovery max chunk = 1048576 2023-10-14T12:27:42.606 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.606 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug shutdown = true 2023-10-14T12:27:42.606 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug op order = true 2023-10-14T12:27:42.607 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug verify stray on activate = true 2023-10-14T12:27:42.607 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.607 INFO:teuthology.orchestra.run.smithi064.stdout: osd open classes on start = true 2023-10-14T12:27:42.607 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug pg log writeout = true 2023-10-14T12:27:42.607 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.608 INFO:teuthology.orchestra.run.smithi064.stdout: osd deep scrub update digest min age = 30 2023-10-14T12:27:42.608 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.608 INFO:teuthology.orchestra.run.smithi064.stdout: osd map max advance = 10 2023-10-14T12:27:42.608 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.608 INFO:teuthology.orchestra.run.smithi064.stdout: journal zero on create = true 2023-10-14T12:27:42.609 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.609 INFO:teuthology.orchestra.run.smithi064.stdout: filestore ondisk finisher threads = 3 2023-10-14T12:27:42.609 INFO:teuthology.orchestra.run.smithi064.stdout: filestore apply finisher threads = 3 2023-10-14T12:27:42.609 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.609 INFO:teuthology.orchestra.run.smithi064.stdout: bdev debug aio = true 2023-10-14T12:27:42.610 INFO:teuthology.orchestra.run.smithi064.stdout: osd debug misdirected ops = true 2023-10-14T12:27:42.610 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore block size = 96636764160 2023-10-14T12:27:42.610 INFO:teuthology.orchestra.run.smithi064.stdout: bluestore fsck on mount = True 2023-10-14T12:27:42.610 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluefs = 20 2023-10-14T12:27:42.610 INFO:teuthology.orchestra.run.smithi064.stdout: debug bluestore = 20 2023-10-14T12:27:42.611 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-10-14T12:27:42.611 INFO:teuthology.orchestra.run.smithi064.stdout: debug osd = 20 2023-10-14T12:27:42.611 INFO:teuthology.orchestra.run.smithi064.stdout: debug rocksdb = 10 2023-10-14T12:27:42.611 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd backfillfull_ratio = 0.85 2023-10-14T12:27:42.611 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd full ratio = 0.9 2023-10-14T12:27:42.611 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd nearfull ratio = 0.8 2023-10-14T12:27:42.612 INFO:teuthology.orchestra.run.smithi064.stdout: osd failsafe full ratio = 0.95 2023-10-14T12:27:42.612 INFO:teuthology.orchestra.run.smithi064.stdout: osd objectstore = bluestore 2023-10-14T12:27:42.612 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2023-10-14T12:27:42.612 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.612 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr] 2023-10-14T12:27:42.613 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-10-14T12:27:42.613 INFO:teuthology.orchestra.run.smithi064.stdout: debug mgr = 20 2023-10-14T12:27:42.613 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2023-10-14T12:27:42.613 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2023-10-14T12:27:42.613 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:27:42.614 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:27:42.614 INFO:teuthology.orchestra.run.smithi064.stdout: mgr/telemetry/nag = false 2023-10-14T12:27:42.614 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.615 INFO:teuthology.orchestra.run.smithi064.stdout:[mon] 2023-10-14T12:27:42.615 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-10-14T12:27:42.615 INFO:teuthology.orchestra.run.smithi064.stdout: debug mon = 20 2023-10-14T12:27:42.615 INFO:teuthology.orchestra.run.smithi064.stdout: debug paxos = 20 2023-10-14T12:27:42.615 INFO:teuthology.orchestra.run.smithi064.stdout: debug auth = 20 2023-10-14T12:27:42.616 INFO:teuthology.orchestra.run.smithi064.stdout: mon data avail warn = 5 2023-10-14T12:27:42.616 INFO:teuthology.orchestra.run.smithi064.stdout: mon mgr mkfs grace = 240 2023-10-14T12:27:42.616 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min pgs per osd = 4 2023-10-14T12:27:42.616 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd reporter subtree level = osd 2023-10-14T12:27:42.616 INFO:teuthology.orchestra.run.smithi064.stdout: mon osd prime pg temp = true 2023-10-14T12:27:42.617 INFO:teuthology.orchestra.run.smithi064.stdout: mon reweight min bytes per osd = 10 2023-10-14T12:27:42.617 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.617 INFO:teuthology.orchestra.run.smithi064.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-14T12:27:42.617 INFO:teuthology.orchestra.run.smithi064.stdout: auth mon ticket ttl = 660 # 11m 2023-10-14T12:27:42.617 INFO:teuthology.orchestra.run.smithi064.stdout: auth service ticket ttl = 240 # 4m 2023-10-14T12:27:42.617 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.618 INFO:teuthology.orchestra.run.smithi064.stdout: # don't complain about insecure global_id in the test suite 2023-10-14T12:27:42.618 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-14T12:27:42.618 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-14T12:27:42.618 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.618 INFO:teuthology.orchestra.run.smithi064.stdout: # 1m isn't quite enough 2023-10-14T12:27:42.619 INFO:teuthology.orchestra.run.smithi064.stdout: mon_down_mkfs_grace = 2m 2023-10-14T12:27:42.619 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.619 INFO:teuthology.orchestra.run.smithi064.stdout: mon_warn_on_filestore_osds = false 2023-10-14T12:27:42.619 INFO:teuthology.orchestra.run.smithi064.stdout: mon op complaint time = 120 2023-10-14T12:27:42.619 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:27:42.619 INFO:teuthology.orchestra.run.smithi064.stdout:[client] 2023-10-14T12:27:42.620 INFO:teuthology.orchestra.run.smithi064.stdout: rgw cache enabled = true 2023-10-14T12:27:42.620 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable ops log = true 2023-10-14T12:27:42.620 INFO:teuthology.orchestra.run.smithi064.stdout: rgw enable usage log = true 2023-10-14T12:27:42.620 INFO:teuthology.orchestra.run.smithi064.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-14T12:27:42.620 INFO:teuthology.orchestra.run.smithi064.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-14T12:27:42.621 INFO:teuthology.orchestra.run.smithi064.stdout: client mount timeout = 600 2023-10-14T12:27:42.621 INFO:teuthology.orchestra.run.smithi064.stdout: debug client = 20 2023-10-14T12:27:42.621 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-10-14T12:27:42.621 INFO:teuthology.orchestra.run.smithi064.stdout: pid file = "" 2023-10-14T12:27:42.621 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2023-10-14T12:27:42.622 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2023-10-14T12:27:42.622 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.a] 2023-10-14T12:27:42.622 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.b] 2023-10-14T12:27:42.622 INFO:teuthology.orchestra.run.smithi064.stdout:[mon.c] 2023-10-14T12:27:42.622 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2023-10-14T12:27:42.622 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2023-10-14T12:27:42.623 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2023-10-14T12:27:42.623 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2023-10-14T12:27:42.623 INFO:teuthology.orchestra.run.smithi064.stdout:[mds] 2023-10-14T12:27:42.623 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds = 20 2023-10-14T12:27:42.623 INFO:teuthology.orchestra.run.smithi064.stdout: debug mds balancer = 20 2023-10-14T12:27:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: debug ms = 1 2023-10-14T12:27:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug frag = True 2023-10-14T12:27:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: mds debug scatterstat = True 2023-10-14T12:27:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: mds op complaint time = 180 2023-10-14T12:27:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: mds verify scatter = True 2023-10-14T12:27:42.624 INFO:teuthology.orchestra.run.smithi064.stdout: osd op complaint time = 180 2023-10-14T12:27:42.625 INFO:teuthology.orchestra.run.smithi064.stdout: rados mon op timeout = 900 2023-10-14T12:27:42.625 INFO:teuthology.orchestra.run.smithi064.stdout: rados osd op timeout = 900 2023-10-14T12:27:42.627 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-14T12:27:42.627 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-14T12:27:42.787 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-14T12:27:42.788 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:42.788 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-14T12:27:42.843 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:42.844 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-14T12:27:42.903 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:27:42.903 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:42.904 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T12:27:42.904 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:27:43.062 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:27:43.063 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:27:43.165 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:27:43.165 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:43.166 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-14T12:27:43.166 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-14T12:27:43.306 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:27:43.307 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:27:43.399 INFO:tasks.ceph:Setting up mon nodes... 2023-10-14T12:27:43.399 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-14T12:27:43.400 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T12:27:43.607 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-14T12:27:43.618 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T12:27:43.797 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-14T12:27:43.805 INFO:tasks.ceph:Setting up mds nodes... 2023-10-14T12:27:43.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T12:27:44.009 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-14T12:27:44.018 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-14T12:27:44.126 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T12:27:44.329 INFO:teuthology.orchestra.run.smithi064.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-14T12:27:44.339 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-14T12:27:44.436 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T12:27:44.619 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-14T12:27:44.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-14T12:27:44.711 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T12:27:44.869 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-14T12:27:44.877 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-14T12:27:44.967 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-14T12:27:44.968 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-14T12:27:45.106 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-14T12:27:45.168 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-14T12:27:45.306 INFO:teuthology.orchestra.run.smithi064.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-14T12:27:45.366 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-14T12:27:45.501 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-14T12:27:45.594 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-14T12:27:45.738 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-14T12:27:45.799 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-14T12:27:45.800 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi064.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-14T12:27:45.800 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-14T12:27:45.928 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:27:45.929 INFO:tasks.ceph:role: osd.0 2023-10-14T12:27:45.929 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:27:45.930 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T12:27:46.047 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:27:46.047 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:27:46.047 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:27:46.047 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:27:46.048 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:27:46.048 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:27:46.048 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:27:46.048 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:27:46.048 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:27:46.049 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:27:46.569 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-10-14T12:27:46.576 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-10-14T12:27:46.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-14T12:27:46.779 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-14T12:27:46.897 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-14T12:27:46.999 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:27:46.999 INFO:tasks.ceph:role: osd.1 2023-10-14T12:27:47.000 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:27:47.000 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T12:27:47.107 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:27:47.107 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:27:47.108 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:27:47.108 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:27:47.108 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:27:47.108 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:27:47.108 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:27:47.109 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:27:47.109 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:27:47.109 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:27:47.596 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-10-14T12:27:47.603 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-10-14T12:27:47.604 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-14T12:27:47.764 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-14T12:27:47.873 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-14T12:27:47.971 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:27:47.971 INFO:tasks.ceph:role: osd.2 2023-10-14T12:27:47.971 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:27:47.972 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T12:27:48.080 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:27:48.081 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:27:48.081 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:27:48.081 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:27:48.081 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:27:48.081 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:27:48.082 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:27:48.082 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:27:48.082 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:27:48.082 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:27:48.602 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-10-14T12:27:48.609 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-10-14T12:27:48.609 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-14T12:27:48.817 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-14T12:27:48.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-14T12:27:49.037 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-14T12:27:49.038 INFO:tasks.ceph:role: osd.3 2023-10-14T12:27:49.038 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:27:49.039 DEBUG:teuthology.orchestra.run.smithi064:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T12:27:49.149 INFO:teuthology.orchestra.run.smithi064.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:27:49.149 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:27:49.149 INFO:teuthology.orchestra.run.smithi064.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:27:49.150 INFO:teuthology.orchestra.run.smithi064.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:27:49.150 INFO:teuthology.orchestra.run.smithi064.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:27:49.150 INFO:teuthology.orchestra.run.smithi064.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:27:49.150 INFO:teuthology.orchestra.run.smithi064.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:27:49.150 INFO:teuthology.orchestra.run.smithi064.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:27:49.151 INFO:teuthology.orchestra.run.smithi064.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:27:49.151 INFO:teuthology.orchestra.run.smithi064.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:27:49.641 INFO:teuthology.orchestra.run.smithi064.stdout:Discarding blocks...Done. 2023-10-14T12:27:49.647 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi064.front.sepia.ceph.com -o noatime 2023-10-14T12:27:49.647 DEBUG:teuthology.orchestra.run.smithi064:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-14T12:27:49.797 DEBUG:teuthology.orchestra.run.smithi064:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-14T12:27:49.898 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:27:50.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:50.076+0000 7fe3987bc500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-14T12:27:50.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:50.079+0000 7fe3987bc500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-14T12:27:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:50.079+0000 7fe3987bc500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:27:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:50.079+0000 7fe3987bc500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:27:50.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:50.079+0000 7fe3987bc500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-14T12:27:50.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:50.092+0000 7fe3987bc500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-14T12:27:53.265 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-14T12:27:53.370 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:27:53.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:53.521+0000 7f774ba0d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-14T12:27:53.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:53.521+0000 7f774ba0d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-14T12:27:53.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:53.521+0000 7f774ba0d500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:27:53.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:53.521+0000 7f774ba0d500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:27:53.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:53.521+0000 7f774ba0d500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-14T12:27:53.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:53.524+0000 7f774ba0d500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-14T12:27:56.697 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-14T12:27:56.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:27:56.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:56.942+0000 7f5a9dc0d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-14T12:27:56.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:56.942+0000 7f5a9dc0d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-14T12:27:56.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:56.942+0000 7f5a9dc0d500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:27:56.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:56.942+0000 7f5a9dc0d500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:27:56.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:56.942+0000 7f5a9dc0d500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-14T12:27:56.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:27:56.945+0000 7f5a9dc0d500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-14T12:27:59.876 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-14T12:27:59.981 DEBUG:teuthology.orchestra.run.smithi064:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:28:00.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:00.129+0000 7f503b6fa500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-14T12:28:00.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:00.130+0000 7f503b6fa500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-14T12:28:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:00.130+0000 7f503b6fa500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:28:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:00.130+0000 7f503b6fa500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:28:00.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:00.130+0000 7f503b6fa500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-14T12:28:00.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:00.132+0000 7f503b6fa500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-14T12:28:03.306 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-14T12:28:03.415 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-14T12:28:03.520 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:28:03.520 INFO:tasks.ceph:role: osd.4 2023-10-14T12:28:03.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:28:03.521 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-14T12:28:03.624 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:28:03.625 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:28:03.625 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:28:03.625 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:28:03.625 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:28:03.625 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:28:03.626 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:28:03.626 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:28:03.626 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:28:03.626 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:28:04.143 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-14T12:28:04.150 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-14T12:28:04.151 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-14T12:28:04.342 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-14T12:28:04.444 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-14T12:28:04.526 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:28:04.527 INFO:tasks.ceph:role: osd.5 2023-10-14T12:28:04.527 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:28:04.527 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-14T12:28:04.613 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:28:04.613 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:28:04.614 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:28:04.614 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:28:04.614 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:28:04.614 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:28:04.614 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:28:04.615 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:28:04.615 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:28:04.615 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:28:05.085 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-14T12:28:05.090 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-14T12:28:05.091 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-14T12:28:05.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-14T12:28:05.311 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-14T12:28:05.393 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:28:05.393 INFO:tasks.ceph:role: osd.6 2023-10-14T12:28:05.393 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:28:05.394 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-14T12:28:05.479 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:28:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:28:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:28:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:28:05.480 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:28:05.480 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:28:05.481 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:28:05.481 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:28:05.481 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:28:05.481 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:28:05.986 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-14T12:28:05.993 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-14T12:28:05.993 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-14T12:28:06.175 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-14T12:28:06.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-14T12:28:06.367 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-14T12:28:06.367 INFO:tasks.ceph:role: osd.7 2023-10-14T12:28:06.368 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:28:06.368 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-14T12:28:06.461 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-14T12:28:06.462 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-14T12:28:06.462 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-14T12:28:06.462 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-10-14T12:28:06.462 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-14T12:28:06.463 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2023-10-14T12:28:06.463 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-14T12:28:06.463 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-10-14T12:28:06.463 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-14T12:28:06.463 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-14T12:28:06.912 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2023-10-14T12:28:06.918 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2023-10-14T12:28:06.918 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-14T12:28:07.049 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-14T12:28:07.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:28:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:07.286+0000 7f985c81c500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-14T12:28:07.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:07.289+0000 7f985c81c500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-14T12:28:07.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:07.289+0000 7f985c81c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:28:07.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:07.289+0000 7f985c81c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:28:07.291 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:07.289+0000 7f985c81c500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-14T12:28:07.295 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:07.294+0000 7f985c81c500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-14T12:28:09.694 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:28:09.704 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:28:10.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-14T12:28:10.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:28:10.729 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:10.728+0000 7ff2c421f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-14T12:28:10.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:10.728+0000 7ff2c421f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-14T12:28:10.730 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:10.729+0000 7ff2c421f500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:28:10.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:10.729+0000 7ff2c421f500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:28:10.731 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:10.729+0000 7ff2c421f500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-14T12:28:10.732 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:10.731+0000 7ff2c421f500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-14T12:28:13.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-14T12:28:14.008 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:28:14.144 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:14.144+0000 7f17891fe500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-14T12:28:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:14.144+0000 7f17891fe500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-14T12:28:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:14.144+0000 7f17891fe500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:28:14.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:14.144+0000 7f17891fe500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:28:14.146 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:14.144+0000 7f17891fe500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-14T12:28:14.147 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:14.147+0000 7f17891fe500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-14T12:28:17.331 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-14T12:28:17.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:28:17.560 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:17.560+0000 7ff916416500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-14T12:28:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:17.560+0000 7ff916416500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-14T12:28:17.561 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:17.560+0000 7ff916416500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:28:17.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:17.560+0000 7ff916416500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:28:17.562 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:17.560+0000 7ff916416500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-14T12:28:17.563 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:17.562+0000 7ff916416500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-14T12:28:20.737 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-14T12:28:20.839 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-14T12:28:20.840 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:20.840 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-14T12:28:20.942 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:20.942 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-14T12:28:21.039 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:21.039 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-14T12:28:21.138 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:21.139 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-14T12:28:21.239 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:21.240 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-14T12:28:21.338 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:21.338 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-14T12:28:21.445 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:21.445 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-14T12:28:21.547 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:21.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-14T12:28:21.649 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:21.650 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-14T12:28:21.747 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:21.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-14T12:28:21.886 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:21.887 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-14T12:28:21.979 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:21.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-14T12:28:22.072 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:22.072 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-14T12:28:22.155 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:22.156 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-14T12:28:22.298 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:22.299 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-14T12:28:22.364 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:22.364 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-14T12:28:22.420 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:22.421 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-14T12:28:22.480 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:22.480 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-14T12:28:22.532 INFO:tasks.ceph:Adding keys to all mons... 2023-10-14T12:28:22.532 DEBUG:teuthology.orchestra.run.smithi064:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T12:28:22.539 DEBUG:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-14T12:28:22.631 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.y] 2023-10-14T12:28:22.631 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQA/iSpln7I0JBAAzQ/eOHXgfCe0k2C9dA5xzQ== 2023-10-14T12:28:22.632 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.a] 2023-10-14T12:28:22.632 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBAiSpliOyMABAA+prdm7RIH9jAU54jikqEXQ== 2023-10-14T12:28:22.632 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.c] 2023-10-14T12:28:22.632 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBAiSplzGGaExAAh4oGDyi8NKrwzxW/yC4UTQ== 2023-10-14T12:28:22.632 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2023-10-14T12:28:22.633 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBGiSplWe6ZBBAAZVQjc85I9bqh+oqATKTwEw== 2023-10-14T12:28:22.633 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2023-10-14T12:28:22.633 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBJiSplL+UVHxAAlLnWEF6td+5QxwDmIIlJIA== 2023-10-14T12:28:22.633 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2023-10-14T12:28:22.633 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBMiSplsy4uOBAA5LLEdrFSZ7Fn464jOjhIlw== 2023-10-14T12:28:22.634 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.3] 2023-10-14T12:28:22.634 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBQiSpl90TNBxAA3c2beAcsjbwkgoFPInzJLg== 2023-10-14T12:28:22.634 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2023-10-14T12:28:22.634 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQA/iSplCeuALxAALpyDfrHvy59BDVFExs09CQ== 2023-10-14T12:28:22.634 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.b] 2023-10-14T12:28:22.635 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBAiSplJJXkJBAAnW1BD8RTSmIHa5A3cKhc2g== 2023-10-14T12:28:22.635 INFO:teuthology.orchestra.run.smithi177.stdout:[mds.d] 2023-10-14T12:28:22.635 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBAiSplMk+2MxAAkPeAM/sIhjtsCAiYBkx0Zw== 2023-10-14T12:28:22.635 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.4] 2023-10-14T12:28:22.635 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBXiSpl9TciERAAExVwLzDDDKJSjKd/FPn3/A== 2023-10-14T12:28:22.636 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.5] 2023-10-14T12:28:22.636 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBaiSplzjt8KxAAPSyhbj8lpdvHwMq3mXdKrw== 2023-10-14T12:28:22.636 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.6] 2023-10-14T12:28:22.636 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBeiSplmgCeCBAAON7G20efkqN6XB5SUGq/wg== 2023-10-14T12:28:22.636 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.7] 2023-10-14T12:28:22.637 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBhiSpl0xBoIRAAFdn8eD5VbuMNkPGPABAeYQ== 2023-10-14T12:28:22.637 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2023-10-14T12:28:22.637 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBBiSplkVBXBhAA+eSaJH/y9hONFgFzhTnWKQ== 2023-10-14T12:28:22.637 INFO:teuthology.orchestra.run.smithi177.stdout:[client.2] 2023-10-14T12:28:22.637 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBBiSplJ9JDEhAAB0x7cWi/OxWVBcF4yJSvjQ== 2023-10-14T12:28:22.638 INFO:teuthology.orchestra.run.smithi177.stdout:[client.1] 2023-10-14T12:28:22.638 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBBiSpl7kPXHRAAir049pudwgcATViT7fjA3A== 2023-10-14T12:28:22.638 INFO:teuthology.orchestra.run.smithi177.stdout:[client.3] 2023-10-14T12:28:22.638 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQBBiSplRIACLBAA+KlMnLui3uhL7tmE35LDTQ== 2023-10-14T12:28:22.640 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.y] 2023-10-14T12:28:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQA/iSpln7I0JBAAzQ/eOHXgfCe0k2C9dA5xzQ== 2023-10-14T12:28:22.640 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.a] 2023-10-14T12:28:22.640 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBAiSpliOyMABAA+prdm7RIH9jAU54jikqEXQ== 2023-10-14T12:28:22.641 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.c] 2023-10-14T12:28:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBAiSplzGGaExAAh4oGDyi8NKrwzxW/yC4UTQ== 2023-10-14T12:28:22.641 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.0] 2023-10-14T12:28:22.641 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBGiSplWe6ZBBAAZVQjc85I9bqh+oqATKTwEw== 2023-10-14T12:28:22.641 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.1] 2023-10-14T12:28:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBJiSplL+UVHxAAlLnWEF6td+5QxwDmIIlJIA== 2023-10-14T12:28:22.642 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.2] 2023-10-14T12:28:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBMiSplsy4uOBAA5LLEdrFSZ7Fn464jOjhIlw== 2023-10-14T12:28:22.642 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.3] 2023-10-14T12:28:22.642 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBQiSpl90TNBxAA3c2beAcsjbwkgoFPInzJLg== 2023-10-14T12:28:22.643 INFO:teuthology.orchestra.run.smithi064.stdout:[mgr.x] 2023-10-14T12:28:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQA/iSplCeuALxAALpyDfrHvy59BDVFExs09CQ== 2023-10-14T12:28:22.643 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.b] 2023-10-14T12:28:22.643 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBAiSplJJXkJBAAnW1BD8RTSmIHa5A3cKhc2g== 2023-10-14T12:28:22.643 INFO:teuthology.orchestra.run.smithi064.stdout:[mds.d] 2023-10-14T12:28:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBAiSplMk+2MxAAkPeAM/sIhjtsCAiYBkx0Zw== 2023-10-14T12:28:22.644 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.4] 2023-10-14T12:28:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBXiSpl9TciERAAExVwLzDDDKJSjKd/FPn3/A== 2023-10-14T12:28:22.644 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.5] 2023-10-14T12:28:22.644 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBaiSplzjt8KxAAPSyhbj8lpdvHwMq3mXdKrw== 2023-10-14T12:28:22.645 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.6] 2023-10-14T12:28:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBeiSplmgCeCBAAON7G20efkqN6XB5SUGq/wg== 2023-10-14T12:28:22.645 INFO:teuthology.orchestra.run.smithi064.stdout:[osd.7] 2023-10-14T12:28:22.645 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBhiSpl0xBoIRAAFdn8eD5VbuMNkPGPABAeYQ== 2023-10-14T12:28:22.645 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2023-10-14T12:28:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBBiSplkVBXBhAA+eSaJH/y9hONFgFzhTnWKQ== 2023-10-14T12:28:22.646 INFO:teuthology.orchestra.run.smithi064.stdout:[client.2] 2023-10-14T12:28:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBBiSplJ9JDEhAAB0x7cWi/OxWVBcF4yJSvjQ== 2023-10-14T12:28:22.646 INFO:teuthology.orchestra.run.smithi064.stdout:[client.1] 2023-10-14T12:28:22.646 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBBiSpl7kPXHRAAir049pudwgcATViT7fjA3A== 2023-10-14T12:28:22.647 INFO:teuthology.orchestra.run.smithi064.stdout:[client.3] 2023-10-14T12:28:22.647 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBBiSplRIACLBAA+KlMnLui3uhL7tmE35LDTQ== 2023-10-14T12:28:22.648 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:28:22.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:28:22.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:22.814 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:22.960 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:22.966 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:23.119 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.124 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.271 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.430 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.437 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.584 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:23.735 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:28:23.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-14T12:28:23.893 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:23.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:24.048 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:24.053 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-14T12:28:24.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.210 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.366 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.511 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.520 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.676 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-14T12:28:24.820 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:24.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:24.980 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:24.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:25.131 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:25.137 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:25.284 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:25.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-14T12:28:25.440 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-14T12:28:25.440 DEBUG:teuthology.orchestra.run.smithi064:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-14T12:28:25.539 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:28:25.709 DEBUG:teuthology.orchestra.run.smithi064:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-14T12:28:25.808 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-14T12:28:25.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:28:26.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-14T12:28:26.151 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-14T12:28:26.251 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-14T12:28:26.407 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-14T12:28:26.486 DEBUG:teuthology.orchestra.run.smithi064:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:28:26.495 DEBUG:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-14T12:28:26.550 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-14T12:28:26.550 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-14T12:28:26.551 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-14T12:28:26.557 INFO:tasks.ceph.mon.a:Started 2023-10-14T12:28:26.557 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-14T12:28:26.557 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-14T12:28:26.563 INFO:tasks.ceph.mon.b:Started 2023-10-14T12:28:26.563 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-14T12:28:26.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-14T12:28:26.569 INFO:tasks.ceph.mon.c:Started 2023-10-14T12:28:26.569 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-14T12:28:26.570 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-14T12:28:26.570 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-14T12:28:26.576 INFO:tasks.ceph.mgr.y:Started 2023-10-14T12:28:26.576 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-14T12:28:26.576 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-14T12:28:26.581 INFO:tasks.ceph.mgr.x:Started 2023-10-14T12:28:26.582 INFO:tasks.ceph:Setting crush tunables to default 2023-10-14T12:28:26.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph osd crush tunables default 2023-10-14T12:28:26.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.760+0000 7f5c05883640 1 Processor -- start 2023-10-14T12:28:26.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.760+0000 7f5c05883640 1 -- start start 2023-10-14T12:28:26.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.761+0000 7f5c05883640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 0x7f5c000cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.761+0000 7f5c05883640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 0x7f5c000c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.761+0000 7f5c05883640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c000cf040 con 0x7f5c000ca550 2023-10-14T12:28:26.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.761+0000 7f5c05883640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000ca9e0 con 0x7f5c00070a30 2023-10-14T12:28:26.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.761+0000 7f5c05883640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c000ce430 con 0x7f5c0015a830 2023-10-14T12:28:26.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfeffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 0x7f5c000cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:26.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bff7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 0x7f5c000c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:26.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfeffd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 0x7f5c000cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:51986/0 (socket says 172.21.15.64:51986) 2023-10-14T12:28:26.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfeffd640 1 -- 172.21.15.64:0/2982836205 learned_addr learned my addr 172.21.15.64:0/2982836205 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:26.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfe7fc640 1 --1- 172.21.15.64:0/2982836205 >> v1:172.21.15.177:6789/0 conn(0x7f5c000ca550 0x7f5c00070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:33606/0 (socket says 172.21.15.64:33606) 2023-10-14T12:28:26.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfeffd640 1 -- 172.21.15.64:0/2982836205 >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 msgr2=0x7f5c000cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-14T12:28:26.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfeffd640 1 -- 172.21.15.64:0/2982836205 >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 msgr2=0x7f5c000cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:28:26.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfeffd640 1 --2- 172.21.15.64:0/2982836205 >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 0x7f5c000cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:28:26.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bff7fe640 1 -- 172.21.15.64:0/2982836205 >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 msgr2=0x7f5c000c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-10-14T12:28:26.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bff7fe640 1 -- 172.21.15.64:0/2982836205 >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 msgr2=0x7f5c000c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-14T12:28:26.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bff7fe640 1 --2- 172.21.15.64:0/2982836205 >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 0x7f5c000c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-10-14T12:28:26.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bff7fe640 1 --2- 172.21.15.64:0/2982836205 >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 0x7f5c000c8b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:28:26.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.762+0000 7f5bfeffd640 1 --2- 172.21.15.64:0/2982836205 >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 0x7f5c000cb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-14T12:28:26.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.781+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2380304829 0 0) 0x7f5c000cf040 con 0x7f5c000ca550 2023-10-14T12:28:26.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.781+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be4003520 con 0x7f5c000ca550 2023-10-14T12:28:26.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3623634614 0 0) 0x7f5be4003520 con 0x7f5c000ca550 2023-10-14T12:28:26.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 msgr2=0x7f5c000cb640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:28:26.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 --2- 172.21.15.64:0/2982836205 >> v2:172.21.15.177:3300/0 conn(0x7f5c0015a830 0x7f5c000cb640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 msgr2=0x7f5c000c8b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:28:26.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 --2- 172.21.15.64:0/2982836205 >> v2:172.21.15.64:3300/0 conn(0x7f5c00070a30 0x7f5c000c8b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000ce710 con 0x7f5c000ca550 2023-10-14T12:28:26.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f5bec001670 con 0x7f5c000ca550 2023-10-14T12:28:26.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 >> v1:172.21.15.177:6789/0 conn(0x7f5c000ca550 legacy=0x7f5c00070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:26.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.786+0000 7f5bfdffb640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5be40039c0 0x7f5be4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfdffb640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5be4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfdffb640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5be4005180 0x7f5be400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000ca9e0 con 0x7f5be40047c0 2023-10-14T12:28:26.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000ce430 con 0x7f5be4005180 2023-10-14T12:28:26.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be400c0d0 con 0x7f5be40039c0 2023-10-14T12:28:26.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfe7fc640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5be4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:26.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bff7fe640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5be4005180 0x7f5be400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:26.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfe7fc640 1 -- 172.21.15.64:0/2982836205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5be40039c0 msgr2=0x7f5be4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:26.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfe7fc640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5be40039c0 0x7f5be4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfe7fc640 1 -- 172.21.15.64:0/2982836205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5be4005180 msgr2=0x7f5be400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:26.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfe7fc640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5be4005180 0x7f5be400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bfe7fc640 1 -- 172.21.15.64:0/2982836205 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be4003520 con 0x7f5be40047c0 2023-10-14T12:28:26.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.787+0000 7f5bff7fe640 1 -- 172.21.15.64:0/2982836205 reap_dead start 2023-10-14T12:28:26.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.789+0000 7f5bfe7fc640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5be4004c40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5bec007f50 tx=0x7f5be40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3566d3c711538a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:26.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.790+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec007270 con 0x7f5be40047c0 2023-10-14T12:28:26.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.790+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec0073d0 con 0x7f5be40047c0 2023-10-14T12:28:26.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.790+0000 7f5bfdffb640 1 -- 172.21.15.64:0/2982836205 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec005810 con 0x7f5be40047c0 2023-10-14T12:28:26.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.791+0000 7f5c05883640 1 -- 172.21.15.64:0/2982836205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 msgr2=0x7f5be4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:26.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.791+0000 7f5c05883640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5be4004c40 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f5bec007f50 tx=0x7f5be40057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.791+0000 7f5c05883640 1 -- 172.21.15.64:0/2982836205 shutdown_connections 2023-10-14T12:28:26.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.791+0000 7f5c05883640 1 --2- 172.21.15.64:0/2982836205 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5be4004c40 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.791+0000 7f5c05883640 1 -- 172.21.15.64:0/2982836205 >> 172.21.15.64:0/2982836205 conn(0x7f5c000b0030 msgr2=0x7f5c000b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:26.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.791+0000 7f5c05883640 1 -- 172.21.15.64:0/2982836205 shutdown_connections 2023-10-14T12:28:26.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.791+0000 7f5c05883640 1 -- 172.21.15.64:0/2982836205 wait complete. 2023-10-14T12:28:26.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.793+0000 7f5c05883640 1 Processor -- start 2023-10-14T12:28:26.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.793+0000 7f5c05883640 1 -- start start 2023-10-14T12:28:26.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5c05883640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5c000c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5c05883640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c0014da00 0x7f5c000a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5c05883640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c000a82a0 0x7f5c0014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:26.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5c05883640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000c9090 con 0x7f5be40047c0 2023-10-14T12:28:26.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5c05883640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0014de80 con 0x7f5c000a82a0 2023-10-14T12:28:26.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5c05883640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000c8480 con 0x7f5c0014da00 2023-10-14T12:28:26.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5bfeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5c000c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:26.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5bfe7fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c0014da00 0x7f5c000a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:26.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5bff7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c000a82a0 0x7f5c0014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:26.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5bfeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5c000c9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54788/0 (socket says 172.21.15.64:54788) 2023-10-14T12:28:26.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5bfeffd640 1 -- 172.21.15.64:0/3150829278 learned_addr learned my addr 172.21.15.64:0/3150829278 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:26.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.795+0000 7f5bfe7fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c0014da00 0x7f5c000a7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:36742/0 (socket says 172.21.15.64:36742) 2023-10-14T12:28:26.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.796+0000 7f5bff7fe640 1 -- 172.21.15.64:0/3150829278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c0014da00 msgr2=0x7f5c000a7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:26.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.796+0000 7f5bff7fe640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c0014da00 0x7f5c000a7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.796+0000 7f5bff7fe640 1 -- 172.21.15.64:0/3150829278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 msgr2=0x7f5c000c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:26.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.796+0000 7f5bff7fe640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5c000c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.796+0000 7f5bff7fe640 1 -- 172.21.15.64:0/3150829278 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c000c8760 con 0x7f5c000a82a0 2023-10-14T12:28:26.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.796+0000 7f5bfeffd640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5c000c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:26.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.796+0000 7f5bff7fe640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c000a82a0 0x7f5c0014e1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5c000cf5d0 tx=0x7f5bf800f520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:26.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.799+0000 7f5bf7fff640 1 -- 172.21.15.64:0/3150829278 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8009a90 con 0x7f5c000a82a0 2023-10-14T12:28:26.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.799+0000 7f5bf7fff640 1 -- 172.21.15.64:0/3150829278 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf8009bf0 con 0x7f5c000a82a0 2023-10-14T12:28:26.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.799+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c000c8a40 con 0x7f5c000a82a0 2023-10-14T12:28:26.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.799+0000 7f5bf7fff640 1 -- 172.21.15.64:0/3150829278 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf8003990 con 0x7f5c000a82a0 2023-10-14T12:28:26.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.799+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c000c80a0 con 0x7f5c000a82a0 2023-10-14T12:28:26.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.799+0000 7f5bf7fff640 1 -- 172.21.15.64:0/3150829278 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5bf8003af0 con 0x7f5c000a82a0 2023-10-14T12:28:26.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.799+0000 7f5bf7fff640 1 -- 172.21.15.64:0/3150829278 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5bf800a030 con 0x7f5c000a82a0 2023-10-14T12:28:26.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.800+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c000c8230 con 0x7f5c000a82a0 2023-10-14T12:28:26.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.805+0000 7f5bf7fff640 1 -- 172.21.15.64:0/3150829278 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f5bf801a070 con 0x7f5c000a82a0 2023-10-14T12:28:26.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.877+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f5c000b2e60 con 0x7f5c000a82a0 2023-10-14T12:28:26.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.886+0000 7f5bf7fff640 1 -- 172.21.15.64:0/3150829278 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f5bf8004000 con 0x7f5c000a82a0 2023-10-14T12:28:26.888 INFO:teuthology.orchestra.run.smithi064.stderr:adjusted tunables profile to default 2023-10-14T12:28:26.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c000a82a0 msgr2=0x7f5c0014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:26.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c000a82a0 0x7f5c0014e1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5c000cf5d0 tx=0x7f5bf800f520 comp rx=0 tx=0).stop 2023-10-14T12:28:26.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 shutdown_connections 2023-10-14T12:28:26.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5c000a82a0 0x7f5c0014e1b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5c0014da00 0x7f5c000a7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 --2- 172.21.15.64:0/3150829278 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5be40047c0 0x7f5c000c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:26.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 >> 172.21.15.64:0/3150829278 conn(0x7f5c000b0030 msgr2=0x7f5c000b31d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:26.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 shutdown_connections 2023-10-14T12:28:26.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:26.888+0000 7f5c05883640 1 -- 172.21.15.64:0/3150829278 wait complete. 2023-10-14T12:28:26.908 INFO:tasks.ceph:check_enable_crimson: False 2023-10-14T12:28:26.908 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-14T12:28:26.908 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:26.909 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-14T12:28:26.988 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:26.988 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-14T12:28:27.123 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:27.124 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-14T12:28:27.265 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:27.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-14T12:28:27.354 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:27.352+0000 7f3518611040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T12:28:27.363 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:27.363 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-14T12:28:27.416 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:27.415+0000 7f3518611040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T12:28:27.453 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:27.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-14T12:28:27.509 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:27.507+0000 7f279ecb6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-14T12:28:27.538 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:27.538 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-14T12:28:27.574 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:27.573+0000 7f279ecb6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-14T12:28:27.667 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:28:27.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-14T12:28:27.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new c82488e5-1d5c-4614-b20e-f82d06bdf4c3 0 2023-10-14T12:28:27.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.983+0000 7fed7916a640 1 Processor -- start 2023-10-14T12:28:27.985 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.983+0000 7fed7916a640 1 -- start start 2023-10-14T12:28:27.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed7916a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7415c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:27.987 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed7916a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fed74160da0 0x7fed7415ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:27.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed7916a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed740ce4c0 con 0x7fed741609c0 2023-10-14T12:28:27.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed7916a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740cd8b0 con 0x7fed74160da0 2023-10-14T12:28:27.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed7916a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740cdb90 con 0x7fed740d17e0 2023-10-14T12:28:27.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:27.988 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7415c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:35410/0 (socket says 172.21.15.177:35410) 2023-10-14T12:28:27.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.985+0000 7fed6bfff640 1 -- 172.21.15.177:0/2725702457 learned_addr learned my addr 172.21.15.177:0/2725702457 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:27.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.986+0000 7fed78969640 1 --2- 172.21.15.177:0/2725702457 >> v2:172.21.15.64:3300/0 conn(0x7fed74160da0 0x7fed7415ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:27.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.986+0000 7fed6bfff640 1 -- 172.21.15.177:0/2725702457 >> v2:172.21.15.64:3300/0 conn(0x7fed74160da0 msgr2=0x7fed7415ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:27.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.986+0000 7fed6bfff640 1 --2- 172.21.15.177:0/2725702457 >> v2:172.21.15.64:3300/0 conn(0x7fed74160da0 0x7fed7415ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:27.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.986+0000 7fed6bfff640 1 -- 172.21.15.177:0/2725702457 >> v1:172.21.15.64:6789/0 conn(0x7fed741609c0 legacy=0x7fed740d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:27.989 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.986+0000 7fed6bfff640 1 -- 172.21.15.177:0/2725702457 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740cde70 con 0x7fed740d17e0 2023-10-14T12:28:27.990 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.986+0000 7fed78969640 1 --2- 172.21.15.177:0/2725702457 >> v2:172.21.15.64:3300/0 conn(0x7fed74160da0 0x7fed7415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:27.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.987+0000 7fed6bfff640 1 --2- 172.21.15.177:0/2725702457 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7415c530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009870 tx=0x7fed5c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=107b4d36dc27c975 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:27.991 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.987+0000 7fed737fe640 1 -- 172.21.15.177:0/2725702457 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c031640 con 0x7fed740d17e0 2023-10-14T12:28:27.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.987+0000 7fed737fe640 1 -- 172.21.15.177:0/2725702457 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0317a0 con 0x7fed740d17e0 2023-10-14T12:28:27.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.987+0000 7fed737fe640 1 -- 172.21.15.177:0/2725702457 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c031b30 con 0x7fed740d17e0 2023-10-14T12:28:27.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 -- 172.21.15.177:0/2725702457 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 msgr2=0x7fed7415c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:27.992 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 --2- 172.21.15.177:0/2725702457 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7415c530 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fed5c009870 tx=0x7fed5c02b8f0 comp rx=0 tx=0).stop 2023-10-14T12:28:27.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 -- 172.21.15.177:0/2725702457 shutdown_connections 2023-10-14T12:28:27.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 --2- 172.21.15.177:0/2725702457 >> v2:172.21.15.64:3300/0 conn(0x7fed74160da0 0x7fed7415ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:27.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 --2- 172.21.15.177:0/2725702457 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7415c530 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:27.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 -- 172.21.15.177:0/2725702457 >> 172.21.15.177:0/2725702457 conn(0x7fed7409bbf0 msgr2=0x7fed740d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:27.993 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 -- 172.21.15.177:0/2725702457 shutdown_connections 2023-10-14T12:28:27.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.988+0000 7fed7916a640 1 -- 172.21.15.177:0/2725702457 wait complete. 2023-10-14T12:28:27.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.990+0000 7fed7916a640 1 Processor -- start 2023-10-14T12:28:27.994 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.990+0000 7fed7916a640 1 -- start start 2023-10-14T12:28:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed7916a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7409e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:27.996 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed7916a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed741609c0 0x7fed7409cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:27.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed7916a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed74160da0 0x7fed740c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:27.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed7916a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed740c8a80 con 0x7fed74160da0 2023-10-14T12:28:27.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed7916a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7409d400 con 0x7fed741609c0 2023-10-14T12:28:27.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed7916a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7409d6e0 con 0x7fed740d17e0 2023-10-14T12:28:27.997 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed73fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7409e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:27.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed741609c0 0x7fed7409cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:27.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed73fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7409e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:35426/0 (socket says 172.21.15.177:35426) 2023-10-14T12:28:27.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed73fff640 1 -- 172.21.15.177:0/3641658947 learned_addr learned my addr 172.21.15.177:0/3641658947 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:27.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed6bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed741609c0 0x7fed7409cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44584/0 (socket says 172.21.15.177:44584) 2023-10-14T12:28:27.998 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.991+0000 7fed78969640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed74160da0 0x7fed740c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed73fff640 1 -- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed741609c0 msgr2=0x7fed7409cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed73fff640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed741609c0 0x7fed7409cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed73fff640 1 -- 172.21.15.177:0/3641658947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed74160da0 msgr2=0x7fed740c8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed73fff640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed74160da0 0x7fed740c8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:27.999 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed73fff640 1 -- 172.21.15.177:0/3641658947 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c0094d0 con 0x7fed740d17e0 2023-10-14T12:28:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed6bfff640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed741609c0 0x7fed7409cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed73fff640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7409e4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed6400c400 tx=0x7fed6400c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed717fa640 1 -- 172.21.15.177:0/3641658947 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed640054e0 con 0x7fed740d17e0 2023-10-14T12:28:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed717fa640 1 -- 172.21.15.177:0/3641658947 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed64003640 con 0x7fed740d17e0 2023-10-14T12:28:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed717fa640 1 -- 172.21.15.177:0/3641658947 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed640039f0 con 0x7fed740d17e0 2023-10-14T12:28:28.000 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed7409d9c0 con 0x7fed740d17e0 2023-10-14T12:28:28.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.992+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed7409df80 con 0x7fed740d17e0 2023-10-14T12:28:28.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.993+0000 7fed717fa640 1 -- 172.21.15.177:0/3641658947 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fed64007020 con 0x7fed740d17e0 2023-10-14T12:28:28.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.993+0000 7fed717fa640 1 -- 172.21.15.177:0/3641658947 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fed64006c10 con 0x7fed740d17e0 2023-10-14T12:28:28.001 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.994+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed740ce930 con 0x7fed740d17e0 2023-10-14T12:28:28.002 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:27.996+0000 7fed717fa640 1 -- 172.21.15.177:0/3641658947 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fed740ce930 con 0x7fed740d17e0 2023-10-14T12:28:28.048 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.047+0000 7f3518611040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T12:28:28.076 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.075+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c82488e5-1d5c-4614-b20e-f82d06bdf4c3", "id": 0} v 0) v1 -- 0x7fed740ce100 con 0x7fed740d17e0 2023-10-14T12:28:28.085 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.083+0000 7fed717fa640 1 -- 172.21.15.177:0/3641658947 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c82488e5-1d5c-4614-b20e-f82d06bdf4c3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fed64017070 con 0x7fed740d17e0 2023-10-14T12:28:28.085 INFO:teuthology.orchestra.run.smithi177.stdout:0 2023-10-14T12:28:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 msgr2=0x7fed7409e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7409e4a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fed6400c400 tx=0x7fed6400c8c0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 shutdown_connections 2023-10-14T12:28:28.087 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fed74160da0 0x7fed740c8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fed741609c0 0x7fed7409cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 --2- 172.21.15.177:0/3641658947 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fed740d17e0 0x7fed7409e4a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 >> 172.21.15.177:0/3641658947 conn(0x7fed7409bbf0 msgr2=0x7fed7406b060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 shutdown_connections 2023-10-14T12:28:28.088 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.085+0000 7fed7916a640 1 -- 172.21.15.177:0/3641658947 wait complete. 2023-10-14T12:28:28.104 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new cb294d40-4734-4fb9-90b3-983fd221c324 1 2023-10-14T12:28:28.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.112+0000 7f3518611040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T12:28:28.168 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.166+0000 7f3518611040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T12:28:28.212 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.210+0000 7f279ecb6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-14T12:28:28.233 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.231+0000 7f3518611040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T12:28:28.276 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.274+0000 7f279ecb6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-14T12:28:28.285 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.283+0000 7f3518611040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T12:28:28.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.294+0000 7fa5679a5640 1 Processor -- start 2023-10-14T12:28:28.296 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.294+0000 7fa5679a5640 1 -- start start 2023-10-14T12:28:28.297 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa5679a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600d29d0 0x7fa5600d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa5679a5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa5600b4410 0x7fa5600b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa5679a5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600d2e10 con 0x7fa56015cbf0 2023-10-14T12:28:28.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa5679a5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5600d0dc0 con 0x7fa5600b4410 2023-10-14T12:28:28.298 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa5679a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600b4dc0 con 0x7fa5600d29d0 2023-10-14T12:28:28.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa565741640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fa56015cbf0 0x7fa5600b8400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46302/0 (socket says 172.21.15.177:46302) 2023-10-14T12:28:28.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa564f40640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600d29d0 0x7fa5600d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa565741640 1 -- 172.21.15.177:0/1511153468 learned_addr learned my addr 172.21.15.177:0/1511153468 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-10-14T12:28:28.299 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.296+0000 7fa565f42640 1 --2- 172.21.15.177:0/1511153468 >> v2:172.21.15.177:3300/0 conn(0x7fa5600b4410 0x7fa5600b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.297+0000 7fa557fff640 1 -- 172.21.15.177:0/1511153468 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1254375060 0 0) 0x7fa5600d2e10 con 0x7fa56015cbf0 2023-10-14T12:28:28.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.297+0000 7fa557fff640 1 -- 172.21.15.177:0/1511153468 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa54c003520 con 0x7fa56015cbf0 2023-10-14T12:28:28.301 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.297+0000 7fa565f42640 1 -- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600d29d0 msgr2=0x7fa5600d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.297+0000 7fa565f42640 1 --2- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600d29d0 0x7fa5600d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.297+0000 7fa565f42640 1 -- 172.21.15.177:0/1511153468 >> v1:172.21.15.177:6789/0 conn(0x7fa56015cbf0 legacy=0x7fa5600b8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.297+0000 7fa565f42640 1 -- 172.21.15.177:0/1511153468 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56015cfd0 con 0x7fa5600b4410 2023-10-14T12:28:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.297+0000 7fa564f40640 1 --2- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600d29d0 0x7fa5600d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:28.302 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.298+0000 7fa565f42640 1 --2- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5600b4410 0x7fa5600b4880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa558009dc0 tx=0x7fa55802be80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c641b16c6ccb2ab7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.298+0000 7fa557fff640 1 -- 172.21.15.177:0/1511153468 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55802cc30 con 0x7fa5600b4410 2023-10-14T12:28:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.298+0000 7fa557fff640 1 -- 172.21.15.177:0/1511153468 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55802cd90 con 0x7fa5600b4410 2023-10-14T12:28:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.298+0000 7fa557fff640 1 -- 172.21.15.177:0/1511153468 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558034660 con 0x7fa5600b4410 2023-10-14T12:28:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 -- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5600b4410 msgr2=0x7fa5600b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 --2- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5600b4410 0x7fa5600b4880 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa558009dc0 tx=0x7fa55802be80 comp rx=0 tx=0).stop 2023-10-14T12:28:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 -- 172.21.15.177:0/1511153468 shutdown_connections 2023-10-14T12:28:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 --2- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa5600b4410 0x7fa5600b4880 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 --2- 172.21.15.177:0/1511153468 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600d29d0 0x7fa5600d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 -- 172.21.15.177:0/1511153468 >> 172.21.15.177:0/1511153468 conn(0x7fa560071900 msgr2=0x7fa560071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 -- 172.21.15.177:0/1511153468 shutdown_connections 2023-10-14T12:28:28.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.299+0000 7fa5679a5640 1 -- 172.21.15.177:0/1511153468 wait complete. 2023-10-14T12:28:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.301+0000 7fa5679a5640 1 Processor -- start 2023-10-14T12:28:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.301+0000 7fa5679a5640 1 -- start start 2023-10-14T12:28:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa5679a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600b4410 0x7fa5600cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa5679a5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5600d29d0 0x7fa56015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa5679a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56015cbf0 0x7fa560150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa5679a5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560159fb0 con 0x7fa5600d29d0 2023-10-14T12:28:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa5679a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601593a0 con 0x7fa56015cbf0 2023-10-14T12:28:28.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa5679a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa560159680 con 0x7fa5600b4410 2023-10-14T12:28:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56015cbf0 0x7fa560150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565741640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600b4410 0x7fa5600cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56015cbf0 0x7fa560150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44610/0 (socket says 172.21.15.177:44610) 2023-10-14T12:28:28.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 -- 172.21.15.177:0/1064738132 learned_addr learned my addr 172.21.15.177:0/1064738132 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 -- 172.21.15.177:0/1064738132 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600b4410 msgr2=0x7fa5600cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 --2- 172.21.15.177:0/1064738132 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600b4410 0x7fa5600cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 -- 172.21.15.177:0/1064738132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5600d29d0 msgr2=0x7fa56015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 --2- 172.21.15.177:0/1064738132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5600d29d0 0x7fa56015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.302+0000 7fa565f42640 1 -- 172.21.15.177:0/1064738132 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550009400 con 0x7fa56015cbf0 2023-10-14T12:28:28.312 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa565f42640 1 --2- 172.21.15.177:0/1064738132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56015cbf0 0x7fa560150750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa558037040 tx=0x7fa558004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa555ffb640 1 -- 172.21.15.177:0/1064738132 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558040650 con 0x7fa56015cbf0 2023-10-14T12:28:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa555ffb640 1 -- 172.21.15.177:0/1064738132 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5580407b0 con 0x7fa56015cbf0 2023-10-14T12:28:28.313 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa558009a70 con 0x7fa56015cbf0 2023-10-14T12:28:28.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa555ffb640 1 -- 172.21.15.177:0/1064738132 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558040b60 con 0x7fa56015cbf0 2023-10-14T12:28:28.314 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa560159c40 con 0x7fa56015cbf0 2023-10-14T12:28:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa555ffb640 1 -- 172.21.15.177:0/1064738132 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa558003990 con 0x7fa56015cbf0 2023-10-14T12:28:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.303+0000 7fa555ffb640 1 -- 172.21.15.177:0/1064738132 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fa558004770 con 0x7fa56015cbf0 2023-10-14T12:28:28.315 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.304+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56015a120 con 0x7fa56015cbf0 2023-10-14T12:28:28.316 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.307+0000 7fa555ffb640 1 -- 172.21.15.177:0/1064738132 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fa558044020 con 0x7fa56015cbf0 2023-10-14T12:28:28.329 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.327+0000 7f279ecb6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-14T12:28:28.386 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.385+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cb294d40-4734-4fb9-90b3-983fd221c324", "id": 1} v 0) v1 -- 0x7fa5600d09b0 con 0x7fa56015cbf0 2023-10-14T12:28:28.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.393+0000 7fa555ffb640 1 -- 172.21.15.177:0/1064738132 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cb294d40-4734-4fb9-90b3-983fd221c324", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa558039070 con 0x7fa56015cbf0 2023-10-14T12:28:28.394 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-14T12:28:28.395 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.393+0000 7f279ecb6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-14T12:28:28.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56015cbf0 msgr2=0x7fa560150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 --2- 172.21.15.177:0/1064738132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56015cbf0 0x7fa560150750 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa558037040 tx=0x7fa558004a40 comp rx=0 tx=0).stop 2023-10-14T12:28:28.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 shutdown_connections 2023-10-14T12:28:28.396 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 --2- 172.21.15.177:0/1064738132 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa56015cbf0 0x7fa560150750 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 --2- 172.21.15.177:0/1064738132 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa5600d29d0 0x7fa56015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 --2- 172.21.15.177:0/1064738132 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa5600b4410 0x7fa5600cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 >> 172.21.15.177:0/1064738132 conn(0x7fa560071900 msgr2=0x7fa560158610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:28.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 shutdown_connections 2023-10-14T12:28:28.397 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.394+0000 7fa5679a5640 1 -- 172.21.15.177:0/1064738132 wait complete. 2023-10-14T12:28:28.405 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.403+0000 7f3518611040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T12:28:28.413 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 7e7f88be-3314-42fb-9d1a-09b7cf83793e 2 2023-10-14T12:28:28.446 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.444+0000 7f279ecb6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-14T12:28:28.490 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.489+0000 7f3518611040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T12:28:28.547 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.546+0000 7f3518611040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T12:28:28.564 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.562+0000 7f279ecb6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-14T12:28:28.610 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.609+0000 7f3518611040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T12:28:28.649 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.646+0000 7f279ecb6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-14T12:28:28.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.647+0000 7f0cab528640 1 Processor -- start 2023-10-14T12:28:28.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.647+0000 7f0cab528640 1 -- start start 2023-10-14T12:28:28.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.648+0000 7f0cab528640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0ca415c940 0x7f0ca40d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0cab528640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca40ce810 con 0x7f0ca40b6fe0 2023-10-14T12:28:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0cab528640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca40b5b40 con 0x7f0ca40d0d80 2023-10-14T12:28:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0cab528640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca4161340 con 0x7f0ca415c940 2023-10-14T12:28:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0ca9d25640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f0ca40d0d80 0x7f0ca4160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46310/0 (socket says 172.21.15.177:46310) 2023-10-14T12:28:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0ca9d25640 1 -- 172.21.15.177:0/3903312861 learned_addr learned my addr 172.21.15.177:0/3903312861 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-10-14T12:28:28.652 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0caa526640 1 --2- 172.21.15.177:0/3903312861 >> v2:172.21.15.64:3300/0 conn(0x7f0ca415c940 0x7f0ca40d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822723928 0 0) 0x7f0ca40b5b40 con 0x7f0ca40d0d80 2023-10-14T12:28:28.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.649+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c90003520 con 0x7f0ca40d0d80 2023-10-14T12:28:28.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2094584815 0 0) 0x7f0c90003520 con 0x7f0ca40d0d80 2023-10-14T12:28:28.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 >> v2:172.21.15.64:3300/0 conn(0x7f0ca415c940 msgr2=0x7f0ca40d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:28.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 --2- 172.21.15.177:0/3903312861 >> v2:172.21.15.64:3300/0 conn(0x7f0ca415c940 0x7f0ca40d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 >> v1:172.21.15.64:6789/0 conn(0x7f0ca40b6fe0 legacy=0x7f0ca4160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:28.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40ce250 con 0x7f0ca40d0d80 2023-10-14T12:28:28.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f0c94001670 con 0x7f0ca40d0d80 2023-10-14T12:28:28.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 >> v1:172.21.15.177:6789/0 conn(0x7f0ca40d0d80 legacy=0x7f0ca4160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c900039e0 0x7f0c90003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900047c0 0x7f0c90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c900051d0 0x7f0c9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca4161340 con 0x7f0c900051d0 2023-10-14T12:28:28.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9000c120 con 0x7f0c900039e0 2023-10-14T12:28:28.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c9000c2e0 con 0x7f0c900047c0 2023-10-14T12:28:28.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0caa526640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c900039e0 0x7f0c90003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0ca9d25640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900047c0 0x7f0c90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.650+0000 7f0caad27640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c900051d0 0x7f0c9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.651+0000 7f0caa526640 1 -- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900047c0 msgr2=0x7f0c90004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:28.658 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.651+0000 7f0caa526640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900047c0 0x7f0c90004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.651+0000 7f0caa526640 1 -- 172.21.15.177:0/3903312861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c900051d0 msgr2=0x7f0c9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:28.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.651+0000 7f0caa526640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0c900051d0 0x7f0c9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.651+0000 7f0caa526640 1 -- 172.21.15.177:0/3903312861 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c90003520 con 0x7f0c900039e0 2023-10-14T12:28:28.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.651+0000 7f0caad27640 1 -- 172.21.15.177:0/3903312861 reap_dead start 2023-10-14T12:28:28.659 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.651+0000 7f0ca9d25640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900047c0 0x7f0c90004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:28.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.652+0000 7f0caa526640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c900039e0 0x7f0c90003de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009a90 tx=0x7f0c900057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b8ed2b4ad1cfc3f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:28.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.652+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca002c660 con 0x7f0c900039e0 2023-10-14T12:28:28.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.652+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca002c7c0 con 0x7f0c900039e0 2023-10-14T12:28:28.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.652+0000 7f0ca9524640 1 -- 172.21.15.177:0/3903312861 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca002cb50 con 0x7f0c900039e0 2023-10-14T12:28:28.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.652+0000 7f0cab528640 1 -- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c900039e0 msgr2=0x7f0c90003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.652+0000 7f0cab528640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c900039e0 0x7f0c90003de0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009a90 tx=0x7f0c900057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.653+0000 7f0cab528640 1 -- 172.21.15.177:0/3903312861 shutdown_connections 2023-10-14T12:28:28.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.653+0000 7f0cab528640 1 --2- 172.21.15.177:0/3903312861 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0c900039e0 0x7f0c90003de0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.653+0000 7f0cab528640 1 -- 172.21.15.177:0/3903312861 >> 172.21.15.177:0/3903312861 conn(0x7f0ca409bb30 msgr2=0x7f0ca40d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:28.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.653+0000 7f0cab528640 1 -- 172.21.15.177:0/3903312861 shutdown_connections 2023-10-14T12:28:28.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.653+0000 7f0cab528640 1 -- 172.21.15.177:0/3903312861 wait complete. 2023-10-14T12:28:28.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.654+0000 7f0cab528640 1 Processor -- start 2023-10-14T12:28:28.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.654+0000 7f0cab528640 1 -- start start 2023-10-14T12:28:28.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.655+0000 7f0cab528640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900039e0 0x7f0ca40cfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.655+0000 7f0cab528640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ca4157ed0 0x7f0ca4157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.655+0000 7f0cab528640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca40b5ed0 0x7f0ca40b6360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:28.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.655+0000 7f0cab528640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40b68a0 con 0x7f0ca4157ed0 2023-10-14T12:28:28.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.655+0000 7f0cab528640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40d0090 con 0x7f0ca40b5ed0 2023-10-14T12:28:28.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.655+0000 7f0cab528640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca40c6450 con 0x7f0c900039e0 2023-10-14T12:28:28.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caad27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca40b5ed0 0x7f0ca40b6360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caa526640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900039e0 0x7f0ca40cfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caad27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca40b5ed0 0x7f0ca40b6360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44620/0 (socket says 172.21.15.177:44620) 2023-10-14T12:28:28.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caad27640 1 -- 172.21.15.177:0/3644507340 learned_addr learned my addr 172.21.15.177:0/3644507340 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:28.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0ca9d25640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ca4157ed0 0x7f0ca4157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:28.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caa526640 1 -- 172.21.15.177:0/3644507340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca40b5ed0 msgr2=0x7f0ca40b6360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caa526640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca40b5ed0 0x7f0ca40b6360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caa526640 1 -- 172.21.15.177:0/3644507340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ca4157ed0 msgr2=0x7f0ca4157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caa526640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ca4157ed0 0x7f0ca4157630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caa526640 1 -- 172.21.15.177:0/3644507340 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca40c6730 con 0x7f0c900039e0 2023-10-14T12:28:28.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.656+0000 7f0caa526640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900039e0 0x7f0ca40cfb50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0033000 tx=0x7f0ca0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:28.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.657+0000 7f0c9affd640 1 -- 172.21.15.177:0/3644507340 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0003810 con 0x7f0c900039e0 2023-10-14T12:28:28.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.657+0000 7f0c9affd640 1 -- 172.21.15.177:0/3644507340 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca0003970 con 0x7f0c900039e0 2023-10-14T12:28:28.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.657+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca40c6a10 con 0x7f0c900039e0 2023-10-14T12:28:28.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.657+0000 7f0c9affd640 1 -- 172.21.15.177:0/3644507340 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0003d00 con 0x7f0c900039e0 2023-10-14T12:28:28.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.657+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca40c6fd0 con 0x7f0c900039e0 2023-10-14T12:28:28.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.657+0000 7f0c9affd640 1 -- 172.21.15.177:0/3644507340 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0ca0005c90 con 0x7f0c900039e0 2023-10-14T12:28:28.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.657+0000 7f0c9affd640 1 -- 172.21.15.177:0/3644507340 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f0ca0040450 con 0x7f0c900039e0 2023-10-14T12:28:28.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.658+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca404e9b0 con 0x7f0c900039e0 2023-10-14T12:28:28.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.660+0000 7f0c9affd640 1 -- 172.21.15.177:0/3644507340 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f0ca0044020 con 0x7f0c900039e0 2023-10-14T12:28:28.669 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:28.668+0000 7f3518611040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T12:28:28.704 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.702+0000 7f279ecb6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-14T12:28:28.738 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.737+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7e7f88be-3314-42fb-9d1a-09b7cf83793e", "id": 2} v 0) v1 -- 0x7f0ca40a04e0 con 0x7f0c900039e0 2023-10-14T12:28:28.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.746+0000 7f0c9affd640 1 -- 172.21.15.177:0/3644507340 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e7f88be-3314-42fb-9d1a-09b7cf83793e", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f0ca0039070 con 0x7f0c900039e0 2023-10-14T12:28:28.749 INFO:teuthology.orchestra.run.smithi177.stdout:2 2023-10-14T12:28:28.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900039e0 msgr2=0x7f0ca40cfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:28.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900039e0 0x7f0ca40cfb50 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0033000 tx=0x7f0ca0004730 comp rx=0 tx=0).stop 2023-10-14T12:28:28.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 shutdown_connections 2023-10-14T12:28:28.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ca40b5ed0 0x7f0ca40b6360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ca4157ed0 0x7f0ca4157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 --2- 172.21.15.177:0/3644507340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0c900039e0 0x7f0ca40cfb50 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:28.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 >> 172.21.15.177:0/3644507340 conn(0x7f0ca409bb30 msgr2=0x7f0ca406b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:28.753 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 shutdown_connections 2023-10-14T12:28:28.754 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:28.748+0000 7f0cab528640 1 -- 172.21.15.177:0/3644507340 wait complete. 2023-10-14T12:28:28.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new cd253ad3-e5c6-44cf-9b91-a95d93c09c0f 3 2023-10-14T12:28:28.767 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.766+0000 7f279ecb6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-14T12:28:28.825 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:28.823+0000 7f279ecb6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-14T12:28:29.007 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.006+0000 7fafc359e640 1 Processor -- start 2023-10-14T12:28:29.008 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.006+0000 7fafc359e640 1 -- start start 2023-10-14T12:28:29.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.007+0000 7fafc359e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fafc4160da0 0x7fafc415cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.007+0000 7fafc359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40ce4c0 con 0x7fafc40d17e0 2023-10-14T12:28:29.009 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.007+0000 7fafc359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc40cd8b0 con 0x7fafc41609c0 2023-10-14T12:28:29.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.007+0000 7fafc359e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc40cdb90 con 0x7fafc4160da0 2023-10-14T12:28:29.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc259c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fafc41609c0 0x7fafc40d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46322/0 (socket says 172.21.15.177:46322) 2023-10-14T12:28:29.010 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc259c640 1 -- 172.21.15.177:0/1472542930 learned_addr learned my addr 172.21.15.177:0/1472542930 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-10-14T12:28:29.012 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc2d9d640 1 --2- 172.21.15.177:0/1472542930 >> v2:172.21.15.64:3300/0 conn(0x7fafc4160da0 0x7fafc415cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435943919 0 0) 0x7fafc40cd8b0 con 0x7fafc41609c0 2023-10-14T12:28:29.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fafb0003520 con 0x7fafc41609c0 2023-10-14T12:28:29.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 395459250 0 0) 0x7fafb0003520 con 0x7fafc41609c0 2023-10-14T12:28:29.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 >> v2:172.21.15.64:3300/0 conn(0x7fafc4160da0 msgr2=0x7fafc415cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.013 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 --2- 172.21.15.177:0/1472542930 >> v2:172.21.15.64:3300/0 conn(0x7fafc4160da0 0x7fafc415cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 >> v1:172.21.15.64:6789/0 conn(0x7fafc40d17e0 legacy=0x7fafc415c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc40cde70 con 0x7fafc41609c0 2023-10-14T12:28:29.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.008+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fafb40017f0 con 0x7fafc41609c0 2023-10-14T12:28:29.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 >> v1:172.21.15.177:6789/0 conn(0x7fafc41609c0 legacy=0x7fafc40d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.014 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc1d9b640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0003a30 0x7fafb0003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc1d9b640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb00047c0 0x7fafb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc1d9b640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb00051d0 0x7fafb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc40cdb90 con 0x7fafb00051d0 2023-10-14T12:28:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb000c100 con 0x7fafb0003a30 2023-10-14T12:28:29.015 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb000c2c0 con 0x7fafb00047c0 2023-10-14T12:28:29.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc259c640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0003a30 0x7fafb0003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafbbfff640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb00047c0 0x7fafb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc2d9d640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb00051d0 0x7fafb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc259c640 1 -- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb00047c0 msgr2=0x7fafb0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.016 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc259c640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafb00047c0 0x7fafb0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc259c640 1 -- 172.21.15.177:0/1472542930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb00051d0 msgr2=0x7fafb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc259c640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb00051d0 0x7fafb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc259c640 1 -- 172.21.15.177:0/1472542930 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb0003520 con 0x7fafb0003a30 2023-10-14T12:28:29.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.009+0000 7fafc2d9d640 1 -- 172.21.15.177:0/1472542930 reap_dead start 2023-10-14T12:28:29.017 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.010+0000 7fafc259c640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0003a30 0x7fafb0003e50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c0e0 tx=0x7fafb00057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df6a81f7954eef59 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.011+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb4007270 con 0x7fafb0003a30 2023-10-14T12:28:29.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.011+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb40073d0 con 0x7fafb0003a30 2023-10-14T12:28:29.018 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.011+0000 7fafc1d9b640 1 -- 172.21.15.177:0/1472542930 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40057a0 con 0x7fafb0003a30 2023-10-14T12:28:29.020 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.011+0000 7fafc359e640 1 -- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0003a30 msgr2=0x7fafb0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.011+0000 7fafc359e640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0003a30 0x7fafb0003e50 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fafb400c0e0 tx=0x7fafb00057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.012+0000 7fafc359e640 1 -- 172.21.15.177:0/1472542930 shutdown_connections 2023-10-14T12:28:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.012+0000 7fafc359e640 1 --2- 172.21.15.177:0/1472542930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafb0003a30 0x7fafb0003e50 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.012+0000 7fafc359e640 1 -- 172.21.15.177:0/1472542930 >> 172.21.15.177:0/1472542930 conn(0x7fafc409bbf0 msgr2=0x7fafc40d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:29.021 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.012+0000 7fafc359e640 1 -- 172.21.15.177:0/1472542930 shutdown_connections 2023-10-14T12:28:29.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.012+0000 7fafc359e640 1 -- 172.21.15.177:0/1472542930 wait complete. 2023-10-14T12:28:29.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.013+0000 7fafc359e640 1 Processor -- start 2023-10-14T12:28:29.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.014+0000 7fafc359e640 1 -- start start 2023-10-14T12:28:29.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.014+0000 7fafc359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb0003a30 0x7fafc409c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.022 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.014+0000 7fafc359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafc40c7080 0x7fafc40cbb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafc414df50 0x7fafc40cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc409e340 con 0x7fafb0003a30 2023-10-14T12:28:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc409e570 con 0x7fafc414df50 2023-10-14T12:28:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc409e850 con 0x7fafc40c7080 2023-10-14T12:28:29.023 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafc414df50 0x7fafc40cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafbbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafc40c7080 0x7fafc40cbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafc414df50 0x7fafc40cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44626/0 (socket says 172.21.15.177:44626) 2023-10-14T12:28:29.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 -- 172.21.15.177:0/3200166715 learned_addr learned my addr 172.21.15.177:0/3200166715 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:29.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc259c640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb0003a30 0x7fafc409c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 -- 172.21.15.177:0/3200166715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafc40c7080 msgr2=0x7fafc40cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.024 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafc40c7080 0x7fafc40cbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 -- 172.21.15.177:0/3200166715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb0003a30 msgr2=0x7fafc409c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb0003a30 0x7fafc409c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 -- 172.21.15.177:0/3200166715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc409eb30 con 0x7fafc414df50 2023-10-14T12:28:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.015+0000 7fafc2d9d640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafc414df50 0x7fafc40cc0c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafc40ccec0 tx=0x7fafbc0115a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.025 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.016+0000 7fafbaffd640 1 -- 172.21.15.177:0/3200166715 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc00e070 con 0x7fafc414df50 2023-10-14T12:28:29.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.016+0000 7fafbaffd640 1 -- 172.21.15.177:0/3200166715 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafbc011de0 con 0x7fafc414df50 2023-10-14T12:28:29.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.016+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc409ee10 con 0x7fafc414df50 2023-10-14T12:28:29.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.016+0000 7fafbaffd640 1 -- 172.21.15.177:0/3200166715 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafbc003990 con 0x7fafc414df50 2023-10-14T12:28:29.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.016+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc409caa0 con 0x7fafc414df50 2023-10-14T12:28:29.026 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.016+0000 7fafbaffd640 1 -- 172.21.15.177:0/3200166715 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fafbc004030 con 0x7fafc414df50 2023-10-14T12:28:29.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.016+0000 7fafbaffd640 1 -- 172.21.15.177:0/3200166715 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fafbc004770 con 0x7fafc414df50 2023-10-14T12:28:29.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.017+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc404e9b0 con 0x7fafc414df50 2023-10-14T12:28:29.027 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.019+0000 7fafbaffd640 1 -- 172.21.15.177:0/3200166715 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fafbc0042e0 con 0x7fafc414df50 2023-10-14T12:28:29.098 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.096+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cd253ad3-e5c6-44cf-9b91-a95d93c09c0f", "id": 3} v 0) v1 -- 0x7fafc40b8860 con 0x7fafc414df50 2023-10-14T12:28:29.104 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.103+0000 7fafbaffd640 1 -- 172.21.15.177:0/3200166715 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cd253ad3-e5c6-44cf-9b91-a95d93c09c0f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fafbc004540 con 0x7fafc414df50 2023-10-14T12:28:29.105 INFO:teuthology.orchestra.run.smithi177.stdout:3 2023-10-14T12:28:29.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.104+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafc414df50 msgr2=0x7fafc40cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.104+0000 7fafc359e640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafc414df50 0x7fafc40cc0c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafc40ccec0 tx=0x7fafbc0115a0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.106 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.104+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 shutdown_connections 2023-10-14T12:28:29.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.104+0000 7fafc359e640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fafc414df50 0x7fafc40cc0c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.104+0000 7fafc359e640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fafc40c7080 0x7fafc40cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.104+0000 7fafc359e640 1 --2- 172.21.15.177:0/3200166715 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fafb0003a30 0x7fafc409c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.104+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 >> 172.21.15.177:0/3200166715 conn(0x7fafc409bbf0 msgr2=0x7fafc40b5590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:29.107 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.105+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 shutdown_connections 2023-10-14T12:28:29.108 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.105+0000 7fafc359e640 1 -- 172.21.15.177:0/3200166715 wait complete. 2023-10-14T12:28:29.121 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 4a24093b-276c-484e-a5ba-06592392a672 4 2023-10-14T12:28:29.148 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.146+0000 7f3518611040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T12:28:29.298 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:29.296+0000 7f279ecb6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-14T12:28:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.301+0000 7efe3b475640 1 Processor -- start 2023-10-14T12:28:29.303 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.301+0000 7efe3b475640 1 -- start start 2023-10-14T12:28:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe3b475640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efe340c9260 0x7efe340cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.304 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe3b475640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe3b475640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe340cb180 con 0x7efe3415c580 2023-10-14T12:28:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe3b475640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe340cac40 con 0x7efe340c9260 2023-10-14T12:28:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe3b475640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340cf440 con 0x7efe340cdbb0 2023-10-14T12:28:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe39211640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7efe3415c580 0x7efe340c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46332/0 (socket says 172.21.15.177:46332) 2023-10-14T12:28:29.305 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe39a12640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.306 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe39211640 1 -- 172.21.15.177:0/3494033988 learned_addr learned my addr 172.21.15.177:0/3494033988 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-10-14T12:28:29.307 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe38a10640 1 --2- 172.21.15.177:0/3494033988 >> v2:172.21.15.64:3300/0 conn(0x7efe340c9260 0x7efe340cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe2bfff640 1 -- 172.21.15.177:0/3494033988 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709596890 0 0) 0x7efe340cb180 con 0x7efe3415c580 2023-10-14T12:28:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe39a12640 1 -- 172.21.15.177:0/3494033988 >> v2:172.21.15.64:3300/0 conn(0x7efe340c9260 msgr2=0x7efe340cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe39a12640 1 --2- 172.21.15.177:0/3494033988 >> v2:172.21.15.64:3300/0 conn(0x7efe340c9260 0x7efe340cd5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe39a12640 1 -- 172.21.15.177:0/3494033988 >> v1:172.21.15.177:6789/0 conn(0x7efe3415c580 legacy=0x7efe340c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.308 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.303+0000 7efe39a12640 1 -- 172.21.15.177:0/3494033988 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe340ceec0 con 0x7efe340cdbb0 2023-10-14T12:28:29.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.304+0000 7efe39a12640 1 --2- 172.21.15.177:0/3494033988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340cb610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009d90 tx=0x7efe2c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50c2d6338bef9ed3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe2bfff640 1 -- 172.21.15.177:0/3494033988 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c02cbc0 con 0x7efe340cdbb0 2023-10-14T12:28:29.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe2bfff640 1 -- 172.21.15.177:0/3494033988 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2c02cd20 con 0x7efe340cdbb0 2023-10-14T12:28:29.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe2bfff640 1 -- 172.21.15.177:0/3494033988 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2c034660 con 0x7efe340cdbb0 2023-10-14T12:28:29.309 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe3b475640 1 -- 172.21.15.177:0/3494033988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 msgr2=0x7efe340cb610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe3b475640 1 --2- 172.21.15.177:0/3494033988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340cb610 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe2c009d90 tx=0x7efe2c02be10 comp rx=0 tx=0).stop 2023-10-14T12:28:29.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe3b475640 1 -- 172.21.15.177:0/3494033988 shutdown_connections 2023-10-14T12:28:29.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe3b475640 1 --2- 172.21.15.177:0/3494033988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340cb610 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.310 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe3b475640 1 --2- 172.21.15.177:0/3494033988 >> v2:172.21.15.64:3300/0 conn(0x7efe340c9260 0x7efe340cd5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.305+0000 7efe3b475640 1 -- 172.21.15.177:0/3494033988 >> 172.21.15.177:0/3494033988 conn(0x7efe340b0030 msgr2=0x7efe340b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:29.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.306+0000 7efe3b475640 1 -- 172.21.15.177:0/3494033988 shutdown_connections 2023-10-14T12:28:29.311 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.306+0000 7efe3b475640 1 -- 172.21.15.177:0/3494033988 wait complete. 2023-10-14T12:28:29.317 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.307+0000 7efe3b475640 1 Processor -- start 2023-10-14T12:28:29.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.307+0000 7efe3b475640 1 -- start start 2023-10-14T12:28:29.318 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe3b475640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe340c9260 0x7efe3414b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe3b475640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340c2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe3b475640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe3415c580 0x7efe340c3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.319 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe3b475640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe340c5d30 con 0x7efe3415c580 2023-10-14T12:28:29.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe3b475640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe340c80c0 con 0x7efe340c9260 2023-10-14T12:28:29.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe3b475640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe340c3950 con 0x7efe340cdbb0 2023-10-14T12:28:29.320 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe39211640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe340c9260 0x7efe3414b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.308+0000 7efe38a10640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340c2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.321 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340c2ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.177:35484/0 (socket says 172.21.15.177:35484) 2023-10-14T12:28:29.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 -- 172.21.15.177:0/4142618437 learned_addr learned my addr 172.21.15.177:0/4142618437 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:29.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe39211640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe340c9260 0x7efe3414b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44636/0 (socket says 172.21.15.177:44636) 2023-10-14T12:28:29.322 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 -- 172.21.15.177:0/4142618437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe340c9260 msgr2=0x7efe3414b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe340c9260 0x7efe3414b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.323 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe39a12640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe3415c580 0x7efe340c3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 -- 172.21.15.177:0/4142618437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe3415c580 msgr2=0x7efe340c3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.324 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe3415c580 0x7efe340c3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 -- 172.21.15.177:0/4142618437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe2c009a70 con 0x7efe340cdbb0 2023-10-14T12:28:29.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe39a12640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe3415c580 0x7efe340c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:29.325 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe38a10640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340c2ed0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d800 tx=0x7efe2400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe29ffb640 1 -- 172.21.15.177:0/4142618437 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400b660 con 0x7efe340cdbb0 2023-10-14T12:28:29.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe29ffb640 1 -- 172.21.15.177:0/4142618437 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe2400b7c0 con 0x7efe340cdbb0 2023-10-14T12:28:29.326 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.309+0000 7efe29ffb640 1 -- 172.21.15.177:0/4142618437 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe2400bb50 con 0x7efe340cdbb0 2023-10-14T12:28:29.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.310+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe34153030 con 0x7efe340cdbb0 2023-10-14T12:28:29.327 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.310+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe340c5670 con 0x7efe340cdbb0 2023-10-14T12:28:29.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.310+0000 7efe29ffb640 1 -- 172.21.15.177:0/4142618437 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efe2401e460 con 0x7efe340cdbb0 2023-10-14T12:28:29.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.310+0000 7efe29ffb640 1 -- 172.21.15.177:0/4142618437 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7efe2401ec20 con 0x7efe340cdbb0 2023-10-14T12:28:29.328 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.311+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe340c5e70 con 0x7efe340cdbb0 2023-10-14T12:28:29.329 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.313+0000 7efe29ffb640 1 -- 172.21.15.177:0/4142618437 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7efe340c5e70 con 0x7efe340cdbb0 2023-10-14T12:28:29.330 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.317+0000 7f3518611040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T12:28:29.393 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.391+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4a24093b-276c-484e-a5ba-06592392a672", "id": 4} v 0) v1 -- 0x7efe34073ef0 con 0x7efe340cdbb0 2023-10-14T12:28:29.402 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.401+0000 7efe29ffb640 1 -- 172.21.15.177:0/4142618437 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a24093b-276c-484e-a5ba-06592392a672", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7efe2401e710 con 0x7efe340cdbb0 2023-10-14T12:28:29.403 INFO:teuthology.orchestra.run.smithi177.stdout:4 2023-10-14T12:28:29.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 msgr2=0x7efe340c2ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340c2ed0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efe2400d800 tx=0x7efe2400dcc0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.404 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 shutdown_connections 2023-10-14T12:28:29.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe3415c580 0x7efe340c3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe340cdbb0 0x7efe340c2ed0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 --2- 172.21.15.177:0/4142618437 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe340c9260 0x7efe3414b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 >> 172.21.15.177:0/4142618437 conn(0x7efe340b0030 msgr2=0x7efe340ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:29.405 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 shutdown_connections 2023-10-14T12:28:29.406 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.402+0000 7efe3b475640 1 -- 172.21.15.177:0/4142618437 wait complete. 2023-10-14T12:28:29.420 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new ede92de1-99ba-4932-95d0-35a00f93a8bc 5 2023-10-14T12:28:29.451 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.449+0000 7f3518611040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T12:28:29.466 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:29.465+0000 7f279ecb6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-14T12:28:29.507 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.505+0000 7f3518611040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T12:28:29.607 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:29.605+0000 7f279ecb6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-14T12:28:29.620 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.619+0000 7f3518611040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:28:29.650 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.649+0000 7f63d62ec640 1 Processor -- start 2023-10-14T12:28:29.651 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.649+0000 7f63d62ec640 1 -- start start 2023-10-14T12:28:29.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.650+0000 7f63d62ec640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63d015c940 0x7f63d00d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d62ec640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d00d0d80 0x7f63d00d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.653 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d62ec640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f63d0160520 0x7f63d01609b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d62ec640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00d1740 con 0x7f63d0160520 2023-10-14T12:28:29.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d62ec640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63d00ce810 con 0x7f63d015c940 2023-10-14T12:28:29.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d62ec640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d00b5b40 con 0x7f63d00d0d80 2023-10-14T12:28:29.654 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63d015c940 0x7f63d00d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d4ae9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d00d0d80 0x7f63d00d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f63d015c940 0x7f63d00d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44646/0 (socket says 172.21.15.177:44646) 2023-10-14T12:28:29.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 -- 172.21.15.177:0/2407124358 learned_addr learned my addr 172.21.15.177:0/2407124358 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:29.655 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d5aeb640 1 --2- 172.21.15.177:0/2407124358 >> v2:172.21.15.64:3300/0 conn(0x7f63d0160520 0x7f63d01609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 -- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d00d0d80 msgr2=0x7f63d00d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 --2- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d00d0d80 0x7f63d00d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 -- 172.21.15.177:0/2407124358 >> v2:172.21.15.64:3300/0 conn(0x7f63d0160520 msgr2=0x7f63d01609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 --2- 172.21.15.177:0/2407124358 >> v2:172.21.15.64:3300/0 conn(0x7f63d0160520 0x7f63d01609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.656 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d52ea640 1 -- 172.21.15.177:0/2407124358 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63d00ce250 con 0x7f63d015c940 2023-10-14T12:28:29.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d4ae9640 1 --2- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d00d0d80 0x7f63d00d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:29.657 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.651+0000 7f63d5aeb640 1 --2- 172.21.15.177:0/2407124358 >> v2:172.21.15.64:3300/0 conn(0x7f63d0160520 0x7f63d01609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:29.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.652+0000 7f63d52ea640 1 --2- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00d0400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f63d00671a0 tx=0x7f63cc02b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77d5d89391a5d84d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.660 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.653+0000 7f63c7fff640 1 -- 172.21.15.177:0/2407124358 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc0317f0 con 0x7f63d015c940 2023-10-14T12:28:29.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.653+0000 7f63c7fff640 1 -- 172.21.15.177:0/2407124358 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63cc031950 con 0x7f63d015c940 2023-10-14T12:28:29.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.653+0000 7f63c7fff640 1 -- 172.21.15.177:0/2407124358 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63cc031ce0 con 0x7f63d015c940 2023-10-14T12:28:29.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.653+0000 7f63d62ec640 1 -- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 msgr2=0x7f63d00d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.653+0000 7f63d62ec640 1 --2- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00d0400 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f63d00671a0 tx=0x7f63cc02b890 comp rx=0 tx=0).stop 2023-10-14T12:28:29.661 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.653+0000 7f63d62ec640 1 -- 172.21.15.177:0/2407124358 shutdown_connections 2023-10-14T12:28:29.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.654+0000 7f63d62ec640 1 --2- 172.21.15.177:0/2407124358 >> v2:172.21.15.64:3300/0 conn(0x7f63d0160520 0x7f63d01609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.654+0000 7f63d62ec640 1 --2- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d00d0d80 0x7f63d00d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.654+0000 7f63d62ec640 1 --2- 172.21.15.177:0/2407124358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00d0400 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.654+0000 7f63d62ec640 1 -- 172.21.15.177:0/2407124358 >> 172.21.15.177:0/2407124358 conn(0x7f63d009bb30 msgr2=0x7f63d00d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:29.662 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.654+0000 7f63d62ec640 1 -- 172.21.15.177:0/2407124358 shutdown_connections 2023-10-14T12:28:29.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.654+0000 7f63d62ec640 1 -- 172.21.15.177:0/2407124358 wait complete. 2023-10-14T12:28:29.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.655+0000 7f63d62ec640 1 Processor -- start 2023-10-14T12:28:29.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.656+0000 7f63d62ec640 1 -- start start 2023-10-14T12:28:29.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d62ec640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d00d0d80 0x7f63d00b73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.663 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d62ec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00cb130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d62ec640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d0160520 0x7f63d00cb670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d62ec640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01f68d0 con 0x7f63d00d0d80 2023-10-14T12:28:29.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d62ec640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01f5a70 con 0x7f63d015c940 2023-10-14T12:28:29.664 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d62ec640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63d01f5d50 con 0x7f63d0160520 2023-10-14T12:28:29.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d4ae9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00cb130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d5aeb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d0160520 0x7f63d00cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d4ae9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00cb130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44656/0 (socket says 172.21.15.177:44656) 2023-10-14T12:28:29.665 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d4ae9640 1 -- 172.21.15.177:0/3915478042 learned_addr learned my addr 172.21.15.177:0/3915478042 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:29.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d52ea640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d00d0d80 0x7f63d00b73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d5aeb640 1 -- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 msgr2=0x7f63d00cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d5aeb640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00cb130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d5aeb640 1 -- 172.21.15.177:0/3915478042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d00d0d80 msgr2=0x7f63d00b73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.666 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d5aeb640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d00d0d80 0x7f63d00b73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d5aeb640 1 -- 172.21.15.177:0/3915478042 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c0009400 con 0x7f63d0160520 2023-10-14T12:28:29.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d4ae9640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:29.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.657+0000 7f63d52ea640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d00d0d80 0x7f63d00b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:28:29.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63d5aeb640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d0160520 0x7f63d00cb670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f63c800cc90 tx=0x7f63c800a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.667 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63c5ffb640 1 -- 172.21.15.177:0/3915478042 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800cea0 con 0x7f63d0160520 2023-10-14T12:28:29.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63c5ffb640 1 -- 172.21.15.177:0/3915478042 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63c800f6a0 con 0x7f63d0160520 2023-10-14T12:28:29.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63c5ffb640 1 -- 172.21.15.177:0/3915478042 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c800fa50 con 0x7f63d0160520 2023-10-14T12:28:29.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc0094d0 con 0x7f63d0160520 2023-10-14T12:28:29.668 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63d01f6310 con 0x7f63d0160520 2023-10-14T12:28:29.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63c5ffb640 1 -- 172.21.15.177:0/3915478042 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f63c800b040 con 0x7f63d0160520 2023-10-14T12:28:29.669 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.658+0000 7f63c5ffb640 1 -- 172.21.15.177:0/3915478042 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f63c8018c70 con 0x7f63d0160520 2023-10-14T12:28:29.670 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:29.660+0000 7f279ecb6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-14T12:28:29.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.659+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63d00c9890 con 0x7f63d0160520 2023-10-14T12:28:29.670 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.662+0000 7f63c5ffb640 1 -- 172.21.15.177:0/3915478042 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f63d00c9890 con 0x7f63d0160520 2023-10-14T12:28:29.735 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.734+0000 7f3518611040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T12:28:29.741 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.740+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd new", "uuid": "ede92de1-99ba-4932-95d0-35a00f93a8bc", "id": 5} v 0) v1 -- 0x7f63d004e9b0 con 0x7f63d0160520 2023-10-14T12:28:29.748 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.746+0000 7f63c5ffb640 1 -- 172.21.15.177:0/3915478042 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ede92de1-99ba-4932-95d0-35a00f93a8bc", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f63c801d020 con 0x7f63d0160520 2023-10-14T12:28:29.748 INFO:teuthology.orchestra.run.smithi177.stdout:5 2023-10-14T12:28:29.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.748+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d0160520 msgr2=0x7f63d00cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.750 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.748+0000 7f63d62ec640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d0160520 0x7f63d00cb670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f63c800cc90 tx=0x7f63c800a650 comp rx=0 tx=0).stop 2023-10-14T12:28:29.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.748+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 shutdown_connections 2023-10-14T12:28:29.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.748+0000 7f63d62ec640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63d0160520 0x7f63d00cb670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.748+0000 7f63d62ec640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63d015c940 0x7f63d00cb130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.748+0000 7f63d62ec640 1 --2- 172.21.15.177:0/3915478042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63d00d0d80 0x7f63d00b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.751 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.748+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 >> 172.21.15.177:0/3915478042 conn(0x7f63d009bb30 msgr2=0x7f63d0072980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:29.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.749+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 shutdown_connections 2023-10-14T12:28:29.752 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.749+0000 7f63d62ec640 1 -- 172.21.15.177:0/3915478042 wait complete. 2023-10-14T12:28:29.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 96e6bf56-293a-40dd-b7cb-c5565c083485 6 2023-10-14T12:28:29.776 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:29.775+0000 7f279ecb6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:28:29.893 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:29.891+0000 7f279ecb6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-14T12:28:29.906 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.904+0000 7f3518611040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:28:29.955 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.954+0000 7fb8e98a3640 1 Processor -- start 2023-10-14T12:28:29.956 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.954+0000 7fb8e98a3640 1 -- start start 2023-10-14T12:28:29.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.955+0000 7fb8e98a3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb8e40d0d80 0x7fb8e40d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.955+0000 7fb8e98a3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e40ce810 con 0x7fb8e40b5fd0 2023-10-14T12:28:29.957 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.955+0000 7fb8e98a3640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e40b5b40 con 0x7fb8e415c940 2023-10-14T12:28:29.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e98a3640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e40d1740 con 0x7fb8e40d0d80 2023-10-14T12:28:29.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e88a1640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb8e415c940 0x7fb8e40d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.177:46342/0 (socket says 172.21.15.177:46342) 2023-10-14T12:28:29.958 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e88a1640 1 -- 172.21.15.177:0/3350341305 learned_addr learned my addr 172.21.15.177:0/3350341305 (peer_addr_for_me v1:172.21.15.177:0/0) 2023-10-14T12:28:29.959 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e3fff640 1 --2- 172.21.15.177:0/3350341305 >> v2:172.21.15.64:3300/0 conn(0x7fb8e40d0d80 0x7fb8e40d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.959 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:29.956+0000 7f3518611040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T12:28:29.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125655636 0 0) 0x7fb8e40b5b40 con 0x7fb8e415c940 2023-10-14T12:28:29.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8d4003520 con 0x7fb8e415c940 2023-10-14T12:28:29.962 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2448451204 0 0) 0x7fb8d4003520 con 0x7fb8e415c940 2023-10-14T12:28:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 >> v2:172.21.15.64:3300/0 conn(0x7fb8e40d0d80 msgr2=0x7fb8e40d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 --2- 172.21.15.177:0/3350341305 >> v2:172.21.15.64:3300/0 conn(0x7fb8e40d0d80 0x7fb8e40d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 >> v1:172.21.15.64:6789/0 conn(0x7fb8e40b5fd0 legacy=0x7fb8e40b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40d0b10 con 0x7fb8e415c940 2023-10-14T12:28:29.963 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.956+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fb8d8001670 con 0x7fb8e415c940 2023-10-14T12:28:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 >> v1:172.21.15.177:6789/0 conn(0x7fb8e415c940 legacy=0x7fb8e40d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e37fe640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d40039e0 0x7fb8d4003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e37fe640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40047c0 0x7fb8d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.964 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e37fe640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d40051f0 0x7fb8d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40d1740 con 0x7fb8d40051f0 2023-10-14T12:28:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d400c150 con 0x7fb8d40039e0 2023-10-14T12:28:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d400c310 con 0x7fb8d40047c0 2023-10-14T12:28:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e88a1640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d40039e0 0x7fb8d4003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.965 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e3fff640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40047c0 0x7fb8d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e88a1640 1 -- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40047c0 msgr2=0x7fb8d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e88a1640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40047c0 0x7fb8d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e88a1640 1 -- 172.21.15.177:0/3350341305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d40051f0 msgr2=0x7fb8d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e90a2640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d40051f0 0x7fb8d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.966 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e88a1640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d40051f0 0x7fb8d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e88a1640 1 -- 172.21.15.177:0/3350341305 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4003520 con 0x7fb8d40039e0 2023-10-14T12:28:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e90a2640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8d40051f0 0x7fb8d400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.957+0000 7fb8e90a2640 1 -- 172.21.15.177:0/3350341305 reap_dead start 2023-10-14T12:28:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.958+0000 7fb8e88a1640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d40039e0 0x7fb8d4003e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800c190 tx=0x7fb8d40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7e90ca46ad9a57b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.967 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8005ad0 con 0x7fb8d40039e0 2023-10-14T12:28:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d8005c50 con 0x7fb8d40039e0 2023-10-14T12:28:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e37fe640 1 -- 172.21.15.177:0/3350341305 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d802c7e0 con 0x7fb8d40039e0 2023-10-14T12:28:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e98a3640 1 -- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d40039e0 msgr2=0x7fb8d4003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.968 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e98a3640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d40039e0 0x7fb8d4003e00 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800c190 tx=0x7fb8d40057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e98a3640 1 -- 172.21.15.177:0/3350341305 shutdown_connections 2023-10-14T12:28:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e98a3640 1 --2- 172.21.15.177:0/3350341305 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8d40039e0 0x7fb8d4003e00 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e98a3640 1 -- 172.21.15.177:0/3350341305 >> 172.21.15.177:0/3350341305 conn(0x7fb8e409bb30 msgr2=0x7fb8e40d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e98a3640 1 -- 172.21.15.177:0/3350341305 shutdown_connections 2023-10-14T12:28:29.969 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.959+0000 7fb8e98a3640 1 -- 172.21.15.177:0/3350341305 wait complete. 2023-10-14T12:28:29.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.961+0000 7fb8e98a3640 1 Processor -- start 2023-10-14T12:28:29.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.961+0000 7fb8e98a3640 1 -- start start 2023-10-14T12:28:29.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e98a3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40039e0 0x7fb8e40c8c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e98a3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40c8360 0x7fb8e4154d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.972 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e98a3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e41f2720 0x7fb8e41f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e98a3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e40c7700 con 0x7fb8e41f2720 2023-10-14T12:28:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e98a3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e41552c0 con 0x7fb8e40c8360 2023-10-14T12:28:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e98a3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e41f3110 con 0x7fb8d40039e0 2023-10-14T12:28:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40c8360 0x7fb8e4154d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.973 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e3fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40c8360 0x7fb8e4154d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44666/0 (socket says 172.21.15.177:44666) 2023-10-14T12:28:29.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e3fff640 1 -- 172.21.15.177:0/1919363461 learned_addr learned my addr 172.21.15.177:0/1919363461 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:29.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.962+0000 7fb8e88a1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40039e0 0x7fb8e40c8c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e90a2640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e41f2720 0x7fb8e41f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:29.974 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e3fff640 1 -- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40039e0 msgr2=0x7fb8e40c8c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e3fff640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40039e0 0x7fb8e40c8c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e3fff640 1 -- 172.21.15.177:0/1919363461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e41f2720 msgr2=0x7fb8e41f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:29.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e3fff640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e41f2720 0x7fb8e41f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:29.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e3fff640 1 -- 172.21.15.177:0/1919363461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e40c92f0 con 0x7fb8e40c8360 2023-10-14T12:28:29.975 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e88a1640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40039e0 0x7fb8e40c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:29.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e3fff640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40c8360 0x7fb8e4154d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0011aa0 tx=0x7fb8d0011f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:29.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e17fa640 1 -- 172.21.15.177:0/1919363461 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0009680 con 0x7fb8e40c8360 2023-10-14T12:28:29.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.963+0000 7fb8e17fa640 1 -- 172.21.15.177:0/1919363461 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d000fb80 con 0x7fb8e40c8360 2023-10-14T12:28:29.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.964+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e40c6d60 con 0x7fb8e40c8360 2023-10-14T12:28:29.976 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.964+0000 7fb8e17fa640 1 -- 172.21.15.177:0/1919363461 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0014440 con 0x7fb8e40c8360 2023-10-14T12:28:29.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.964+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e40c7320 con 0x7fb8e40c8360 2023-10-14T12:28:29.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.964+0000 7fb8e17fa640 1 -- 172.21.15.177:0/1919363461 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb8d00148a0 con 0x7fb8e40c8360 2023-10-14T12:28:29.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.964+0000 7fb8e17fa640 1 -- 172.21.15.177:0/1919363461 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fb8d001d400 con 0x7fb8e40c8360 2023-10-14T12:28:29.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.965+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8e40c74b0 con 0x7fb8e40c8360 2023-10-14T12:28:29.977 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:29.967+0000 7fb8e17fa640 1 -- 172.21.15.177:0/1919363461 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7fb8d0014b50 con 0x7fb8e40c8360 2023-10-14T12:28:30.046 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.045+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "96e6bf56-293a-40dd-b7cb-c5565c083485", "id": 6} v 0) v1 -- 0x7fb8e404e9b0 con 0x7fb8e40c8360 2023-10-14T12:28:30.053 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.051+0000 7fb8e17fa640 1 -- 172.21.15.177:0/1919363461 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "96e6bf56-293a-40dd-b7cb-c5565c083485", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb8d0014cf0 con 0x7fb8e40c8360 2023-10-14T12:28:30.053 INFO:teuthology.orchestra.run.smithi177.stdout:6 2023-10-14T12:28:30.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40c8360 msgr2=0x7fb8e4154d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.055 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40c8360 0x7fb8e4154d80 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb8d0011aa0 tx=0x7fb8d0011f60 comp rx=0 tx=0).stop 2023-10-14T12:28:30.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 shutdown_connections 2023-10-14T12:28:30.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb8e41f2720 0x7fb8e41f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb8e40c8360 0x7fb8e4154d80 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 --2- 172.21.15.177:0/1919363461 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb8d40039e0 0x7fb8e40c8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.056 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 >> 172.21.15.177:0/1919363461 conn(0x7fb8e409bb30 msgr2=0x7fb8e40cbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:30.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 shutdown_connections 2023-10-14T12:28:30.057 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.053+0000 7fb8e98a3640 1 -- 172.21.15.177:0/1919363461 wait complete. 2023-10-14T12:28:30.060 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:30.058+0000 7f279ecb6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-14T12:28:30.070 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new 5a5a8c51-fbfc-4d8b-a462-f7127b648d79 7 2023-10-14T12:28:30.111 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:30.110+0000 7f279ecb6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-14T12:28:30.125 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:30.123+0000 7f3518611040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T12:28:30.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.256+0000 7f3344c56640 1 Processor -- start 2023-10-14T12:28:30.258 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.256+0000 7f3344c56640 1 -- start start 2023-10-14T12:28:30.259 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f3344c56640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f334015c580 0x7f33400cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f3344c56640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33400cdbb0 0x7f33400cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f3344c56640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33400cb180 con 0x7f33400c8b50 2023-10-14T12:28:30.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f3344c56640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33400cac40 con 0x7f334015c580 2023-10-14T12:28:30.260 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f3344c56640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400cf440 con 0x7f33400cdbb0 2023-10-14T12:28:30.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f333e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f334015c580 0x7f33400cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f3337fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33400cdbb0 0x7f33400cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f333e59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f334015c580 0x7f33400cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44676/0 (socket says 172.21.15.177:44676) 2023-10-14T12:28:30.261 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.258+0000 7f333e59c640 1 -- 172.21.15.177:0/3649479678 learned_addr learned my addr 172.21.15.177:0/3649479678 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:30.262 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.259+0000 7f333e59c640 1 -- 172.21.15.177:0/3649479678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33400cdbb0 msgr2=0x7f33400cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:30.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.259+0000 7f333e59c640 1 --2- 172.21.15.177:0/3649479678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33400cdbb0 0x7f33400cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.259+0000 7f333e59c640 1 -- 172.21.15.177:0/3649479678 >> v1:172.21.15.177:6789/0 conn(0x7f33400c8b50 legacy=0x7f334015cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.259+0000 7f333e59c640 1 -- 172.21.15.177:0/3649479678 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33400ceec0 con 0x7f334015c580 2023-10-14T12:28:30.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.259+0000 7f333dd9b640 1 -- 172.21.15.177:0/3649479678 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655484368 0 0) 0x7f33400cb180 con 0x7f33400c8b50 2023-10-14T12:28:30.263 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.260+0000 7f333e59c640 1 --2- 172.21.15.177:0/3649479678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334015c580 0x7f33400cd5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3330009870 tx=0x7f333002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=db4fc99d393f517a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:30.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.260+0000 7f333dd9b640 1 -- 172.21.15.177:0/3649479678 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330031640 con 0x7f334015c580 2023-10-14T12:28:30.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.260+0000 7f333dd9b640 1 -- 172.21.15.177:0/3649479678 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33300317a0 con 0x7f334015c580 2023-10-14T12:28:30.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.260+0000 7f333dd9b640 1 -- 172.21.15.177:0/3649479678 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3330031b30 con 0x7f334015c580 2023-10-14T12:28:30.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 -- 172.21.15.177:0/3649479678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334015c580 msgr2=0x7f33400cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.264 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 --2- 172.21.15.177:0/3649479678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334015c580 0x7f33400cd5f0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3330009870 tx=0x7f333002b8f0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 -- 172.21.15.177:0/3649479678 shutdown_connections 2023-10-14T12:28:30.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 --2- 172.21.15.177:0/3649479678 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f33400cdbb0 0x7f33400cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 --2- 172.21.15.177:0/3649479678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f334015c580 0x7f33400cd5f0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 -- 172.21.15.177:0/3649479678 >> 172.21.15.177:0/3649479678 conn(0x7f33400b0030 msgr2=0x7f33400b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:30.265 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 -- 172.21.15.177:0/3649479678 shutdown_connections 2023-10-14T12:28:30.266 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.261+0000 7f3344c56640 1 -- 172.21.15.177:0/3649479678 wait complete. 2023-10-14T12:28:30.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.263+0000 7f3344c56640 1 Processor -- start 2023-10-14T12:28:30.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.263+0000 7f3344c56640 1 -- start start 2023-10-14T12:28:30.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f3344c56640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33400c8b50 0x7f3340155980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.268 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f3344c56640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33400cdbb0 0x7f3340157820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f3344c56640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f334015c580 0x7f3340157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f3344c56640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33400acf70 con 0x7f33400cdbb0 2023-10-14T12:28:30.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f3344c56640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33400c3dd0 con 0x7f33400c8b50 2023-10-14T12:28:30.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f3344c56640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33400c40b0 con 0x7f334015c580 2023-10-14T12:28:30.269 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f333e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33400c8b50 0x7f3340155980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f333e59c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33400c8b50 0x7f3340155980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.177:44688/0 (socket says 172.21.15.177:44688) 2023-10-14T12:28:30.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f333e59c640 1 -- 172.21.15.177:0/1824783356 learned_addr learned my addr 172.21.15.177:0/1824783356 (peer_addr_for_me v2:172.21.15.177:0/0) 2023-10-14T12:28:30.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.264+0000 7f333ed9d640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f334015c580 0x7f3340157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f333e59c640 1 -- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f334015c580 msgr2=0x7f3340157d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.270 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f333e59c640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f334015c580 0x7f3340157d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f333e59c640 1 -- 172.21.15.177:0/1824783356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33400cdbb0 msgr2=0x7f3340157820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f3337fff640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33400cdbb0 0x7f3340157820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f333e59c640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33400cdbb0 0x7f3340157820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f333e59c640 1 -- 172.21.15.177:0/1824783356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33300094d0 con 0x7f33400c8b50 2023-10-14T12:28:30.271 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f333ed9d640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f334015c580 0x7f3340157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:30.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f333e59c640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33400c8b50 0x7f3340155980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3330009870 tx=0x7f33300046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:30.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f3336ffd640 1 -- 172.21.15.177:0/1824783356 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333003a930 con 0x7f33400c8b50 2023-10-14T12:28:30.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f3336ffd640 1 -- 172.21.15.177:0/1824783356 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333003aa90 con 0x7f33400c8b50 2023-10-14T12:28:30.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f3336ffd640 1 -- 172.21.15.177:0/1824783356 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333003ae40 con 0x7f33400c8b50 2023-10-14T12:28:30.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.265+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33400c4390 con 0x7f33400c8b50 2023-10-14T12:28:30.272 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.266+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33400b1120 con 0x7f33400c8b50 2023-10-14T12:28:30.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.266+0000 7f3336ffd640 1 -- 172.21.15.177:0/1824783356 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f333002f050 con 0x7f33400c8b50 2023-10-14T12:28:30.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.266+0000 7f3336ffd640 1 -- 172.21.15.177:0/1824783356 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f3330044b90 con 0x7f33400c8b50 2023-10-14T12:28:30.273 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.267+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3340073ef0 con 0x7f33400c8b50 2023-10-14T12:28:30.274 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.269+0000 7f3336ffd640 1 -- 172.21.15.177:0/1824783356 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f3330035020 con 0x7f33400c8b50 2023-10-14T12:28:30.276 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:30.274+0000 7f279ecb6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-14T12:28:30.347 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.346+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5a5a8c51-fbfc-4d8b-a462-f7127b648d79", "id": 7} v 0) v1 -- 0x7f33400c88a0 con 0x7f33400c8b50 2023-10-14T12:28:30.358 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.357+0000 7f3336ffd640 1 -- 172.21.15.177:0/1824783356 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a5a8c51-fbfc-4d8b-a462-f7127b648d79", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f333002d040 con 0x7f33400c8b50 2023-10-14T12:28:30.359 INFO:teuthology.orchestra.run.smithi177.stdout:7 2023-10-14T12:28:30.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33400c8b50 msgr2=0x7f3340155980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33400c8b50 0x7f3340155980 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f3330009870 tx=0x7f33300046c0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 shutdown_connections 2023-10-14T12:28:30.360 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f334015c580 0x7f3340157d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f33400cdbb0 0x7f3340157820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 --2- 172.21.15.177:0/1824783356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f33400c8b50 0x7f3340155980 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 >> 172.21.15.177:0/1824783356 conn(0x7f33400b0030 msgr2=0x7f33400c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:30.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 shutdown_connections 2023-10-14T12:28:30.361 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:28:30.358+0000 7f3344c56640 1 -- 172.21.15.177:0/1824783356 wait complete. 2023-10-14T12:28:30.376 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-14T12:28:30.376 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-14T12:28:30.385 INFO:tasks.ceph.osd.0:Started 2023-10-14T12:28:30.385 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-14T12:28:30.386 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-14T12:28:30.394 INFO:tasks.ceph.osd.1:Started 2023-10-14T12:28:30.394 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-14T12:28:30.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-14T12:28:30.400 INFO:tasks.ceph.osd.2:Started 2023-10-14T12:28:30.401 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-14T12:28:30.401 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-14T12:28:30.406 INFO:tasks.ceph.osd.3:Started 2023-10-14T12:28:30.407 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-14T12:28:30.407 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-14T12:28:30.415 INFO:tasks.ceph.osd.4:Started 2023-10-14T12:28:30.415 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-14T12:28:30.416 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-14T12:28:30.424 INFO:tasks.ceph.osd.5:Started 2023-10-14T12:28:30.424 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-14T12:28:30.425 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-14T12:28:30.430 INFO:tasks.ceph.osd.6:Started 2023-10-14T12:28:30.431 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-14T12:28:30.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-14T12:28:30.437 INFO:tasks.ceph.osd.7:Started 2023-10-14T12:28:30.438 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:30.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.637+0000 7f95f359e640 1 Processor -- start 2023-10-14T12:28:30.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.638+0000 7f95f359e640 1 -- start start 2023-10-14T12:28:30.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.639+0000 7f95f359e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f95f40cf240 0x7f95f40d0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.639+0000 7f95f359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f415d4e0 con 0x7f95f40b1c60 2023-10-14T12:28:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.639+0000 7f95f359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95f415e080 con 0x7f95f415cf30 2023-10-14T12:28:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.639+0000 7f95f359e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95f40b2160 con 0x7f95f40cf240 2023-10-14T12:28:30.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.639+0000 7f95f1d9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f95f40b1c60 0x7f95f40cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41026/0 (socket says 172.21.15.64:41026) 2023-10-14T12:28:30.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.639+0000 7f95f1d9b640 1 -- 172.21.15.64:0/2789733325 learned_addr learned my addr 172.21.15.64:0/2789733325 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:30.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.639+0000 7f95f259c640 1 --2- 172.21.15.64:0/2789733325 >> v2:172.21.15.64:3300/0 conn(0x7f95f40cf240 0x7f95f40d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.640+0000 7f95f259c640 1 -- 172.21.15.64:0/2789733325 >> v1:172.21.15.177:6789/0 conn(0x7f95f415cf30 legacy=0x7f95f415d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.640+0000 7f95f259c640 1 -- 172.21.15.64:0/2789733325 >> v1:172.21.15.64:6789/0 conn(0x7f95f40b1c60 legacy=0x7f95f40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.640+0000 7f95f259c640 1 -- 172.21.15.64:0/2789733325 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95f40d3300 con 0x7f95f40cf240 2023-10-14T12:28:30.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.641+0000 7f95f259c640 1 --2- 172.21.15.64:0/2789733325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f40cf240 0x7f95f40d0640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f95e40097a0 tx=0x7f95e402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cfc6ec16da65e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:30.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.641+0000 7f95f159a640 1 -- 172.21.15.64:0/2789733325 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e402f810 con 0x7f95f40cf240 2023-10-14T12:28:30.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.641+0000 7f95f159a640 1 -- 172.21.15.64:0/2789733325 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e402f970 con 0x7f95f40cf240 2023-10-14T12:28:30.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.641+0000 7f95f159a640 1 -- 172.21.15.64:0/2789733325 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e402fd00 con 0x7f95f40cf240 2023-10-14T12:28:30.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.642+0000 7f95f359e640 1 -- 172.21.15.64:0/2789733325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f40cf240 msgr2=0x7f95f40d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.642+0000 7f95f359e640 1 --2- 172.21.15.64:0/2789733325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f40cf240 0x7f95f40d0640 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f95e40097a0 tx=0x7f95e402b9f0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.642+0000 7f95f359e640 1 -- 172.21.15.64:0/2789733325 shutdown_connections 2023-10-14T12:28:30.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.642+0000 7f95f359e640 1 --2- 172.21.15.64:0/2789733325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f40cf240 0x7f95f40d0640 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.642+0000 7f95f359e640 1 -- 172.21.15.64:0/2789733325 >> 172.21.15.64:0/2789733325 conn(0x7f95f4089f70 msgr2=0x7f95f40d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:30.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.642+0000 7f95f359e640 1 -- 172.21.15.64:0/2789733325 shutdown_connections 2023-10-14T12:28:30.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.642+0000 7f95f359e640 1 -- 172.21.15.64:0/2789733325 wait complete. 2023-10-14T12:28:30.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.644+0000 7f95f359e640 1 Processor -- start 2023-10-14T12:28:30.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.644+0000 7f95f359e640 1 -- start start 2023-10-14T12:28:30.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95f40b1c60 0x7f95f40b7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95f40cf240 0x7f95f40cad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f415cf30 0x7f95f40c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:30.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40cb2b0 con 0x7f95f415cf30 2023-10-14T12:28:30.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40b7a20 con 0x7f95f40b1c60 2023-10-14T12:28:30.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95f40b7d00 con 0x7f95f40cf240 2023-10-14T12:28:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f415cf30 0x7f95f40c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95f40b1c60 0x7f95f40b7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f259c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95f40b1c60 0x7f95f40b7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:52040/0 (socket says 172.21.15.64:52040) 2023-10-14T12:28:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f415cf30 0x7f95f40c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:54848/0 (socket says 172.21.15.64:54848) 2023-10-14T12:28:30.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f259c640 1 -- 172.21.15.64:0/2880236016 learned_addr learned my addr 172.21.15.64:0/2880236016 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f1d9b640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95f40cf240 0x7f95f40cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.645+0000 7f95f2d9d640 1 -- 172.21.15.64:0/2880236016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95f40cf240 msgr2=0x7f95f40cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95f2d9d640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95f40cf240 0x7f95f40cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95f2d9d640 1 -- 172.21.15.64:0/2880236016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95f40b1c60 msgr2=0x7f95f40b7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95f2d9d640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95f40b1c60 0x7f95f40b7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95f2d9d640 1 -- 172.21.15.64:0/2880236016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4009400 con 0x7f95f415cf30 2023-10-14T12:28:30.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95f2d9d640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f415cf30 0x7f95f40c9930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f95f415d380 tx=0x7f95ec00cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:30.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95e2ffd640 1 -- 172.21.15.64:0/2880236016 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec003b70 con 0x7f95f415cf30 2023-10-14T12:28:30.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95e2ffd640 1 -- 172.21.15.64:0/2880236016 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ec003cd0 con 0x7f95f415cf30 2023-10-14T12:28:30.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f40b7fe0 con 0x7f95f415cf30 2023-10-14T12:28:30.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95e2ffd640 1 -- 172.21.15.64:0/2880236016 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ec005310 con 0x7f95f415cf30 2023-10-14T12:28:30.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f40c9e70 con 0x7f95f415cf30 2023-10-14T12:28:30.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.646+0000 7f95e2ffd640 1 -- 172.21.15.64:0/2880236016 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f95ec00a640 con 0x7f95f415cf30 2023-10-14T12:28:30.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.647+0000 7f95e2ffd640 1 -- 172.21.15.64:0/2880236016 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f95ec012500 con 0x7f95f415cf30 2023-10-14T12:28:30.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.648+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f404e9b0 con 0x7f95f415cf30 2023-10-14T12:28:30.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.650+0000 7f95e2ffd640 1 -- 172.21.15.64:0/2880236016 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f95ec00a8f0 con 0x7f95f415cf30 2023-10-14T12:28:30.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.714+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f95f415c750 con 0x7f95f415cf30 2023-10-14T12:28:30.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.715+0000 7f95e2ffd640 1 -- 172.21.15.64:0/2880236016 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f95ec00aa90 con 0x7f95f415cf30 2023-10-14T12:28:30.717 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:30.717 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":10,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:30.348896+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:30.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f415cf30 msgr2=0x7f95f40c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:30.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f415cf30 0x7f95f40c9930 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f95f415d380 tx=0x7f95ec00cb90 comp rx=0 tx=0).stop 2023-10-14T12:28:30.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 shutdown_connections 2023-10-14T12:28:30.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95f415cf30 0x7f95f40c9930 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95f40cf240 0x7f95f40cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 --2- 172.21.15.64:0/2880236016 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95f40b1c60 0x7f95f40b7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:30.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 >> 172.21.15.64:0/2880236016 conn(0x7f95f4089f70 msgr2=0x7f95f40cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:30.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 shutdown_connections 2023-10-14T12:28:30.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:30.717+0000 7f95f359e640 1 -- 172.21.15.64:0/2880236016 wait complete. 2023-10-14T12:28:30.741 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-14T12:28:30.742 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-14T12:28:31.106 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T12:28:31.104+0000 7f2805e12500 -1 Falling back to public interface 2023-10-14T12:28:31.123 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T12:28:31.121+0000 7f5d25012500 -1 Falling back to public interface 2023-10-14T12:28:31.132 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T12:28:31.130+0000 7f84bf0af500 -1 Falling back to public interface 2023-10-14T12:28:31.132 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T12:28:31.130+0000 7fb5d4412500 -1 Falling back to public interface 2023-10-14T12:28:31.133 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T12:28:31.130+0000 7f84be056640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2023-10-14T12:28:31.133 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T12:28:31.130+0000 7f84be056640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-10-14T12:28:31.134 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T12:28:31.132+0000 7f7106012500 -1 Falling back to public interface 2023-10-14T12:28:31.134 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T12:28:31.133+0000 7fccbd00d500 -1 Falling back to public interface 2023-10-14T12:28:31.144 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T12:28:31.143+0000 7fbebee0c500 -1 Falling back to public interface 2023-10-14T12:28:31.152 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T12:28:31.150+0000 7fbc10c0c500 -1 Falling back to public interface 2023-10-14T12:28:31.215 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:31.214+0000 7f3518611040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T12:28:31.446 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:31.444+0000 7f279ecb6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-14T12:28:31.527 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:31.525+0000 7f3518611040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T12:28:31.549 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:31.586 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:31.584+0000 7f3518611040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T12:28:31.699 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:31.697+0000 7f3518611040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T12:28:31.713 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.711+0000 7f2a629c5640 1 Processor -- start 2023-10-14T12:28:31.713 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.711+0000 7f2a629c5640 1 -- start start 2023-10-14T12:28:31.715 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.712+0000 7f2a629c5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 0x7f2a5c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.716 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.712+0000 7f2a629c5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2a5c06c970 0x7f2a5c06cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.716 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.712+0000 7f2a629c5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a5c0cb930 con 0x7f2a5c15ae90 2023-10-14T12:28:31.716 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.712+0000 7f2a629c5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5c070260 con 0x7f2a5c06c970 2023-10-14T12:28:31.716 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.712+0000 7f2a629c5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c070540 con 0x7f2a5c0cafb0 2023-10-14T12:28:31.716 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5bfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2a5c15ae90 0x7f2a5c15f230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41036/0 (socket says 172.21.15.64:41036) 2023-10-14T12:28:31.717 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5bfff640 1 -- 172.21.15.64:0/683741340 learned_addr learned my addr 172.21.15.64:0/683741340 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:31.717 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a53fff640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 0x7f2a5c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.717 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a60f62640 1 --2- 172.21.15.64:0/683741340 >> v2:172.21.15.177:3300/0 conn(0x7f2a5c06c970 0x7f2a5c06cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.717 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2634515216 0 0) 0x7f2a5c0cb930 con 0x7f2a5c15ae90 2023-10-14T12:28:31.717 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a48003520 con 0x7f2a5c15ae90 2023-10-14T12:28:31.718 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2774265061 0 0) 0x7f2a48003520 con 0x7f2a5c15ae90 2023-10-14T12:28:31.718 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 msgr2=0x7f2a5c0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:31.718 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 0x7f2a5c0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.718 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 >> v2:172.21.15.177:3300/0 conn(0x7f2a5c06c970 msgr2=0x7f2a5c06cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:31.718 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 --2- 172.21.15.64:0/683741340 >> v2:172.21.15.177:3300/0 conn(0x7f2a5c06c970 0x7f2a5c06cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.719 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c070820 con 0x7f2a5c15ae90 2023-10-14T12:28:31.719 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.713+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f2a4c001670 con 0x7f2a5c15ae90 2023-10-14T12:28:31.719 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 >> v1:172.21.15.64:6789/0 conn(0x7f2a5c15ae90 legacy=0x7f2a5c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:31.719 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5b7fe640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 0x7f2a48003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.719 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5b7fe640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a48003f40 0x7f2a480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.720 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5b7fe640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48004d00 0x7f2a48005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.720 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c070260 con 0x7f2a48003f40 2023-10-14T12:28:31.720 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c070540 con 0x7f2a48004d00 2023-10-14T12:28:31.720 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4800ff20 con 0x7f2a5c0cafb0 2023-10-14T12:28:31.720 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a5bfff640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 0x7f2a48003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.721 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a60f62640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48004d00 0x7f2a48005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.721 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a53fff640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a48003f40 0x7f2a480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.724 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a53fff640 1 -- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 msgr2=0x7f2a48003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:31.724 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a53fff640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c0cafb0 0x7f2a48003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.724 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a53fff640 1 -- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48004d00 msgr2=0x7f2a48005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:31.724 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a53fff640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48004d00 0x7f2a48005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.724 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.714+0000 7f2a53fff640 1 -- 172.21.15.64:0/683741340 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a48003520 con 0x7f2a48003f40 2023-10-14T12:28:31.725 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.716+0000 7f2a53fff640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a48003f40 0x7f2a480047c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c06ade0 tx=0x7f2a480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7d5384b3f9aee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:31.725 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.716+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4402c660 con 0x7f2a48003f40 2023-10-14T12:28:31.725 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.716+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a4402c7c0 con 0x7f2a48003f40 2023-10-14T12:28:31.725 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.716+0000 7f2a5b7fe640 1 -- 172.21.15.64:0/683741340 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4402cb70 con 0x7f2a48003f40 2023-10-14T12:28:31.725 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.717+0000 7f2a629c5640 1 -- 172.21.15.64:0/683741340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a48003f40 msgr2=0x7f2a480047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:31.726 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.717+0000 7f2a629c5640 1 --2- 172.21.15.64:0/683741340 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a48003f40 0x7f2a480047c0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c06ade0 tx=0x7f2a480057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.726 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.717+0000 7f2a60f62640 1 -- 172.21.15.64:0/683741340 reap_dead start 2023-10-14T12:28:31.726 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.717+0000 7f2a629c5640 1 -- 172.21.15.64:0/683741340 shutdown_connections 2023-10-14T12:28:31.726 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.717+0000 7f2a629c5640 1 -- 172.21.15.64:0/683741340 >> 172.21.15.64:0/683741340 conn(0x7f2a5c0b0110 msgr2=0x7f2a5c0b04f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:31.727 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.717+0000 7f2a629c5640 1 -- 172.21.15.64:0/683741340 shutdown_connections 2023-10-14T12:28:31.727 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.717+0000 7f2a629c5640 1 -- 172.21.15.64:0/683741340 wait complete. 2023-10-14T12:28:31.727 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.719+0000 7f2a629c5640 1 Processor -- start 2023-10-14T12:28:31.727 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.719+0000 7f2a629c5640 1 -- start start 2023-10-14T12:28:31.727 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.720+0000 7f2a629c5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48003f40 0x7f2a5c159db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.727 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.720+0000 7f2a629c5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a5c159490 0x7f2a5c1ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.728 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.720+0000 7f2a629c5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c1588d0 0x7f2a5c158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:31.728 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.720+0000 7f2a629c5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c159290 con 0x7f2a5c159490 2023-10-14T12:28:31.728 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.720+0000 7f2a629c5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c15e150 con 0x7f2a48003f40 2023-10-14T12:28:31.728 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.720+0000 7f2a629c5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5c15d540 con 0x7f2a5c1588d0 2023-10-14T12:28:31.728 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a53fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a5c159490 0x7f2a5c1ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.729 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48003f40 0x7f2a5c159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.729 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a5bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48003f40 0x7f2a5c159db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:52072/0 (socket says 172.21.15.64:52072) 2023-10-14T12:28:31.729 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a5bfff640 1 -- 172.21.15.64:0/1997780956 learned_addr learned my addr 172.21.15.64:0/1997780956 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:31.729 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a60f62640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c1588d0 0x7f2a5c158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:31.729 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a53fff640 1 -- 172.21.15.64:0/1997780956 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c1588d0 msgr2=0x7f2a5c158d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:31.730 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a53fff640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c1588d0 0x7f2a5c158d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.730 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a53fff640 1 -- 172.21.15.64:0/1997780956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48003f40 msgr2=0x7f2a5c159db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:31.730 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a53fff640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48003f40 0x7f2a5c159db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.730 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a53fff640 1 -- 172.21.15.64:0/1997780956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c15d820 con 0x7f2a5c159490 2023-10-14T12:28:31.730 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.721+0000 7f2a53fff640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a5c159490 0x7f2a5c1ed3e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800ba60 tx=0x7f2a44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:31.731 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.722+0000 7f2a597fa640 1 -- 172.21.15.64:0/1997780956 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a44034a10 con 0x7f2a5c159490 2023-10-14T12:28:31.731 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.722+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5c15db00 con 0x7f2a5c159490 2023-10-14T12:28:31.731 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.722+0000 7f2a597fa640 1 -- 172.21.15.64:0/1997780956 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a44034b90 con 0x7f2a5c159490 2023-10-14T12:28:31.731 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.722+0000 7f2a597fa640 1 -- 172.21.15.64:0/1997780956 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4403e400 con 0x7f2a5c159490 2023-10-14T12:28:31.731 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.722+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a5c1ed920 con 0x7f2a5c159490 2023-10-14T12:28:31.732 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.723+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5c152de0 con 0x7f2a5c159490 2023-10-14T12:28:31.732 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.723+0000 7f2a597fa640 1 -- 172.21.15.64:0/1997780956 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 2) v1 ==== 44566+0+0 (secure 0 0 0) 0x7f2a4403e560 con 0x7f2a5c159490 2023-10-14T12:28:31.733 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.724+0000 7f2a597fa640 1 -- 172.21.15.64:0/1997780956 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f2a4406b710 con 0x7f2a5c159490 2023-10-14T12:28:31.733 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.726+0000 7f2a597fa640 1 -- 172.21.15.64:0/1997780956 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72483 (secure 0 0 0) 0x7f2a5c152de0 con 0x7f2a5c159490 2023-10-14T12:28:31.778 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:31.777+0000 7f279ecb6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-14T12:28:31.799 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.797+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2a5c152de0 con 0x7f2a5c159490 2023-10-14T12:28:31.800 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.798+0000 7f2a597fa640 1 -- 172.21.15.64:0/1997780956 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f2a5c152de0 con 0x7f2a5c159490 2023-10-14T12:28:31.800 INFO:teuthology.misc.health.smithi064.stdout: 2023-10-14T12:28:31.800 INFO:teuthology.misc.health.smithi064.stdout:{"epoch":10,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:30.348896+0000","last_up_change":"0.000000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:31.801 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a5c159490 msgr2=0x7f2a5c1ed3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:31.802 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a5c159490 0x7f2a5c1ed3e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800ba60 tx=0x7f2a44004730 comp rx=0 tx=0).stop 2023-10-14T12:28:31.802 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 shutdown_connections 2023-10-14T12:28:31.802 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2a5c1588d0 0x7f2a5c158d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.802 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2a5c159490 0x7f2a5c1ed3e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.802 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 --2- 172.21.15.64:0/1997780956 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2a48003f40 0x7f2a5c159db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:31.803 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 >> 172.21.15.64:0/1997780956 conn(0x7f2a5c0b0110 msgr2=0x7f2a5c0cb390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:31.803 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 shutdown_connections 2023-10-14T12:28:31.803 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:31.799+0000 7f2a629c5640 1 -- 172.21.15.64:0/1997780956 wait complete. 2023-10-14T12:28:31.814 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-14T12:28:31.845 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:31.843+0000 7f279ecb6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-14T12:28:31.967 INFO:tasks.ceph.mgr.y.smithi064.stderr:2023-10-14T12:28:31.966+0000 7f279ecb6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-14T12:28:32.740 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:32.739+0000 7f34ba127640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-14T12:28:32.745 INFO:tasks.ceph.mgr.x.smithi177.stderr:2023-10-14T12:28:32.744+0000 7f34ba127640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-14T12:28:34.632 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T12:28:34.631+0000 7f2805e12500 -1 osd.4 0 log_to_monitors true 2023-10-14T12:28:34.686 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T12:28:34.685+0000 7f7106012500 -1 osd.6 0 log_to_monitors true 2023-10-14T12:28:34.699 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T12:28:34.697+0000 7f5d25012500 -1 osd.5 0 log_to_monitors true 2023-10-14T12:28:34.729 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T12:28:34.729+0000 7f84bf0af500 -1 osd.1 0 log_to_monitors true 2023-10-14T12:28:34.735 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T12:28:34.735+0000 7fb5d4412500 -1 osd.3 0 log_to_monitors true 2023-10-14T12:28:34.738 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T12:28:34.736+0000 7fbc10c0c500 -1 osd.7 0 log_to_monitors true 2023-10-14T12:28:34.990 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T12:28:34.990+0000 7fbebee0c500 -1 osd.2 0 log_to_monitors true 2023-10-14T12:28:34.994 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T12:28:34.993+0000 7fccbd00d500 -1 osd.0 0 log_to_monitors true 2023-10-14T12:28:37.478 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T12:28:37.477+0000 7fb5cfd75640 -1 osd.3 0 waiting for initial osdmap 2023-10-14T12:28:37.516 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T12:28:37.515+0000 7fb5c7b95640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:37.566 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T12:28:37.565+0000 7f84bb03b640 -1 osd.1 0 waiting for initial osdmap 2023-10-14T12:28:37.612 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T12:28:37.611+0000 7f84b2e5b640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:38.250 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T12:28:38.247+0000 7fbc0c5da640 -1 osd.7 0 waiting for initial osdmap 2023-10-14T12:28:38.266 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T12:28:38.265+0000 7f28016dd640 -1 osd.4 0 waiting for initial osdmap 2023-10-14T12:28:38.267 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T12:28:38.266+0000 7fbc043fa640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:38.276 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T12:28:38.273+0000 7f5d208dd640 -1 osd.5 0 waiting for initial osdmap 2023-10-14T12:28:38.281 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T12:28:38.279+0000 7f27f94fd640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:38.289 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T12:28:38.287+0000 7f5d186fd640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:38.312 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T12:28:38.310+0000 7f7101975640 -1 osd.6 0 waiting for initial osdmap 2023-10-14T12:28:38.330 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T12:28:38.329+0000 7f70f9795640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:38.464 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T12:28:38.463+0000 7fbeba88b640 -1 osd.2 0 waiting for initial osdmap 2023-10-14T12:28:38.468 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T12:28:38.467+0000 7fccb8898640 -1 osd.0 0 waiting for initial osdmap 2023-10-14T12:28:38.477 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T12:28:38.477+0000 7fbeb26ab640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:38.490 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T12:28:38.490+0000 7fccb06b8640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-14T12:28:38.621 DEBUG:teuthology.orchestra.run.smithi064:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:38.804 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.804+0000 7f37bffff640 1 Processor -- start 2023-10-14T12:28:38.805 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.804+0000 7f37bffff640 1 -- start start 2023-10-14T12:28:38.807 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.806+0000 7f37bffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37c015d7f0 0x7f37c00cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.807 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.806+0000 7f37bffff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00cfbe0 con 0x7f37c00d2570 2023-10-14T12:28:38.807 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.806+0000 7f37beffd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f37c00d2570 0x7f37c00d0320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47846/0 (socket says 172.21.15.64:47846) 2023-10-14T12:28:38.807 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.806+0000 7f37beffd640 1 -- 172.21.15.64:0/4242149871 learned_addr learned my addr 172.21.15.64:0/4242149871 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:38.808 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.806+0000 7f37bffff640 1 -- 172.21.15.64:0/4242149871 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c00cfec0 con 0x7f37c00d2950 2023-10-14T12:28:38.808 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bffff640 1 -- 172.21.15.64:0/4242149871 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00d2de0 con 0x7f37c015d7f0 2023-10-14T12:28:38.810 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276994940 0 0) 0x7f37c00cfbe0 con 0x7f37c00d2570 2023-10-14T12:28:38.810 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37a8003520 con 0x7f37c00d2570 2023-10-14T12:28:38.810 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bf7fe640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37c015d7f0 0x7f37c00cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:38.811 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1138548653 0 0) 0x7f37a8003520 con 0x7f37c00d2570 2023-10-14T12:28:38.811 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37c015d7f0 msgr2=0x7f37c00cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:38.811 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37c015d7f0 0x7f37c00cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:38.811 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 >> v1:172.21.15.177:6789/0 conn(0x7f37c00d2950 legacy=0x7f37c00cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:38.812 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c00cd540 con 0x7f37c00d2570 2023-10-14T12:28:38.812 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f37b00017f0 con 0x7f37c00d2570 2023-10-14T12:28:38.812 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 >> v1:172.21.15.64:6789/0 conn(0x7f37c00d2570 legacy=0x7f37c00d0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:38.812 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a8003a10 0x7f37a8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.812 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37c015d7f0 0x7f37a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.813 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.807+0000 7f37bdffb640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37a8004d50 0x7f37a80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.813 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c00d2de0 con 0x7f37a8004d50 2023-10-14T12:28:38.813 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800bc00 con 0x7f37a8003a10 2023-10-14T12:28:38.813 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a800bdc0 con 0x7f37c015d7f0 2023-10-14T12:28:38.813 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bf7fe640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37a8004d50 0x7f37a80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:38.813 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bf7fe640 1 -- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37c015d7f0 msgr2=0x7f37a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:38.814 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bf7fe640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37c015d7f0 0x7f37a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:38.814 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bf7fe640 1 -- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a8003a10 msgr2=0x7f37a8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:38.814 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bf7fe640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37a8003a10 0x7f37a8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:38.814 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.808+0000 7f37bf7fe640 1 -- 172.21.15.64:0/4242149871 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a8003520 con 0x7f37a8004d50 2023-10-14T12:28:38.815 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.810+0000 7f37bf7fe640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37a8004d50 0x7f37a80051d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f37b8007330 tx=0x7f37a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65af8bc6b946ab6d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:38.817 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.810+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b802ccb0 con 0x7f37a8004d50 2023-10-14T12:28:38.818 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.810+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b802ce10 con 0x7f37a8004d50 2023-10-14T12:28:38.818 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.810+0000 7f37bdffb640 1 -- 172.21.15.64:0/4242149871 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8034660 con 0x7f37a8004d50 2023-10-14T12:28:38.818 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.811+0000 7f37bffff640 1 -- 172.21.15.64:0/4242149871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37a8004d50 msgr2=0x7f37a80051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:38.818 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.811+0000 7f37bffff640 1 --2- 172.21.15.64:0/4242149871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37a8004d50 0x7f37a80051d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f37b8007330 tx=0x7f37a80057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:38.818 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.811+0000 7f37bf7fe640 1 -- 172.21.15.64:0/4242149871 reap_dead start 2023-10-14T12:28:38.819 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.811+0000 7f37bffff640 1 -- 172.21.15.64:0/4242149871 shutdown_connections 2023-10-14T12:28:38.819 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.811+0000 7f37bffff640 1 -- 172.21.15.64:0/4242149871 >> 172.21.15.64:0/4242149871 conn(0x7f37c008c150 msgr2=0x7f37c009ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:38.819 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.811+0000 7f37bffff640 1 -- 172.21.15.64:0/4242149871 shutdown_connections 2023-10-14T12:28:38.819 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.811+0000 7f37bffff640 1 -- 172.21.15.64:0/4242149871 wait complete. 2023-10-14T12:28:38.819 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.812+0000 7f37bffff640 1 Processor -- start 2023-10-14T12:28:38.820 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.813+0000 7f37bffff640 1 -- start start 2023-10-14T12:28:38.820 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.813+0000 7f37bffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a8004d50 0x7f37c01519a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.820 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37bffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c01583c0 0x7f37c00c8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.820 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37bffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37c0158840 0x7f37c015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.820 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37bffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0151ee0 con 0x7f37c01583c0 2023-10-14T12:28:38.821 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37bffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0157320 con 0x7f37c0158840 2023-10-14T12:28:38.821 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37bffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c0157600 con 0x7f37a8004d50 2023-10-14T12:28:38.821 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c01583c0 0x7f37c00c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:38.821 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c01583c0 0x7f37c00c8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39588/0 (socket says 172.21.15.64:39588) 2023-10-14T12:28:38.821 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 -- 172.21.15.64:0/3838275676 learned_addr learned my addr 172.21.15.64:0/3838275676 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:38.822 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37beffd640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a8004d50 0x7f37c01519a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:38.822 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37bf7fe640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37c0158840 0x7f37c015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:38.822 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 -- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a8004d50 msgr2=0x7f37c01519a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:38.822 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a8004d50 0x7f37c01519a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:38.822 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 -- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37c0158840 msgr2=0x7f37c015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:38.823 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37c0158840 0x7f37c015ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:38.823 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 -- 172.21.15.64:0/3838275676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c01578e0 con 0x7f37c01583c0 2023-10-14T12:28:38.823 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.814+0000 7f37be7fc640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c01583c0 0x7f37c00c8900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c410 tx=0x7f37b400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:38.823 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.815+0000 7f37a7fff640 1 -- 172.21.15.64:0/3838275676 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4011790 con 0x7f37c01583c0 2023-10-14T12:28:38.823 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.815+0000 7f37a7fff640 1 -- 172.21.15.64:0/3838275676 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b40118f0 con 0x7f37c01583c0 2023-10-14T12:28:38.823 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.815+0000 7f37a7fff640 1 -- 172.21.15.64:0/3838275676 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b4011ce0 con 0x7f37c01583c0 2023-10-14T12:28:38.824 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.815+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c0157bc0 con 0x7f37c01583c0 2023-10-14T12:28:38.824 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.815+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c00c73e0 con 0x7f37c01583c0 2023-10-14T12:28:38.824 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.816+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c0073f00 con 0x7f37c01583c0 2023-10-14T12:28:38.824 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.817+0000 7f37a7fff640 1 -- 172.21.15.64:0/3838275676 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f37b401c460 con 0x7f37c01583c0 2023-10-14T12:28:38.825 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.818+0000 7f37a7fff640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f37ac06ade0 0x7f37ac06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:38.825 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.818+0000 7f37a7fff640 1 -- 172.21.15.64:0/3838275676 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f37b4088cd0 con 0x7f37c01583c0 2023-10-14T12:28:38.825 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.818+0000 7f37beffd640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f37ac06ade0 0x7f37ac06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:38.826 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.819+0000 7f37beffd640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f37ac06ade0 0x7f37ac06d2a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f37b0001eb0 tx=0x7f37b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:38.826 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:38.823+0000 7f37a7fff640 1 -- 172.21.15.64:0/3838275676 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37b4054330 con 0x7f37c01583c0 2023-10-14T12:28:39.022 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.022+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37c006ae90 con 0x7f37c01583c0 2023-10-14T12:28:39.024 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.023+0000 7f37a7fff640 1 -- 172.21.15.64:0/3838275676 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10896 (secure 0 0 0) 0x7f37b4057950 con 0x7f37c01583c0 2023-10-14T12:28:39.024 INFO:teuthology.misc.health.smithi064.stdout: 2023-10-14T12:28:39.024 INFO:teuthology.misc.health.smithi064.stdout:{"epoch":14,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:38.498621+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:39.027 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f37ac06ade0 msgr2=0x7f37ac06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.027 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f37ac06ade0 0x7f37ac06d2a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f37b0001eb0 tx=0x7f37b0009040 comp rx=0 tx=0).stop 2023-10-14T12:28:39.027 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c01583c0 msgr2=0x7f37c00c8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.027 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c01583c0 0x7f37c00c8900 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f37b400c410 tx=0x7f37b400c8d0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.028 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 shutdown_connections 2023-10-14T12:28:39.028 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f37ac06ade0 0x7f37ac06d2a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.028 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37c0158840 0x7f37c015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.028 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37c01583c0 0x7f37c00c8900 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.028 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 --2- 172.21.15.64:0/3838275676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37a8004d50 0x7f37c01519a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.028 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 >> 172.21.15.64:0/3838275676 conn(0x7f37c008c150 msgr2=0x7f37c015bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:39.029 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 shutdown_connections 2023-10-14T12:28:39.029 INFO:teuthology.misc.health.smithi064.stderr:2023-10-14T12:28:39.026+0000 7f37bffff640 1 -- 172.21.15.64:0/3838275676 wait complete. 2023-10-14T12:28:39.041 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-14T12:28:39.042 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-14T12:28:39.042 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T12:28:39.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T12:28:39.051 INFO:tasks.ceph.mds.a:Started 2023-10-14T12:28:39.051 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T12:28:39.051 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T12:28:39.059 INFO:tasks.ceph.mds.c:Started 2023-10-14T12:28:39.060 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T12:28:39.060 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T12:28:39.069 INFO:tasks.ceph.mds.b:Started 2023-10-14T12:28:39.069 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T12:28:39.070 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T12:28:39.078 INFO:tasks.ceph.mds.d:Started 2023-10-14T12:28:39.079 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-14T12:28:39.079 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:39.216 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2023-10-14T12:28:39.225 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2023-10-14T12:28:39.234 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2023-10-14T12:28:39.235 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2023-10-14T12:28:39.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.282+0000 7f607cd00640 1 Processor -- start 2023-10-14T12:28:39.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.282+0000 7f607cd00640 1 -- start start 2023-10-14T12:28:39.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.283+0000 7f607cd00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815ad00 0x7f60780701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.283+0000 7f607cd00640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60780707f0 con 0x7f60780b0010 2023-10-14T12:28:39.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.283+0000 7f607cd00640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6078070ad0 con 0x7f607815f040 2023-10-14T12:28:39.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.283+0000 7f607cd00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607815b1d0 con 0x7f607815ad00 2023-10-14T12:28:39.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.284+0000 7f607659c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f60780b0010 0x7f60780b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47862/0 (socket says 172.21.15.64:47862) 2023-10-14T12:28:39.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.284+0000 7f607659c640 1 -- 172.21.15.64:0/2424732040 learned_addr learned my addr 172.21.15.64:0/2424732040 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:39.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.284+0000 7f606ffff640 1 --2- 172.21.15.64:0/2424732040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815ad00 0x7f60780701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.284+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387203859 0 0) 0x7f60780707f0 con 0x7f60780b0010 2023-10-14T12:28:39.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.284+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6064003520 con 0x7f60780b0010 2023-10-14T12:28:39.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.284+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4089281142 0 0) 0x7f6078070ad0 con 0x7f607815f040 2023-10-14T12:28:39.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.284+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60780707f0 con 0x7f607815f040 2023-10-14T12:28:39.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.285+0000 7f606ffff640 1 -- 172.21.15.64:0/2424732040 >> v1:172.21.15.177:6789/0 conn(0x7f607815f040 legacy=0x7f607815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.285+0000 7f606ffff640 1 -- 172.21.15.64:0/2424732040 >> v1:172.21.15.64:6789/0 conn(0x7f60780b0010 legacy=0x7f60780b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.285+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 895087586 0 0) 0x7f6064003520 con 0x7f60780b0010 2023-10-14T12:28:39.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.285+0000 7f606ffff640 1 -- 172.21.15.64:0/2424732040 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607815b4b0 con 0x7f607815ad00 2023-10-14T12:28:39.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.286+0000 7f606ffff640 1 --2- 172.21.15.64:0/2424732040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815ad00 0x7f60780701a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60600097d0 tx=0x7f606002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebd464d9db35f74 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:39.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.286+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068001670 con 0x7f607815ad00 2023-10-14T12:28:39.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.286+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606002e050 con 0x7f607815ad00 2023-10-14T12:28:39.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.286+0000 7f6075d9b640 1 -- 172.21.15.64:0/2424732040 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6060030730 con 0x7f607815ad00 2023-10-14T12:28:39.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.287+0000 7f607cd00640 1 -- 172.21.15.64:0/2424732040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815ad00 msgr2=0x7f60780701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.287+0000 7f607cd00640 1 --2- 172.21.15.64:0/2424732040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815ad00 0x7f60780701a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f60600097d0 tx=0x7f606002b800 comp rx=0 tx=0).stop 2023-10-14T12:28:39.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.287+0000 7f607cd00640 1 -- 172.21.15.64:0/2424732040 shutdown_connections 2023-10-14T12:28:39.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.287+0000 7f607cd00640 1 --2- 172.21.15.64:0/2424732040 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815ad00 0x7f60780701a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.287+0000 7f607cd00640 1 -- 172.21.15.64:0/2424732040 >> 172.21.15.64:0/2424732040 conn(0x7f607806c1c0 msgr2=0x7f607806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:39.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.287+0000 7f607cd00640 1 -- 172.21.15.64:0/2424732040 shutdown_connections 2023-10-14T12:28:39.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.287+0000 7f607cd00640 1 -- 172.21.15.64:0/2424732040 wait complete. 2023-10-14T12:28:39.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.288+0000 7f607cd00640 1 Processor -- start 2023-10-14T12:28:39.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.289+0000 7f607cd00640 1 -- start start 2023-10-14T12:28:39.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607cd00640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60780b0010 0x7f60780cc160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607cd00640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607815ad00 0x7f607814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607cd00640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815f040 0x7f6078154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607cd00640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60780cd400 con 0x7f60780b0010 2023-10-14T12:28:39.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607cd00640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607815eb40 con 0x7f607815ad00 2023-10-14T12:28:39.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607cd00640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60780cc7f0 con 0x7f607815f040 2023-10-14T12:28:39.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60780b0010 0x7f60780cc160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60780b0010 0x7f60780cc160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39608/0 (socket says 172.21.15.64:39608) 2023-10-14T12:28:39.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 -- 172.21.15.64:0/2758452306 learned_addr learned my addr 172.21.15.64:0/2758452306 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:39.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f606ffff640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607815ad00 0x7f607814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f6076d9d640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815f040 0x7f6078154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 -- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815f040 msgr2=0x7f6078154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815f040 0x7f6078154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 -- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607815ad00 msgr2=0x7f607814fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607815ad00 0x7f607814fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.290+0000 7f607659c640 1 -- 172.21.15.64:0/2758452306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6060009400 con 0x7f60780b0010 2023-10-14T12:28:39.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.291+0000 7f607659c640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60780b0010 0x7f60780cc160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f606800c750 tx=0x7f606800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:39.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.291+0000 7f606effd640 1 -- 172.21.15.64:0/2758452306 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068005ad0 con 0x7f60780b0010 2023-10-14T12:28:39.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.291+0000 7f606effd640 1 -- 172.21.15.64:0/2758452306 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6068005c30 con 0x7f60780b0010 2023-10-14T12:28:39.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.291+0000 7f606effd640 1 -- 172.21.15.64:0/2758452306 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6068007070 con 0x7f60780b0010 2023-10-14T12:28:39.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.291+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60780ccad0 con 0x7f60780b0010 2023-10-14T12:28:39.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.291+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60780cd090 con 0x7f60780b0010 2023-10-14T12:28:39.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.292+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6078073ef0 con 0x7f60780b0010 2023-10-14T12:28:39.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.293+0000 7f606effd640 1 -- 172.21.15.64:0/2758452306 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f60680071d0 con 0x7f60780b0010 2023-10-14T12:28:39.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.294+0000 7f606effd640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f605806ae10 0x7f605806d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.294+0000 7f606effd640 1 -- 172.21.15.64:0/2758452306 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f6068088c20 con 0x7f60780b0010 2023-10-14T12:28:39.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.294+0000 7f606ffff640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f605806ae10 0x7f605806d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.295+0000 7f606ffff640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f605806ae10 0x7f605806d2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6060034000 tx=0x7f6060008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:39.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.299+0000 7f606effd640 1 -- 172.21.15.64:0/2758452306 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6068054290 con 0x7f60780b0010 2023-10-14T12:28:39.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.495+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60780703b0 con 0x7f60780b0010 2023-10-14T12:28:39.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.496+0000 7f606effd640 1 -- 172.21.15.64:0/2758452306 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10896 (secure 0 0 0) 0x7f60680578b0 con 0x7f60780b0010 2023-10-14T12:28:39.497 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:39.497 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":14,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:38.498621+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:39.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.498+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f605806ae10 msgr2=0x7f605806d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.498+0000 7f607cd00640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f605806ae10 0x7f605806d2d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6060034000 tx=0x7f6060008030 comp rx=0 tx=0).stop 2023-10-14T12:28:39.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.498+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60780b0010 msgr2=0x7f60780cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.498+0000 7f607cd00640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60780b0010 0x7f60780cc160 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f606800c750 tx=0x7f606800cc10 comp rx=0 tx=0).stop 2023-10-14T12:28:39.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 shutdown_connections 2023-10-14T12:28:39.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f605806ae10 0x7f605806d2d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f607815f040 0x7f6078154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f607815ad00 0x7f607814fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 --2- 172.21.15.64:0/2758452306 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f60780b0010 0x7f60780cc160 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 >> 172.21.15.64:0/2758452306 conn(0x7f607806c1c0 msgr2=0x7f6078072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:39.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 shutdown_connections 2023-10-14T12:28:39.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.499+0000 7f607cd00640 1 -- 172.21.15.64:0/2758452306 wait complete. 2023-10-14T12:28:39.519 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-14T12:28:39.519 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:28:39.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.744+0000 7f3e1051d640 1 Processor -- start 2023-10-14T12:28:39.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.744+0000 7f3e1051d640 1 -- start start 2023-10-14T12:28:39.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.746+0000 7f3e1051d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3e080ca190 0x7f3e080b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.746+0000 7f3e1051d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e08070e20 con 0x7f3e08158f70 2023-10-14T12:28:39.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.746+0000 7f3e1051d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e08070af0 con 0x7f3e080cb8a0 2023-10-14T12:28:39.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.746+0000 7f3e1051d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e080cc870 con 0x7f3e080ca190 2023-10-14T12:28:39.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.747+0000 7f3e0eaba640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f3e080cb8a0 0x7f3e080712b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:51038/0 (socket says 172.21.15.64:51038) 2023-10-14T12:28:39.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.747+0000 7f3e0eaba640 1 -- 172.21.15.64:0/477663690 learned_addr learned my addr 172.21.15.64:0/477663690 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:39.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.747+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3455823099 0 0) 0x7f3e08070af0 con 0x7f3e080cb8a0 2023-10-14T12:28:39.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3df4003520 con 0x7f3e080cb8a0 2023-10-14T12:28:39.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3760155205 0 0) 0x7f3df4003520 con 0x7f3e080cb8a0 2023-10-14T12:28:39.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 >> v2:172.21.15.64:3300/0 conn(0x7f3e080ca190 msgr2=0x7f3e080b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:39.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 --2- 172.21.15.64:0/477663690 >> v2:172.21.15.64:3300/0 conn(0x7f3e080ca190 0x7f3e080b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 >> v1:172.21.15.64:6789/0 conn(0x7f3e08158f70 legacy=0x7f3e080cc160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:39.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080ad8d0 con 0x7f3e080cb8a0 2023-10-14T12:28:39.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f3e000019f0 con 0x7f3e080cb8a0 2023-10-14T12:28:39.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 >> v1:172.21.15.177:6789/0 conn(0x7f3e080cb8a0 legacy=0x7f3e080712b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3df4003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3df40047c0 0x7f3df4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df4005380 0x7f3df400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080cc870 con 0x7f3df40047c0 2023-10-14T12:28:39.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3df400c240 con 0x7f3df4005380 2023-10-14T12:28:39.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.748+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3df400e610 con 0x7f3df4003a30 2023-10-14T12:28:39.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.749+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3df4003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.749+0000 7f3e0eaba640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df4005380 0x7f3df400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.750+0000 7f3e0e2b9640 1 -- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df4005380 msgr2=0x7f3df400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:39.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.750+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df4005380 0x7f3df400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.750+0000 7f3e0e2b9640 1 -- 172.21.15.64:0/477663690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3df40047c0 msgr2=0x7f3df4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:39.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.750+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3df40047c0 0x7f3df4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.750+0000 7f3e0e2b9640 1 -- 172.21.15.64:0/477663690 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df4003520 con 0x7f3df4003a30 2023-10-14T12:28:39.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.750+0000 7f3e0eaba640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3df4005380 0x7f3df400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:39.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.750+0000 7f3e0eaba640 1 -- 172.21.15.64:0/477663690 reap_dead start 2023-10-14T12:28:39.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.752+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3df4003e30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e04001650 tx=0x7f3df40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66554d173b470ee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:39.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.752+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04005270 con 0x7f3df4003a30 2023-10-14T12:28:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.752+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0402e070 con 0x7f3df4003a30 2023-10-14T12:28:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.752+0000 7f3e0d2b7640 1 -- 172.21.15.64:0/477663690 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04003610 con 0x7f3df4003a30 2023-10-14T12:28:39.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.753+0000 7f3e1051d640 1 -- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 msgr2=0x7f3df4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.753+0000 7f3e1051d640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3df4003e30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3e04001650 tx=0x7f3df40057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.753+0000 7f3e1051d640 1 -- 172.21.15.64:0/477663690 shutdown_connections 2023-10-14T12:28:39.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.753+0000 7f3e1051d640 1 --2- 172.21.15.64:0/477663690 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3df4003e30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.753+0000 7f3e1051d640 1 -- 172.21.15.64:0/477663690 >> 172.21.15.64:0/477663690 conn(0x7f3e0806c1c0 msgr2=0x7f3e0806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:39.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.753+0000 7f3e1051d640 1 -- 172.21.15.64:0/477663690 shutdown_connections 2023-10-14T12:28:39.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.753+0000 7f3e1051d640 1 -- 172.21.15.64:0/477663690 wait complete. 2023-10-14T12:28:39.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.756+0000 7f3e1051d640 1 Processor -- start 2023-10-14T12:28:39.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.756+0000 7f3e1051d640 1 -- start start 2023-10-14T12:28:39.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.757+0000 7f3e1051d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3e080c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.757+0000 7f3e1051d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e08155860 0x7f3e080c3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.757+0000 7f3e1051d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e080b3360 0x7f3e080b37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.757+0000 7f3e1051d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080b3d20 con 0x7f3e080b3360 2023-10-14T12:28:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.757+0000 7f3e1051d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e080c4080 con 0x7f3e08155860 2023-10-14T12:28:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.757+0000 7f3e1051d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e08155cc0 con 0x7f3df4003a30 2023-10-14T12:28:39.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0eaba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e080b3360 0x7f3e080b37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0eaba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e080b3360 0x7f3e080b37e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39642/0 (socket says 172.21.15.64:39642) 2023-10-14T12:28:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0eaba640 1 -- 172.21.15.64:0/1348003724 learned_addr learned my addr 172.21.15.64:0/1348003724 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:39.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3e080c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0dab8640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e08155860 0x7f3e080c3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0e2b9640 1 -- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e08155860 msgr2=0x7f3e080c3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e08155860 0x7f3e080c3b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0e2b9640 1 -- 172.21.15.64:0/1348003724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e080b3360 msgr2=0x7f3e080b37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:39.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e080b3360 0x7f3e080b37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:39.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.758+0000 7f3e0e2b9640 1 -- 172.21.15.64:0/1348003724 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e080c42c0 con 0x7f3df4003a30 2023-10-14T12:28:39.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.759+0000 7f3e0e2b9640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3e080c4b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e04030000 tx=0x7f3e04000fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:39.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.759+0000 7f3dfeffd640 1 -- 172.21.15.64:0/1348003724 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e04042070 con 0x7f3df4003a30 2023-10-14T12:28:39.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.759+0000 7f3dfeffd640 1 -- 172.21.15.64:0/1348003724 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e04007040 con 0x7f3df4003a30 2023-10-14T12:28:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.759+0000 7f3dfeffd640 1 -- 172.21.15.64:0/1348003724 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e040073f0 con 0x7f3df4003a30 2023-10-14T12:28:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.759+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e081569a0 con 0x7f3df4003a30 2023-10-14T12:28:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.760+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e08156f60 con 0x7f3df4003a30 2023-10-14T12:28:39.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.761+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e081570f0 con 0x7f3df4003a30 2023-10-14T12:28:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.763+0000 7f3dfeffd640 1 -- 172.21.15.64:0/1348003724 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f3e04030030 con 0x7f3df4003a30 2023-10-14T12:28:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.764+0000 7f3dfeffd640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3dec06ade0 0x7f3dec06d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:39.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.764+0000 7f3dfeffd640 1 -- 172.21.15.64:0/1348003724 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f3e040a9d70 con 0x7f3df4003a30 2023-10-14T12:28:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.765+0000 7f3e0dab8640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3dec06ade0 0x7f3dec06d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:39.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.766+0000 7f3e0dab8640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3dec06ade0 0x7f3dec06d2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e080c85b0 tx=0x7f3df8009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:39.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:39.779+0000 7f3dfeffd640 1 -- 172.21.15.64:0/1348003724 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e04075610 con 0x7f3df4003a30 2023-10-14T12:28:39.853 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:28:39.862 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:28:40.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.021+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e08073ef0 con 0x7f3df4003a30 2023-10-14T12:28:40.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.022+0000 7f3dfeffd640 1 -- 172.21.15.64:0/1348003724 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1321 (secure 0 0 0) 0x7f3e04078c30 con 0x7f3df4003a30 2023-10-14T12:28:40.024 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:40.024 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-10-14T12:28:40.024 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 2 2023-10-14T12:28:40.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3dec06ade0 msgr2=0x7f3dec06d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:40.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3dec06ade0 0x7f3dec06d2a0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3e080c85b0 tx=0x7f3df8009190 comp rx=0 tx=0).stop 2023-10-14T12:28:40.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 msgr2=0x7f3e080c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:40.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3e080c4b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f3e04030000 tx=0x7f3e04000fb0 comp rx=0 tx=0).stop 2023-10-14T12:28:40.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 shutdown_connections 2023-10-14T12:28:40.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3dec06ade0 0x7f3dec06d2a0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:40.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e080b3360 0x7f3e080b37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:40.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e08155860 0x7f3e080c3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:40.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 --2- 172.21.15.64:0/1348003724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3df4003a30 0x7f3e080c4b90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:40.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.024+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 >> 172.21.15.64:0/1348003724 conn(0x7f3e0806c1c0 msgr2=0x7f3e080af420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:40.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.025+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 shutdown_connections 2023-10-14T12:28:40.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:40.025+0000 7f3e1051d640 1 -- 172.21.15.64:0/1348003724 wait complete. 2023-10-14T12:28:42.046 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:28:42.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.256+0000 7fc7d4808640 1 Processor -- start 2023-10-14T12:28:42.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.257+0000 7fc7d4808640 1 -- start start 2023-10-14T12:28:42.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7d4808640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d00cb250 0x7fc7d00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7d4808640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7d00ca660 0x7fc7d00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7d4808640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7d015acb0 con 0x7fc7d015a8d0 2023-10-14T12:28:42.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7d4808640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7d00c1c60 con 0x7fc7d00ca660 2023-10-14T12:28:42.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7d4808640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d015e350 con 0x7fc7d00cb250 2023-10-14T12:28:42.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7ced9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fc7d015a8d0 0x7fc7d00cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47886/0 (socket says 172.21.15.64:47886) 2023-10-14T12:28:42.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7ced9d640 1 -- 172.21.15.64:0/472199926 learned_addr learned my addr 172.21.15.64:0/472199926 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.258+0000 7fc7cf59e640 1 --2- 172.21.15.64:0/472199926 >> v2:172.21.15.64:3300/0 conn(0x7fc7d00ca660 0x7fc7d00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.259+0000 7fc7c7fff640 1 --2- 172.21.15.64:0/472199926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d00cb250 0x7fc7d00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.259+0000 7fc7cf59e640 1 -- 172.21.15.64:0/472199926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d00cb250 msgr2=0x7fc7d00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.259+0000 7fc7cf59e640 1 --2- 172.21.15.64:0/472199926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d00cb250 0x7fc7d00c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.259+0000 7fc7cf59e640 1 -- 172.21.15.64:0/472199926 >> v1:172.21.15.64:6789/0 conn(0x7fc7d015a8d0 legacy=0x7fc7d00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.259+0000 7fc7cf59e640 1 -- 172.21.15.64:0/472199926 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d015e630 con 0x7fc7d00ca660 2023-10-14T12:28:42.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.260+0000 7fc7cf59e640 1 --2- 172.21.15.64:0/472199926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00ca660 0x7fc7d00c9350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009d90 tx=0x7fc7c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7eed52e8223c883 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.260+0000 7fc7ce59c640 1 -- 172.21.15.64:0/472199926 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c802cc50 con 0x7fc7d00ca660 2023-10-14T12:28:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.260+0000 7fc7ce59c640 1 -- 172.21.15.64:0/472199926 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c802cdb0 con 0x7fc7d00ca660 2023-10-14T12:28:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7ce59c640 1 -- 172.21.15.64:0/472199926 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8034660 con 0x7fc7d00ca660 2023-10-14T12:28:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 -- 172.21.15.64:0/472199926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00ca660 msgr2=0x7fc7d00c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 --2- 172.21.15.64:0/472199926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00ca660 0x7fc7d00c9350 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8009d90 tx=0x7fc7c802bea0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 -- 172.21.15.64:0/472199926 shutdown_connections 2023-10-14T12:28:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 --2- 172.21.15.64:0/472199926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00ca660 0x7fc7d00c9350 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 --2- 172.21.15.64:0/472199926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d00cb250 0x7fc7d00c8e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 -- 172.21.15.64:0/472199926 >> 172.21.15.64:0/472199926 conn(0x7fc7d006a470 msgr2=0x7fc7d00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:42.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 -- 172.21.15.64:0/472199926 shutdown_connections 2023-10-14T12:28:42.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.261+0000 7fc7d4808640 1 -- 172.21.15.64:0/472199926 wait complete. 2023-10-14T12:28:42.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.263+0000 7fc7d4808640 1 Processor -- start 2023-10-14T12:28:42.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.263+0000 7fc7d4808640 1 -- start start 2023-10-14T12:28:42.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.264+0000 7fc7d4808640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d00ca660 0x7fc7d015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.264+0000 7fc7d4808640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00cb250 0x7fc7d014ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.264+0000 7fc7d4808640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d015a8d0 0x7fc7d014b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.264+0000 7fc7d4808640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00b13a0 con 0x7fc7d00cb250 2023-10-14T12:28:42.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.264+0000 7fc7d4808640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00b32d0 con 0x7fc7d00ca660 2023-10-14T12:28:42.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.264+0000 7fc7d4808640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7d00b3e50 con 0x7fc7d015a8d0 2023-10-14T12:28:42.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00cb250 0x7fc7d014ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00cb250 0x7fc7d014ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39656/0 (socket says 172.21.15.64:39656) 2023-10-14T12:28:42.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 -- 172.21.15.64:0/1389907983 learned_addr learned my addr 172.21.15.64:0/1389907983 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:42.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7ced9d640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d00ca660 0x7fc7d015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7cf59e640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d015a8d0 0x7fc7d014b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 -- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d015a8d0 msgr2=0x7fc7d014b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d015a8d0 0x7fc7d014b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 -- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d00ca660 msgr2=0x7fc7d015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d00ca660 0x7fc7d015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.265+0000 7fc7c7fff640 1 -- 172.21.15.64:0/1389907983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c8009a70 con 0x7fc7d00cb250 2023-10-14T12:28:42.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.266+0000 7fc7c7fff640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00cb250 0x7fc7d014ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800d800 tx=0x7fc7b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:42.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.266+0000 7fc7c77fe640 1 -- 172.21.15.64:0/1389907983 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800b6c0 con 0x7fc7d00cb250 2023-10-14T12:28:42.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.266+0000 7fc7c77fe640 1 -- 172.21.15.64:0/1389907983 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b800b820 con 0x7fc7d00cb250 2023-10-14T12:28:42.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.266+0000 7fc7c77fe640 1 -- 172.21.15.64:0/1389907983 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800bbb0 con 0x7fc7d00cb250 2023-10-14T12:28:42.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.266+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7d015dc20 con 0x7fc7d00cb250 2023-10-14T12:28:42.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.266+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d00b3800 con 0x7fc7d00cb250 2023-10-14T12:28:42.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.268+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7d00b3f90 con 0x7fc7d00cb250 2023-10-14T12:28:42.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.268+0000 7fc7c77fe640 1 -- 172.21.15.64:0/1389907983 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fc7b800bd10 con 0x7fc7d00cb250 2023-10-14T12:28:42.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.270+0000 7fc7c77fe640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b006ade0 0x7fc7b006d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.270+0000 7fc7c77fe640 1 -- 172.21.15.64:0/1389907983 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc7b8089750 con 0x7fc7d00cb250 2023-10-14T12:28:42.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.276+0000 7fc7c77fe640 1 -- 172.21.15.64:0/1389907983 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7b8054c30 con 0x7fc7d00cb250 2023-10-14T12:28:42.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.279+0000 7fc7ced9d640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b006ade0 0x7fc7b006d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.280+0000 7fc7ced9d640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b006ade0 0x7fc7b006d2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00010e0 tx=0x7fc7c0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:42.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.511+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7d004e9b0 con 0x7fc7d00cb250 2023-10-14T12:28:42.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.512+0000 7fc7c77fe640 1 -- 172.21.15.64:0/1389907983 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3688 (secure 0 0 0) 0x7fc7b8058250 con 0x7fc7d00cb250 2023-10-14T12:28:42.514 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:42.515 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-10-14T12:28:42.515 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 3 2023-10-14T12:28:42.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b006ade0 msgr2=0x7fc7b006d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b006ade0 0x7fc7b006d2a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc7c00010e0 tx=0x7fc7c0009040 comp rx=0 tx=0).stop 2023-10-14T12:28:42.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00cb250 msgr2=0x7fc7d014ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00cb250 0x7fc7d014ef90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc7b800d800 tx=0x7fc7b800dcc0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 shutdown_connections 2023-10-14T12:28:42.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b006ade0 0x7fc7b006d2a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7d015a8d0 0x7fc7d014b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7d00cb250 0x7fc7d014ef90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 --2- 172.21.15.64:0/1389907983 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7d00ca660 0x7fc7d015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 >> 172.21.15.64:0/1389907983 conn(0x7fc7d006a470 msgr2=0x7fc7d0158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:42.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 shutdown_connections 2023-10-14T12:28:42.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.515+0000 7fc7d4808640 1 -- 172.21.15.64:0/1389907983 wait complete. 2023-10-14T12:28:42.535 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:42.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.743+0000 7fd70566d640 1 Processor -- start 2023-10-14T12:28:42.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.743+0000 7fd70566d640 1 -- start start 2023-10-14T12:28:42.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd70566d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd70015c9d0 0x7fd7000cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd70566d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd7000d16a0 0x7fd7000cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd70566d640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7000b2f90 con 0x7fd7000ce4d0 2023-10-14T12:28:42.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd70566d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7000d0320 con 0x7fd7000d16a0 2023-10-14T12:28:42.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd70566d640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7000d0600 con 0x7fd70015c9d0 2023-10-14T12:28:42.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd6f7fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd7000d16a0 0x7fd7000cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd6f7fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd7000d16a0 0x7fd7000cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39670/0 (socket says 172.21.15.64:39670) 2023-10-14T12:28:42.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd6f7fff640 1 -- 172.21.15.64:0/136797706 learned_addr learned my addr 172.21.15.64:0/136797706 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:42.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.745+0000 7fd6fffff640 1 --2- 172.21.15.64:0/136797706 >> v2:172.21.15.177:3300/0 conn(0x7fd70015c9d0 0x7fd7000cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.749 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.746+0000 7fd6f7fff640 1 -- 172.21.15.64:0/136797706 >> v2:172.21.15.177:3300/0 conn(0x7fd70015c9d0 msgr2=0x7fd7000cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:42.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.746+0000 7fd6f7fff640 1 --2- 172.21.15.64:0/136797706 >> v2:172.21.15.177:3300/0 conn(0x7fd70015c9d0 0x7fd7000cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.746+0000 7fd6f7fff640 1 -- 172.21.15.64:0/136797706 >> v1:172.21.15.177:6789/0 conn(0x7fd7000ce4d0 legacy=0x7fd700160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:42.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.746+0000 7fd6f7fff640 1 -- 172.21.15.64:0/136797706 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000d08e0 con 0x7fd7000d16a0 2023-10-14T12:28:42.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.747+0000 7fd6f7fff640 1 --2- 172.21.15.64:0/136797706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd7000cf140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7000d26b0 tx=0x7fd6e802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47779aa7dcb7bad2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:42.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.747+0000 7fd6ff7fe640 1 -- 172.21.15.64:0/136797706 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8031870 con 0x7fd7000d16a0 2023-10-14T12:28:42.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.747+0000 7fd6ff7fe640 1 -- 172.21.15.64:0/136797706 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e80319d0 con 0x7fd7000d16a0 2023-10-14T12:28:42.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.747+0000 7fd6ff7fe640 1 -- 172.21.15.64:0/136797706 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e8031d60 con 0x7fd7000d16a0 2023-10-14T12:28:42.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 -- 172.21.15.64:0/136797706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 msgr2=0x7fd7000cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 --2- 172.21.15.64:0/136797706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd7000cf140 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fd7000d26b0 tx=0x7fd6e802b910 comp rx=0 tx=0).stop 2023-10-14T12:28:42.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 -- 172.21.15.64:0/136797706 shutdown_connections 2023-10-14T12:28:42.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 --2- 172.21.15.64:0/136797706 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd7000cf140 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 --2- 172.21.15.64:0/136797706 >> v2:172.21.15.177:3300/0 conn(0x7fd70015c9d0 0x7fd7000cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 -- 172.21.15.64:0/136797706 >> 172.21.15.64:0/136797706 conn(0x7fd70009bad0 msgr2=0x7fd7000d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:42.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 -- 172.21.15.64:0/136797706 shutdown_connections 2023-10-14T12:28:42.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.748+0000 7fd70566d640 1 -- 172.21.15.64:0/136797706 wait complete. 2023-10-14T12:28:42.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.751+0000 7fd70566d640 1 Processor -- start 2023-10-14T12:28:42.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.752+0000 7fd70566d640 1 -- start start 2023-10-14T12:28:42.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.753+0000 7fd70566d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7000ce4d0 0x7fd70014bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.753+0000 7fd70566d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd70015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.753+0000 7fd70566d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd70015c9d0 0x7fd70015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.753+0000 7fd70566d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70014c3e0 con 0x7fd7000d16a0 2023-10-14T12:28:42.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.753+0000 7fd70566d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000c9820 con 0x7fd70015c9d0 2023-10-14T12:28:42.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.753+0000 7fd70566d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7000c9b00 con 0x7fd7000ce4d0 2023-10-14T12:28:42.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.753+0000 7fd6f7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd70015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd70015a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39682/0 (socket says 172.21.15.64:39682) 2023-10-14T12:28:42.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 -- 172.21.15.64:0/1969722538 learned_addr learned my addr 172.21.15.64:0/1969722538 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:42.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6fffff640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7000ce4d0 0x7fd70014bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd704e6c640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd70015c9d0 0x7fd70015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 -- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7000ce4d0 msgr2=0x7fd70014bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7000ce4d0 0x7fd70014bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 -- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd70015c9d0 msgr2=0x7fd70015abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd70015c9d0 0x7fd70015abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 -- 172.21.15.64:0/1969722538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e80094d0 con 0x7fd7000d16a0 2023-10-14T12:28:42.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd704e6c640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd70015c9d0 0x7fd70015abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:42.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.754+0000 7fd6f7fff640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd70015a6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6e802b950 tx=0x7fd6e80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:42.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.755+0000 7fd6fd7fa640 1 -- 172.21.15.64:0/1969722538 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e803ad30 con 0x7fd7000d16a0 2023-10-14T12:28:42.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.755+0000 7fd6fd7fa640 1 -- 172.21.15.64:0/1969722538 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e80443f0 con 0x7fd7000d16a0 2023-10-14T12:28:42.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.755+0000 7fd6fd7fa640 1 -- 172.21.15.64:0/1969722538 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e80447a0 con 0x7fd7000d16a0 2023-10-14T12:28:42.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.755+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7000c9de0 con 0x7fd7000d16a0 2023-10-14T12:28:42.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.755+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7000ca3a0 con 0x7fd7000d16a0 2023-10-14T12:28:42.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.756+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70004e9b0 con 0x7fd7000d16a0 2023-10-14T12:28:42.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.757+0000 7fd6fd7fa640 1 -- 172.21.15.64:0/1969722538 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7fd6e8044900 con 0x7fd7000d16a0 2023-10-14T12:28:42.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.758+0000 7fd6fd7fa640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6e006ae10 0x7fd6e006d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:42.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.758+0000 7fd6fd7fa640 1 -- 172.21.15.64:0/1969722538 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6e802d040 con 0x7fd7000d16a0 2023-10-14T12:28:42.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.759+0000 7fd6fffff640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6e006ae10 0x7fd6e006d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:42.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.760+0000 7fd6fffff640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6e006ae10 0x7fd6e006d2d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006fd0 tx=0x7fd6f0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:42.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.763+0000 7fd6fd7fa640 1 -- 172.21.15.64:0/1969722538 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd6e8076cf0 con 0x7fd7000d16a0 2023-10-14T12:28:42.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.961+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd7000cc950 con 0x7fd7000d16a0 2023-10-14T12:28:42.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.962+0000 7fd6fd7fa640 1 -- 172.21.15.64:0/1969722538 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12838 (secure 0 0 0) 0x7fd6e8035070 con 0x7fd7000d16a0 2023-10-14T12:28:42.963 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:42.963 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:42.527964+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:42.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.964+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6e006ae10 msgr2=0x7fd6e006d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.964+0000 7fd70566d640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6e006ae10 0x7fd6e006d2d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd6f0006fd0 tx=0x7fd6f0008040 comp rx=0 tx=0).stop 2023-10-14T12:28:42.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 msgr2=0x7fd70015a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:42.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd70015a6b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd6e802b950 tx=0x7fd6e80046c0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 shutdown_connections 2023-10-14T12:28:42.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6e006ae10 0x7fd6e006d2d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd70015c9d0 0x7fd70015abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7000d16a0 0x7fd70015a6b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 --2- 172.21.15.64:0/1969722538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7000ce4d0 0x7fd70014bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:42.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 >> 172.21.15.64:0/1969722538 conn(0x7fd70009bad0 msgr2=0x7fd7000b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:42.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 shutdown_connections 2023-10-14T12:28:42.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:42.965+0000 7fd70566d640 1 -- 172.21.15.64:0/1969722538 wait complete. 2023-10-14T12:28:42.983 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:28:42.983 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:28:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.203+0000 7ff876b54640 1 Processor -- start 2023-10-14T12:28:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.203+0000 7ff876b54640 1 -- start start 2023-10-14T12:28:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff876b54640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff870071b50 0x7ff870159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff876b54640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8700cdc00 0x7ff87006bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff876b54640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8700c89d0 con 0x7ff870071f30 2023-10-14T12:28:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff876b54640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff870071600 con 0x7ff870071b50 2023-10-14T12:28:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff876b54640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87015a260 con 0x7ff8700cdc00 2023-10-14T12:28:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff875b52640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff870071b50 0x7ff870159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff875351640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ff870071f30 0x7ff870070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47896/0 (socket says 172.21.15.64:47896) 2023-10-14T12:28:43.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff875351640 1 -- 172.21.15.64:0/1344311253 learned_addr learned my addr 172.21.15.64:0/1344311253 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:43.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.205+0000 7ff875b52640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff870071b50 0x7ff870159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39696/0 (socket says 172.21.15.64:39696) 2023-10-14T12:28:43.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.206+0000 7ff876353640 1 --2- 172.21.15.64:0/1344311253 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8700cdc00 0x7ff87006bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.206+0000 7ff875b52640 1 -- 172.21.15.64:0/1344311253 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8700cdc00 msgr2=0x7ff87006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:43.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.206+0000 7ff875b52640 1 --2- 172.21.15.64:0/1344311253 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8700cdc00 0x7ff87006bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.206+0000 7ff875b52640 1 -- 172.21.15.64:0/1344311253 >> v1:172.21.15.64:6789/0 conn(0x7ff870071f30 legacy=0x7ff870070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.206+0000 7ff875b52640 1 -- 172.21.15.64:0/1344311253 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff87015a540 con 0x7ff870071b50 2023-10-14T12:28:43.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.207+0000 7ff875b52640 1 --2- 172.21.15.64:0/1344311253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071b50 0x7ff870159c10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0097a0 tx=0x7ff86c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=605b8f76b4e2c6d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:43.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.207+0000 7ff874b50640 1 -- 172.21.15.64:0/1344311253 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c02d040 con 0x7ff870071b50 2023-10-14T12:28:43.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.207+0000 7ff874b50640 1 -- 172.21.15.64:0/1344311253 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c031810 con 0x7ff870071b50 2023-10-14T12:28:43.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.207+0000 7ff874b50640 1 -- 172.21.15.64:0/1344311253 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c031ba0 con 0x7ff870071b50 2023-10-14T12:28:43.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 -- 172.21.15.64:0/1344311253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071b50 msgr2=0x7ff870159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 --2- 172.21.15.64:0/1344311253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071b50 0x7ff870159c10 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff86c0097a0 tx=0x7ff86c02b8b0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 -- 172.21.15.64:0/1344311253 shutdown_connections 2023-10-14T12:28:43.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 --2- 172.21.15.64:0/1344311253 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff8700cdc00 0x7ff87006bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 --2- 172.21.15.64:0/1344311253 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071b50 0x7ff870159c10 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 -- 172.21.15.64:0/1344311253 >> 172.21.15.64:0/1344311253 conn(0x7ff87006a470 msgr2=0x7ff8700afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:43.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 -- 172.21.15.64:0/1344311253 shutdown_connections 2023-10-14T12:28:43.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.208+0000 7ff876b54640 1 -- 172.21.15.64:0/1344311253 wait complete. 2023-10-14T12:28:43.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.210+0000 7ff876b54640 1 Processor -- start 2023-10-14T12:28:43.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.210+0000 7ff876b54640 1 -- start start 2023-10-14T12:28:43.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff876b54640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff870071b50 0x7ff8700b10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff876b54640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071f30 0x7ff87014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff876b54640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8700cdc00 0x7ff8700c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff876b54640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700b15f0 con 0x7ff870071f30 2023-10-14T12:28:43.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff876b54640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700cab40 con 0x7ff8700cdc00 2023-10-14T12:28:43.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff876b54640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700cae20 con 0x7ff870071b50 2023-10-14T12:28:43.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff875351640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071f30 0x7ff87014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff875351640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071f30 0x7ff87014e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39698/0 (socket says 172.21.15.64:39698) 2023-10-14T12:28:43.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff875351640 1 -- 172.21.15.64:0/256396653 learned_addr learned my addr 172.21.15.64:0/256396653 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:43.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.211+0000 7ff875b52640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff870071b50 0x7ff8700b10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff876353640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8700cdc00 0x7ff8700c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff875351640 1 -- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff870071b50 msgr2=0x7ff8700b10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff875351640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff870071b50 0x7ff8700b10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff875351640 1 -- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8700cdc00 msgr2=0x7ff8700c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff875351640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8700cdc00 0x7ff8700c7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff875351640 1 -- 172.21.15.64:0/256396653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c009400 con 0x7ff870071f30 2023-10-14T12:28:43.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff875351640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071f30 0x7ff87014e1f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff86000c500 tx=0x7ff86000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:43.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff8667fc640 1 -- 172.21.15.64:0/256396653 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860005ce0 con 0x7ff870071f30 2023-10-14T12:28:43.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff8667fc640 1 -- 172.21.15.64:0/256396653 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff860005e40 con 0x7ff870071f30 2023-10-14T12:28:43.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8700cb100 con 0x7ff870071f30 2023-10-14T12:28:43.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff8667fc640 1 -- 172.21.15.64:0/256396653 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8600072f0 con 0x7ff870071f30 2023-10-14T12:28:43.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.212+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8700cb6c0 con 0x7ff870071f30 2023-10-14T12:28:43.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.214+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8700cb8e0 con 0x7ff870071f30 2023-10-14T12:28:43.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.215+0000 7ff8667fc640 1 -- 172.21.15.64:0/256396653 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff860007510 con 0x7ff870071f30 2023-10-14T12:28:43.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.215+0000 7ff8667fc640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff85406ade0 0x7ff85406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.216+0000 7ff8667fc640 1 -- 172.21.15.64:0/256396653 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff860088690 con 0x7ff870071f30 2023-10-14T12:28:43.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.216+0000 7ff875b52640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff85406ade0 0x7ff85406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.217+0000 7ff875b52640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff85406ade0 0x7ff85406d2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff86c036000 tx=0x7ff86c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:43.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.220+0000 7ff8667fc640 1 -- 172.21.15.64:0/256396653 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff860053b80 con 0x7ff870071f30 2023-10-14T12:28:43.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.422+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff87004e9b0 con 0x7ff870071f30 2023-10-14T12:28:43.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.423+0000 7ff8667fc640 1 -- 172.21.15.64:0/256396653 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff860017020 con 0x7ff870071f30 2023-10-14T12:28:43.423 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:28:43.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff85406ade0 msgr2=0x7ff85406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff85406ade0 0x7ff85406d2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff86c036000 tx=0x7ff86c03c040 comp rx=0 tx=0).stop 2023-10-14T12:28:43.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071f30 msgr2=0x7ff87014e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071f30 0x7ff87014e1f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff86000c500 tx=0x7ff86000c9c0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 shutdown_connections 2023-10-14T12:28:43.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff85406ade0 0x7ff85406d2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8700cdc00 0x7ff8700c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff870071f30 0x7ff87014e1f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 --2- 172.21.15.64:0/256396653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff870071b50 0x7ff8700b10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.425+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 >> 172.21.15.64:0/256396653 conn(0x7ff87006a470 msgr2=0x7ff87006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:43.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.426+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 shutdown_connections 2023-10-14T12:28:43.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.426+0000 7ff876b54640 1 -- 172.21.15.64:0/256396653 wait complete. 2023-10-14T12:28:43.445 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T12:28:43.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.660+0000 7f0533fff640 1 Processor -- start 2023-10-14T12:28:43.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.661+0000 7f0533fff640 1 -- start start 2023-10-14T12:28:43.663 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f0533fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f053415c9d0 0x7f05340cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f0533fff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340d0320 con 0x7f05340d16a0 2023-10-14T12:28:43.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f0533fff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05340d0600 con 0x7f05340cf850 2023-10-14T12:28:43.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f0533fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05340d08e0 con 0x7f053415c9d0 2023-10-14T12:28:43.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f052bfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f05340d16a0 0x7f05340cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47910/0 (socket says 172.21.15.64:47910) 2023-10-14T12:28:43.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f052bfff640 1 -- 172.21.15.64:0/1201844295 learned_addr learned my addr 172.21.15.64:0/1201844295 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:43.665 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f0532ffd640 1 --2- 172.21.15.64:0/1201844295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f053415c9d0 0x7f05340cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f05327fc640 1 -- 172.21.15.64:0/1201844295 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110763114 0 0) 0x7f05340d0320 con 0x7f05340d16a0 2023-10-14T12:28:43.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.663+0000 7f05327fc640 1 -- 172.21.15.64:0/1201844295 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0520003520 con 0x7f05340d16a0 2023-10-14T12:28:43.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.664+0000 7f05327fc640 1 -- 172.21.15.64:0/1201844295 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3207655940 0 0) 0x7f05340d0600 con 0x7f05340cf850 2023-10-14T12:28:43.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.664+0000 7f05327fc640 1 -- 172.21.15.64:0/1201844295 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05340d0320 con 0x7f05340cf850 2023-10-14T12:28:43.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.664+0000 7f0532ffd640 1 -- 172.21.15.64:0/1201844295 >> v1:172.21.15.177:6789/0 conn(0x7f05340cf850 legacy=0x7f05340b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.664+0000 7f0532ffd640 1 -- 172.21.15.64:0/1201844295 >> v1:172.21.15.64:6789/0 conn(0x7f05340d16a0 legacy=0x7f05340cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.664+0000 7f0532ffd640 1 -- 172.21.15.64:0/1201844295 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05340d0bc0 con 0x7f053415c9d0 2023-10-14T12:28:43.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.665+0000 7f0532ffd640 1 --2- 172.21.15.64:0/1201844295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f053415c9d0 0x7f05340cdf90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05240097d0 tx=0x7f052402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffc46cf8f28ec377 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:43.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.665+0000 7f05327fc640 1 -- 172.21.15.64:0/1201844295 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524031890 con 0x7f053415c9d0 2023-10-14T12:28:43.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f05327fc640 1 -- 172.21.15.64:0/1201844295 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05240319f0 con 0x7f053415c9d0 2023-10-14T12:28:43.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f05327fc640 1 -- 172.21.15.64:0/1201844295 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0524031d60 con 0x7f053415c9d0 2023-10-14T12:28:43.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f0533fff640 1 -- 172.21.15.64:0/1201844295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f053415c9d0 msgr2=0x7f05340cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f0533fff640 1 --2- 172.21.15.64:0/1201844295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f053415c9d0 0x7f05340cdf90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f05240097d0 tx=0x7f052402b930 comp rx=0 tx=0).stop 2023-10-14T12:28:43.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f0533fff640 1 -- 172.21.15.64:0/1201844295 shutdown_connections 2023-10-14T12:28:43.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f0533fff640 1 --2- 172.21.15.64:0/1201844295 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f053415c9d0 0x7f05340cdf90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f0533fff640 1 -- 172.21.15.64:0/1201844295 >> 172.21.15.64:0/1201844295 conn(0x7f053409bad0 msgr2=0x7f05340d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:43.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f0533fff640 1 -- 172.21.15.64:0/1201844295 shutdown_connections 2023-10-14T12:28:43.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.666+0000 7f0533fff640 1 -- 172.21.15.64:0/1201844295 wait complete. 2023-10-14T12:28:43.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.669+0000 7f0533fff640 1 Processor -- start 2023-10-14T12:28:43.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.669+0000 7f0533fff640 1 -- start start 2023-10-14T12:28:43.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f0533fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05340cf850 0x7f05341f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f0533fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05340d16a0 0x7f053414b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f0533fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f053415c9d0 0x7f053406c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f0533fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341f20e0 con 0x7f053415c9d0 2023-10-14T12:28:43.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f0533fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053415e550 con 0x7f05340d16a0 2023-10-14T12:28:43.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f0533fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053415e7d0 con 0x7f05340cf850 2023-10-14T12:28:43.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f05337fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f053415c9d0 0x7f053406c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f0532ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05340cf850 0x7f05341f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f05337fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f053415c9d0 0x7f053406c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39700/0 (socket says 172.21.15.64:39700) 2023-10-14T12:28:43.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f05337fe640 1 -- 172.21.15.64:0/3188844844 learned_addr learned my addr 172.21.15.64:0/3188844844 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:43.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.670+0000 7f052bfff640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05340d16a0 0x7f053414b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.671+0000 7f05337fe640 1 -- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05340cf850 msgr2=0x7f05341f1ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.671+0000 7f05337fe640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05340cf850 0x7f05341f1ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.671+0000 7f05337fe640 1 -- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05340d16a0 msgr2=0x7f053414b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.671+0000 7f05337fe640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05340d16a0 0x7f053414b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.671+0000 7f05337fe640 1 -- 172.21.15.64:0/3188844844 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0524009400 con 0x7f053415c9d0 2023-10-14T12:28:43.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.671+0000 7f05337fe640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f053415c9d0 0x7f053406c390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f052c00c680 tx=0x7f052c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:43.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.671+0000 7f0530ff9640 1 -- 172.21.15.64:0/3188844844 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c003b70 con 0x7f053415c9d0 2023-10-14T12:28:43.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.672+0000 7f0530ff9640 1 -- 172.21.15.64:0/3188844844 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052c003cd0 con 0x7f053415c9d0 2023-10-14T12:28:43.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.672+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f053414be50 con 0x7f053415c9d0 2023-10-14T12:28:43.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.672+0000 7f0530ff9640 1 -- 172.21.15.64:0/3188844844 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052c005310 con 0x7f053415c9d0 2023-10-14T12:28:43.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.672+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053415ea90 con 0x7f053415c9d0 2023-10-14T12:28:43.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.673+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053414c370 con 0x7f053415c9d0 2023-10-14T12:28:43.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.674+0000 7f0530ff9640 1 -- 172.21.15.64:0/3188844844 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7f052c005470 con 0x7f053415c9d0 2023-10-14T12:28:43.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.675+0000 7f0530ff9640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f051406ade0 0x7f051406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:43.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.675+0000 7f0530ff9640 1 -- 172.21.15.64:0/3188844844 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f052c088d60 con 0x7f053415c9d0 2023-10-14T12:28:43.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.675+0000 7f0532ffd640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f051406ade0 0x7f051406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:43.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.676+0000 7f0532ffd640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f051406ade0 0x7f051406d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0524036000 tx=0x7f0524008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:43.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.679+0000 7f0530ff9640 1 -- 172.21.15.64:0/3188844844 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f052c054380 con 0x7f053415c9d0 2023-10-14T12:28:43.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.876+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f053404e9b0 con 0x7f053415c9d0 2023-10-14T12:28:43.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.877+0000 7f0530ff9640 1 -- 172.21.15.64:0/3188844844 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f052c0579a0 con 0x7f053415c9d0 2023-10-14T12:28:43.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:43.879 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2023-10-14T12:28:43.879 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:28:43.880 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2023-10-14T12:28:43.880 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2023-10-14T12:28:43.880 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:28:43.880 INFO:teuthology.orchestra.run.smithi064.stdout:] 2023-10-14T12:28:43.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f051406ade0 msgr2=0x7f051406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f051406ade0 0x7f051406d2a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0524036000 tx=0x7f0524008030 comp rx=0 tx=0).stop 2023-10-14T12:28:43.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f053415c9d0 msgr2=0x7f053406c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:43.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f053415c9d0 0x7f053406c390 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f052c00c680 tx=0x7f052c00cb40 comp rx=0 tx=0).stop 2023-10-14T12:28:43.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 shutdown_connections 2023-10-14T12:28:43.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f051406ade0 0x7f051406d2a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f053415c9d0 0x7f053406c390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f05340d16a0 0x7f053414b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 --2- 172.21.15.64:0/3188844844 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05340cf850 0x7f05341f1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:43.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 >> 172.21.15.64:0/3188844844 conn(0x7f053409bad0 msgr2=0x7f05340b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:43.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 shutdown_connections 2023-10-14T12:28:43.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:43.880+0000 7f0533fff640 1 -- 172.21.15.64:0/3188844844 wait complete. 2023-10-14T12:28:43.901 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-14T12:28:43.902 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-14T12:28:44.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.126+0000 7ff90a002640 1 Processor -- start 2023-10-14T12:28:44.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.126+0000 7ff90a002640 1 -- start start 2023-10-14T12:28:44.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.128+0000 7ff90a002640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff90415cb80 0x7ff9040cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.128+0000 7ff90a002640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9040cc1e0 con 0x7ff9040cc470 2023-10-14T12:28:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.128+0000 7ff90a002640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9040ccac0 con 0x7ff9040cacf0 2023-10-14T12:28:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.128+0000 7ff90a002640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff904070170 con 0x7ff90415cb80 2023-10-14T12:28:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.128+0000 7ff903fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff90415cb80 0x7ff9040cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:44.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.128+0000 7ff903fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff90415cb80 0x7ff9040cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39704/0 (socket says 172.21.15.64:39704) 2023-10-14T12:28:44.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.128+0000 7ff903fff640 1 -- 172.21.15.64:0/3241356839 learned_addr learned my addr 172.21.15.64:0/3241356839 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.129+0000 7ff903fff640 1 -- 172.21.15.64:0/3241356839 >> v1:172.21.15.177:6789/0 conn(0x7ff9040cacf0 legacy=0x7ff9040cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.129+0000 7ff903fff640 1 -- 172.21.15.64:0/3241356839 >> v1:172.21.15.64:6789/0 conn(0x7ff9040cc470 legacy=0x7ff904070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.129+0000 7ff9037fe640 1 -- 172.21.15.64:0/3241356839 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1186886965 0 0) 0x7ff9040cc1e0 con 0x7ff9040cc470 2023-10-14T12:28:44.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.129+0000 7ff903fff640 1 -- 172.21.15.64:0/3241356839 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9040ccda0 con 0x7ff90415cb80 2023-10-14T12:28:44.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.130+0000 7ff903fff640 1 --2- 172.21.15.64:0/3241356839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9040cdc20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009870 tx=0x7ff8f002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65d1506d8ae77de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:44.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.130+0000 7ff9037fe640 1 -- 172.21.15.64:0/3241356839 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f002f840 con 0x7ff90415cb80 2023-10-14T12:28:44.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.130+0000 7ff9037fe640 1 -- 172.21.15.64:0/3241356839 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8f002f9a0 con 0x7ff90415cb80 2023-10-14T12:28:44.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.130+0000 7ff9037fe640 1 -- 172.21.15.64:0/3241356839 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8f002fd30 con 0x7ff90415cb80 2023-10-14T12:28:44.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.131+0000 7ff90a002640 1 -- 172.21.15.64:0/3241356839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 msgr2=0x7ff9040cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:44.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.131+0000 7ff90a002640 1 --2- 172.21.15.64:0/3241356839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9040cdc20 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff8f0009870 tx=0x7ff8f002ba20 comp rx=0 tx=0).stop 2023-10-14T12:28:44.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.131+0000 7ff90a002640 1 -- 172.21.15.64:0/3241356839 shutdown_connections 2023-10-14T12:28:44.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.131+0000 7ff90a002640 1 --2- 172.21.15.64:0/3241356839 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9040cdc20 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:44.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.131+0000 7ff90a002640 1 -- 172.21.15.64:0/3241356839 >> 172.21.15.64:0/3241356839 conn(0x7ff90406a4a0 msgr2=0x7ff9040afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:44.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.131+0000 7ff90a002640 1 -- 172.21.15.64:0/3241356839 shutdown_connections 2023-10-14T12:28:44.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.131+0000 7ff90a002640 1 -- 172.21.15.64:0/3241356839 wait complete. 2023-10-14T12:28:44.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.133+0000 7ff90a002640 1 Processor -- start 2023-10-14T12:28:44.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.133+0000 7ff90a002640 1 -- start start 2023-10-14T12:28:44.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff90a002640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9040cacf0 0x7ff9041f24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:44.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff90a002640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9040cc470 0x7ff9040c7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:44.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff90a002640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9041f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:44.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff90a002640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9040c8340 con 0x7ff90415cb80 2023-10-14T12:28:44.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff90a002640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff90414bf40 con 0x7ff9040cc470 2023-10-14T12:28:44.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff90a002640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9041f57f0 con 0x7ff9040cacf0 2023-10-14T12:28:44.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff909801640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9041f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:44.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff909801640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9041f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39714/0 (socket says 172.21.15.64:39714) 2023-10-14T12:28:44.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff909801640 1 -- 172.21.15.64:0/746443010 learned_addr learned my addr 172.21.15.64:0/746443010 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:44.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff903fff640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9040cc470 0x7ff9040c7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:44.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.134+0000 7ff909000640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9040cacf0 0x7ff9041f24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:44.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff909801640 1 -- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9040cacf0 msgr2=0x7ff9041f24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:44.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff909801640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9040cacf0 0x7ff9041f24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:44.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff909801640 1 -- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9040cc470 msgr2=0x7ff9040c7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:44.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff909801640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9040cc470 0x7ff9040c7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:44.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff909801640 1 -- 172.21.15.64:0/746443010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00094d0 con 0x7ff90415cb80 2023-10-14T12:28:44.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff909801640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9041f4fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc001560 tx=0x7ff8fc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:44.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff9017fa640 1 -- 172.21.15.64:0/746443010 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc003da0 con 0x7ff90415cb80 2023-10-14T12:28:44.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff9017fa640 1 -- 172.21.15.64:0/746443010 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8fc005070 con 0x7ff90415cb80 2023-10-14T12:28:44.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9041f5ad0 con 0x7ff90415cb80 2023-10-14T12:28:44.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.135+0000 7ff9017fa640 1 -- 172.21.15.64:0/746443010 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8fc005420 con 0x7ff90415cb80 2023-10-14T12:28:44.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.136+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9041f54e0 con 0x7ff90415cb80 2023-10-14T12:28:44.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.136+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff90414c3f0 con 0x7ff90415cb80 2023-10-14T12:28:44.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.138+0000 7ff9017fa640 1 -- 172.21.15.64:0/746443010 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 4) v1 ==== 89173+0+0 (secure 0 0 0) 0x7ff8fc005580 con 0x7ff90415cb80 2023-10-14T12:28:44.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.139+0000 7ff9017fa640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff8e806ade0 0x7ff8e806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:44.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.139+0000 7ff9017fa640 1 -- 172.21.15.64:0/746443010 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8fc088b00 con 0x7ff90415cb80 2023-10-14T12:28:44.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.140+0000 7ff909000640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff8e806ade0 0x7ff8e806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:44.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.141+0000 7ff909000640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff8e806ade0 0x7ff8e806d2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9040709e0 tx=0x7ff8f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:44.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.143+0000 7ff9017fa640 1 -- 172.21.15.64:0/746443010 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff90414c3f0 con 0x7ff90415cb80 2023-10-14T12:28:44.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:44.341+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff90414c3f0 con 0x7ff90415cb80 2023-10-14T12:28:45.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.029+0000 7ff9017fa640 1 -- 172.21.15.64:0/746443010 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff90414c3f0 con 0x7ff90415cb80 2023-10-14T12:28:45.030 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' created 2023-10-14T12:28:45.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.032+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff8e806ade0 msgr2=0x7ff8e806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:45.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.032+0000 7ff90a002640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff8e806ade0 0x7ff8e806d2a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff9040709e0 tx=0x7ff8f8009040 comp rx=0 tx=0).stop 2023-10-14T12:28:45.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.032+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 msgr2=0x7ff9041f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:45.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.032+0000 7ff90a002640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9041f4fa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8fc001560 tx=0x7ff8fc00cc70 comp rx=0 tx=0).stop 2023-10-14T12:28:45.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 shutdown_connections 2023-10-14T12:28:45.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff8e806ade0 0x7ff8e806d2a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:45.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff90415cb80 0x7ff9041f4fa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:45.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff9040cc470 0x7ff9040c7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:45.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 --2- 172.21.15.64:0/746443010 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff9040cacf0 0x7ff9041f24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:45.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 >> 172.21.15.64:0/746443010 conn(0x7ff90406a4a0 msgr2=0x7ff904071210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:45.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 shutdown_connections 2023-10-14T12:28:45.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.033+0000 7ff90a002640 1 -- 172.21.15.64:0/746443010 wait complete. 2023-10-14T12:28:45.066 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-10-14T12:28:45.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.269+0000 7f24c6f6e640 1 Processor -- start 2023-10-14T12:28:45.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.270+0000 7f24c6f6e640 1 -- start start 2023-10-14T12:28:45.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.271+0000 7f24c6f6e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f24c015ac60 0x7f24c00cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:45.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.271+0000 7f24c6f6e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c00704f0 con 0x7f24c00ad640 2023-10-14T12:28:45.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.271+0000 7f24c6f6e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24c0070740 con 0x7f24c015a880 2023-10-14T12:28:45.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.271+0000 7f24c6f6e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24c0070a20 con 0x7f24c015ac60 2023-10-14T12:28:45.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.271+0000 7f24bffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f24c015ac60 0x7f24c00cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:45.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.272+0000 7f24bffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f24c015ac60 0x7f24c00cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39724/0 (socket says 172.21.15.64:39724) 2023-10-14T12:28:45.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.272+0000 7f24bffff640 1 -- 172.21.15.64:0/1708662909 learned_addr learned my addr 172.21.15.64:0/1708662909 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:45.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.272+0000 7f24c550b640 1 --1- 172.21.15.64:0/1708662909 >> v1:172.21.15.64:6789/0 conn(0x7f24c00ad640 0x7f24c00cec10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47928/0 (socket says 172.21.15.64:47928) 2023-10-14T12:28:45.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.272+0000 7f24bffff640 1 -- 172.21.15.64:0/1708662909 >> v1:172.21.15.177:6789/0 conn(0x7f24c015a880 legacy=0x7f24c015e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:45.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.272+0000 7f24bffff640 1 -- 172.21.15.64:0/1708662909 >> v1:172.21.15.64:6789/0 conn(0x7f24c00ad640 legacy=0x7f24c00cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:45.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.272+0000 7f24bf7fe640 1 -- 172.21.15.64:0/1708662909 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356215652 0 0) 0x7f24c00704f0 con 0x7f24c00ad640 2023-10-14T12:28:45.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.272+0000 7f24bffff640 1 -- 172.21.15.64:0/1708662909 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0070d00 con 0x7f24c015ac60 2023-10-14T12:28:45.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.273+0000 7f24bffff640 1 --2- 172.21.15.64:0/1708662909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c015ac60 0x7f24c00cb320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009870 tx=0x7f24b402b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3739442a44a3bb2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:45.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.273+0000 7f24bf7fe640 1 -- 172.21.15.64:0/1708662909 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4030850 con 0x7f24c015ac60 2023-10-14T12:28:45.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.273+0000 7f24bf7fe640 1 -- 172.21.15.64:0/1708662909 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b40309b0 con 0x7f24c015ac60 2023-10-14T12:28:45.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.273+0000 7f24bf7fe640 1 -- 172.21.15.64:0/1708662909 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b4030d40 con 0x7f24c015ac60 2023-10-14T12:28:45.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.274+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1708662909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c015ac60 msgr2=0x7f24c00cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:45.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.274+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1708662909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c015ac60 0x7f24c00cb320 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f24b4009870 tx=0x7f24b402b990 comp rx=0 tx=0).stop 2023-10-14T12:28:45.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.274+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1708662909 shutdown_connections 2023-10-14T12:28:45.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.274+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1708662909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c015ac60 0x7f24c00cb320 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:45.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.274+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1708662909 >> 172.21.15.64:0/1708662909 conn(0x7f24c00660e0 msgr2=0x7f24c0069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:45.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.274+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1708662909 shutdown_connections 2023-10-14T12:28:45.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.274+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1708662909 wait complete. 2023-10-14T12:28:45.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.276+0000 7f24c6f6e640 1 Processor -- start 2023-10-14T12:28:45.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.276+0000 7f24c6f6e640 1 -- start start 2023-10-14T12:28:45.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c6f6e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c00ad640 0x7f24c00c3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:45.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c6f6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24c015a880 0x7f24c00c4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:45.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c6f6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24c015ac60 0x7f24c0156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:45.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c6f6e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00b32d0 con 0x7f24c00ad640 2023-10-14T12:28:45.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c6f6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c5310 con 0x7f24c015a880 2023-10-14T12:28:45.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c6f6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24c00c3d30 con 0x7f24c015ac60 2023-10-14T12:28:45.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c4d0a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c00ad640 0x7f24c00c3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:45.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c4d0a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c00ad640 0x7f24c00c3630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39728/0 (socket says 172.21.15.64:39728) 2023-10-14T12:28:45.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.277+0000 7f24c4d0a640 1 -- 172.21.15.64:0/1215452556 learned_addr learned my addr 172.21.15.64:0/1215452556 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:45.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c4d0a640 1 -- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24c015ac60 msgr2=0x7f24c0156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:45.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24bffff640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24c015a880 0x7f24c00c4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:45.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c550b640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24c015ac60 0x7f24c0156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:45.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c4d0a640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24c015ac60 0x7f24c0156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:45.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c4d0a640 1 -- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24c015a880 msgr2=0x7f24c00c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:45.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c4d0a640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24c015a880 0x7f24c00c4dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:45.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c4d0a640 1 -- 172.21.15.64:0/1215452556 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24b40094d0 con 0x7f24c00ad640 2023-10-14T12:28:45.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24bffff640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24c015a880 0x7f24c00c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:45.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c550b640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24c015ac60 0x7f24c0156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:45.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.278+0000 7f24c4d0a640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c00ad640 0x7f24c00c3630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24b000c7c0 tx=0x7f24b000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:45.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.279+0000 7f24bd7fa640 1 -- 172.21.15.64:0/1215452556 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b000aa50 con 0x7f24c00ad640 2023-10-14T12:28:45.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.279+0000 7f24bd7fa640 1 -- 172.21.15.64:0/1215452556 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24b000abb0 con 0x7f24c00ad640 2023-10-14T12:28:45.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.279+0000 7f24bd7fa640 1 -- 172.21.15.64:0/1215452556 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24b0012420 con 0x7f24c00ad640 2023-10-14T12:28:45.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.279+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c00c4010 con 0x7f24c00ad640 2023-10-14T12:28:45.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.279+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c00c45d0 con 0x7f24c00ad640 2023-10-14T12:28:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.280+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c00cc360 con 0x7f24c00ad640 2023-10-14T12:28:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.281+0000 7f24bd7fa640 1 -- 172.21.15.64:0/1215452556 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f24b0012580 con 0x7f24c00ad640 2023-10-14T12:28:45.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.282+0000 7f24bd7fa640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f24ac06ae70 0x7f24ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:45.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.282+0000 7f24bd7fa640 1 -- 172.21.15.64:0/1215452556 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f24b0089760 con 0x7f24c00ad640 2023-10-14T12:28:45.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.283+0000 7f24bffff640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f24ac06ae70 0x7f24ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:45.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.284+0000 7f24bffff640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f24ac06ae70 0x7f24ac06d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24b4036000 tx=0x7f24b403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:45.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.287+0000 7f24bd7fa640 1 -- 172.21.15.64:0/1215452556 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f24b0054950 con 0x7f24c00ad640 2023-10-14T12:28:45.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:45.479+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f24c0073ef0 con 0x7f24c00ad640 2023-10-14T12:28:46.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.042+0000 7f24bd7fa640 1 -- 172.21.15.64:0/1215452556 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f24b0057f70 con 0x7f24c00ad640 2023-10-14T12:28:46.044 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' created 2023-10-14T12:28:46.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f24ac06ae70 msgr2=0x7f24ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:46.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f24ac06ae70 0x7f24ac06d330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f24b4036000 tx=0x7f24b403b040 comp rx=0 tx=0).stop 2023-10-14T12:28:46.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c00ad640 msgr2=0x7f24c00c3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:46.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c00ad640 0x7f24c00c3630 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f24b000c7c0 tx=0x7f24b000cc80 comp rx=0 tx=0).stop 2023-10-14T12:28:46.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 shutdown_connections 2023-10-14T12:28:46.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f24ac06ae70 0x7f24ac06d330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f24c015ac60 0x7f24c0156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f24c015a880 0x7f24c00c4dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 --2- 172.21.15.64:0/1215452556 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f24c00ad640 0x7f24c00c3630 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.047+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 >> 172.21.15.64:0/1215452556 conn(0x7f24c00660e0 msgr2=0x7f24c0159ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:46.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.048+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 shutdown_connections 2023-10-14T12:28:46.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.048+0000 7f24c6f6e640 1 -- 172.21.15.64:0/1215452556 wait complete. 2023-10-14T12:28:46.086 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-14T12:28:46.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.280+0000 7fc31ab67640 1 Processor -- start 2023-10-14T12:28:46.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.280+0000 7fc31ab67640 1 -- start start 2023-10-14T12:28:46.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.281+0000 7fc31ab67640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc3140cf030 0x7fc31406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc31ab67640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3141550f0 con 0x7fc31406d360 2023-10-14T12:28:46.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc31ab67640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc31406db50 con 0x7fc314154d10 2023-10-14T12:28:46.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc31ab67640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3140b13f0 con 0x7fc3140cf030 2023-10-14T12:28:46.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc31a366640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fc31406d360 0x7fc3140ac1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42702/0 (socket says 172.21.15.64:42702) 2023-10-14T12:28:46.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc31a366640 1 -- 172.21.15.64:0/3904996717 learned_addr learned my addr 172.21.15.64:0/3904996717 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:46.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc319364640 1 --2- 172.21.15.64:0/3904996717 >> v2:172.21.15.177:3300/0 conn(0x7fc3140cf030 0x7fc31406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1917188787 0 0) 0x7fc3141550f0 con 0x7fc31406d360 2023-10-14T12:28:46.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.282+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc300003520 con 0x7fc31406d360 2023-10-14T12:28:46.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1872110556 0 0) 0x7fc300003520 con 0x7fc31406d360 2023-10-14T12:28:46.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 >> v2:172.21.15.177:3300/0 conn(0x7fc3140cf030 msgr2=0x7fc31406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:46.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 --2- 172.21.15.64:0/3904996717 >> v2:172.21.15.177:3300/0 conn(0x7fc3140cf030 0x7fc31406ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 >> v1:172.21.15.177:6789/0 conn(0x7fc314154d10 legacy=0x7fc3140ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:46.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140b16d0 con 0x7fc31406d360 2023-10-14T12:28:46.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fc30c0019f0 con 0x7fc31406d360 2023-10-14T12:28:46.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 >> v1:172.21.15.64:6789/0 conn(0x7fc31406d360 legacy=0x7fc3140ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:46.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3000039e0 0x7fc300003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3000047c0 0x7fc300004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc300005180 0x7fc30000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140b13f0 con 0x7fc3000039e0 2023-10-14T12:28:46.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c0b0 con 0x7fc300005180 2023-10-14T12:28:46.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30000c270 con 0x7fc3000047c0 2023-10-14T12:28:46.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.283+0000 7fc319b65640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3000039e0 0x7fc300003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc319364640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3000047c0 0x7fc300004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc31a366640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc300005180 0x7fc30000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc319b65640 1 -- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3000047c0 msgr2=0x7fc300004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:46.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc319b65640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3000047c0 0x7fc300004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc319b65640 1 -- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc300005180 msgr2=0x7fc30000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:46.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc319b65640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc300005180 0x7fc30000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc319b65640 1 -- 172.21.15.64:0/3904996717 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc300003520 con 0x7fc3000039e0 2023-10-14T12:28:46.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc319364640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3000047c0 0x7fc300004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:46.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc31a366640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc300005180 0x7fc30000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:46.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.284+0000 7fc31a366640 1 -- 172.21.15.64:0/3904996717 reap_dead start 2023-10-14T12:28:46.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.285+0000 7fc319b65640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3000039e0 0x7fc300003e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc310001750 tx=0x7fc3000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ada554afcc47310 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:46.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.285+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3100052d0 con 0x7fc3000039e0 2023-10-14T12:28:46.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.285+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc31002e050 con 0x7fc3000039e0 2023-10-14T12:28:46.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.285+0000 7fc318b63640 1 -- 172.21.15.64:0/3904996717 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310003830 con 0x7fc3000039e0 2023-10-14T12:28:46.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.286+0000 7fc31ab67640 1 -- 172.21.15.64:0/3904996717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3000039e0 msgr2=0x7fc300003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:46.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.286+0000 7fc31ab67640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3000039e0 0x7fc300003e00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fc310001750 tx=0x7fc3000057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.286+0000 7fc31ab67640 1 -- 172.21.15.64:0/3904996717 shutdown_connections 2023-10-14T12:28:46.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.286+0000 7fc31ab67640 1 --2- 172.21.15.64:0/3904996717 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc3000039e0 0x7fc300003e00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.286+0000 7fc31ab67640 1 -- 172.21.15.64:0/3904996717 >> 172.21.15.64:0/3904996717 conn(0x7fc31406a200 msgr2=0x7fc31406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:46.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.286+0000 7fc31ab67640 1 -- 172.21.15.64:0/3904996717 shutdown_connections 2023-10-14T12:28:46.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.286+0000 7fc31ab67640 1 -- 172.21.15.64:0/3904996717 wait complete. 2023-10-14T12:28:46.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.288+0000 7fc31ab67640 1 Processor -- start 2023-10-14T12:28:46.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.288+0000 7fc31ab67640 1 -- start start 2023-10-14T12:28:46.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31ab67640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3000039e0 0x7fc3141540e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31ab67640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3140ab150 0x7fc3140bcb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31ab67640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc314070f90 0x7fc314071410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31ab67640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc314071950 con 0x7fc314070f90 2023-10-14T12:28:46.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31ab67640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3140ac8f0 con 0x7fc3000039e0 2023-10-14T12:28:46.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31ab67640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc314154620 con 0x7fc3140ab150 2023-10-14T12:28:46.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31a366640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc314070f90 0x7fc314071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31a366640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc314070f90 0x7fc314071410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41432/0 (socket says 172.21.15.64:41432) 2023-10-14T12:28:46.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31a366640 1 -- 172.21.15.64:0/922659553 learned_addr learned my addr 172.21.15.64:0/922659553 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:46.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc319b65640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3000039e0 0x7fc3141540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc319364640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3140ab150 0x7fc3140bcb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31a366640 1 -- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3140ab150 msgr2=0x7fc3140bcb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:46.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31a366640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3140ab150 0x7fc3140bcb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31a366640 1 -- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3000039e0 msgr2=0x7fc3141540e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:46.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.289+0000 7fc31a366640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3000039e0 0x7fc3141540e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:46.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.290+0000 7fc31a366640 1 -- 172.21.15.64:0/922659553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3140be7b0 con 0x7fc314070f90 2023-10-14T12:28:46.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.290+0000 7fc31a366640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc314070f90 0x7fc314071410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3140cf4c0 tx=0x7fc30c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:46.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.290+0000 7fc30a7fc640 1 -- 172.21.15.64:0/922659553 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c004d60 con 0x7fc314070f90 2023-10-14T12:28:46.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.290+0000 7fc30a7fc640 1 -- 172.21.15.64:0/922659553 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc30c00bb80 con 0x7fc314070f90 2023-10-14T12:28:46.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.290+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3140ab6c0 con 0x7fc314070f90 2023-10-14T12:28:46.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.290+0000 7fc30a7fc640 1 -- 172.21.15.64:0/922659553 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc30c007070 con 0x7fc314070f90 2023-10-14T12:28:46.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.290+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3140abc80 con 0x7fc314070f90 2023-10-14T12:28:46.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.291+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc31404e9b0 con 0x7fc314070f90 2023-10-14T12:28:46.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.292+0000 7fc30a7fc640 1 -- 172.21.15.64:0/922659553 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc30c0071d0 con 0x7fc314070f90 2023-10-14T12:28:46.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.293+0000 7fc30a7fc640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc2f806ae70 0x7fc2f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:46.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.293+0000 7fc30a7fc640 1 -- 172.21.15.64:0/922659553 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fc30c089ad0 con 0x7fc314070f90 2023-10-14T12:28:46.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.294+0000 7fc319b65640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc2f806ae70 0x7fc2f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:46.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.295+0000 7fc319b65640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc2f806ae70 0x7fc2f806d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc310033000 tx=0x7fc310009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:46.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.298+0000 7fc30a7fc640 1 -- 172.21.15.64:0/922659553 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc30c054ab0 con 0x7fc314070f90 2023-10-14T12:28:46.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:46.534+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fc31415aaa0 con 0x7fc314070f90 2023-10-14T12:28:47.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.046+0000 7fc30a7fc640 1 -- 172.21.15.64:0/922659553 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fc30c0580d0 con 0x7fc314070f90 2023-10-14T12:28:47.047 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 2 and data pool 3 2023-10-14T12:28:47.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc2f806ae70 msgr2=0x7fc2f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc2f806ae70 0x7fc2f806d330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc310033000 tx=0x7fc310009030 comp rx=0 tx=0).stop 2023-10-14T12:28:47.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc314070f90 msgr2=0x7fc314071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc314070f90 0x7fc314071410 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc3140cf4c0 tx=0x7fc30c00b4a0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 shutdown_connections 2023-10-14T12:28:47.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc2f806ae70 0x7fc2f806d330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc314070f90 0x7fc314071410 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc3140ab150 0x7fc3140bcb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 --2- 172.21.15.64:0/922659553 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc3000039e0 0x7fc3141540e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 >> 172.21.15.64:0/922659553 conn(0x7fc31406a200 msgr2=0x7fc3140cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:47.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.050+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 shutdown_connections 2023-10-14T12:28:47.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.051+0000 7fc31ab67640 1 -- 172.21.15.64:0/922659553 wait complete. 2023-10-14T12:28:47.076 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-10-14T12:28:47.077 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-10-14T12:28:47.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.280+0000 7fdda9787640 1 Processor -- start 2023-10-14T12:28:47.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.280+0000 7fdda9787640 1 -- start start 2023-10-14T12:28:47.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda9787640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdda406bf20 0x7fdda406c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda9787640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda406c840 con 0x7fdda40cc850 2023-10-14T12:28:47.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda9787640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda4071c70 con 0x7fdda4159700 2023-10-14T12:28:47.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda9787640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda4072230 con 0x7fdda406bf20 2023-10-14T12:28:47.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda8f86640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdda40cc850 0x7fdda40ccd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42710/0 (socket says 172.21.15.64:42710) 2023-10-14T12:28:47.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda8f86640 1 -- 172.21.15.64:0/936892270 learned_addr learned my addr 172.21.15.64:0/936892270 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:47.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda3fff640 1 --2- 172.21.15.64:0/936892270 >> v2:172.21.15.177:3300/0 conn(0x7fdda406bf20 0x7fdda406c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.282+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680555548 0 0) 0x7fdda406c840 con 0x7fdda40cc850 2023-10-14T12:28:47.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd8c005730 con 0x7fdda40cc850 2023-10-14T12:28:47.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2078910567 0 0) 0x7fdd8c005730 con 0x7fdda40cc850 2023-10-14T12:28:47.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 >> v2:172.21.15.177:3300/0 conn(0x7fdda406bf20 msgr2=0x7fdda406c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:47.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 --2- 172.21.15.64:0/936892270 >> v2:172.21.15.177:3300/0 conn(0x7fdda406bf20 0x7fdda406c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 >> v1:172.21.15.177:6789/0 conn(0x7fdda4159700 legacy=0x7fdda40c1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda4071f50 con 0x7fdda40cc850 2023-10-14T12:28:47.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fdd9c0019f0 con 0x7fdda40cc850 2023-10-14T12:28:47.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 >> v1:172.21.15.64:6789/0 conn(0x7fdda40cc850 legacy=0x7fdda40ccd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c005c40 0x7fdd8c006060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0069d0 0x7fdd8c006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8c0073e0 0x7fdd8c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4072230 con 0x7fdd8c0069d0 2023-10-14T12:28:47.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c00e310 con 0x7fdd8c005c40 2023-10-14T12:28:47.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c00e4d0 con 0x7fdd8c0073e0 2023-10-14T12:28:47.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.283+0000 7fdda37fe640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0069d0 0x7fdd8c006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda3fff640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c005c40 0x7fdd8c006060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda8f86640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8c0073e0 0x7fdd8c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda37fe640 1 -- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8c0073e0 msgr2=0x7fdd8c00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda37fe640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdd8c0073e0 0x7fdd8c00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda37fe640 1 -- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c005c40 msgr2=0x7fdd8c006060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:47.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda37fe640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c005c40 0x7fdd8c006060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda37fe640 1 -- 172.21.15.64:0/936892270 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd8c005730 con 0x7fdd8c0069d0 2023-10-14T12:28:47.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.284+0000 7fdda8f86640 1 -- 172.21.15.64:0/936892270 reap_dead start 2023-10-14T12:28:47.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.285+0000 7fdda37fe640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0069d0 0x7fdd8c006e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd98001720 tx=0x7fdd8c007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eed98cbc5df52d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:47.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.285+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd980052d0 con 0x7fdd8c0069d0 2023-10-14T12:28:47.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.285+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9802e050 con 0x7fdd8c0069d0 2023-10-14T12:28:47.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda2ffd640 1 -- 172.21.15.64:0/936892270 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98003830 con 0x7fdd8c0069d0 2023-10-14T12:28:47.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda9787640 1 -- 172.21.15.64:0/936892270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0069d0 msgr2=0x7fdd8c006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda9787640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0069d0 0x7fdd8c006e50 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fdd98001720 tx=0x7fdd8c007a00 comp rx=0 tx=0).stop 2023-10-14T12:28:47.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda9787640 1 -- 172.21.15.64:0/936892270 shutdown_connections 2023-10-14T12:28:47.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda9787640 1 --2- 172.21.15.64:0/936892270 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdd8c0069d0 0x7fdd8c006e50 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda9787640 1 -- 172.21.15.64:0/936892270 >> 172.21.15.64:0/936892270 conn(0x7fdda406a4a0 msgr2=0x7fdda40afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:47.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda9787640 1 -- 172.21.15.64:0/936892270 shutdown_connections 2023-10-14T12:28:47.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.286+0000 7fdda9787640 1 -- 172.21.15.64:0/936892270 wait complete. 2023-10-14T12:28:47.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.288+0000 7fdda9787640 1 Processor -- start 2023-10-14T12:28:47.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.288+0000 7fdda9787640 1 -- start start 2023-10-14T12:28:47.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.289+0000 7fdda9787640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c0069d0 0x7fdda40c3af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.289+0000 7fdda9787640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdda4147ce0 0x7fdda4147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.289+0000 7fdda9787640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdda4147590 0x7fdda4140dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.289+0000 7fdda9787640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda40c3660 con 0x7fdda4147ce0 2023-10-14T12:28:47.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.289+0000 7fdda9787640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda4147a10 con 0x7fdd8c0069d0 2023-10-14T12:28:47.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.289+0000 7fdda9787640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda41dec30 con 0x7fdda4147590 2023-10-14T12:28:47.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdda4147ce0 0x7fdda4147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdda4147ce0 0x7fdda4147050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41462/0 (socket says 172.21.15.64:41462) 2023-10-14T12:28:47.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 -- 172.21.15.64:0/3725751338 learned_addr learned my addr 172.21.15.64:0/3725751338 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:47.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda3fff640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c0069d0 0x7fdda40c3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda8f86640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdda4147590 0x7fdda4140dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 -- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdda4147590 msgr2=0x7fdda4140dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdda4147590 0x7fdda4140dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 -- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c0069d0 msgr2=0x7fdda40c3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c0069d0 0x7fdda40c3af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 -- 172.21.15.64:0/3725751338 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda40c3010 con 0x7fdda4147ce0 2023-10-14T12:28:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda3fff640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c0069d0 0x7fdda40c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:28:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.290+0000 7fdda37fe640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdda4147ce0 0x7fdda4147050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005040 tx=0x7fdd98001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.291+0000 7fdda0ff9640 1 -- 172.21.15.64:0/3725751338 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd980076c0 con 0x7fdda4147ce0 2023-10-14T12:28:47.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.291+0000 7fdda0ff9640 1 -- 172.21.15.64:0/3725751338 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd98007a30 con 0x7fdda4147ce0 2023-10-14T12:28:47.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.291+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda40c32f0 con 0x7fdda4147ce0 2023-10-14T12:28:47.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.291+0000 7fdda0ff9640 1 -- 172.21.15.64:0/3725751338 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd98006c00 con 0x7fdda4147ce0 2023-10-14T12:28:47.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.291+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda41de850 con 0x7fdda4147ce0 2023-10-14T12:28:47.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.292+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40c3810 con 0x7fdda4147ce0 2023-10-14T12:28:47.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.293+0000 7fdda0ff9640 1 -- 172.21.15.64:0/3725751338 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdd980035f0 con 0x7fdda4147ce0 2023-10-14T12:28:47.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.294+0000 7fdda0ff9640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9006ae70 0x7fdd9006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:47.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.294+0000 7fdda0ff9640 1 -- 172.21.15.64:0/3725751338 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd980ab4c0 con 0x7fdda4147ce0 2023-10-14T12:28:47.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.295+0000 7fdda3fff640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9006ae70 0x7fdd9006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:47.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.296+0000 7fdda3fff640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9006ae70 0x7fdd9006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdda4066c10 tx=0x7fdd94008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:47.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.299+0000 7fdda0ff9640 1 -- 172.21.15.64:0/3725751338 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdda40c3810 con 0x7fdda4147ce0 2023-10-14T12:28:47.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.502+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fdda40c3810 con 0x7fdda4147ce0 2023-10-14T12:28:47.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.757+0000 7fdda0ff9640 1 -- 172.21.15.64:0/3725751338 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7fdda40c3810 con 0x7fdda4147ce0 2023-10-14T12:28:47.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9006ae70 msgr2=0x7fdd9006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9006ae70 0x7fdd9006d330 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdda4066c10 tx=0x7fdd94008040 comp rx=0 tx=0).stop 2023-10-14T12:28:47.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdda4147ce0 msgr2=0x7fdda4147050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:47.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdda4147ce0 0x7fdda4147050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd98005040 tx=0x7fdd98001120 comp rx=0 tx=0).stop 2023-10-14T12:28:47.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 shutdown_connections 2023-10-14T12:28:47.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9006ae70 0x7fdd9006d330 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdda4147590 0x7fdda4140dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdda4147ce0 0x7fdda4147050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 --2- 172.21.15.64:0/3725751338 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdd8c0069d0 0x7fdda40c3af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:47.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 >> 172.21.15.64:0/3725751338 conn(0x7fdda406a4a0 msgr2=0x7fdda41551b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:47.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.763+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 shutdown_connections 2023-10-14T12:28:47.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:47.764+0000 7fdda9787640 1 -- 172.21.15.64:0/3725751338 wait complete. 2023-10-14T12:28:47.784 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T12:28:48.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.029+0000 7fb62cd54640 1 Processor -- start 2023-10-14T12:28:48.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.029+0000 7fb62cd54640 1 -- start start 2023-10-14T12:28:48.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.030+0000 7fb62cd54640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb62815ca20 0x7fb6280d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:48.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.030+0000 7fb62cd54640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb6280d31f0 0x7fb6280cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:48.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb62cd54640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb62806b560 con 0x7fb6280cf640 2023-10-14T12:28:48.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb62cd54640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6280cfad0 con 0x7fb6280d31f0 2023-10-14T12:28:48.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb62cd54640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6280d3650 con 0x7fb62815ca20 2023-10-14T12:28:48.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb61effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb6280d31f0 0x7fb6280cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:48.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb61effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb6280d31f0 0x7fb6280cf100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41472/0 (socket says 172.21.15.64:41472) 2023-10-14T12:28:48.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb61effd640 1 -- 172.21.15.64:0/3711844970 learned_addr learned my addr 172.21.15.64:0/3711844970 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:48.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb6277fe640 1 --2- 172.21.15.64:0/3711844970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb62815ca20 0x7fb6280d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:48.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb61effd640 1 -- 172.21.15.64:0/3711844970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb62815ca20 msgr2=0x7fb6280d0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:48.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb61effd640 1 --2- 172.21.15.64:0/3711844970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb62815ca20 0x7fb6280d0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:48.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb61effd640 1 -- 172.21.15.64:0/3711844970 >> v1:172.21.15.64:6789/0 conn(0x7fb6280cf640 legacy=0x7fb6280cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:48.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.031+0000 7fb61effd640 1 -- 172.21.15.64:0/3711844970 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6280d1460 con 0x7fb6280d31f0 2023-10-14T12:28:48.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.032+0000 7fb6277fe640 1 --2- 172.21.15.64:0/3711844970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb62815ca20 0x7fb6280d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:28:48.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.033+0000 7fb61effd640 1 --2- 172.21.15.64:0/3711844970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280d31f0 0x7fb6280cf100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb610009870 tx=0x7fb61002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c91acafcdade6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:48.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.033+0000 7fb626ffd640 1 -- 172.21.15.64:0/3711844970 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610030840 con 0x7fb6280d31f0 2023-10-14T12:28:48.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.033+0000 7fb626ffd640 1 -- 172.21.15.64:0/3711844970 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6100309a0 con 0x7fb6280d31f0 2023-10-14T12:28:48.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.033+0000 7fb626ffd640 1 -- 172.21.15.64:0/3711844970 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb610030d30 con 0x7fb6280d31f0 2023-10-14T12:28:48.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 -- 172.21.15.64:0/3711844970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280d31f0 msgr2=0x7fb6280cf100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:48.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 --2- 172.21.15.64:0/3711844970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280d31f0 0x7fb6280cf100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fb610009870 tx=0x7fb61002b980 comp rx=0 tx=0).stop 2023-10-14T12:28:48.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 -- 172.21.15.64:0/3711844970 shutdown_connections 2023-10-14T12:28:48.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 --2- 172.21.15.64:0/3711844970 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280d31f0 0x7fb6280cf100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:48.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 --2- 172.21.15.64:0/3711844970 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb62815ca20 0x7fb6280d0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:48.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 -- 172.21.15.64:0/3711844970 >> 172.21.15.64:0/3711844970 conn(0x7fb62809baf0 msgr2=0x7fb6280d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:48.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 -- 172.21.15.64:0/3711844970 shutdown_connections 2023-10-14T12:28:48.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.034+0000 7fb62cd54640 1 -- 172.21.15.64:0/3711844970 wait complete. 2023-10-14T12:28:48.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.036+0000 7fb62cd54640 1 Processor -- start 2023-10-14T12:28:48.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.036+0000 7fb62cd54640 1 -- start start 2023-10-14T12:28:48.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb62cd54640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280cf640 0x7fb6280c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:48.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb62cd54640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6280d31f0 0x7fb628154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:48.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb62cd54640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815ca20 0x7fb6281f6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:48.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb62cd54640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62815e610 con 0x7fb6280cf640 2023-10-14T12:28:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb62cd54640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb62815f190 con 0x7fb62815ca20 2023-10-14T12:28:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb62cd54640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6280ccbf0 con 0x7fb6280d31f0 2023-10-14T12:28:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb6277fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280cf640 0x7fb6280c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb6277fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280cf640 0x7fb6280c9850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41478/0 (socket says 172.21.15.64:41478) 2023-10-14T12:28:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.037+0000 7fb6277fe640 1 -- 172.21.15.64:0/966412452 learned_addr learned my addr 172.21.15.64:0/966412452 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb61effd640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6280d31f0 0x7fb628154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb627fff640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815ca20 0x7fb6281f6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb6277fe640 1 -- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6280d31f0 msgr2=0x7fb628154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb6277fe640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6280d31f0 0x7fb628154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb6277fe640 1 -- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815ca20 msgr2=0x7fb6281f6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:48.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb6277fe640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815ca20 0x7fb6281f6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:48.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb6277fe640 1 -- 172.21.15.64:0/966412452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6100094d0 con 0x7fb6280cf640 2023-10-14T12:28:48.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb6277fe640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280cf640 0x7fb6280c9850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb61800d800 tx=0x7fb61800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb624ff9640 1 -- 172.21.15.64:0/966412452 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618004030 con 0x7fb6280cf640 2023-10-14T12:28:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb624ff9640 1 -- 172.21.15.64:0/966412452 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb618004190 con 0x7fb6280cf640 2023-10-14T12:28:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb628155110 con 0x7fb6280cf640 2023-10-14T12:28:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.038+0000 7fb624ff9640 1 -- 172.21.15.64:0/966412452 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb618004520 con 0x7fb6280cf640 2023-10-14T12:28:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.039+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb62815ead0 con 0x7fb6280cf640 2023-10-14T12:28:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.040+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb628066880 con 0x7fb6280cf640 2023-10-14T12:28:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.041+0000 7fb624ff9640 1 -- 172.21.15.64:0/966412452 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb618005990 con 0x7fb6280cf640 2023-10-14T12:28:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.042+0000 7fb624ff9640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb60806ae70 0x7fb60806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.042+0000 7fb624ff9640 1 -- 172.21.15.64:0/966412452 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb6180896d0 con 0x7fb6280cf640 2023-10-14T12:28:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.042+0000 7fb61effd640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb60806ae70 0x7fb60806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.043+0000 7fb61effd640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb60806ae70 0x7fb60806d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb610036000 tx=0x7fb61003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.046+0000 7fb624ff9640 1 -- 172.21.15.64:0/966412452 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb618054690 con 0x7fb6280cf640 2023-10-14T12:28:48.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:48.250+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb62804e9b0 con 0x7fb6280cf640 2023-10-14T12:28:50.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.092+0000 7fb624ff9640 1 -- 172.21.15.64:0/966412452 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb618057cb0 con 0x7fb6280cf640 2023-10-14T12:28:50.094 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data_ec' created 2023-10-14T12:28:50.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb60806ae70 msgr2=0x7fb60806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:50.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb60806ae70 0x7fb60806d330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb610036000 tx=0x7fb61003b040 comp rx=0 tx=0).stop 2023-10-14T12:28:50.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280cf640 msgr2=0x7fb6280c9850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:50.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280cf640 0x7fb6280c9850 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb61800d800 tx=0x7fb61800dcc0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 shutdown_connections 2023-10-14T12:28:50.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb60806ae70 0x7fb60806d330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb62815ca20 0x7fb6281f6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb6280d31f0 0x7fb628154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 --2- 172.21.15.64:0/966412452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb6280cf640 0x7fb6280c9850 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.097+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 >> 172.21.15.64:0/966412452 conn(0x7fb62809baf0 msgr2=0x7fb62806c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:50.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.099+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 shutdown_connections 2023-10-14T12:28:50.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.099+0000 7fb62cd54640 1 -- 172.21.15.64:0/966412452 wait complete. 2023-10-14T12:28:50.128 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-10-14T12:28:50.244 INFO:tasks.ceph.mds.d.smithi177.stderr:2023-10-14T12:28:50.244+0000 7fb037f22640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:28:50.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.333+0000 7f4fd20a9640 1 Processor -- start 2023-10-14T12:28:50.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.333+0000 7f4fd20a9640 1 -- start start 2023-10-14T12:28:50.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.334+0000 7f4fd20a9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4fcc1612a0 0x7f4fcc0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.334+0000 7f4fd20a9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4fcc0b05a0 0x7f4fcc0702d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.334+0000 7f4fd20a9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fcc0cc800 con 0x7f4fcc0b01c0 2023-10-14T12:28:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.334+0000 7f4fd20a9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fcc0c9510 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.334+0000 7f4fd20a9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fcc0ce310 con 0x7f4fcc1612a0 2023-10-14T12:28:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fcbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4fcc0b05a0 0x7f4fcc0702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:50.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fcbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4fcc0b05a0 0x7f4fcc0702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41484/0 (socket says 172.21.15.64:41484) 2023-10-14T12:28:50.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fcbfff640 1 -- 172.21.15.64:0/3473509917 learned_addr learned my addr 172.21.15.64:0/3473509917 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:50.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fc3fff640 1 --2- 172.21.15.64:0/3473509917 >> v2:172.21.15.177:3300/0 conn(0x7f4fcc1612a0 0x7f4fcc0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:50.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fcbfff640 1 -- 172.21.15.64:0/3473509917 >> v2:172.21.15.177:3300/0 conn(0x7f4fcc1612a0 msgr2=0x7f4fcc0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:50.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fcbfff640 1 --2- 172.21.15.64:0/3473509917 >> v2:172.21.15.177:3300/0 conn(0x7f4fcc1612a0 0x7f4fcc0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fcbfff640 1 -- 172.21.15.64:0/3473509917 >> v1:172.21.15.177:6789/0 conn(0x7f4fcc0b01c0 legacy=0x7f4fcc0cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:50.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.335+0000 7f4fcbfff640 1 -- 172.21.15.64:0/3473509917 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fcc0c9720 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.336+0000 7f4fcbfff640 1 --2- 172.21.15.64:0/3473509917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0702d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc06e2a0 tx=0x7f4fc402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cfcb5de721f3644 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:50.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fcaffd640 1 -- 172.21.15.64:0/3473509917 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc402ca80 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fcaffd640 1 -- 172.21.15.64:0/3473509917 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fc402cbe0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fcaffd640 1 -- 172.21.15.64:0/3473509917 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc40343f0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fd20a9640 1 -- 172.21.15.64:0/3473509917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 msgr2=0x7f4fcc0702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:50.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/3473509917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0702d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc06e2a0 tx=0x7f4fc402bee0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fd20a9640 1 -- 172.21.15.64:0/3473509917 shutdown_connections 2023-10-14T12:28:50.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/3473509917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0702d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/3473509917 >> v2:172.21.15.177:3300/0 conn(0x7f4fcc1612a0 0x7f4fcc0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fd20a9640 1 -- 172.21.15.64:0/3473509917 >> 172.21.15.64:0/3473509917 conn(0x7f4fcc06c190 msgr2=0x7f4fcc06c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:50.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.337+0000 7f4fd20a9640 1 -- 172.21.15.64:0/3473509917 shutdown_connections 2023-10-14T12:28:50.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.338+0000 7f4fd20a9640 1 -- 172.21.15.64:0/3473509917 wait complete. 2023-10-14T12:28:50.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.339+0000 7f4fd20a9640 1 Processor -- start 2023-10-14T12:28:50.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.339+0000 7f4fd20a9640 1 -- start start 2023-10-14T12:28:50.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.340+0000 7f4fd20a9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fcc0b01c0 0x7f4fcc0c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:50.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.340+0000 7f4fd20a9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:50.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.340+0000 7f4fd20a9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4fcc1612a0 0x7f4fcc14e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:50.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.340+0000 7f4fd20a9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0b10f0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.340+0000 7f4fd20a9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0c7a50 con 0x7f4fcc0b01c0 2023-10-14T12:28:50.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.340+0000 7f4fd20a9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fcc0c6600 con 0x7f4fcc1612a0 2023-10-14T12:28:50.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:50.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0c7510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41494/0 (socket says 172.21.15.64:41494) 2023-10-14T12:28:50.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 -- 172.21.15.64:0/2061598979 learned_addr learned my addr 172.21.15.64:0/2061598979 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:50.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fcbfff640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4fcc1612a0 0x7f4fcc14e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:50.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fcb7fe640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fcc0b01c0 0x7f4fcc0c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:50.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 -- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4fcc1612a0 msgr2=0x7f4fcc14e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:50.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4fcc1612a0 0x7f4fcc14e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 -- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fcc0b01c0 msgr2=0x7f4fcc0c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:50.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fcc0b01c0 0x7f4fcc0c5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:50.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 -- 172.21.15.64:0/2061598979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc4009b30 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.341+0000 7f4fc3fff640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0c7510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400d5f0 tx=0x7f4fb400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:50.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.342+0000 7f4fc8ff9640 1 -- 172.21.15.64:0/2061598979 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb40125f0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.342+0000 7f4fc8ff9640 1 -- 172.21.15.64:0/2061598979 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fb4012750 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.342+0000 7f4fc8ff9640 1 -- 172.21.15.64:0/2061598979 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fb4012b00 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.342+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fcc0c68e0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.342+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fcc0c6ea0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.343+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fcc073ef0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.344+0000 7f4fc8ff9640 1 -- 172.21.15.64:0/2061598979 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4fb4012c60 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.345+0000 7f4fc8ff9640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4fac06ae70 0x7f4fac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:50.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.345+0000 7f4fc8ff9640 1 -- 172.21.15.64:0/2061598979 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f4fb4089ce0 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.346+0000 7f4fcb7fe640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4fac06ae70 0x7f4fac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:50.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.347+0000 7f4fcb7fe640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4fac06ae70 0x7f4fac06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0015d0 tx=0x7f4fbc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:50.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.350+0000 7f4fc8ff9640 1 -- 172.21.15.64:0/2061598979 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4fb4054b50 con 0x7f4fcc0b05a0 2023-10-14T12:28:50.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:50.540+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f4fcc15bfb0 con 0x7f4fcc0b05a0 2023-10-14T12:28:51.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.104+0000 7f4fc8ff9640 1 -- 172.21.15.64:0/2061598979 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7f4fb4058170 con 0x7f4fcc0b05a0 2023-10-14T12:28:51.106 INFO:teuthology.orchestra.run.smithi064.stderr:set pool 4 allow_ec_overwrites to true 2023-10-14T12:28:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4fac06ae70 msgr2=0x7f4fac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4fac06ae70 0x7f4fac06d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4fbc0015d0 tx=0x7f4fbc009040 comp rx=0 tx=0).stop 2023-10-14T12:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 msgr2=0x7f4fcc0c7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0c7510 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4fb400d5f0 tx=0x7f4fb400dab0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 shutdown_connections 2023-10-14T12:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4fac06ae70 0x7f4fac06d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4fcc1612a0 0x7f4fcc14e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4fcc0b05a0 0x7f4fcc0c7510 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.107+0000 7f4fd20a9640 1 --2- 172.21.15.64:0/2061598979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4fcc0b01c0 0x7f4fcc0c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.108+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 >> 172.21.15.64:0/2061598979 conn(0x7f4fcc06c190 msgr2=0x7f4fcc0c87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.108+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 shutdown_connections 2023-10-14T12:28:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.108+0000 7f4fd20a9640 1 -- 172.21.15.64:0/2061598979 wait complete. 2023-10-14T12:28:51.141 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-10-14T12:28:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.333+0000 7f229f244640 1 Processor -- start 2023-10-14T12:28:51.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.333+0000 7f229f244640 1 -- start start 2023-10-14T12:28:51.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229f244640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980ca820 0x7f2298071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:51.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229f244640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22980c8ea0 0x7f22980c9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:51.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229f244640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2298072480 con 0x7f2298159890 2023-10-14T12:28:51.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229f244640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22980cd0c0 con 0x7f22980c8ea0 2023-10-14T12:28:51.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229f244640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22980cc540 con 0x7f22980ca820 2023-10-14T12:28:51.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229d7e1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22980c8ea0 0x7f22980c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229d7e1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f22980c8ea0 0x7f22980c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41504/0 (socket says 172.21.15.64:41504) 2023-10-14T12:28:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.335+0000 7f229d7e1640 1 -- 172.21.15.64:0/1540218584 learned_addr learned my addr 172.21.15.64:0/1540218584 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.336+0000 7f2297fff640 1 --2- 172.21.15.64:0/1540218584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980ca820 0x7f2298071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:51.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.336+0000 7f229d7e1640 1 -- 172.21.15.64:0/1540218584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980ca820 msgr2=0x7f2298071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.336+0000 7f229d7e1640 1 --2- 172.21.15.64:0/1540218584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980ca820 0x7f2298071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.336+0000 7f229d7e1640 1 -- 172.21.15.64:0/1540218584 >> v1:172.21.15.177:6789/0 conn(0x7f2298159890 legacy=0x7f22980ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.336+0000 7f229d7e1640 1 -- 172.21.15.64:0/1540218584 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22980cc820 con 0x7f22980c8ea0 2023-10-14T12:28:51.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.336+0000 7f2297fff640 1 --2- 172.21.15.64:0/1540218584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980ca820 0x7f2298071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:51.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.337+0000 7f229d7e1640 1 --2- 172.21.15.64:0/1540218584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22980c8ea0 0x7f22980c9330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2290009e50 tx=0x7f229002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=636a0a9b00161006 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:51.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.337+0000 7f22977fe640 1 -- 172.21.15.64:0/1540218584 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229002ca80 con 0x7f22980c8ea0 2023-10-14T12:28:51.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.337+0000 7f22977fe640 1 -- 172.21.15.64:0/1540218584 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229002cbe0 con 0x7f22980c8ea0 2023-10-14T12:28:51.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.337+0000 7f22977fe640 1 -- 172.21.15.64:0/1540218584 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22900343f0 con 0x7f22980c8ea0 2023-10-14T12:28:51.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 -- 172.21.15.64:0/1540218584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22980c8ea0 msgr2=0x7f22980c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:51.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 --2- 172.21.15.64:0/1540218584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22980c8ea0 0x7f22980c9330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2290009e50 tx=0x7f229002bee0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 -- 172.21.15.64:0/1540218584 shutdown_connections 2023-10-14T12:28:51.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 --2- 172.21.15.64:0/1540218584 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f22980c8ea0 0x7f22980c9330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 --2- 172.21.15.64:0/1540218584 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980ca820 0x7f2298071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 -- 172.21.15.64:0/1540218584 >> 172.21.15.64:0/1540218584 conn(0x7f22980b0030 msgr2=0x7f22980b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:51.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 -- 172.21.15.64:0/1540218584 shutdown_connections 2023-10-14T12:28:51.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.338+0000 7f229f244640 1 -- 172.21.15.64:0/1540218584 wait complete. 2023-10-14T12:28:51.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.340+0000 7f229f244640 1 Processor -- start 2023-10-14T12:28:51.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.340+0000 7f229f244640 1 -- start start 2023-10-14T12:28:51.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229f244640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980c8ea0 0x7f22980aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:51.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229f244640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22980ca820 0x7f22981f1f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:51.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229f244640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2298159890 0x7f22980c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:51.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229f244640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22981f2440 con 0x7f2298159890 2023-10-14T12:28:51.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229f244640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22980c81f0 con 0x7f22980ca820 2023-10-14T12:28:51.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229f244640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2298159c70 con 0x7f22980c8ea0 2023-10-14T12:28:51.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229d7e1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2298159890 0x7f22980c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:51.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229d7e1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2298159890 0x7f22980c77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41520/0 (socket says 172.21.15.64:41520) 2023-10-14T12:28:51.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.341+0000 7f229d7e1640 1 -- 172.21.15.64:0/1842636807 learned_addr learned my addr 172.21.15.64:0/1842636807 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:51.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229cfe0640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980c8ea0 0x7f22980aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:51.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f2297fff640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22980ca820 0x7f22981f1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:51.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229d7e1640 1 -- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980c8ea0 msgr2=0x7f22980aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:51.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229d7e1640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980c8ea0 0x7f22980aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229d7e1640 1 -- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22980ca820 msgr2=0x7f22981f1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:51.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229d7e1640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22980ca820 0x7f22981f1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:51.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229d7e1640 1 -- 172.21.15.64:0/1842636807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2290009b30 con 0x7f2298159890 2023-10-14T12:28:51.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229cfe0640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980c8ea0 0x7f22980aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:51.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229d7e1640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2298159890 0x7f22980c77a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2290036040 tx=0x7f2290004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:51.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f22957fa640 1 -- 172.21.15.64:0/1842636807 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229003e450 con 0x7f2298159890 2023-10-14T12:28:51.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f22957fa640 1 -- 172.21.15.64:0/1842636807 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f229003e5d0 con 0x7f2298159890 2023-10-14T12:28:51.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f22957fa640 1 -- 172.21.15.64:0/1842636807 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f229003e980 con 0x7f2298159890 2023-10-14T12:28:51.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.342+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2298159f50 con 0x7f2298159890 2023-10-14T12:28:51.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.343+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f229815a510 con 0x7f2298159890 2023-10-14T12:28:51.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.344+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229815a700 con 0x7f2298159890 2023-10-14T12:28:51.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.345+0000 7f22957fa640 1 -- 172.21.15.64:0/1842636807 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f229002cd50 con 0x7f2298159890 2023-10-14T12:28:51.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.346+0000 7f22957fa640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f227c06ae70 0x7f227c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:51.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.346+0000 7f22957fa640 1 -- 172.21.15.64:0/1842636807 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f22900ac4e0 con 0x7f2298159890 2023-10-14T12:28:51.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.347+0000 7f229cfe0640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f227c06ae70 0x7f227c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:51.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.348+0000 7f229cfe0640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f227c06ae70 0x7f227c06d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f228c00a830 tx=0x7f228c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:51.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.353+0000 7f22957fa640 1 -- 172.21.15.64:0/1842636807 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2290077490 con 0x7f2298159890 2023-10-14T12:28:51.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:51.580+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f22980ccdb0 con 0x7f2298159890 2023-10-14T12:28:52.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.116+0000 7f22957fa640 1 -- 172.21.15.64:0/1842636807 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f229007aab0 con 0x7f2298159890 2023-10-14T12:28:52.119 INFO:teuthology.orchestra.run.smithi064.stderr:added data pool 4 to fsmap 2023-10-14T12:28:52.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f227c06ae70 msgr2=0x7f227c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f227c06ae70 0x7f227c06d330 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f228c00a830 tx=0x7f228c008040 comp rx=0 tx=0).stop 2023-10-14T12:28:52.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2298159890 msgr2=0x7f22980c77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2298159890 0x7f22980c77a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2290036040 tx=0x7f2290004a40 comp rx=0 tx=0).stop 2023-10-14T12:28:52.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 shutdown_connections 2023-10-14T12:28:52.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f227c06ae70 0x7f227c06d330 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2298159890 0x7f22980c77a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f22980ca820 0x7f22981f1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 --2- 172.21.15.64:0/1842636807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22980c8ea0 0x7f22980aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 >> 172.21.15.64:0/1842636807 conn(0x7f22980b0030 msgr2=0x7f2298157ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:52.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.120+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 shutdown_connections 2023-10-14T12:28:52.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.121+0000 7f229f244640 1 -- 172.21.15.64:0/1842636807 wait complete. 2023-10-14T12:28:52.145 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:28:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.363+0000 7fa9860da640 1 Processor -- start 2023-10-14T12:28:52.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.363+0000 7fa9860da640 1 -- start start 2023-10-14T12:28:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.364+0000 7fa9860da640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa98015a8d0 0x7fa9800cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.364+0000 7fa9860da640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98006ff40 0x7fa9800cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.364+0000 7fa9860da640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98015acb0 con 0x7fa9800ca660 2023-10-14T12:28:52.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.364+0000 7fa9860da640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9800c1c60 con 0x7fa98015a8d0 2023-10-14T12:28:52.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.364+0000 7fa9860da640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98015e350 con 0x7fa98006ff40 2023-10-14T12:28:52.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9850d8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa98015a8d0 0x7fa9800cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9850d8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa98015a8d0 0x7fa9800cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41530/0 (socket says 172.21.15.64:41530) 2023-10-14T12:28:52.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9850d8640 1 -- 172.21.15.64:0/1399069041 learned_addr learned my addr 172.21.15.64:0/1399069041 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:52.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9848d7640 1 --1- 172.21.15.64:0/1399069041 >> v1:172.21.15.64:6789/0 conn(0x7fa9800ca660 0x7fa98006bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42718/0 (socket says 172.21.15.64:42718) 2023-10-14T12:28:52.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9858d9640 1 --2- 172.21.15.64:0/1399069041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98006ff40 0x7fa9800cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9850d8640 1 -- 172.21.15.64:0/1399069041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98006ff40 msgr2=0x7fa9800cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:52.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9850d8640 1 --2- 172.21.15.64:0/1399069041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98006ff40 0x7fa9800cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9850d8640 1 -- 172.21.15.64:0/1399069041 >> v1:172.21.15.64:6789/0 conn(0x7fa9800ca660 legacy=0x7fa98006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa9850d8640 1 -- 172.21.15.64:0/1399069041 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98015e630 con 0x7fa98015a8d0 2023-10-14T12:28:52.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.365+0000 7fa977fff640 1 -- 172.21.15.64:0/1399069041 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4274630448 0 0) 0x7fa970001110 con 0x7fa9800ca660 2023-10-14T12:28:52.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.366+0000 7fa9850d8640 1 --2- 172.21.15.64:0/1399069041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98015a8d0 0x7fa9800cab40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009860 tx=0x7fa97c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96397d4757bc32ce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:52.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.366+0000 7fa977fff640 1 -- 172.21.15.64:0/1399069041 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c030840 con 0x7fa98015a8d0 2023-10-14T12:28:52.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.366+0000 7fa977fff640 1 -- 172.21.15.64:0/1399069041 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c0309a0 con 0x7fa98015a8d0 2023-10-14T12:28:52.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.366+0000 7fa977fff640 1 -- 172.21.15.64:0/1399069041 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c030d30 con 0x7fa98015a8d0 2023-10-14T12:28:52.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 -- 172.21.15.64:0/1399069041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98015a8d0 msgr2=0x7fa9800cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 --2- 172.21.15.64:0/1399069041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98015a8d0 0x7fa9800cab40 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009860 tx=0x7fa97c02b980 comp rx=0 tx=0).stop 2023-10-14T12:28:52.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 -- 172.21.15.64:0/1399069041 shutdown_connections 2023-10-14T12:28:52.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 --2- 172.21.15.64:0/1399069041 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa98006ff40 0x7fa9800cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 --2- 172.21.15.64:0/1399069041 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98015a8d0 0x7fa9800cab40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 -- 172.21.15.64:0/1399069041 >> 172.21.15.64:0/1399069041 conn(0x7fa98006a470 msgr2=0x7fa9800afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:52.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 -- 172.21.15.64:0/1399069041 shutdown_connections 2023-10-14T12:28:52.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.367+0000 7fa9860da640 1 -- 172.21.15.64:0/1399069041 wait complete. 2023-10-14T12:28:52.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.369+0000 7fa9860da640 1 Processor -- start 2023-10-14T12:28:52.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.369+0000 7fa9860da640 1 -- start start 2023-10-14T12:28:52.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9860da640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98006ff40 0x7fa98015bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9860da640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9800ca660 0x7fa9801f0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9860da640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98015a8d0 0x7fa98014c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9860da640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9801f1200 con 0x7fa98006ff40 2023-10-14T12:28:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9860da640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9800b3500 con 0x7fa98015a8d0 2023-10-14T12:28:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9860da640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98015c580 con 0x7fa9800ca660 2023-10-14T12:28:52.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9850d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98006ff40 0x7fa98015bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9850d8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98006ff40 0x7fa98015bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41540/0 (socket says 172.21.15.64:41540) 2023-10-14T12:28:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.370+0000 7fa9850d8640 1 -- 172.21.15.64:0/1277302959 learned_addr learned my addr 172.21.15.64:0/1277302959 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9850d8640 1 -- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9800ca660 msgr2=0x7fa9801f0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9850d8640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9800ca660 0x7fa9801f0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9850d8640 1 -- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98015a8d0 msgr2=0x7fa98014c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9850d8640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98015a8d0 0x7fa98014c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9850d8640 1 -- 172.21.15.64:0/1277302959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c009470 con 0x7fa98006ff40 2023-10-14T12:28:52.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9850d8640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98006ff40 0x7fa98015bea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009860 tx=0x7fa97c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:52.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa975ffb640 1 -- 172.21.15.64:0/1277302959 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0307f0 con 0x7fa98006ff40 2023-10-14T12:28:52.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa975ffb640 1 -- 172.21.15.64:0/1277302959 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c039d90 con 0x7fa98006ff40 2023-10-14T12:28:52.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa975ffb640 1 -- 172.21.15.64:0/1277302959 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c043630 con 0x7fa98006ff40 2023-10-14T12:28:52.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98015c860 con 0x7fa98006ff40 2023-10-14T12:28:52.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.371+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98015ce20 con 0x7fa98006ff40 2023-10-14T12:28:52.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.372+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98004e9b0 con 0x7fa98006ff40 2023-10-14T12:28:52.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.373+0000 7fa975ffb640 1 -- 172.21.15.64:0/1277302959 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa97c042390 con 0x7fa98006ff40 2023-10-14T12:28:52.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.375+0000 7fa975ffb640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa96406ae70 0x7fa96406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.375+0000 7fa975ffb640 1 -- 172.21.15.64:0/1277302959 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa97c0abd80 con 0x7fa98006ff40 2023-10-14T12:28:52.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.375+0000 7fa9848d7640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa96406ae70 0x7fa96406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.376+0000 7fa9848d7640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa96406ae70 0x7fa96406d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa970007fd0 tx=0x7fa970001310 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:52.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.379+0000 7fa975ffb640 1 -- 172.21.15.64:0/1277302959 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa97c076aa0 con 0x7fa98006ff40 2023-10-14T12:28:52.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.611+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa98015e8e0 con 0x7fa98006ff40 2023-10-14T12:28:52.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.612+0000 7fa975ffb640 1 -- 172.21.15.64:0/1277302959 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fa97c07a0c0 con 0x7fa98006ff40 2023-10-14T12:28:52.614 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:52.614 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:28:51.583102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-14T12:28:52.615 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 7 2023-10-14T12:28:52.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa96406ae70 msgr2=0x7fa96406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa96406ae70 0x7fa96406d330 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fa970007fd0 tx=0x7fa970001310 comp rx=0 tx=0).stop 2023-10-14T12:28:52.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98006ff40 msgr2=0x7fa98015bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98006ff40 0x7fa98015bea0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009860 tx=0x7fa97c004730 comp rx=0 tx=0).stop 2023-10-14T12:28:52.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 shutdown_connections 2023-10-14T12:28:52.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa96406ae70 0x7fa96406d330 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa98015a8d0 0x7fa98014c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa9800ca660 0x7fa9801f0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 --2- 172.21.15.64:0/1277302959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa98006ff40 0x7fa98015bea0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 >> 172.21.15.64:0/1277302959 conn(0x7fa98006a470 msgr2=0x7fa9800c1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:52.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 shutdown_connections 2023-10-14T12:28:52.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.615+0000 7fa9860da640 1 -- 172.21.15.64:0/1277302959 wait complete. 2023-10-14T12:28:52.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:52.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.848+0000 7fe482b2e640 1 Processor -- start 2023-10-14T12:28:52.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.848+0000 7fe482b2e640 1 -- start start 2023-10-14T12:28:52.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.850+0000 7fe482b2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0cb250 0x7fe47c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.850+0000 7fe482b2e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c15acb0 con 0x7fe47c15a8d0 2023-10-14T12:28:52.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.850+0000 7fe482b2e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47c0c1c60 con 0x7fe47c0ca660 2023-10-14T12:28:52.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.850+0000 7fe482b2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c15e350 con 0x7fe47c0cb250 2023-10-14T12:28:52.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.850+0000 7fe481b2c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fe47c15a8d0 0x7fe47c0cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42720/0 (socket says 172.21.15.64:42720) 2023-10-14T12:28:52.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.850+0000 7fe481b2c640 1 -- 172.21.15.64:0/1870475564 learned_addr learned my addr 172.21.15.64:0/1870475564 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:52.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe48132b640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0cb250 0x7fe47c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1563180054 0 0) 0x7fe478004b30 con 0x7fe47c15a8d0 2023-10-14T12:28:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe468003520 con 0x7fe47c15a8d0 2023-10-14T12:28:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3946617553 0 0) 0x7fe468003520 con 0x7fe47c15a8d0 2023-10-14T12:28:52.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0cb250 msgr2=0x7fe47c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0cb250 0x7fe47c0c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 >> v1:172.21.15.177:6789/0 conn(0x7fe47c0ca660 legacy=0x7fe47c0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c15e630 con 0x7fe47c15a8d0 2023-10-14T12:28:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fe478005220 con 0x7fe47c15a8d0 2023-10-14T12:28:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 >> v1:172.21.15.64:6789/0 conn(0x7fe47c15a8d0 legacy=0x7fe47c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680039a0 0x7fe468003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0cb250 0x7fe468005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c15e350 con 0x7fe4680047c0 2023-10-14T12:28:52.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800ba60 con 0x7fe4680039a0 2023-10-14T12:28:52.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.851+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46800bc20 con 0x7fe47c0cb250 2023-10-14T12:28:52.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe48132b640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe48132b640 1 -- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0cb250 msgr2=0x7fe468005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:52.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe48132b640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0cb250 0x7fe468005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe481b2c640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680039a0 0x7fe468003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe48132b640 1 -- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680039a0 msgr2=0x7fe468003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe48132b640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680039a0 0x7fe468003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe48132b640 1 -- 172.21.15.64:0/1870475564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe468003520 con 0x7fe4680047c0 2023-10-14T12:28:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.852+0000 7fe481b2c640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680039a0 0x7fe468003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.853+0000 7fe48132b640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009a90 tx=0x7fe4680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e5b1c3685c7c4b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:52.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c02c6b0 con 0x7fe4680047c0 2023-10-14T12:28:52.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c02c810 con 0x7fe4680047c0 2023-10-14T12:28:52.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe480b2a640 1 -- 172.21.15.64:0/1870475564 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c02cba0 con 0x7fe4680047c0 2023-10-14T12:28:52.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe482b2e640 1 -- 172.21.15.64:0/1870475564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4680047c0 msgr2=0x7fe468004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe482b2e640 1 --2- 172.21.15.64:0/1870475564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe4680047c0 0x7fe468004c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe46c009a90 tx=0x7fe4680057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe48232d640 1 -- 172.21.15.64:0/1870475564 reap_dead start 2023-10-14T12:28:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe482b2e640 1 -- 172.21.15.64:0/1870475564 shutdown_connections 2023-10-14T12:28:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe482b2e640 1 -- 172.21.15.64:0/1870475564 >> 172.21.15.64:0/1870475564 conn(0x7fe47c06a470 msgr2=0x7fe47c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe482b2e640 1 -- 172.21.15.64:0/1870475564 shutdown_connections 2023-10-14T12:28:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.854+0000 7fe482b2e640 1 -- 172.21.15.64:0/1870475564 wait complete. 2023-10-14T12:28:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.856+0000 7fe482b2e640 1 Processor -- start 2023-10-14T12:28:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.856+0000 7fe482b2e640 1 -- start start 2023-10-14T12:28:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe482b2e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680047c0 0x7fe47c0c7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe482b2e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe47c149170 0x7fe47c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe482b2e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0c5440 0x7fe47c0c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe482b2e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c5e00 con 0x7fe47c149170 2023-10-14T12:28:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe482b2e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c7850 con 0x7fe4680047c0 2023-10-14T12:28:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe482b2e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe47c0c7ab0 con 0x7fe47c0c5440 2023-10-14T12:28:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe48132b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe47c149170 0x7fe47c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe48132b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe47c149170 0x7fe47c0b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41560/0 (socket says 172.21.15.64:41560) 2023-10-14T12:28:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.857+0000 7fe48132b640 1 -- 172.21.15.64:0/2328610981 learned_addr learned my addr 172.21.15.64:0/2328610981 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe481b2c640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680047c0 0x7fe47c0c7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe48132b640 1 -- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0c5440 msgr2=0x7fe47c0c58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe48232d640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0c5440 0x7fe47c0c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe48132b640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0c5440 0x7fe47c0c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe48132b640 1 -- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680047c0 msgr2=0x7fe47c0c7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe48132b640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680047c0 0x7fe47c0c7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe48132b640 1 -- 172.21.15.64:0/2328610981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47c0c7d90 con 0x7fe47c149170 2023-10-14T12:28:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe481b2c640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680047c0 0x7fe47c0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe48132b640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe47c149170 0x7fe47c0b39f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe46c02c250 tx=0x7fe46c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe4727fc640 1 -- 172.21.15.64:0/2328610981 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003810 con 0x7fe47c149170 2023-10-14T12:28:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe4727fc640 1 -- 172.21.15.64:0/2328610981 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46c003970 con 0x7fe47c149170 2023-10-14T12:28:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.858+0000 7fe4727fc640 1 -- 172.21.15.64:0/2328610981 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46c003ce0 con 0x7fe47c149170 2023-10-14T12:28:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.859+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe47c0c8070 con 0x7fe47c149170 2023-10-14T12:28:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.859+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe47c0c8630 con 0x7fe47c149170 2023-10-14T12:28:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.860+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe47c0c87f0 con 0x7fe47c149170 2023-10-14T12:28:52.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.861+0000 7fe4727fc640 1 -- 172.21.15.64:0/2328610981 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe46c040450 con 0x7fe47c149170 2023-10-14T12:28:52.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.862+0000 7fe4727fc640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe46006ae70 0x7fe46006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:52.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.862+0000 7fe4727fc640 1 -- 172.21.15.64:0/2328610981 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe46c0ab7b0 con 0x7fe47c149170 2023-10-14T12:28:52.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.863+0000 7fe481b2c640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe46006ae70 0x7fe46006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:52.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.864+0000 7fe481b2c640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe46006ae70 0x7fe46006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe478005350 tx=0x7fe478009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:52.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:52.867+0000 7fe4727fc640 1 -- 172.21.15.64:0/2328610981 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe46c076570 con 0x7fe47c149170 2023-10-14T12:28:53.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.060+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe47c04e9b0 con 0x7fe47c149170 2023-10-14T12:28:53.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.063+0000 7fe4727fc640 1 -- 172.21.15.64:0/2328610981 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fe46c0044e0 con 0x7fe47c149170 2023-10-14T12:28:53.065 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:53.065 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:53.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe46006ae70 msgr2=0x7fe46006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe46006ae70 0x7fe46006d330 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe478005350 tx=0x7fe478009040 comp rx=0 tx=0).stop 2023-10-14T12:28:53.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe47c149170 msgr2=0x7fe47c0b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe47c149170 0x7fe47c0b39f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe46c02c250 tx=0x7fe46c004730 comp rx=0 tx=0).stop 2023-10-14T12:28:53.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 shutdown_connections 2023-10-14T12:28:53.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe46006ae70 0x7fe46006d330 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe47c0c5440 0x7fe47c0c58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe47c149170 0x7fe47c0b39f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 --2- 172.21.15.64:0/2328610981 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe4680047c0 0x7fe47c0c7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 >> 172.21.15.64:0/2328610981 conn(0x7fe47c06a470 msgr2=0x7fe47c0c2610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:53.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 shutdown_connections 2023-10-14T12:28:53.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.066+0000 7fe482b2e640 1 -- 172.21.15.64:0/2328610981 wait complete. 2023-10-14T12:28:53.088 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:53.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.312+0000 7f90e70df640 1 Processor -- start 2023-10-14T12:28:53.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.312+0000 7f90e70df640 1 -- start start 2023-10-14T12:28:53.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e70df640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90e015a8d0 0x7f90e00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e70df640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e006ff40 0x7f90e00cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e70df640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e015acb0 con 0x7f90e00ca660 2023-10-14T12:28:53.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e70df640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e00c1c60 con 0x7f90e015a8d0 2023-10-14T12:28:53.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e70df640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e015e350 con 0x7f90e006ff40 2023-10-14T12:28:53.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e60dd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90e015a8d0 0x7f90e00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e60dd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90e015a8d0 0x7f90e00cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:39962/0 (socket says 172.21.15.64:39962) 2023-10-14T12:28:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e68de640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e006ff40 0x7f90e00cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.314+0000 7f90e60dd640 1 -- 172.21.15.64:0/1581190871 learned_addr learned my addr 172.21.15.64:0/1581190871 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.315+0000 7f90e60dd640 1 -- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e006ff40 msgr2=0x7f90e00cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.315+0000 7f90e60dd640 1 --2- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e006ff40 0x7f90e00cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.315+0000 7f90e60dd640 1 -- 172.21.15.64:0/1581190871 >> v1:172.21.15.177:6789/0 conn(0x7f90e00ca660 legacy=0x7f90e006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.315+0000 7f90e60dd640 1 -- 172.21.15.64:0/1581190871 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e015e630 con 0x7f90e015a8d0 2023-10-14T12:28:53.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.315+0000 7f90e68de640 1 --2- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e006ff40 0x7f90e00cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:28:53.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.317+0000 7f90e60dd640 1 --2- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e015a8d0 0x7f90e00cab40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009850 tx=0x7f90dc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782b19b8caa0ddfc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:53.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.317+0000 7f90e50db640 1 -- 172.21.15.64:0/1581190871 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc004230 con 0x7f90e015a8d0 2023-10-14T12:28:53.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.317+0000 7f90e50db640 1 -- 172.21.15.64:0/1581190871 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc004390 con 0x7f90e015a8d0 2023-10-14T12:28:53.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.317+0000 7f90e50db640 1 -- 172.21.15.64:0/1581190871 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc003810 con 0x7f90e015a8d0 2023-10-14T12:28:53.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 -- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e015a8d0 msgr2=0x7f90e00cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 --2- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e015a8d0 0x7f90e00cab40 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f90dc009850 tx=0x7f90dc02b960 comp rx=0 tx=0).stop 2023-10-14T12:28:53.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 -- 172.21.15.64:0/1581190871 shutdown_connections 2023-10-14T12:28:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 --2- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e006ff40 0x7f90e00cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 --2- 172.21.15.64:0/1581190871 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e015a8d0 0x7f90e00cab40 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 -- 172.21.15.64:0/1581190871 >> 172.21.15.64:0/1581190871 conn(0x7f90e006a470 msgr2=0x7f90e00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:53.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 -- 172.21.15.64:0/1581190871 shutdown_connections 2023-10-14T12:28:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.318+0000 7f90e70df640 1 -- 172.21.15.64:0/1581190871 wait complete. 2023-10-14T12:28:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.320+0000 7f90e70df640 1 Processor -- start 2023-10-14T12:28:53.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.320+0000 7f90e70df640 1 -- start start 2023-10-14T12:28:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e70df640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e006ff40 0x7f90e01596a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e70df640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00ca660 0x7f90e00cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e70df640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e015a8d0 0x7f90e00cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e70df640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00cd720 con 0x7f90e006ff40 2023-10-14T12:28:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e70df640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00ccaa0 con 0x7f90e00ca660 2023-10-14T12:28:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e70df640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e00ccd80 con 0x7f90e015a8d0 2023-10-14T12:28:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e60dd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e006ff40 0x7f90e01596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e60dd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e006ff40 0x7f90e01596a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41562/0 (socket says 172.21.15.64:41562) 2023-10-14T12:28:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e60dd640 1 -- 172.21.15.64:0/2672678622 learned_addr learned my addr 172.21.15.64:0/2672678622 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e68de640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e015a8d0 0x7f90e00cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e58dc640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00ca660 0x7f90e00cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.322+0000 7f90e60dd640 1 -- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e015a8d0 msgr2=0x7f90e00cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e60dd640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e015a8d0 0x7f90e00cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e60dd640 1 -- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00ca660 msgr2=0x7f90e00cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e60dd640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00ca660 0x7f90e00cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e60dd640 1 -- 172.21.15.64:0/2672678622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009a70 con 0x7f90e006ff40 2023-10-14T12:28:53.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e58dc640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00ca660 0x7f90e00cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:53.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e60dd640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e006ff40 0x7f90e01596a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90dc02b9a0 tx=0x7f90dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:53.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90d6ffd640 1 -- 172.21.15.64:0/2672678622 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc03d070 con 0x7f90e006ff40 2023-10-14T12:28:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90d6ffd640 1 -- 172.21.15.64:0/2672678622 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90dc004500 con 0x7f90e006ff40 2023-10-14T12:28:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90dc009460 con 0x7f90e006ff40 2023-10-14T12:28:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90d6ffd640 1 -- 172.21.15.64:0/2672678622 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90dc003e10 con 0x7f90e006ff40 2023-10-14T12:28:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.323+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e00cd340 con 0x7f90e006ff40 2023-10-14T12:28:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.325+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e00cd990 con 0x7f90e006ff40 2023-10-14T12:28:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.326+0000 7f90d6ffd640 1 -- 172.21.15.64:0/2672678622 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90dc006040 con 0x7f90e006ff40 2023-10-14T12:28:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.327+0000 7f90d6ffd640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90c406ae70 0x7f90c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.327+0000 7f90d6ffd640 1 -- 172.21.15.64:0/2672678622 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f90dc0ab6d0 con 0x7f90e006ff40 2023-10-14T12:28:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.327+0000 7f90e58dc640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90c406ae70 0x7f90c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.328+0000 7f90e58dc640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90c406ae70 0x7f90c406d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90e00c24d0 tx=0x7f90d0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:53.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.333+0000 7f90d6ffd640 1 -- 172.21.15.64:0/2672678622 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90dc0763f0 con 0x7f90e006ff40 2023-10-14T12:28:53.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.527+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90e004e9b0 con 0x7f90e006ff40 2023-10-14T12:28:53.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.530+0000 7f90d6ffd640 1 -- 172.21.15.64:0/2672678622 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f90dc079a10 con 0x7f90e006ff40 2023-10-14T12:28:53.532 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:53.532 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:53.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90c406ae70 msgr2=0x7f90c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90c406ae70 0x7f90c406d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f90e00c24d0 tx=0x7f90d0009040 comp rx=0 tx=0).stop 2023-10-14T12:28:53.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e006ff40 msgr2=0x7f90e01596a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e006ff40 0x7f90e01596a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f90dc02b9a0 tx=0x7f90dc0046c0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 shutdown_connections 2023-10-14T12:28:53.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90c406ae70 0x7f90c406d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90e015a8d0 0x7f90e00cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90e00ca660 0x7f90e00cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 --2- 172.21.15.64:0/2672678622 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90e006ff40 0x7f90e01596a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.532+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 >> 172.21.15.64:0/2672678622 conn(0x7f90e006a470 msgr2=0x7f90e00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:53.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.533+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 shutdown_connections 2023-10-14T12:28:53.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.533+0000 7f90e70df640 1 -- 172.21.15.64:0/2672678622 wait complete. 2023-10-14T12:28:53.566 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:28:53.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.798+0000 7f7f1d339640 1 Processor -- start 2023-10-14T12:28:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.798+0000 7f7f1d339640 1 -- start start 2023-10-14T12:28:53.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f1d339640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7f180cec20 0x7f7f180b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f1d339640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180ad1e0 0x7f7f1806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f1d339640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1815aea0 con 0x7f7f180ce420 2023-10-14T12:28:53.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f1d339640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f180ad670 con 0x7f7f180cec20 2023-10-14T12:28:53.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f1d339640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1806def0 con 0x7f7f180ad1e0 2023-10-14T12:28:53.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f16ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7f180cec20 0x7f7f180b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f16ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7f180cec20 0x7f7f180b2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41570/0 (socket says 172.21.15.64:41570) 2023-10-14T12:28:53.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f16ffd640 1 -- 172.21.15.64:0/3400782634 learned_addr learned my addr 172.21.15.64:0/3400782634 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:53.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.800+0000 7f7f0ffff640 1 --1- 172.21.15.64:0/3400782634 >> v1:172.21.15.64:6789/0 conn(0x7f7f180ce420 0x7f7f180cf000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42736/0 (socket says 172.21.15.64:42736) 2023-10-14T12:28:53.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.801+0000 7f7f177fe640 1 --2- 172.21.15.64:0/3400782634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180ad1e0 0x7f7f1806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.801+0000 7f7f16ffd640 1 -- 172.21.15.64:0/3400782634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180ad1e0 msgr2=0x7f7f1806ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:53.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.801+0000 7f7f16ffd640 1 --2- 172.21.15.64:0/3400782634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180ad1e0 0x7f7f1806ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.801+0000 7f7f16ffd640 1 -- 172.21.15.64:0/3400782634 >> v1:172.21.15.64:6789/0 conn(0x7f7f180ce420 legacy=0x7f7f180cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.801+0000 7f7f16ffd640 1 -- 172.21.15.64:0/3400782634 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1806e1d0 con 0x7f7f180cec20 2023-10-14T12:28:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.801+0000 7f7f167fc640 1 -- 172.21.15.64:0/3400782634 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413210361 0 0) 0x7f7f00001110 con 0x7f7f180ce420 2023-10-14T12:28:53.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.802+0000 7f7f16ffd640 1 --2- 172.21.15.64:0/3400782634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180cec20 0x7f7f180b2b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009850 tx=0x7f7f0802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=524ccfcf188c59da server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.802+0000 7f7f167fc640 1 -- 172.21.15.64:0/3400782634 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08004230 con 0x7f7f180cec20 2023-10-14T12:28:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.802+0000 7f7f167fc640 1 -- 172.21.15.64:0/3400782634 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f08004390 con 0x7f7f180cec20 2023-10-14T12:28:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.802+0000 7f7f167fc640 1 -- 172.21.15.64:0/3400782634 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f08031830 con 0x7f7f180cec20 2023-10-14T12:28:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 -- 172.21.15.64:0/3400782634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180cec20 msgr2=0x7f7f180b2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 --2- 172.21.15.64:0/3400782634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180cec20 0x7f7f180b2b60 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009850 tx=0x7f7f0802b8d0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 -- 172.21.15.64:0/3400782634 shutdown_connections 2023-10-14T12:28:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 --2- 172.21.15.64:0/3400782634 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180ad1e0 0x7f7f1806ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 --2- 172.21.15.64:0/3400782634 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180cec20 0x7f7f180b2b60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 -- 172.21.15.64:0/3400782634 >> 172.21.15.64:0/3400782634 conn(0x7f7f180d06d0 msgr2=0x7f7f180d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 -- 172.21.15.64:0/3400782634 shutdown_connections 2023-10-14T12:28:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.803+0000 7f7f1d339640 1 -- 172.21.15.64:0/3400782634 wait complete. 2023-10-14T12:28:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.805+0000 7f7f1d339640 1 Processor -- start 2023-10-14T12:28:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.805+0000 7f7f1d339640 1 -- start start 2023-10-14T12:28:53.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f1d339640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f180ad1e0 0x7f7f1815da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f1d339640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180ce420 0x7f7f181ef840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f1d339640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180cec20 0x7f7f180b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f1d339640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1815ca40 con 0x7f7f180ce420 2023-10-14T12:28:53.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f1d339640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f181efd80 con 0x7f7f180ad1e0 2023-10-14T12:28:53.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f1d339640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1815be30 con 0x7f7f180cec20 2023-10-14T12:28:53.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180ce420 0x7f7f181ef840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180ce420 0x7f7f181ef840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41582/0 (socket says 172.21.15.64:41582) 2023-10-14T12:28:53.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 -- 172.21.15.64:0/2888820407 learned_addr learned my addr 172.21.15.64:0/2888820407 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:53.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f16ffd640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f180ad1e0 0x7f7f1815da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f177fe640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180cec20 0x7f7f180b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 -- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180cec20 msgr2=0x7f7f180b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180cec20 0x7f7f180b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 -- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f180ad1e0 msgr2=0x7f7f1815da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:53.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f180ad1e0 0x7f7f1815da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:53.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.806+0000 7f7f0ffff640 1 -- 172.21.15.64:0/2888820407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f08009460 con 0x7f7f180ce420 2023-10-14T12:28:53.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.807+0000 7f7f177fe640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180cec20 0x7f7f180b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:53.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.807+0000 7f7f0ffff640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180ce420 0x7f7f181ef840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c460 tx=0x7f7f0000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:53.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.807+0000 7f7f0f7fe640 1 -- 172.21.15.64:0/2888820407 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f000074e0 con 0x7f7f180ce420 2023-10-14T12:28:53.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.807+0000 7f7f0f7fe640 1 -- 172.21.15.64:0/2888820407 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f00007660 con 0x7f7f180ce420 2023-10-14T12:28:53.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.807+0000 7f7f0f7fe640 1 -- 172.21.15.64:0/2888820407 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f00004a20 con 0x7f7f180ce420 2023-10-14T12:28:53.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.807+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1815c110 con 0x7f7f180ce420 2023-10-14T12:28:53.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.807+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1815c6d0 con 0x7f7f180ce420 2023-10-14T12:28:53.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.808+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f180b3360 con 0x7f7f180ce420 2023-10-14T12:28:53.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.809+0000 7f7f0f7fe640 1 -- 172.21.15.64:0/2888820407 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7f00004b80 con 0x7f7f180ce420 2023-10-14T12:28:53.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.810+0000 7f7f0f7fe640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ef806aea0 0x7f7ef806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:53.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.810+0000 7f7f0f7fe640 1 -- 172.21.15.64:0/2888820407 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7f000889d0 con 0x7f7f180ce420 2023-10-14T12:28:53.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.811+0000 7f7f16ffd640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ef806aea0 0x7f7ef806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:53.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.812+0000 7f7f16ffd640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ef806aea0 0x7f7ef806d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f08035000 tx=0x7f7f08008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:53.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:53.814+0000 7f7f0f7fe640 1 -- 172.21.15.64:0/2888820407 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7f180b3360 con 0x7f7f180ce420 2023-10-14T12:28:54.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.048+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7f1815aea0 con 0x7f7f180ce420 2023-10-14T12:28:54.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.049+0000 7f7f0f7fe640 1 -- 172.21.15.64:0/2888820407 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f7f1815aea0 con 0x7f7f180ce420 2023-10-14T12:28:54.051 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:54.052 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:28:51.583102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-10-14T12:28:54.052 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 7 2023-10-14T12:28:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ef806aea0 msgr2=0x7f7ef806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ef806aea0 0x7f7ef806d360 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7f08035000 tx=0x7f7f08008030 comp rx=0 tx=0).stop 2023-10-14T12:28:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180ce420 msgr2=0x7f7f181ef840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180ce420 0x7f7f181ef840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f0000c460 tx=0x7f7f0000c920 comp rx=0 tx=0).stop 2023-10-14T12:28:54.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 shutdown_connections 2023-10-14T12:28:54.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ef806aea0 0x7f7ef806d360 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7f180cec20 0x7f7f180b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7f180ce420 0x7f7f181ef840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 --2- 172.21.15.64:0/2888820407 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7f180ad1e0 0x7f7f1815da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 >> 172.21.15.64:0/2888820407 conn(0x7f7f180d06d0 msgr2=0x7f7f18158f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 shutdown_connections 2023-10-14T12:28:54.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.052+0000 7f7f1d339640 1 -- 172.21.15.64:0/2888820407 wait complete. 2023-10-14T12:28:54.075 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:54.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.291+0000 7f79dbfff640 1 Processor -- start 2023-10-14T12:28:54.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.291+0000 7f79dbfff640 1 -- start start 2023-10-14T12:28:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79dbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc0cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79dbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f79dc06bf30 0x7f79dc06c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:54.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79dbfff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79dc154110 con 0x7f79dc159c00 2023-10-14T12:28:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79dbfff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc06c900 con 0x7f79dc06bf30 2023-10-14T12:28:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79dbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc15d1f0 con 0x7f79dc0cd980 2023-10-14T12:28:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79d3fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f79dc159c00 0x7f79dc15d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42746/0 (socket says 172.21.15.64:42746) 2023-10-14T12:28:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79d3fff640 1 -- 172.21.15.64:0/126880774 learned_addr learned my addr 172.21.15.64:0/126880774 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:54.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.293+0000 7f79db7fe640 1 --2- 172.21.15.64:0/126880774 >> v2:172.21.15.64:3300/0 conn(0x7f79dc06bf30 0x7f79dc06c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:54.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.294+0000 7f79daffd640 1 --2- 172.21.15.64:0/126880774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc0cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:54.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.294+0000 7f79da7fc640 1 -- 172.21.15.64:0/126880774 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458182777 0 0) 0x7f79dc154110 con 0x7f79dc159c00 2023-10-14T12:28:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.294+0000 7f79da7fc640 1 -- 172.21.15.64:0/126880774 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79c8005730 con 0x7f79dc159c00 2023-10-14T12:28:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.294+0000 7f79db7fe640 1 -- 172.21.15.64:0/126880774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 msgr2=0x7f79dc0cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.294+0000 7f79db7fe640 1 --2- 172.21.15.64:0/126880774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc0cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.294+0000 7f79db7fe640 1 -- 172.21.15.64:0/126880774 >> v1:172.21.15.64:6789/0 conn(0x7f79dc159c00 legacy=0x7f79dc15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.294+0000 7f79db7fe640 1 -- 172.21.15.64:0/126880774 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc15e0c0 con 0x7f79dc06bf30 2023-10-14T12:28:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.295+0000 7f79db7fe640 1 --2- 172.21.15.64:0/126880774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc06bf30 0x7f79dc06c3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009d90 tx=0x7f79d402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9621786286a2d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.295+0000 7f79da7fc640 1 -- 172.21.15.64:0/126880774 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d402cc50 con 0x7f79dc06bf30 2023-10-14T12:28:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.295+0000 7f79da7fc640 1 -- 172.21.15.64:0/126880774 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d402cdb0 con 0x7f79dc06bf30 2023-10-14T12:28:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.295+0000 7f79da7fc640 1 -- 172.21.15.64:0/126880774 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4034640 con 0x7f79dc06bf30 2023-10-14T12:28:54.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 -- 172.21.15.64:0/126880774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc06bf30 msgr2=0x7f79dc06c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 --2- 172.21.15.64:0/126880774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc06bf30 0x7f79dc06c3c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009d90 tx=0x7f79d402bea0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 -- 172.21.15.64:0/126880774 shutdown_connections 2023-10-14T12:28:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 --2- 172.21.15.64:0/126880774 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc06bf30 0x7f79dc06c3c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 --2- 172.21.15.64:0/126880774 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc0cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 -- 172.21.15.64:0/126880774 >> 172.21.15.64:0/126880774 conn(0x7f79dc06a470 msgr2=0x7f79dc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 -- 172.21.15.64:0/126880774 shutdown_connections 2023-10-14T12:28:54.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.296+0000 7f79dbfff640 1 -- 172.21.15.64:0/126880774 wait complete. 2023-10-14T12:28:54.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.298+0000 7f79dbfff640 1 Processor -- start 2023-10-14T12:28:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.298+0000 7f79dbfff640 1 -- start start 2023-10-14T12:28:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79dbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79dc06bf30 0x7f79dc1470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79dbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc1561f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:54.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79dbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc159c00 0x7f79dc0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:54.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79dbfff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc147610 con 0x7f79dc159c00 2023-10-14T12:28:54.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79dbfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc144100 con 0x7f79dc06bf30 2023-10-14T12:28:54.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79dbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0c56f0 con 0x7f79dc0cd980 2023-10-14T12:28:54.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79db7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc159c00 0x7f79dc0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:54.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79db7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc159c00 0x7f79dc0cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41590/0 (socket says 172.21.15.64:41590) 2023-10-14T12:28:54.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.299+0000 7f79db7fe640 1 -- 172.21.15.64:0/2830764193 learned_addr learned my addr 172.21.15.64:0/2830764193 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:54.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79daffd640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79dc06bf30 0x7f79dc1470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:54.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79d3fff640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc1561f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:54.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79db7fe640 1 -- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 msgr2=0x7f79dc1561f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79db7fe640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc1561f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79db7fe640 1 -- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79dc06bf30 msgr2=0x7f79dc1470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79db7fe640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79dc06bf30 0x7f79dc1470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79db7fe640 1 -- 172.21.15.64:0/2830764193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d4009a70 con 0x7f79dc159c00 2023-10-14T12:28:54.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79daffd640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79dc06bf30 0x7f79dc1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:54.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79db7fe640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc159c00 0x7f79dc0cb5d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009eb0 tx=0x7f79d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:54.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79d8ff9640 1 -- 172.21.15.64:0/2830764193 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d403f420 con 0x7f79dc159c00 2023-10-14T12:28:54.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79d8ff9640 1 -- 172.21.15.64:0/2830764193 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d403f5a0 con 0x7f79dc159c00 2023-10-14T12:28:54.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79d8ff9640 1 -- 172.21.15.64:0/2830764193 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d403f990 con 0x7f79dc159c00 2023-10-14T12:28:54.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.300+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79dc1434f0 con 0x7f79dc159c00 2023-10-14T12:28:54.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.301+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc143ab0 con 0x7f79dc159c00 2023-10-14T12:28:54.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.302+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc141180 con 0x7f79dc159c00 2023-10-14T12:28:54.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.303+0000 7f79d8ff9640 1 -- 172.21.15.64:0/2830764193 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79d403faf0 con 0x7f79dc159c00 2023-10-14T12:28:54.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.303+0000 7f79d8ff9640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79bc06ae70 0x7f79bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:54.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.304+0000 7f79d8ff9640 1 -- 172.21.15.64:0/2830764193 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79d40ac270 con 0x7f79dc159c00 2023-10-14T12:28:54.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.304+0000 7f79daffd640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79bc06ae70 0x7f79bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:54.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.305+0000 7f79daffd640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79bc06ae70 0x7f79bc06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009820 tx=0x7f79cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:54.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.308+0000 7f79d8ff9640 1 -- 172.21.15.64:0/2830764193 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79dc141180 con 0x7f79dc159c00 2023-10-14T12:28:54.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.508+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79dc141180 con 0x7f79dc159c00 2023-10-14T12:28:54.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.511+0000 7f79d8ff9640 1 -- 172.21.15.64:0/2830764193 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f79dc141180 con 0x7f79dc159c00 2023-10-14T12:28:54.514 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:54.514 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:54.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79bc06ae70 msgr2=0x7f79bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79bc06ae70 0x7f79bc06d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f79cc009820 tx=0x7f79cc008040 comp rx=0 tx=0).stop 2023-10-14T12:28:54.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc159c00 msgr2=0x7f79dc0cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:54.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc159c00 0x7f79dc0cb5d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009eb0 tx=0x7f79d4004a40 comp rx=0 tx=0).stop 2023-10-14T12:28:54.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 shutdown_connections 2023-10-14T12:28:54.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79bc06ae70 0x7f79bc06d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79dc159c00 0x7f79dc0cb5d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79dc0cd980 0x7f79dc1561f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 --2- 172.21.15.64:0/2830764193 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79dc06bf30 0x7f79dc1470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:54.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 >> 172.21.15.64:0/2830764193 conn(0x7f79dc06a470 msgr2=0x7f79dc0b2c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:54.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.514+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 shutdown_connections 2023-10-14T12:28:54.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:54.515+0000 7f79dbfff640 1 -- 172.21.15.64:0/2830764193 wait complete. 2023-10-14T12:28:54.936 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:28:46.535748+0000', 'modified': '2023-10-14T12:28:51.583102+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6837/150618122', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6835', 'nonce': 150618122}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 150618122}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-10-14T12:28:54.936 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:28:54.937 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T12:28:55.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.167+0000 7fc70ffff640 1 Processor -- start 2023-10-14T12:28:55.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.167+0000 7fc70ffff640 1 -- start start 2023-10-14T12:28:55.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.169+0000 7fc70ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc71015cc90 0x7fc7100d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.169+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7100cfe70 0x7fc7100d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.169+0000 7fc70ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7100d05c0 0x7fc71006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.169+0000 7fc70ffff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7100d3760 con 0x7fc7100d05c0 2023-10-14T12:28:55.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.169+0000 7fc70ffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7100cf9e0 con 0x7fc71015cc90 2023-10-14T12:28:55.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.169+0000 7fc70ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71015d070 con 0x7fc7100cfe70 2023-10-14T12:28:55.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7100d05c0 0x7fc71006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7100d05c0 0x7fc71006af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41602/0 (socket says 172.21.15.64:41602) 2023-10-14T12:28:55.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1209853416 learned_addr learned my addr 172.21.15.64:0/1209853416 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:55.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70effd640 1 --2- 172.21.15.64:0/1209853416 >> v2:172.21.15.177:3300/0 conn(0x7fc71015cc90 0x7fc7100d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc707fff640 1 --2- 172.21.15.64:0/1209853416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7100cfe70 0x7fc7100d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1209853416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7100cfe70 msgr2=0x7fc7100d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1209853416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7100cfe70 0x7fc7100d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1209853416 >> v2:172.21.15.177:3300/0 conn(0x7fc71015cc90 msgr2=0x7fc7100d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1209853416 >> v2:172.21.15.177:3300/0 conn(0x7fc71015cc90 0x7fc7100d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1209853416 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7100b1870 con 0x7fc7100d05c0 2023-10-14T12:28:55.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.170+0000 7fc70effd640 1 --2- 172.21.15.64:0/1209853416 >> v2:172.21.15.177:3300/0 conn(0x7fc71015cc90 0x7fc7100d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:28:55.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.171+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1209853416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100d05c0 0x7fc71006af60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7100ce890 tx=0x7fc70802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e28506678cd6a5e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.172+0000 7fc70e7fc640 1 -- 172.21.15.64:0/1209853416 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70802c9e0 con 0x7fc7100d05c0 2023-10-14T12:28:55.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.172+0000 7fc70e7fc640 1 -- 172.21.15.64:0/1209853416 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70802cb40 con 0x7fc7100d05c0 2023-10-14T12:28:55.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.172+0000 7fc70e7fc640 1 -- 172.21.15.64:0/1209853416 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7080343f0 con 0x7fc7100d05c0 2023-10-14T12:28:55.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.172+0000 7fc70ffff640 1 -- 172.21.15.64:0/1209853416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100d05c0 msgr2=0x7fc71006af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.172+0000 7fc70ffff640 1 --2- 172.21.15.64:0/1209853416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100d05c0 0x7fc71006af60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc7100ce890 tx=0x7fc70802be40 comp rx=0 tx=0).stop 2023-10-14T12:28:55.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.173+0000 7fc70ffff640 1 -- 172.21.15.64:0/1209853416 shutdown_connections 2023-10-14T12:28:55.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.173+0000 7fc70ffff640 1 --2- 172.21.15.64:0/1209853416 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100d05c0 0x7fc71006af60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.173+0000 7fc70ffff640 1 --2- 172.21.15.64:0/1209853416 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7100cfe70 0x7fc7100d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.173+0000 7fc70ffff640 1 --2- 172.21.15.64:0/1209853416 >> v2:172.21.15.177:3300/0 conn(0x7fc71015cc90 0x7fc7100d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.173+0000 7fc70ffff640 1 -- 172.21.15.64:0/1209853416 >> 172.21.15.64:0/1209853416 conn(0x7fc7100d27e0 msgr2=0x7fc7100d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.173+0000 7fc70ffff640 1 -- 172.21.15.64:0/1209853416 shutdown_connections 2023-10-14T12:28:55.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.173+0000 7fc70ffff640 1 -- 172.21.15.64:0/1209853416 wait complete. 2023-10-14T12:28:55.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.174+0000 7fc70ffff640 1 Processor -- start 2023-10-14T12:28:55.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.175+0000 7fc70ffff640 1 -- start start 2023-10-14T12:28:55.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.175+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100cfe70 0x7fc7101564b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100d05c0 0x7fc71015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71015cc90 0x7fc71015dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70ffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100b1520 con 0x7fc7100cfe70 2023-10-14T12:28:55.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70ffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7101569f0 con 0x7fc7100d05c0 2023-10-14T12:28:55.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7100b09a0 con 0x7fc71015cc90 2023-10-14T12:28:55.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100cfe70 0x7fc7101564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100cfe70 0x7fc7101564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41610/0 (socket says 172.21.15.64:41610) 2023-10-14T12:28:55.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 -- 172.21.15.64:0/869717289 learned_addr learned my addr 172.21.15.64:0/869717289 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:55.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc707fff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100d05c0 0x7fc71015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 -- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71015cc90 msgr2=0x7fc71015dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71015cc90 0x7fc71015dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 -- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100d05c0 msgr2=0x7fc71015d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100d05c0 0x7fc71015d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc70effd640 1 -- 172.21.15.64:0/869717289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc708009b30 con 0x7fc7100cfe70 2023-10-14T12:28:55.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.176+0000 7fc707fff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100d05c0 0x7fc71015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:55.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.177+0000 7fc70effd640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100cfe70 0x7fc7101564b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc70000d7d0 tx=0x7fc70000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.177+0000 7fc7077fe640 1 -- 172.21.15.64:0/869717289 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700004030 con 0x7fc7100cfe70 2023-10-14T12:28:55.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.177+0000 7fc7077fe640 1 -- 172.21.15.64:0/869717289 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700004190 con 0x7fc7100cfe70 2023-10-14T12:28:55.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.177+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7100b0c80 con 0x7fc7100cfe70 2023-10-14T12:28:55.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.177+0000 7fc7077fe640 1 -- 172.21.15.64:0/869717289 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700004520 con 0x7fc7100cfe70 2023-10-14T12:28:55.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.177+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7100b1240 con 0x7fc7100cfe70 2023-10-14T12:28:55.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.179+0000 7fc7077fe640 1 -- 172.21.15.64:0/869717289 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc7000096a0 con 0x7fc7100cfe70 2023-10-14T12:28:55.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.181+0000 7fc7077fe640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc6f006ae70 0x7fc6f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.181+0000 7fc7077fe640 1 -- 172.21.15.64:0/869717289 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc700089b20 con 0x7fc7100cfe70 2023-10-14T12:28:55.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.182+0000 7fc707fff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc6f006ae70 0x7fc6f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.182+0000 7fc717fb9740 1 Processor -- start 2023-10-14T12:28:55.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.182+0000 7fc717fb9740 1 -- start start 2023-10-14T12:28:55.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc707fff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc6f006ae70 0x7fc6f006d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7100ca620 tx=0x7fc6f8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717170 0x5593176ea070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317719f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5593176ea5b0 0x55931771a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc717fb9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931760a7a0 con 0x5593176ea5b0 2023-10-14T12:28:55.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931765c740 con 0x559317717170 2023-10-14T12:28:55.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559317659e30 con 0x559317717550 2023-10-14T12:28:55.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5593176ea5b0 0x55931771a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5593176ea5b0 0x55931771a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41626/0 (socket says 172.21.15.64:41626) 2023-10-14T12:28:55.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1183231564 learned_addr learned my addr 172.21.15.64:0/1183231564 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:55.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70effd640 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717170 0x5593176ea070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc707fff640 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317719f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 msgr2=0x559317719f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317719f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717170 msgr2=0x5593176ea070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.183+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717170 0x5593176ea070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.184+0000 7fc70f7fe640 1 -- 172.21.15.64:0/1183231564 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559317619910 con 0x5593176ea5b0 2023-10-14T12:28:55.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.184+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5593176ea5b0 0x55931771a440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc708009f40 tx=0x7fc70802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8cf3cacd7fb691 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.184+0000 7fc704ff9640 1 -- 172.21.15.64:0/1183231564 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70802c7e0 con 0x5593176ea5b0 2023-10-14T12:28:55.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.184+0000 7fc704ff9640 1 -- 172.21.15.64:0/1183231564 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70802c980 con 0x5593176ea5b0 2023-10-14T12:28:55.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.184+0000 7fc704ff9640 1 -- 172.21.15.64:0/1183231564 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc70803e690 con 0x5593176ea5b0 2023-10-14T12:28:55.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 -- 172.21.15.64:0/1183231564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5593176ea5b0 msgr2=0x55931771a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5593176ea5b0 0x55931771a440 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fc708009f40 tx=0x7fc70802e070 comp rx=0 tx=0).stop 2023-10-14T12:28:55.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 -- 172.21.15.64:0/1183231564 shutdown_connections 2023-10-14T12:28:55.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5593176ea5b0 0x55931771a440 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317719f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1183231564 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717170 0x5593176ea070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 -- 172.21.15.64:0/1183231564 >> 172.21.15.64:0/1183231564 conn(0x5593176ec380 msgr2=0x559317734f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 -- 172.21.15.64:0/1183231564 shutdown_connections 2023-10-14T12:28:55.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.185+0000 7fc717fb9740 1 -- 172.21.15.64:0/1183231564 wait complete. 2023-10-14T12:28:55.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.186+0000 7fc717fb9740 1 -- start start 2023-10-14T12:28:55.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.186+0000 7fc717fb9740 1 Processor -- start 2023-10-14T12:28:55.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x559317744890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317744dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x55931771d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc717fb9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x559317655720 con 0x559317717170 2023-10-14T12:28:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593175f3970 con 0x559317706580 2023-10-14T12:28:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5593175f3610 con 0x559317717550 2023-10-14T12:28:55.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc717fb9740 10 client.0 _ll_register_callbacks cb 0x5593176159d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:28:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc70effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x559317744890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc70effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x559317744890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41638/0 (socket says 172.21.15.64:41638) 2023-10-14T12:28:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.187+0000 7fc70effd640 1 -- 172.21.15.64:0/1891368555 learned_addr learned my addr 172.21.15.64:0/1891368555 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc707fff640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317744dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc70effd640 1 -- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 msgr2=0x559317744dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x55931771d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc70effd640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317744dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc70effd640 1 -- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 msgr2=0x55931771d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc70effd640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x55931771d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc70effd640 1 -- 172.21.15.64:0/1891368555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7100b1870 con 0x559317717170 2023-10-14T12:28:55.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc707fff640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317744dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc70effd640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x559317744890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc700058490 tx=0x7fc700058640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b7a260d72e4fee server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc6edffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2023-10-14T12:28:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc6edffb640 1 -- 172.21.15.64:0/1891368555 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700081be0 con 0x559317717170 2023-10-14T12:28:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc6edffb640 1 -- 172.21.15.64:0/1891368555 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc700081d40 con 0x559317717170 2023-10-14T12:28:55.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55931767c160 con 0x559317717170 2023-10-14T12:28:55.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc6edffb640 1 -- 172.21.15.64:0/1891368555 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc700060370 con 0x559317717170 2023-10-14T12:28:55.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc717fb9740 10 client.4398 fetch_fsmap learned FSMap version 7 2023-10-14T12:28:55.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.188+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559317653da0 con 0x559317717170 2023-10-14T12:28:55.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc6edffb640 1 -- 172.21.15.64:0/1891368555 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55931767c160 con 0x559317717170 2023-10-14T12:28:55.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc6edffb640 1 -- 172.21.15.64:0/1891368555 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc70001b020 con 0x559317717170 2023-10-14T12:28:55.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc717fb9740 10 client.4398 fetch_fsmap finished waiting for FSMap version 7 2023-10-14T12:28:55.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc717fb9740 10 client.4398 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:28:55.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc717fb9740 20 client.4398 populate_metadata read hostname 'smithi064' 2023-10-14T12:28:55.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x55931772cfc0 0x559317747e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc717fb9740 4 client.4398 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:28:55.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.189+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 --> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559317627cc0 con 0x55931772cfc0 2023-10-14T12:28:55.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.190+0000 7fc707fff640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x55931772cfc0 0x559317747e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.190+0000 7fc707fff640 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x55931772cfc0 0x559317747e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a70f9648446b015d server_cookie=160d13c490e59c92 in_seq=0 out_seq=0 2023-10-14T12:28:55.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.190+0000 7fc6edffb640 10 client.4398 ms_handle_connect on v2:172.21.15.177:6835/150618122 2023-10-14T12:28:55.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.192+0000 7fc6edffb640 1 -- 172.21.15.64:0/1891368555 <== mds.0 v2:172.21.15.177:6835/150618122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559317627cc0 con 0x55931772cfc0 2023-10-14T12:28:55.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.192+0000 7fc6edffb640 10 client.4398 handle_command_reply: tid=0 2023-10-14T12:28:55.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 client.4398 shutdown 2023-10-14T12:28:55.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 msgr2=0x559317744890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x559317744890 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc700058490 tx=0x7fc700058640 comp rx=0 tx=0).stop 2023-10-14T12:28:55.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 shutdown_connections 2023-10-14T12:28:55.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x55931772cfc0 0x559317747e00 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x55931771d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x559317744dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1891368555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x559317744890 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc6edffb640 0 client.4398 ms_handle_reset on v2:172.21.15.177:6835/150618122 2023-10-14T12:28:55.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 >> 172.21.15.64:0/1891368555 conn(0x5593176ea5b0 msgr2=0x559317719ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 shutdown_connections 2023-10-14T12:28:55.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 1 -- 172.21.15.64:0/1891368555 wait complete. 2023-10-14T12:28:55.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.193+0000 7fc717fb9740 20 client.4398 trim_cache size 0 max 16384 2023-10-14T12:28:55.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.210+0000 7fc717fb9740 1 Processor -- start 2023-10-14T12:28:55.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.210+0000 7fc717fb9740 1 -- start start 2023-10-14T12:28:55.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317706580 0x55931771dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc717fb9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593173b9f20 con 0x559317717170 2023-10-14T12:28:55.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593176edc70 con 0x559317717550 2023-10-14T12:28:55.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x559317735e60 con 0x559317706580 2023-10-14T12:28:55.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc707fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc707fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41642/0 (socket says 172.21.15.64:41642) 2023-10-14T12:28:55.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.211+0000 7fc707fff640 1 -- 172.21.15.64:0/1791594505 learned_addr learned my addr 172.21.15.64:0/1791594505 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:55.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc70effd640 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317706580 0x55931771dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc707fff640 1 -- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317706580 msgr2=0x55931771dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc707fff640 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317706580 0x55931771dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc707fff640 1 -- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717550 msgr2=0x5593176e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc707fff640 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc707fff640 1 -- 172.21.15.64:0/1791594505 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593175f2b80 con 0x559317717170 2023-10-14T12:28:55.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc70f7fe640 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:55.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc707fff640 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc71008cb90 tx=0x7fc6f8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4867e87219fee51 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc7057fa640 1 -- 172.21.15.64:0/1791594505 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800eda0 con 0x559317717170 2023-10-14T12:28:55.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc7057fa640 1 -- 172.21.15.64:0/1791594505 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f80260e0 con 0x559317717170 2023-10-14T12:28:55.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.212+0000 7fc7057fa640 1 -- 172.21.15.64:0/1791594505 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8026450 con 0x559317717170 2023-10-14T12:28:55.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 -- 172.21.15.64:0/1791594505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 msgr2=0x5593176e90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc71008cb90 tx=0x7fc6f8014000 comp rx=0 tx=0).stop 2023-10-14T12:28:55.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 -- 172.21.15.64:0/1791594505 shutdown_connections 2023-10-14T12:28:55.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 --2- 172.21.15.64:0/1791594505 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317706580 0x55931771dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 -- 172.21.15.64:0/1791594505 >> 172.21.15.64:0/1791594505 conn(0x5593176ea5b0 msgr2=0x5593176e5810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 -- 172.21.15.64:0/1791594505 shutdown_connections 2023-10-14T12:28:55.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.213+0000 7fc717fb9740 1 -- 172.21.15.64:0/1791594505 wait complete. 2023-10-14T12:28:55.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.214+0000 7fc717fb9740 1 -- start start 2023-10-14T12:28:55.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.214+0000 7fc717fb9740 1 Processor -- start 2023-10-14T12:28:55.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x559317785b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc717fb9740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc717fb9740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x55931774eca0 con 0x559317717170 2023-10-14T12:28:55.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x559317715340 con 0x559317706580 2023-10-14T12:28:55.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc717fb9740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55931774ddd0 con 0x559317717550 2023-10-14T12:28:55.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc717fb9740 10 client.0 _ll_register_callbacks cb 0x559317745b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:28:55.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc707fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc707fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41644/0 (socket says 172.21.15.64:41644) 2023-10-14T12:28:55.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.215+0000 7fc707fff640 1 -- 172.21.15.64:0/3473424993 learned_addr learned my addr 172.21.15.64:0/3473424993 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:55.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc707fff640 1 -- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 msgr2=0x5593176e9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc707fff640 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc707fff640 1 -- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 msgr2=0x559317785b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc70effd640 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x559317785b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc707fff640 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x559317785b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc707fff640 1 -- 172.21.15.64:0/3473424993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f8009dd0 con 0x559317717170 2023-10-14T12:28:55.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc707fff640 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8028000 tx=0x7fc6f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f702dc1fddaf5d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc6edffb640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2023-10-14T12:28:55.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc6edffb640 1 -- 172.21.15.64:0/3473424993 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800eee0 con 0x559317717170 2023-10-14T12:28:55.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc6edffb640 1 -- 172.21.15.64:0/3473424993 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc6f8026450 con 0x559317717170 2023-10-14T12:28:55.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.216+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc70802c980 con 0x559317717170 2023-10-14T12:28:55.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc6edffb640 1 -- 172.21.15.64:0/3473424993 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6f8005990 con 0x559317717170 2023-10-14T12:28:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 10 client.4404 fetch_fsmap learned FSMap version 7 2023-10-14T12:28:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x559317618170 con 0x559317717170 2023-10-14T12:28:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc6edffb640 1 -- 172.21.15.64:0/3473424993 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc70802c980 con 0x559317717170 2023-10-14T12:28:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc6edffb640 1 -- 172.21.15.64:0/3473424993 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fc6f8005af0 con 0x559317717170 2023-10-14T12:28:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 10 client.4404 fetch_fsmap finished waiting for FSMap version 7 2023-10-14T12:28:55.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 10 client.4404 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:28:55.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 20 client.4404 populate_metadata read hostname 'smithi064' 2023-10-14T12:28:55.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x559317738bb0 0x559317738f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 4 client.4404 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:28:55.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.217+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 --> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55931764e700 con 0x559317738bb0 2023-10-14T12:28:55.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.218+0000 7fc70effd640 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x559317738bb0 0x559317738f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.218+0000 7fc70effd640 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x559317738bb0 0x559317738f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0d0e836233a17e1 server_cookie=4cda91478f86ea99 in_seq=0 out_seq=0 2023-10-14T12:28:55.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.219+0000 7fc6edffb640 10 client.4404 ms_handle_connect on v2:172.21.15.177:6835/150618122 2023-10-14T12:28:55.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.219+0000 7fc6edffb640 1 -- 172.21.15.64:0/3473424993 <== mds.0 v2:172.21.15.177:6835/150618122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55931764e700 con 0x559317738bb0 2023-10-14T12:28:55.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.219+0000 7fc6edffb640 10 client.4404 handle_command_reply: tid=0 2023-10-14T12:28:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.219+0000 7fc717fb9740 1 client.4404 shutdown 2023-10-14T12:28:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.219+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 msgr2=0x5593176e90f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.219+0000 7fc717fb9740 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6f8028000 tx=0x7fc6f8004730 comp rx=0 tx=0).stop 2023-10-14T12:28:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 shutdown_connections 2023-10-14T12:28:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x559317738bb0 0x559317738f90 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x559317717550 0x5593176e9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x559317717170 0x5593176e90f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 --2- 172.21.15.64:0/3473424993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x559317706580 0x559317785b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc6edffb640 0 client.4404 ms_handle_reset on v2:172.21.15.177:6835/150618122 2023-10-14T12:28:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 >> 172.21.15.64:0/3473424993 conn(0x5593176ea5b0 msgr2=0x5593177056b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 shutdown_connections 2023-10-14T12:28:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 1 -- 172.21.15.64:0/3473424993 wait complete. 2023-10-14T12:28:55.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc717fb9740 20 client.4404 trim_cache size 0 max 16384 2023-10-14T12:28:55.233 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:28:55.233 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "0b341ded-8bb8-4993-857a-677cfc30784b", 2023-10-14T12:28:55.234 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2023-10-14T12:28:55.234 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4267, 2023-10-14T12:28:55.234 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2023-10-14T12:28:55.234 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2023-10-14T12:28:55.234 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2023-10-14T12:28:55.235 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 8.1705993550000002, 2023-10-14T12:28:55.235 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 7, 2023-10-14T12:28:55.235 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 27, 2023-10-14T12:28:55.235 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 26, 2023-10-14T12:28:55.235 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 15.979022240000001 2023-10-14T12:28:55.236 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:28:55.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc6f006ae70 msgr2=0x7fc6f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc70ffff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc6f006ae70 0x7fc6f006d330 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc7100ca620 tx=0x7fc6f8008040 comp rx=0 tx=0).stop 2023-10-14T12:28:55.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100cfe70 msgr2=0x7fc7101564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.220+0000 7fc70ffff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100cfe70 0x7fc7101564b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc70000d7d0 tx=0x7fc70000dc90 comp rx=0 tx=0).stop 2023-10-14T12:28:55.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 shutdown_connections 2023-10-14T12:28:55.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc6f006ae70 0x7fc6f006d330 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc71015cc90 0x7fc71015dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7100d05c0 0x7fc71015d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 --2- 172.21.15.64:0/869717289 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7100cfe70 0x7fc7101564b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 >> 172.21.15.64:0/869717289 conn(0x7fc7100d27e0 msgr2=0x7fc71015b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 shutdown_connections 2023-10-14T12:28:55.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.221+0000 7fc70ffff640 1 -- 172.21.15.64:0/869717289 wait complete. 2023-10-14T12:28:55.242 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:28:55.243 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:28:55.243 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:28:55.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.450+0000 7f29b14d7640 1 Processor -- start 2023-10-14T12:28:55.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.450+0000 7f29b14d7640 1 -- start start 2023-10-14T12:28:55.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.451+0000 7f29b14d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 0x7f29ac159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.451+0000 7f29b14d7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f29ac0cdc00 0x7f29ac06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.451+0000 7f29b14d7640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac0c89d0 con 0x7f29ac071b50 2023-10-14T12:28:55.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.451+0000 7f29b14d7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac071600 con 0x7f29ac0cdc00 2023-10-14T12:28:55.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.451+0000 7f29b14d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac15a260 con 0x7f29ac071f30 2023-10-14T12:28:55.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.452+0000 7f29abfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f29ac071b50 0x7f29ac070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42752/0 (socket says 172.21.15.64:42752) 2023-10-14T12:28:55.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.452+0000 7f29abfff640 1 -- 172.21.15.64:0/3776714959 learned_addr learned my addr 172.21.15.64:0/3776714959 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:28:55.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.452+0000 7f29b0cd6640 1 --2- 172.21.15.64:0/3776714959 >> v2:172.21.15.177:3300/0 conn(0x7f29ac0cdc00 0x7f29ac06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.452+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 0x7f29ac159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.452+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3808809783 0 0) 0x7f29ac0c89d0 con 0x7f29ac071b50 2023-10-14T12:28:55.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.452+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2994003520 con 0x7f29ac071b50 2023-10-14T12:28:55.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.452+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3075971354 0 0) 0x7f2994003520 con 0x7f29ac071b50 2023-10-14T12:28:55.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 msgr2=0x7f29ac159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 0x7f29ac159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 >> v2:172.21.15.177:3300/0 conn(0x7f29ac0cdc00 msgr2=0x7f29ac06bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 --2- 172.21.15.64:0/3776714959 >> v2:172.21.15.177:3300/0 conn(0x7f29ac0cdc00 0x7f29ac06bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac15a540 con 0x7f29ac071b50 2023-10-14T12:28:55.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f299c0019f0 con 0x7f29ac071b50 2023-10-14T12:28:55.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 >> v1:172.21.15.64:6789/0 conn(0x7f29ac071b50 legacy=0x7f29ac070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 0x7f2994003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29940047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2994004d00 0x7f2994005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac071600 con 0x7f2994004020 2023-10-14T12:28:55.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac15a260 con 0x7f2994004d00 2023-10-14T12:28:55.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f299400ba60 con 0x7f29ac071f30 2023-10-14T12:28:55.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29940047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29abfff640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 0x7f2994003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.453+0000 7f29b0cd6640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2994004d00 0x7f2994005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.454+0000 7f29ab7fe640 1 -- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 msgr2=0x7f2994003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.454+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac071f30 0x7f2994003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.454+0000 7f29ab7fe640 1 -- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2994004d00 msgr2=0x7f2994005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:28:55.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.454+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2994004d00 0x7f2994005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.454+0000 7f29ab7fe640 1 -- 172.21.15.64:0/3776714959 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2994003520 con 0x7f2994004020 2023-10-14T12:28:55.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.455+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29940047c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009ac0 tx=0x7f29940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e274321beb3e48de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.455+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a002c600 con 0x7f2994004020 2023-10-14T12:28:55.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.455+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a002c760 con 0x7f2994004020 2023-10-14T12:28:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.455+0000 7f29aaffd640 1 -- 172.21.15.64:0/3776714959 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a002caf0 con 0x7f2994004020 2023-10-14T12:28:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.455+0000 7f29b14d7640 1 -- 172.21.15.64:0/3776714959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 msgr2=0x7f29940047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.455+0000 7f29b14d7640 1 --2- 172.21.15.64:0/3776714959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29940047c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f29a0009ac0 tx=0x7f29940057f0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.455+0000 7f29b0cd6640 1 -- 172.21.15.64:0/3776714959 reap_dead start 2023-10-14T12:28:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.456+0000 7f29b14d7640 1 -- 172.21.15.64:0/3776714959 shutdown_connections 2023-10-14T12:28:55.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.456+0000 7f29b14d7640 1 -- 172.21.15.64:0/3776714959 >> 172.21.15.64:0/3776714959 conn(0x7f29ac06a470 msgr2=0x7f29ac0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.456+0000 7f29b14d7640 1 -- 172.21.15.64:0/3776714959 shutdown_connections 2023-10-14T12:28:55.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.456+0000 7f29b14d7640 1 -- 172.21.15.64:0/3776714959 wait complete. 2023-10-14T12:28:55.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.458+0000 7f29b14d7640 1 Processor -- start 2023-10-14T12:28:55.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.458+0000 7f29b14d7640 1 -- start start 2023-10-14T12:28:55.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29b14d7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29ac14fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29b14d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac1f6420 0x7f29ac14f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29b14d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29ac0c53b0 0x7f29ac1f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29b14d7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac14f910 con 0x7f2994004020 2023-10-14T12:28:55.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29b14d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c4630 con 0x7f29ac0c53b0 2023-10-14T12:28:55.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29b14d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c4910 con 0x7f29ac1f6420 2023-10-14T12:28:55.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29abfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29ac14fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29abfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29ac14fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41664/0 (socket says 172.21.15.64:41664) 2023-10-14T12:28:55.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.459+0000 7f29abfff640 1 -- 172.21.15.64:0/446967332 learned_addr learned my addr 172.21.15.64:0/446967332 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:55.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac1f6420 0x7f29ac14f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29abfff640 1 -- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac1f6420 msgr2=0x7f29ac14f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29abfff640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac1f6420 0x7f29ac14f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29b0cd6640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29ac0c53b0 0x7f29ac1f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29abfff640 1 -- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29ac0c53b0 msgr2=0x7f29ac1f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29abfff640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29ac0c53b0 0x7f29ac1f57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29abfff640 1 -- 172.21.15.64:0/446967332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0c4bf0 con 0x7f2994004020 2023-10-14T12:28:55.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29abfff640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29ac14fb40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f299c001df0 tx=0x7f299c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29a8ff9640 1 -- 172.21.15.64:0/446967332 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c00ee20 con 0x7f2994004020 2023-10-14T12:28:55.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29a8ff9640 1 -- 172.21.15.64:0/446967332 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c013420 con 0x7f2994004020 2023-10-14T12:28:55.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29a8ff9640 1 -- 172.21.15.64:0/446967332 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c0137d0 con 0x7f2994004020 2023-10-14T12:28:55.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac0cc1a0 con 0x7f2994004020 2023-10-14T12:28:55.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.460+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac0c4250 con 0x7f2994004020 2023-10-14T12:28:55.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.462+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac04e9b0 con 0x7f2994004020 2023-10-14T12:28:55.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.463+0000 7f29a8ff9640 1 -- 172.21.15.64:0/446967332 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f299c013930 con 0x7f2994004020 2023-10-14T12:28:55.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.463+0000 7f29a8ff9640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f299806aea0 0x7f299806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:55.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.464+0000 7f29a8ff9640 1 -- 172.21.15.64:0/446967332 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f299c08a090 con 0x7f2994004020 2023-10-14T12:28:55.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.464+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f299806aea0 0x7f299806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:55.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.465+0000 7f29ab7fe640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f299806aea0 0x7f299806d360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29a0036000 tx=0x7f29a0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:55.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.467+0000 7f29a8ff9640 1 -- 172.21.15.64:0/446967332 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f299c058980 con 0x7f2994004020 2023-10-14T12:28:55.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.706+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f29ac072e90 con 0x7f2994004020 2023-10-14T12:28:55.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.706+0000 7f29a8ff9640 1 -- 172.21.15.64:0/446967332 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f299c001e20 con 0x7f2994004020 2023-10-14T12:28:55.708 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:28:55.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f299806aea0 msgr2=0x7f299806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f299806aea0 0x7f299806d360 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f29a0036000 tx=0x7f29a0030000 comp rx=0 tx=0).stop 2023-10-14T12:28:55.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 msgr2=0x7f29ac14fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:55.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29ac14fb40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f299c001df0 tx=0x7f299c00e530 comp rx=0 tx=0).stop 2023-10-14T12:28:55.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 shutdown_connections 2023-10-14T12:28:55.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f299806aea0 0x7f299806d360 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29ac0c53b0 0x7f29ac1f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29ac1f6420 0x7f29ac14f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 --2- 172.21.15.64:0/446967332 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2994004020 0x7f29ac14fb40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:55.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.709+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 >> 172.21.15.64:0/446967332 conn(0x7f29ac06a470 msgr2=0x7f29ac0ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:55.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.710+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 shutdown_connections 2023-10-14T12:28:55.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:55.710+0000 7f29b14d7640 1 -- 172.21.15.64:0/446967332 wait complete. 2023-10-14T12:28:55.730 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-14T12:28:55.730 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:28:55.731 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2023-10-14T12:28:55.731 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-10-14T12:28:55.731 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:28:55.732 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-14T12:28:55.732 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:28:55.732 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:28:55.733 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-10-14T12:28:55.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:55.733 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2023-10-14T12:28:55.788 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:28:55.789 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:28:55.789 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:28:55.789 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:28:55.789 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-10-14T12:28:55.789 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:28:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:28:55.790 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:28:55.790 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2023-10-14T12:28:55.790 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:28:55.791 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:28:55.791 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2023-10-14T12:28:55.791 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:28:55.791 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2023-10-14T12:28:55.792 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:28:55.792 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2023-10-14T12:28:55.792 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:28:55.792 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42378sec preferred_lft 42378sec 2023-10-14T12:28:55.792 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-10-14T12:28:55.793 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:28:55.794 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:28:55.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:55.795 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:28:55.795 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:28:55.795 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:28:55.796 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2023-10-14T12:28:55.796 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2023-10-14T12:28:55.796 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:28:55.797 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:28:56.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:56.282 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:28:56.367 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-10-14T12:28:56.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:56.371 DEBUG:teuthology.orchestra.run.smithi064:> route 2023-10-14T12:28:56.423 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2023-10-14T12:28:56.423 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:28:56.423 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:28:56.424 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:28:56.424 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:28:56.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:56.425 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:28:56.425 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:28:56.425 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:28:56.426 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:28:56.426 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:28:56.427 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:28:57.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:57.217 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-10-14T12:28:57.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:57.268 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2023-10-14T12:28:57.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:57.314 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:28:57.315 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:28:57.315 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:28:57.315 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-10-14T12:28:57.316 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:28:57.507 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-10-14T12:28:57.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:57.508 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:28:57.508 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:28:57.509 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-10-14T12:28:57.509 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:28:57.509 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-10-14T12:28:57.510 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-10-14T12:28:57.510 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-10-14T12:28:57.511 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:28:57.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:57.797 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:28:57.797 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:28:57.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2023-10-14T12:28:57.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:28:57.799 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:28:57.960 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-10-14T12:28:57.961 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:28:57.961 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:28:58.006 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-10-14T12:28:58.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:28:58.007 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:28:58.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:28:58.183 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:28:58.230 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:28:58.230 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:28:58.230 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:28:58.231 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:28:58.231 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:28:58.231 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:28:58.231 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:28:58.231 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:28:58.232 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:28:58.232 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:28:58.232 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:28:58.232 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:28:58.233 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:28:58.233 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:28:58.233 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:28:58.233 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:28:58.233 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:28:58.234 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:28:58.234 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:28:58.234 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:28:58.234 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:28:58.235 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:28:58.235 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:28:58.235 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:28:58.235 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:28:58.235 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:28:58.235 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:28:58.236 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:28:58.236 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:28:58.236 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:28:58.236 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:28:58.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:58.238 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:28:58.339 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T12:28:58.340 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-10-14T12:28:58.346 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:28:58.424 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:28:58.470 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:28:58.470 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:28:58.471 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:28:58.471 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:28:58.471 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:28:58.471 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:28:58.471 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:28:58.472 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:28:58.472 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:28:58.472 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:28:58.472 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:28:58.472 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:28:58.473 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:28:58.473 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:28:58.473 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:28:58.473 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:28:58.473 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:28:58.473 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:28:58.474 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:28:58.474 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:28:58.474 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:28:58.474 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:28:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:28:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:28:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:28:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:28:58.475 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:28:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:28:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:28:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:28:58.476 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:28:58.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:58.478 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:28:58.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:2023-10-14T12:28:58.545+0000 7feabdc40480 -1 init, newargv = 0x560d8b852610 newargc=15 2023-10-14T12:28:58.547 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:ceph-fuse[92997]: starting ceph client 2023-10-14T12:28:58.561 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:ceph-fuse[92997]: starting fuse 2023-10-14T12:28:58.566 INFO:teuthology.orchestra.run.smithi064.stdout:39 2023-10-14T12:28:58.566 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-14T12:28:58.566 DEBUG:teuthology.orchestra.run.smithi064:> sudo stdin-killer -- python3 -c ' 2023-10-14T12:28:58.567 DEBUG:teuthology.orchestra.run.smithi064:> import glob 2023-10-14T12:28:58.567 DEBUG:teuthology.orchestra.run.smithi064:> import re 2023-10-14T12:28:58.568 DEBUG:teuthology.orchestra.run.smithi064:> import os 2023-10-14T12:28:58.568 DEBUG:teuthology.orchestra.run.smithi064:> import subprocess 2023-10-14T12:28:58.568 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:28:58.569 DEBUG:teuthology.orchestra.run.smithi064:> def _find_admin_socket(client_name): 2023-10-14T12:28:58.569 DEBUG:teuthology.orchestra.run.smithi064:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-10-14T12:28:58.569 DEBUG:teuthology.orchestra.run.smithi064:> files = glob.glob(asok_path) 2023-10-14T12:28:58.570 DEBUG:teuthology.orchestra.run.smithi064:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-10-14T12:28:58.570 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:28:58.571 DEBUG:teuthology.orchestra.run.smithi064:> # Given a non-glob path, it better be there 2023-10-14T12:28:58.571 DEBUG:teuthology.orchestra.run.smithi064:> if "*" not in asok_path: 2023-10-14T12:28:58.571 DEBUG:teuthology.orchestra.run.smithi064:> assert(len(files) == 1) 2023-10-14T12:28:58.572 DEBUG:teuthology.orchestra.run.smithi064:> return files[0] 2023-10-14T12:28:58.572 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:28:58.572 DEBUG:teuthology.orchestra.run.smithi064:> for f in files: 2023-10-14T12:28:58.572 DEBUG:teuthology.orchestra.run.smithi064:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T12:28:58.573 DEBUG:teuthology.orchestra.run.smithi064:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T12:28:58.573 DEBUG:teuthology.orchestra.run.smithi064:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T12:28:58.574 DEBUG:teuthology.orchestra.run.smithi064:> contents = proc_f.read() 2023-10-14T12:28:58.574 DEBUG:teuthology.orchestra.run.smithi064:> if mountpoint in contents: 2023-10-14T12:28:58.574 DEBUG:teuthology.orchestra.run.smithi064:> return f 2023-10-14T12:28:58.575 DEBUG:teuthology.orchestra.run.smithi064:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T12:28:58.575 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:28:58.575 DEBUG:teuthology.orchestra.run.smithi064:> print(_find_admin_socket("client.admin")) 2023-10-14T12:28:58.576 DEBUG:teuthology.orchestra.run.smithi064:> ' 2023-10-14T12:28:58.776 INFO:teuthology.orchestra.run.smithi064.stdout:/var/run/ceph/ceph-client.admin.92997.asok 2023-10-14T12:28:58.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T12:28:58.792 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.92997.asok 2023-10-14T12:28:58.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:58.793 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.92997.asok status 2023-10-14T12:28:59.039 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:28:59.040 INFO:teuthology.orchestra.run.smithi064.stdout: "metadata": { 2023-10-14T12:28:59.040 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T12:28:59.040 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T12:28:59.040 INFO:teuthology.orchestra.run.smithi064.stdout: "entity_id": "admin", 2023-10-14T12:28:59.040 INFO:teuthology.orchestra.run.smithi064.stdout: "hostname": "smithi064", 2023-10-14T12:28:59.041 INFO:teuthology.orchestra.run.smithi064.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-10-14T12:28:59.041 INFO:teuthology.orchestra.run.smithi064.stdout: "pid": "92997", 2023-10-14T12:28:59.041 INFO:teuthology.orchestra.run.smithi064.stdout: "root": "/" 2023-10-14T12:28:59.041 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:28:59.042 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_count": 0, 2023-10-14T12:28:59.042 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_pinned_count": 0, 2023-10-14T12:28:59.042 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4416, 2023-10-14T12:28:59.042 INFO:teuthology.orchestra.run.smithi064.stdout: "inst": { 2023-10-14T12:28:59.042 INFO:teuthology.orchestra.run.smithi064.stdout: "name": { 2023-10-14T12:28:59.043 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "client", 2023-10-14T12:28:59.043 INFO:teuthology.orchestra.run.smithi064.stdout: "num": 4416 2023-10-14T12:28:59.043 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:28:59.043 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:28:59.043 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:28:59.044 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:28:59.044 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 834058455 2023-10-14T12:28:59.044 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:28:59.044 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:28:59.044 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:28:59.045 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:28:59.045 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:28:59.045 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 834058455 2023-10-14T12:28:59.045 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:28:59.045 INFO:teuthology.orchestra.run.smithi064.stdout: "inst_str": "client.4416 192.168.0.1:0/834058455", 2023-10-14T12:28:59.046 INFO:teuthology.orchestra.run.smithi064.stdout: "addr_str": "192.168.0.1:0/834058455", 2023-10-14T12:28:59.046 INFO:teuthology.orchestra.run.smithi064.stdout: "inode_count": 1, 2023-10-14T12:28:59.046 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_epoch": 7, 2023-10-14T12:28:59.046 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch": 27, 2023-10-14T12:28:59.047 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch_barrier": 0, 2023-10-14T12:28:59.047 INFO:teuthology.orchestra.run.smithi064.stdout: "blocklisted": false, 2023-10-14T12:28:59.047 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs" 2023-10-14T12:28:59.047 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:28:59.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:59.054 DEBUG:teuthology.orchestra.run.smithi064:> stat --file-system '--printf=%T 2023-10-14T12:28:59.055 DEBUG:teuthology.orchestra.run.smithi064:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:28:59.111 INFO:teuthology.orchestra.run.smithi064.stdout:fuseblk 2023-10-14T12:28:59.111 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:28:59.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:59.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:28:59.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:28:59.213 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-10-14T12:28:59.296 INFO:teuthology.orchestra.run.smithi064.stdout:# file: . 2023-10-14T12:28:59.296 INFO:teuthology.orchestra.run.smithi064.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-10-14T12:28:59.296 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:59.297 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:28:59.298 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:28:59.356 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:28:59.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.580+0000 7fcf3b10f640 1 Processor -- start 2023-10-14T12:28:59.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.580+0000 7fcf3b10f640 1 -- start start 2023-10-14T12:28:59.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.582+0000 7fcf3b10f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcf34071800 0x7fcf340cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:59.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.582+0000 7fcf3b10f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf34071c10 con 0x7fcf340c20e0 2023-10-14T12:28:59.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.582+0000 7fcf3b10f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf340c2570 con 0x7fcf340c9e00 2023-10-14T12:28:59.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.582+0000 7fcf3b10f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf340cde00 con 0x7fcf34071800 2023-10-14T12:28:59.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.582+0000 7fcf396ac640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcf34071800 0x7fcf340cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:59.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.582+0000 7fcf396ac640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcf34071800 0x7fcf340cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48696/0 (socket says 172.21.15.64:48696) 2023-10-14T12:28:59.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.582+0000 7fcf396ac640 1 -- 172.21.15.64:0/810758888 learned_addr learned my addr 172.21.15.64:0/810758888 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:59.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.583+0000 7fcf396ac640 1 -- 172.21.15.64:0/810758888 >> v1:172.21.15.177:6789/0 conn(0x7fcf340c9e00 legacy=0x7fcf340ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:59.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.583+0000 7fcf396ac640 1 -- 172.21.15.64:0/810758888 >> v1:172.21.15.64:6789/0 conn(0x7fcf340c20e0 legacy=0x7fcf340710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:59.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.583+0000 7fcf396ac640 1 -- 172.21.15.64:0/810758888 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34071e40 con 0x7fcf34071800 2023-10-14T12:28:59.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.584+0000 7fcf396ac640 1 --2- 172.21.15.64:0/810758888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340cca00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009e50 tx=0x7fcf2c02e220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b68e7511ab3fd04 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:59.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.584+0000 7fcf2b7fe640 1 -- 172.21.15.64:0/810758888 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c02edc0 con 0x7fcf34071800 2023-10-14T12:28:59.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.584+0000 7fcf2b7fe640 1 -- 172.21.15.64:0/810758888 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0363f0 con 0x7fcf34071800 2023-10-14T12:28:59.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.584+0000 7fcf2b7fe640 1 -- 172.21.15.64:0/810758888 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c036780 con 0x7fcf34071800 2023-10-14T12:28:59.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.585+0000 7fcf3b10f640 1 -- 172.21.15.64:0/810758888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 msgr2=0x7fcf340cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:59.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.585+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/810758888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340cca00 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c009e50 tx=0x7fcf2c02e220 comp rx=0 tx=0).stop 2023-10-14T12:28:59.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.585+0000 7fcf3b10f640 1 -- 172.21.15.64:0/810758888 shutdown_connections 2023-10-14T12:28:59.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.585+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/810758888 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340cca00 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.585+0000 7fcf3b10f640 1 -- 172.21.15.64:0/810758888 >> 172.21.15.64:0/810758888 conn(0x7fcf3406c1c0 msgr2=0x7fcf3406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:59.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.585+0000 7fcf3b10f640 1 -- 172.21.15.64:0/810758888 shutdown_connections 2023-10-14T12:28:59.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.585+0000 7fcf3b10f640 1 -- 172.21.15.64:0/810758888 wait complete. 2023-10-14T12:28:59.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.587+0000 7fcf3b10f640 1 Processor -- start 2023-10-14T12:28:59.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.587+0000 7fcf3b10f640 1 -- start start 2023-10-14T12:28:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf3b10f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340c10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf3b10f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf340c20e0 0x7fcf340ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf3b10f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf340c9e00 0x7fcf34143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:59.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf3b10f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340c1620 con 0x7fcf34071800 2023-10-14T12:28:59.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf3b10f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3414f2f0 con 0x7fcf340c9e00 2023-10-14T12:28:59.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf3b10f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf341442d0 con 0x7fcf340c20e0 2023-10-14T12:28:59.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340c10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:59.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340c10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48712/0 (socket says 172.21.15.64:48712) 2023-10-14T12:28:59.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 -- 172.21.15.64:0/598109017 learned_addr learned my addr 172.21.15.64:0/598109017 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:28:59.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf396ac640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf340c9e00 0x7fcf34143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:59.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 -- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf340c20e0 msgr2=0x7fcf340ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:59.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf340c20e0 0x7fcf340ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 -- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf340c9e00 msgr2=0x7fcf34143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:59.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf340c9e00 0x7fcf34143760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf38eab640 1 -- 172.21.15.64:0/598109017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c009b30 con 0x7fcf34071800 2023-10-14T12:28:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.588+0000 7fcf396ac640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf340c9e00 0x7fcf34143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:28:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.589+0000 7fcf38eab640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340c10e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c450 tx=0x7fcf3000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.589+0000 7fcf297fa640 1 -- 172.21.15.64:0/598109017 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf300052d0 con 0x7fcf34071800 2023-10-14T12:28:59.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.589+0000 7fcf297fa640 1 -- 172.21.15.64:0/598109017 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf30005430 con 0x7fcf34071800 2023-10-14T12:28:59.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.589+0000 7fcf297fa640 1 -- 172.21.15.64:0/598109017 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf30012870 con 0x7fcf34071800 2023-10-14T12:28:59.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.589+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf341445b0 con 0x7fcf34071800 2023-10-14T12:28:59.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.589+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf341541c0 con 0x7fcf34071800 2023-10-14T12:28:59.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.590+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf34073ef0 con 0x7fcf34071800 2023-10-14T12:28:59.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.591+0000 7fcf297fa640 1 -- 172.21.15.64:0/598109017 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf300129d0 con 0x7fcf34071800 2023-10-14T12:28:59.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.592+0000 7fcf297fa640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf2006ae70 0x7fcf2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:28:59.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.592+0000 7fcf297fa640 1 -- 172.21.15.64:0/598109017 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcf300893d0 con 0x7fcf34071800 2023-10-14T12:28:59.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.593+0000 7fcf2bfff640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf2006ae70 0x7fcf2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:28:59.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.594+0000 7fcf2bfff640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf2006ae70 0x7fcf2006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf24000f60 tx=0x7fcf240079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:28:59.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.602+0000 7fcf297fa640 1 -- 172.21.15.64:0/598109017 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf30054220 con 0x7fcf34071800 2023-10-14T12:28:59.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.799+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf34071220 con 0x7fcf34071800 2023-10-14T12:28:59.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.803+0000 7fcf297fa640 1 -- 172.21.15.64:0/598109017 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fcf30057840 con 0x7fcf34071800 2023-10-14T12:28:59.806 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:28:59.806 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:28:59.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf2006ae70 msgr2=0x7fcf2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:59.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf2006ae70 0x7fcf2006d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fcf24000f60 tx=0x7fcf240079b0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 msgr2=0x7fcf340c10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:28:59.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340c10e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fcf3000c450 tx=0x7fcf3000c910 comp rx=0 tx=0).stop 2023-10-14T12:28:59.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 shutdown_connections 2023-10-14T12:28:59.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf2006ae70 0x7fcf2006d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf340c9e00 0x7fcf34143760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf340c20e0 0x7fcf340ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 --2- 172.21.15.64:0/598109017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf34071800 0x7fcf340c10e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:28:59.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 >> 172.21.15.64:0/598109017 conn(0x7fcf3406c1c0 msgr2=0x7fcf34158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:28:59.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 shutdown_connections 2023-10-14T12:28:59.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:28:59.806+0000 7fcf3b10f640 1 -- 172.21.15.64:0/598109017 wait complete. 2023-10-14T12:28:59.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:28:59.827 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.059+0000 7f2e99e21640 1 Processor -- start 2023-10-14T12:29:00.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.059+0000 7f2e99e21640 1 -- start start 2023-10-14T12:29:00.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.061+0000 7f2e99e21640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2e9415cbf0 0x7f2e940caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.061+0000 7f2e99e21640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e94160730 con 0x7f2e941611f0 2023-10-14T12:29:00.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.061+0000 7f2e99e21640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9415dd60 con 0x7f2e9415d6e0 2023-10-14T12:29:00.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.061+0000 7f2e99e21640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9415db50 con 0x7f2e9415cbf0 2023-10-14T12:29:00.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.061+0000 7f2e8bfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2e941611f0 0x7f2e9415cfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:48250/0 (socket says 172.21.15.64:48250) 2023-10-14T12:29:00.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.061+0000 7f2e8bfff640 1 -- 172.21.15.64:0/2738533142 learned_addr learned my addr 172.21.15.64:0/2738533142 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:00.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.061+0000 7f2e937fe640 1 --2- 172.21.15.64:0/2738533142 >> v2:172.21.15.177:3300/0 conn(0x7f2e9415cbf0 0x7f2e940caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514718475 0 0) 0x7f2e94160730 con 0x7f2e941611f0 2023-10-14T12:29:00.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e80003520 con 0x7f2e941611f0 2023-10-14T12:29:00.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 893158132 0 0) 0x7f2e80003520 con 0x7f2e941611f0 2023-10-14T12:29:00.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 >> v2:172.21.15.177:3300/0 conn(0x7f2e9415cbf0 msgr2=0x7f2e940caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 --2- 172.21.15.64:0/2738533142 >> v2:172.21.15.177:3300/0 conn(0x7f2e9415cbf0 0x7f2e940caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 >> v1:172.21.15.177:6789/0 conn(0x7f2e9415d6e0 legacy=0x7f2e940cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e941609f0 con 0x7f2e941611f0 2023-10-14T12:29:00.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f2e7c001670 con 0x7f2e941611f0 2023-10-14T12:29:00.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 >> v1:172.21.15.64:6789/0 conn(0x7f2e941611f0 legacy=0x7f2e9415cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e80003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e800047c0 0x7f2e80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e80005180 0x7f2e8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9415db50 con 0x7f2e80003970 2023-10-14T12:29:00.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8000c120 con 0x7f2e800047c0 2023-10-14T12:29:00.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8000c2e0 con 0x7f2e80005180 2023-10-14T12:29:00.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.062+0000 7f2e937fe640 1 --2- 172.21.15.64:0/2738533142 >> v2:172.21.15.177:3300/0 conn(0x7f2e9415cbf0 0x7f2e940caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:00.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e937fe640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e80003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e8bfff640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e800047c0 0x7f2e80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e93fff640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e80005180 0x7f2e8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e937fe640 1 -- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e80005180 msgr2=0x7f2e8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e937fe640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e80005180 0x7f2e8000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e937fe640 1 -- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e800047c0 msgr2=0x7f2e80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e937fe640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e800047c0 0x7f2e80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e937fe640 1 -- 172.21.15.64:0/2738533142 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e80003520 con 0x7f2e80003970 2023-10-14T12:29:00.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.063+0000 7f2e93fff640 1 -- 172.21.15.64:0/2738533142 reap_dead start 2023-10-14T12:29:00.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.064+0000 7f2e937fe640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e80003d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009c70 tx=0x7f2e800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b79794eda6cfe4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84004020 con 0x7f2e80003970 2023-10-14T12:29:00.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84004180 con 0x7f2e80003970 2023-10-14T12:29:00.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e92ffd640 1 -- 172.21.15.64:0/2738533142 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8402c8f0 con 0x7f2e80003970 2023-10-14T12:29:00.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e99e21640 1 -- 172.21.15.64:0/2738533142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 msgr2=0x7f2e80003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e99e21640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e80003d90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f2e84009c70 tx=0x7f2e800057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e99e21640 1 -- 172.21.15.64:0/2738533142 shutdown_connections 2023-10-14T12:29:00.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e99e21640 1 --2- 172.21.15.64:0/2738533142 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e80003d90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e99e21640 1 -- 172.21.15.64:0/2738533142 >> 172.21.15.64:0/2738533142 conn(0x7f2e940b0030 msgr2=0x7f2e940b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e99e21640 1 -- 172.21.15.64:0/2738533142 shutdown_connections 2023-10-14T12:29:00.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.065+0000 7f2e99e21640 1 -- 172.21.15.64:0/2738533142 wait complete. 2023-10-14T12:29:00.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.067+0000 7f2e99e21640 1 Processor -- start 2023-10-14T12:29:00.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.067+0000 7f2e99e21640 1 -- start start 2023-10-14T12:29:00.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.068+0000 7f2e99e21640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e94153380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.068+0000 7f2e99e21640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e941f2680 0x7f2e94159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.068+0000 7f2e99e21640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e94159990 0x7f2e94071430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e99e21640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9415a1d0 con 0x7f2e80003970 2023-10-14T12:29:00.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e99e21640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e940c35b0 con 0x7f2e941f2680 2023-10-14T12:29:00.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e99e21640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e94159ef0 con 0x7f2e94159990 2023-10-14T12:29:00.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e94153380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e94153380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48736/0 (socket says 172.21.15.64:48736) 2023-10-14T12:29:00.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 -- 172.21.15.64:0/1650570646 learned_addr learned my addr 172.21.15.64:0/1650570646 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:00.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e8bfff640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e941f2680 0x7f2e94159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e93fff640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e94159990 0x7f2e94071430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 -- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e94159990 msgr2=0x7f2e94071430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e94159990 0x7f2e94071430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 -- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e941f2680 msgr2=0x7f2e94159450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e941f2680 0x7f2e94159450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.069+0000 7f2e937fe640 1 -- 172.21.15.64:0/1650570646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e940c3870 con 0x7f2e80003970 2023-10-14T12:29:00.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.070+0000 7f2e937fe640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e94153380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e84036040 tx=0x7f2e84004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.070+0000 7f2e90ff9640 1 -- 172.21.15.64:0/1650570646 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8402cb00 con 0x7f2e80003970 2023-10-14T12:29:00.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.070+0000 7f2e90ff9640 1 -- 172.21.15.64:0/1650570646 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8402cc60 con 0x7f2e80003970 2023-10-14T12:29:00.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.070+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e940c3b50 con 0x7f2e80003970 2023-10-14T12:29:00.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.070+0000 7f2e90ff9640 1 -- 172.21.15.64:0/1650570646 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e84006040 con 0x7f2e80003970 2023-10-14T12:29:00.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.070+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e940c2f60 con 0x7f2e80003970 2023-10-14T12:29:00.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.071+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e94073ef0 con 0x7f2e80003970 2023-10-14T12:29:00.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.072+0000 7f2e90ff9640 1 -- 172.21.15.64:0/1650570646 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2e840061a0 con 0x7f2e80003970 2023-10-14T12:29:00.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.074+0000 7f2e90ff9640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2e7406aea0 0x7f2e7406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.074+0000 7f2e90ff9640 1 -- 172.21.15.64:0/1650570646 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e840abcc0 con 0x7f2e80003970 2023-10-14T12:29:00.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.074+0000 7f2e8bfff640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2e7406aea0 0x7f2e7406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.075+0000 7f2e8bfff640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2e7406aea0 0x7f2e7406d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e940cd7c0 tx=0x7f2e7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.078+0000 7f2e90ff9640 1 -- 172.21.15.64:0/1650570646 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2e840b2080 con 0x7f2e80003970 2023-10-14T12:29:00.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.269+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e940c1dc0 con 0x7f2e80003970 2023-10-14T12:29:00.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.270+0000 7f2e90ff9640 1 -- 172.21.15.64:0/1650570646 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e84076b00 con 0x7f2e80003970 2023-10-14T12:29:00.273 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:00.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2e7406aea0 msgr2=0x7f2e7406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2e7406aea0 0x7f2e7406d360 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2e940cd7c0 tx=0x7f2e7c009040 comp rx=0 tx=0).stop 2023-10-14T12:29:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 msgr2=0x7f2e94153380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e94153380 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e84036040 tx=0x7f2e84004730 comp rx=0 tx=0).stop 2023-10-14T12:29:00.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 shutdown_connections 2023-10-14T12:29:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2e7406aea0 0x7f2e7406d360 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2e94159990 0x7f2e94071430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2e941f2680 0x7f2e94159450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 --2- 172.21.15.64:0/1650570646 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2e80003970 0x7f2e94153380 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 >> 172.21.15.64:0/1650570646 conn(0x7f2e940b0030 msgr2=0x7f2e940ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:00.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 shutdown_connections 2023-10-14T12:29:00.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.273+0000 7f2e99e21640 1 -- 172.21.15.64:0/1650570646 wait complete. 2023-10-14T12:29:00.293 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:00.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.515+0000 7fa41882e640 1 Processor -- start 2023-10-14T12:29:00.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.515+0000 7fa41882e640 1 -- start start 2023-10-14T12:29:00.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa41882e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140d0d80 0x7fa4140d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa41882e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140ce810 con 0x7fa41415c940 2023-10-14T12:29:00.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa41882e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4140b5b40 con 0x7fa4140b5fd0 2023-10-14T12:29:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa41882e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140d1740 con 0x7fa4140d0d80 2023-10-14T12:29:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa4137fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fa41415c940 0x7fa4140d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:48258/0 (socket says 172.21.15.64:48258) 2023-10-14T12:29:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa4137fe640 1 -- 172.21.15.64:0/3757656007 learned_addr learned my addr 172.21.15.64:0/3757656007 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa412ffd640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140d0d80 0x7fa4140d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1455210716 0 0) 0x7fa4140ce810 con 0x7fa41415c940 2023-10-14T12:29:00.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.517+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa400003520 con 0x7fa41415c940 2023-10-14T12:29:00.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 435436440 0 0) 0x7fa400003520 con 0x7fa41415c940 2023-10-14T12:29:00.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140d0d80 msgr2=0x7fa4140d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140d0d80 0x7fa4140d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 >> v1:172.21.15.177:6789/0 conn(0x7fa4140b5fd0 legacy=0x7fa4140b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140d0b10 con 0x7fa41415c940 2023-10-14T12:29:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fa4040019f0 con 0x7fa41415c940 2023-10-14T12:29:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 >> v1:172.21.15.64:6789/0 conn(0x7fa41415c940 legacy=0x7fa4140d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa400003a10 0x7fa400003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4000047c0 0x7fa400004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140d0d80 0x7fa400005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4140d1740 con 0x7fa400003a10 2023-10-14T12:29:00.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40000bb40 con 0x7fa4000047c0 2023-10-14T12:29:00.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40000bd00 con 0x7fa4140d0d80 2023-10-14T12:29:00.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa4137fe640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa400003a10 0x7fa400003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.518+0000 7fa412ffd640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4000047c0 0x7fa400004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.519+0000 7fa4137fe640 1 -- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140d0d80 msgr2=0x7fa400005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.519+0000 7fa4137fe640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140d0d80 0x7fa400005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.519+0000 7fa4137fe640 1 -- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4000047c0 msgr2=0x7fa400004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.519+0000 7fa4137fe640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa4000047c0 0x7fa400004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.519+0000 7fa4137fe640 1 -- 172.21.15.64:0/3757656007 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa400003520 con 0x7fa400003a10 2023-10-14T12:29:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.520+0000 7fa4137fe640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa400003a10 0x7fa400003e30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa40400a7f0 tx=0x7fa4000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3b6e6dcab04ea7b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.520+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040072d0 con 0x7fa400003a10 2023-10-14T12:29:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.520+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa40402f070 con 0x7fa400003a10 2023-10-14T12:29:00.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.520+0000 7fa4127fc640 1 -- 172.21.15.64:0/3757656007 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4040076b0 con 0x7fa400003a10 2023-10-14T12:29:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.521+0000 7fa41882e640 1 -- 172.21.15.64:0/3757656007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa400003a10 msgr2=0x7fa400003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.521+0000 7fa41882e640 1 --2- 172.21.15.64:0/3757656007 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa400003a10 0x7fa400003e30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa40400a7f0 tx=0x7fa4000057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.521+0000 7fa413fff640 1 -- 172.21.15.64:0/3757656007 reap_dead start 2023-10-14T12:29:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.521+0000 7fa41882e640 1 -- 172.21.15.64:0/3757656007 shutdown_connections 2023-10-14T12:29:00.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.521+0000 7fa41882e640 1 -- 172.21.15.64:0/3757656007 >> 172.21.15.64:0/3757656007 conn(0x7fa41409bb30 msgr2=0x7fa4140d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:00.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.521+0000 7fa41882e640 1 -- 172.21.15.64:0/3757656007 shutdown_connections 2023-10-14T12:29:00.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.521+0000 7fa41882e640 1 -- 172.21.15.64:0/3757656007 wait complete. 2023-10-14T12:29:00.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.523+0000 7fa41882e640 1 Processor -- start 2023-10-14T12:29:00.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.523+0000 7fa41882e640 1 -- start start 2023-10-14T12:29:00.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa41882e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa400003a10 0x7fa414158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa41882e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4140cb900 0x7fa4140b6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa41882e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140cbd80 0x7fa4140b7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa41882e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4141f5780 con 0x7fa4140cb900 2023-10-14T12:29:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa41882e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4141f5a60 con 0x7fa400003a10 2023-10-14T12:29:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa41882e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4141f5d40 con 0x7fa4140cbd80 2023-10-14T12:29:00.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa412ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4140cb900 0x7fa4140b6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa412ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4140cb900 0x7fa4140b6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48756/0 (socket says 172.21.15.64:48756) 2023-10-14T12:29:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa412ffd640 1 -- 172.21.15.64:0/1145161117 learned_addr learned my addr 172.21.15.64:0/1145161117 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa4137fe640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa400003a10 0x7fa414158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa413fff640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140cbd80 0x7fa4140b7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.524+0000 7fa412ffd640 1 -- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140cbd80 msgr2=0x7fa4140b7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa412ffd640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140cbd80 0x7fa4140b7430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa412ffd640 1 -- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa400003a10 msgr2=0x7fa414158cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa412ffd640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa400003a10 0x7fa414158cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa412ffd640 1 -- 172.21.15.64:0/1145161117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4141f6020 con 0x7fa4140cb900 2023-10-14T12:29:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa412ffd640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4140cb900 0x7fa4140b6ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0115e0 tx=0x7fa3fc011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa40bfff640 1 -- 172.21.15.64:0/1145161117 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc004220 con 0x7fa4140cb900 2023-10-14T12:29:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa40bfff640 1 -- 172.21.15.64:0/1145161117 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc004380 con 0x7fa4140cb900 2023-10-14T12:29:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa40bfff640 1 -- 172.21.15.64:0/1145161117 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00f8f0 con 0x7fa4140cb900 2023-10-14T12:29:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4141f6300 con 0x7fa4140cb900 2023-10-14T12:29:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.525+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4140cc830 con 0x7fa4140cb900 2023-10-14T12:29:00.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.526+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41404e9b0 con 0x7fa4140cb900 2023-10-14T12:29:00.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.527+0000 7fa40bfff640 1 -- 172.21.15.64:0/1145161117 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa3fc00fa50 con 0x7fa4140cb900 2023-10-14T12:29:00.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.528+0000 7fa40bfff640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3f406ae70 0x7fa3f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.528+0000 7fa40bfff640 1 -- 172.21.15.64:0/1145161117 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3fc089a50 con 0x7fa4140cb900 2023-10-14T12:29:00.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.529+0000 7fa4137fe640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3f406ae70 0x7fa3f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.530+0000 7fa4137fe640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3f406ae70 0x7fa3f406d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa404034000 tx=0x7fa404007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.533+0000 7fa40bfff640 1 -- 172.21.15.64:0/1145161117 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3fc054800 con 0x7fa4140cb900 2023-10-14T12:29:00.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.724+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4140ce220 con 0x7fa4140cb900 2023-10-14T12:29:00.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.724+0000 7fa40bfff640 1 -- 172.21.15.64:0/1145161117 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3fc022020 con 0x7fa4140cb900 2023-10-14T12:29:00.726 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:00.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3f406ae70 msgr2=0x7fa3f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3f406ae70 0x7fa3f406d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa404034000 tx=0x7fa404007000 comp rx=0 tx=0).stop 2023-10-14T12:29:00.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4140cb900 msgr2=0x7fa4140b6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4140cb900 0x7fa4140b6ef0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0115e0 tx=0x7fa3fc011aa0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 shutdown_connections 2023-10-14T12:29:00.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3f406ae70 0x7fa3f406d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa4140cbd80 0x7fa4140b7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa4140cb900 0x7fa4140b6ef0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 --2- 172.21.15.64:0/1145161117 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa400003a10 0x7fa414158cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 >> 172.21.15.64:0/1145161117 conn(0x7fa41409bb30 msgr2=0x7fa4140b7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:00.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 shutdown_connections 2023-10-14T12:29:00.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.727+0000 7fa41882e640 1 -- 172.21.15.64:0/1145161117 wait complete. 2023-10-14T12:29:00.746 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:00.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.972+0000 7f7b8da7c640 1 Processor -- start 2023-10-14T12:29:00.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.973+0000 7f7b8da7c640 1 -- start start 2023-10-14T12:29:00.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b8da7c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7b88159890 0x7f7b88071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b8da7c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b880ca110 0x7f7b880ca570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b8da7c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880caab0 con 0x7f7b8815d3f0 2023-10-14T12:29:00.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b8da7c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b88072480 con 0x7f7b88159890 2023-10-14T12:29:00.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b8da7c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880cd0c0 con 0x7f7b880ca110 2023-10-14T12:29:00.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b877fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7b88159890 0x7f7b88071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b877fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7b88159890 0x7f7b88071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48768/0 (socket says 172.21.15.64:48768) 2023-10-14T12:29:00.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.974+0000 7f7b877fe640 1 -- 172.21.15.64:0/2255952204 learned_addr learned my addr 172.21.15.64:0/2255952204 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:00.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.975+0000 7f7b7ffff640 1 --2- 172.21.15.64:0/2255952204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b880ca110 0x7f7b880ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.975+0000 7f7b877fe640 1 -- 172.21.15.64:0/2255952204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b880ca110 msgr2=0x7f7b880ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.975+0000 7f7b877fe640 1 --2- 172.21.15.64:0/2255952204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b880ca110 0x7f7b880ca570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.975+0000 7f7b877fe640 1 -- 172.21.15.64:0/2255952204 >> v1:172.21.15.177:6789/0 conn(0x7f7b8815d3f0 legacy=0x7f7b8815d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:00.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.975+0000 7f7b877fe640 1 -- 172.21.15.64:0/2255952204 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880cc540 con 0x7f7b88159890 2023-10-14T12:29:00.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.976+0000 7f7b877fe640 1 --2- 172.21.15.64:0/2255952204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b88159890 0x7f7b88071f40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800bb10 tx=0x7f7b7802e0c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f8b6a0495b003d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.976+0000 7f7b86ffd640 1 -- 172.21.15.64:0/2255952204 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b7802ee70 con 0x7f7b88159890 2023-10-14T12:29:00.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.976+0000 7f7b86ffd640 1 -- 172.21.15.64:0/2255952204 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78036440 con 0x7f7b88159890 2023-10-14T12:29:00.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.976+0000 7f7b86ffd640 1 -- 172.21.15.64:0/2255952204 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b780367d0 con 0x7f7b88159890 2023-10-14T12:29:00.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 -- 172.21.15.64:0/2255952204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b88159890 msgr2=0x7f7b88071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/2255952204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b88159890 0x7f7b88071f40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7b7800bb10 tx=0x7f7b7802e0c0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 -- 172.21.15.64:0/2255952204 shutdown_connections 2023-10-14T12:29:00.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/2255952204 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b880ca110 0x7f7b880ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/2255952204 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b88159890 0x7f7b88071f40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 -- 172.21.15.64:0/2255952204 >> 172.21.15.64:0/2255952204 conn(0x7f7b880b0030 msgr2=0x7f7b880b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:00.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 -- 172.21.15.64:0/2255952204 shutdown_connections 2023-10-14T12:29:00.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.977+0000 7f7b8da7c640 1 -- 172.21.15.64:0/2255952204 wait complete. 2023-10-14T12:29:00.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.979+0000 7f7b8da7c640 1 Processor -- start 2023-10-14T12:29:00.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.979+0000 7f7b8da7c640 1 -- start start 2023-10-14T12:29:00.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b8da7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b880ca110 0x7f7b881e34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b8da7c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b88159890 0x7f7b88156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b8da7c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b8815d3f0 0x7f7b880c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b8da7c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880c2230 con 0x7f7b880ca110 2023-10-14T12:29:00.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b8da7c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880c2030 con 0x7f7b88159890 2023-10-14T12:29:00.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b8da7c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88157380 con 0x7f7b8815d3f0 2023-10-14T12:29:00.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b877fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b880ca110 0x7f7b881e34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b877fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b880ca110 0x7f7b881e34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48778/0 (socket says 172.21.15.64:48778) 2023-10-14T12:29:00.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.980+0000 7f7b877fe640 1 -- 172.21.15.64:0/915651374 learned_addr learned my addr 172.21.15.64:0/915651374 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b877fe640 1 -- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b8815d3f0 msgr2=0x7f7b880c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b877fe640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b8815d3f0 0x7f7b880c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b877fe640 1 -- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b88159890 msgr2=0x7f7b88156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b877fe640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b88159890 0x7f7b88156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:00.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b877fe640 1 -- 172.21.15.64:0/915651374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7800b770 con 0x7f7b880ca110 2023-10-14T12:29:00.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b877fe640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b880ca110 0x7f7b881e34b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b7802e650 tx=0x7f7b780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b84ff9640 1 -- 172.21.15.64:0/915651374 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b78034b80 con 0x7f7b880ca110 2023-10-14T12:29:00.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b84ff9640 1 -- 172.21.15.64:0/915651374 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b78034d20 con 0x7f7b880ca110 2023-10-14T12:29:00.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b84ff9640 1 -- 172.21.15.64:0/915651374 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b780416a0 con 0x7f7b880ca110 2023-10-14T12:29:00.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b880c6520 con 0x7f7b880ca110 2023-10-14T12:29:00.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.981+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b880c6aa0 con 0x7f7b880ca110 2023-10-14T12:29:00.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.983+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b88073ef0 con 0x7f7b880ca110 2023-10-14T12:29:00.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.983+0000 7f7b84ff9640 1 -- 172.21.15.64:0/915651374 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7b78041800 con 0x7f7b880ca110 2023-10-14T12:29:00.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.984+0000 7f7b84ff9640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7b6806ae70 0x7f7b6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:00.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.985+0000 7f7b84ff9640 1 -- 172.21.15.64:0/915651374 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b780abfe0 con 0x7f7b880ca110 2023-10-14T12:29:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.985+0000 7f7b7ffff640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7b6806ae70 0x7f7b6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.986+0000 7f7b7ffff640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7b6806ae70 0x7f7b6806d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b880c1580 tx=0x7f7b70008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:00.989+0000 7f7b84ff9640 1 -- 172.21.15.64:0/915651374 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7b78076cd0 con 0x7f7b880ca110 2023-10-14T12:29:01.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.172+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7b880cd290 con 0x7f7b880ca110 2023-10-14T12:29:01.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.173+0000 7f7b84ff9640 1 -- 172.21.15.64:0/915651374 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b78046020 con 0x7f7b880ca110 2023-10-14T12:29:01.175 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:01.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7b6806ae70 msgr2=0x7f7b6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7b6806ae70 0x7f7b6806d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7b880c1580 tx=0x7f7b70008040 comp rx=0 tx=0).stop 2023-10-14T12:29:01.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b880ca110 msgr2=0x7f7b881e34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b880ca110 0x7f7b881e34b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7b7802e650 tx=0x7f7b780046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 shutdown_connections 2023-10-14T12:29:01.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7b6806ae70 0x7f7b6806d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7b8815d3f0 0x7f7b880c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7b88159890 0x7f7b88156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 --2- 172.21.15.64:0/915651374 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7b880ca110 0x7f7b881e34b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 >> 172.21.15.64:0/915651374 conn(0x7f7b880b0030 msgr2=0x7f7b880abfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:01.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 shutdown_connections 2023-10-14T12:29:01.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.175+0000 7f7b8da7c640 1 -- 172.21.15.64:0/915651374 wait complete. 2023-10-14T12:29:01.195 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.423+0000 7f1951a87640 1 Processor -- start 2023-10-14T12:29:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.423+0000 7f1951a87640 1 -- start start 2023-10-14T12:29:01.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.424+0000 7f1951a87640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f194c0ca820 0x7f194c071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.424+0000 7f1951a87640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c0c8ea0 0x7f194c0c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.424+0000 7f1951a87640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c072480 con 0x7f194c159890 2023-10-14T12:29:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.424+0000 7f1951a87640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c0cd0c0 con 0x7f194c0ca820 2023-10-14T12:29:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.424+0000 7f1951a87640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0cc540 con 0x7f194c0c8ea0 2023-10-14T12:29:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.425+0000 7f194bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c0c8ea0 0x7f194c0c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.425+0000 7f194b7fe640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f194c159890 0x7f194c0ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:47564/0 (socket says 172.21.15.64:47564) 2023-10-14T12:29:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.425+0000 7f194b7fe640 1 -- 172.21.15.64:0/3061784013 learned_addr learned my addr 172.21.15.64:0/3061784013 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.425+0000 7f194affd640 1 --2- 172.21.15.64:0/3061784013 >> v2:172.21.15.177:3300/0 conn(0x7f194c0ca820 0x7f194c071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.426+0000 7f194a7fc640 1 -- 172.21.15.64:0/3061784013 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317249691 0 0) 0x7f194c072480 con 0x7f194c159890 2023-10-14T12:29:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.426+0000 7f194a7fc640 1 -- 172.21.15.64:0/3061784013 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1938005730 con 0x7f194c159890 2023-10-14T12:29:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.426+0000 7f194bfff640 1 -- 172.21.15.64:0/3061784013 >> v2:172.21.15.177:3300/0 conn(0x7f194c0ca820 msgr2=0x7f194c071f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.426+0000 7f194bfff640 1 --2- 172.21.15.64:0/3061784013 >> v2:172.21.15.177:3300/0 conn(0x7f194c0ca820 0x7f194c071f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.426+0000 7f194bfff640 1 -- 172.21.15.64:0/3061784013 >> v1:172.21.15.177:6789/0 conn(0x7f194c159890 legacy=0x7f194c0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.426+0000 7f194bfff640 1 -- 172.21.15.64:0/3061784013 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c0cc820 con 0x7f194c0c8ea0 2023-10-14T12:29:01.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.427+0000 7f194bfff640 1 --2- 172.21.15.64:0/3061784013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c0c8ea0 0x7f194c0c9310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19440097a0 tx=0x7f194402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57d2a6c42e73457 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:01.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f194a7fc640 1 -- 172.21.15.64:0/3061784013 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194402d040 con 0x7f194c0c8ea0 2023-10-14T12:29:01.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f194a7fc640 1 -- 172.21.15.64:0/3061784013 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944031810 con 0x7f194c0c8ea0 2023-10-14T12:29:01.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f194a7fc640 1 -- 172.21.15.64:0/3061784013 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944031ba0 con 0x7f194c0c8ea0 2023-10-14T12:29:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f1951a87640 1 -- 172.21.15.64:0/3061784013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c0c8ea0 msgr2=0x7f194c0c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f1951a87640 1 --2- 172.21.15.64:0/3061784013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c0c8ea0 0x7f194c0c9310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f19440097a0 tx=0x7f194402b8b0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f1951a87640 1 -- 172.21.15.64:0/3061784013 shutdown_connections 2023-10-14T12:29:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f1951a87640 1 --2- 172.21.15.64:0/3061784013 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c0c8ea0 0x7f194c0c9310 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f1951a87640 1 --2- 172.21.15.64:0/3061784013 >> v2:172.21.15.177:3300/0 conn(0x7f194c0ca820 0x7f194c071f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.428+0000 7f1951a87640 1 -- 172.21.15.64:0/3061784013 >> 172.21.15.64:0/3061784013 conn(0x7f194c0b0030 msgr2=0x7f194c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:01.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.429+0000 7f1951a87640 1 -- 172.21.15.64:0/3061784013 shutdown_connections 2023-10-14T12:29:01.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.429+0000 7f1951a87640 1 -- 172.21.15.64:0/3061784013 wait complete. 2023-10-14T12:29:01.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.430+0000 7f1951a87640 1 Processor -- start 2023-10-14T12:29:01.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.431+0000 7f1951a87640 1 -- start start 2023-10-14T12:29:01.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f1951a87640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c0c8ea0 0x7f194c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f1951a87640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194c0ca820 0x7f194c14f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f1951a87640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c159890 0x7f194c14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f1951a87640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c14fc20 con 0x7f194c0ca820 2023-10-14T12:29:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f1951a87640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c159fa0 con 0x7f194c0c8ea0 2023-10-14T12:29:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f1951a87640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c0ab860 con 0x7f194c159890 2023-10-14T12:29:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f194affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194c0ca820 0x7f194c14f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f194affd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194c0ca820 0x7f194c14f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48792/0 (socket says 172.21.15.64:48792) 2023-10-14T12:29:01.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f194affd640 1 -- 172.21.15.64:0/216541248 learned_addr learned my addr 172.21.15.64:0/216541248 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:01.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f194b7fe640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c0c8ea0 0x7f194c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.432+0000 7f194bfff640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c159890 0x7f194c14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f194affd640 1 -- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c159890 msgr2=0x7f194c14f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f194affd640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c159890 0x7f194c14f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f194affd640 1 -- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c0c8ea0 msgr2=0x7f194c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f194affd640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c0c8ea0 0x7f194c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f194affd640 1 -- 172.21.15.64:0/216541248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1944009400 con 0x7f194c0ca820 2023-10-14T12:29:01.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f194affd640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194c0ca820 0x7f194c14f1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f193400e8a0 tx=0x7f193400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:01.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f1943fff640 1 -- 172.21.15.64:0/216541248 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340094f0 con 0x7f194c0ca820 2023-10-14T12:29:01.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f1943fff640 1 -- 172.21.15.64:0/216541248 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193400c940 con 0x7f194c0ca820 2023-10-14T12:29:01.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f1943fff640 1 -- 172.21.15.64:0/216541248 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193400ccf0 con 0x7f194c0ca820 2023-10-14T12:29:01.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c15c6c0 con 0x7f194c0ca820 2023-10-14T12:29:01.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.433+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c0abb20 con 0x7f194c0ca820 2023-10-14T12:29:01.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.434+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194c073ef0 con 0x7f194c0ca820 2023-10-14T12:29:01.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.435+0000 7f1943fff640 1 -- 172.21.15.64:0/216541248 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1934013470 con 0x7f194c0ca820 2023-10-14T12:29:01.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.436+0000 7f1943fff640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f192c06ae70 0x7f192c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.436+0000 7f1943fff640 1 -- 172.21.15.64:0/216541248 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f19340898f0 con 0x7f194c0ca820 2023-10-14T12:29:01.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.437+0000 7f194b7fe640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f192c06ae70 0x7f192c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.438+0000 7f194b7fe640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f192c06ae70 0x7f192c06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f193c005c00 tx=0x7f193c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:01.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.440+0000 7f1943fff640 1 -- 172.21.15.64:0/216541248 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1934054740 con 0x7f194c0ca820 2023-10-14T12:29:01.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.635+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f194c0cd290 con 0x7f194c0ca820 2023-10-14T12:29:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.636+0000 7f1943fff640 1 -- 172.21.15.64:0/216541248 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1934057d60 con 0x7f194c0ca820 2023-10-14T12:29:01.638 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:01.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f192c06ae70 msgr2=0x7f192c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f192c06ae70 0x7f192c06d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f193c005c00 tx=0x7f193c009040 comp rx=0 tx=0).stop 2023-10-14T12:29:01.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194c0ca820 msgr2=0x7f194c14f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194c0ca820 0x7f194c14f1a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f193400e8a0 tx=0x7f193400ed60 comp rx=0 tx=0).stop 2023-10-14T12:29:01.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 shutdown_connections 2023-10-14T12:29:01.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f192c06ae70 0x7f192c06d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f194c159890 0x7f194c14f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f194c0ca820 0x7f194c14f1a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 --2- 172.21.15.64:0/216541248 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f194c0c8ea0 0x7f194c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 >> 172.21.15.64:0/216541248 conn(0x7f194c0b0030 msgr2=0x7f194c158af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:01.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.639+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 shutdown_connections 2023-10-14T12:29:01.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.640+0000 7f1951a87640 1 -- 172.21.15.64:0/216541248 wait complete. 2023-10-14T12:29:01.661 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:29:01.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.878+0000 7fde54bb0640 1 Processor -- start 2023-10-14T12:29:01.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.878+0000 7fde54bb0640 1 -- start start 2023-10-14T12:29:01.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.879+0000 7fde54bb0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fde500aebb0 0x7fde5006ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.879+0000 7fde54bb0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500cd400 con 0x7fde500cec00 2023-10-14T12:29:01.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.879+0000 7fde54bb0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde500cd6a0 con 0x7fde5006cf60 2023-10-14T12:29:01.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.879+0000 7fde54bb0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde500cd980 con 0x7fde500aebb0 2023-10-14T12:29:01.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.879+0000 7fde47fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fde500cec00 0x7fde500cf030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:48268/0 (socket says 172.21.15.64:48268) 2023-10-14T12:29:01.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.879+0000 7fde47fff640 1 -- 172.21.15.64:0/2275470576 learned_addr learned my addr 172.21.15.64:0/2275470576 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:01.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.880+0000 7fde4e59c640 1 --2- 172.21.15.64:0/2275470576 >> v2:172.21.15.177:3300/0 conn(0x7fde500aebb0 0x7fde5006ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.880+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886603299 0 0) 0x7fde500cd400 con 0x7fde500cec00 2023-10-14T12:29:01.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.880+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde3c003520 con 0x7fde500cec00 2023-10-14T12:29:01.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.880+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1480772065 0 0) 0x7fde3c003520 con 0x7fde500cec00 2023-10-14T12:29:01.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.880+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 >> v2:172.21.15.177:3300/0 conn(0x7fde500aebb0 msgr2=0x7fde5006ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:01.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.880+0000 7fde4dd9b640 1 --2- 172.21.15.64:0/2275470576 >> v2:172.21.15.177:3300/0 conn(0x7fde500aebb0 0x7fde5006ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.880+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 >> v1:172.21.15.177:6789/0 conn(0x7fde5006cf60 legacy=0x7fde5006d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:01.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500cdc60 con 0x7fde500cec00 2023-10-14T12:29:01.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fde38001670 con 0x7fde500cec00 2023-10-14T12:29:01.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 >> v1:172.21.15.64:6789/0 conn(0x7fde500cec00 legacy=0x7fde500cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde3c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde3c0047c0 0x7fde3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde3c005180 0x7fde3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500cd980 con 0x7fde3c0039c0 2023-10-14T12:29:01.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c00c080 con 0x7fde3c005180 2023-10-14T12:29:01.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde3c00c240 con 0x7fde3c0047c0 2023-10-14T12:29:01.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.881+0000 7fde4e59c640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde3c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde47fff640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde3c0047c0 0x7fde3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4e59c640 1 -- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde3c0047c0 msgr2=0x7fde3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4ed9d640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde3c005180 0x7fde3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4e59c640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde3c0047c0 0x7fde3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4e59c640 1 -- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde3c005180 msgr2=0x7fde3c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4e59c640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde3c005180 0x7fde3c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4e59c640 1 -- 172.21.15.64:0/2275470576 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde3c003520 con 0x7fde3c0039c0 2023-10-14T12:29:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde47fff640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde3c0047c0 0x7fde3c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4ed9d640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde3c005180 0x7fde3c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.882+0000 7fde4ed9d640 1 -- 172.21.15.64:0/2275470576 reap_dead start 2023-10-14T12:29:01.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.883+0000 7fde4e59c640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde3c003de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fde40009ab0 tx=0x7fde3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8d300514652045 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:01.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.883+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40005990 con 0x7fde3c0039c0 2023-10-14T12:29:01.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.883+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40005af0 con 0x7fde3c0039c0 2023-10-14T12:29:01.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.883+0000 7fde4dd9b640 1 -- 172.21.15.64:0/2275470576 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40005ea0 con 0x7fde3c0039c0 2023-10-14T12:29:01.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.884+0000 7fde54bb0640 1 -- 172.21.15.64:0/2275470576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 msgr2=0x7fde3c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.884+0000 7fde54bb0640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde3c003de0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fde40009ab0 tx=0x7fde3c0057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.884+0000 7fde54bb0640 1 -- 172.21.15.64:0/2275470576 shutdown_connections 2023-10-14T12:29:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.884+0000 7fde54bb0640 1 --2- 172.21.15.64:0/2275470576 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde3c003de0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.884+0000 7fde54bb0640 1 -- 172.21.15.64:0/2275470576 >> 172.21.15.64:0/2275470576 conn(0x7fde500989e0 msgr2=0x7fde500cf830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.884+0000 7fde54bb0640 1 -- 172.21.15.64:0/2275470576 shutdown_connections 2023-10-14T12:29:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.884+0000 7fde54bb0640 1 -- 172.21.15.64:0/2275470576 wait complete. 2023-10-14T12:29:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.886+0000 7fde54bb0640 1 Processor -- start 2023-10-14T12:29:01.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.886+0000 7fde54bb0640 1 -- start start 2023-10-14T12:29:01.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde54bb0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde500b3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde54bb0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde500c7dd0 0x7fde50148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde54bb0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde5014c8e0 0x7fde500cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde54bb0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde500b4500 con 0x7fde3c0039c0 2023-10-14T12:29:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde54bb0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde501491a0 con 0x7fde500c7dd0 2023-10-14T12:29:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde54bb0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde500c8590 con 0x7fde5014c8e0 2023-10-14T12:29:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde4e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde500b3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde4e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde500b3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48816/0 (socket says 172.21.15.64:48816) 2023-10-14T12:29:01.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.887+0000 7fde4e59c640 1 -- 172.21.15.64:0/933211755 learned_addr learned my addr 172.21.15.64:0/933211755 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:01.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4ed9d640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde5014c8e0 0x7fde500cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde47fff640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde500c7dd0 0x7fde50148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4e59c640 1 -- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde5014c8e0 msgr2=0x7fde500cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4e59c640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde5014c8e0 0x7fde500cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4e59c640 1 -- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde500c7dd0 msgr2=0x7fde50148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:01.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4e59c640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde500c7dd0 0x7fde50148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:01.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4e59c640 1 -- 172.21.15.64:0/933211755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde500c8870 con 0x7fde3c0039c0 2023-10-14T12:29:01.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4ed9d640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde5014c8e0 0x7fde500cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:01.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde47fff640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde500c7dd0 0x7fde50148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.888+0000 7fde4e59c640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde500b3fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde40036040 tx=0x7fde40004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.889+0000 7fde46ffd640 1 -- 172.21.15.64:0/933211755 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40006030 con 0x7fde3c0039c0 2023-10-14T12:29:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.889+0000 7fde46ffd640 1 -- 172.21.15.64:0/933211755 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde40006190 con 0x7fde3c0039c0 2023-10-14T12:29:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.889+0000 7fde46ffd640 1 -- 172.21.15.64:0/933211755 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40006500 con 0x7fde3c0039c0 2023-10-14T12:29:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.889+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde500c8b50 con 0x7fde3c0039c0 2023-10-14T12:29:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.889+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde500c9110 con 0x7fde3c0039c0 2023-10-14T12:29:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.890+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde500c92a0 con 0x7fde3c0039c0 2023-10-14T12:29:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.891+0000 7fde46ffd640 1 -- 172.21.15.64:0/933211755 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde40006660 con 0x7fde3c0039c0 2023-10-14T12:29:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.892+0000 7fde46ffd640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde3006ae70 0x7fde3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:01.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.892+0000 7fde46ffd640 1 -- 172.21.15.64:0/933211755 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde400abed0 con 0x7fde3c0039c0 2023-10-14T12:29:01.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.892+0000 7fde47fff640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde3006ae70 0x7fde3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:01.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.893+0000 7fde47fff640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde3006ae70 0x7fde3006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde38001eb0 tx=0x7fde38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:01.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:01.896+0000 7fde46ffd640 1 -- 172.21.15.64:0/933211755 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde40076d10 con 0x7fde3c0039c0 2023-10-14T12:29:02.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.125+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fde50073ef0 con 0x7fde3c0039c0 2023-10-14T12:29:02.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.126+0000 7fde46ffd640 1 -- 172.21.15.64:0/933211755 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fde4004d080 con 0x7fde3c0039c0 2023-10-14T12:29:02.128 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:29:02.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde3006ae70 msgr2=0x7fde3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde3006ae70 0x7fde3006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fde38001eb0 tx=0x7fde38009040 comp rx=0 tx=0).stop 2023-10-14T12:29:02.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 msgr2=0x7fde500b3fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde500b3fc0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde40036040 tx=0x7fde40004730 comp rx=0 tx=0).stop 2023-10-14T12:29:02.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 shutdown_connections 2023-10-14T12:29:02.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde3006ae70 0x7fde3006d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde5014c8e0 0x7fde500cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde500c7dd0 0x7fde50148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 --2- 172.21.15.64:0/933211755 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde3c0039c0 0x7fde500b3fc0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 >> 172.21.15.64:0/933211755 conn(0x7fde500989e0 msgr2=0x7fde500cb6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:02.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 shutdown_connections 2023-10-14T12:29:02.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.129+0000 7fde54bb0640 1 -- 172.21.15.64:0/933211755 wait complete. 2023-10-14T12:29:02.151 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:29:02.152 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:29:02.205 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:02.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.417+0000 7f47fa7f0640 1 Processor -- start 2023-10-14T12:29:02.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.417+0000 7f47fa7f0640 1 -- start start 2023-10-14T12:29:02.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47fa7f0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f47f40cd980 0x7f47f40cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47fa7f0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f47f4159c00 0x7f47f415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47fa7f0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f4154110 con 0x7f47f415def0 2023-10-14T12:29:02.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47fa7f0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f415d1f0 con 0x7f47f40cd980 2023-10-14T12:29:02.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47fa7f0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f415a4c0 con 0x7f47f4159c00 2023-10-14T12:29:02.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47f97ee640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f47f40cd980 0x7f47f40cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47f97ee640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f47f40cd980 0x7f47f40cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48830/0 (socket says 172.21.15.64:48830) 2023-10-14T12:29:02.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47f97ee640 1 -- 172.21.15.64:0/1176024329 learned_addr learned my addr 172.21.15.64:0/1176024329 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:02.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.419+0000 7f47f8fed640 1 --2- 172.21.15.64:0/1176024329 >> v2:172.21.15.177:3300/0 conn(0x7f47f4159c00 0x7f47f415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.420+0000 7f47f97ee640 1 -- 172.21.15.64:0/1176024329 >> v2:172.21.15.177:3300/0 conn(0x7f47f4159c00 msgr2=0x7f47f415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.420+0000 7f47f97ee640 1 --2- 172.21.15.64:0/1176024329 >> v2:172.21.15.177:3300/0 conn(0x7f47f4159c00 0x7f47f415d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.420+0000 7f47f97ee640 1 -- 172.21.15.64:0/1176024329 >> v1:172.21.15.177:6789/0 conn(0x7f47f415def0 legacy=0x7f47f406bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.420+0000 7f47f97ee640 1 -- 172.21.15.64:0/1176024329 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f415a7a0 con 0x7f47f40cd980 2023-10-14T12:29:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.421+0000 7f47f97ee640 1 --2- 172.21.15.64:0/1176024329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f40cdd60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47f40b0680 tx=0x7f47f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4995f38b0137e83 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.421+0000 7f47ebfff640 1 -- 172.21.15.64:0/1176024329 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0030860 con 0x7f47f40cd980 2023-10-14T12:29:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.421+0000 7f47ebfff640 1 -- 172.21.15.64:0/1176024329 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f00309c0 con 0x7f47f40cd980 2023-10-14T12:29:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.421+0000 7f47ebfff640 1 -- 172.21.15.64:0/1176024329 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0030d50 con 0x7f47f40cd980 2023-10-14T12:29:02.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 -- 172.21.15.64:0/1176024329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 msgr2=0x7f47f40cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/1176024329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f40cdd60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47f40b0680 tx=0x7f47f002b9a0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 -- 172.21.15.64:0/1176024329 shutdown_connections 2023-10-14T12:29:02.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/1176024329 >> v2:172.21.15.177:3300/0 conn(0x7f47f4159c00 0x7f47f415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/1176024329 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f40cdd60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 -- 172.21.15.64:0/1176024329 >> 172.21.15.64:0/1176024329 conn(0x7f47f406a470 msgr2=0x7f47f40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:02.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 -- 172.21.15.64:0/1176024329 shutdown_connections 2023-10-14T12:29:02.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.422+0000 7f47fa7f0640 1 -- 172.21.15.64:0/1176024329 wait complete. 2023-10-14T12:29:02.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.424+0000 7f47fa7f0640 1 Processor -- start 2023-10-14T12:29:02.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.424+0000 7f47fa7f0640 1 -- start start 2023-10-14T12:29:02.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47fa7f0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47fa7f0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47f4159c00 0x7f47f406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47fa7f0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47f4145880 0x7f47f40702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47fa7f0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40b2c90 con 0x7f47f40cd980 2023-10-14T12:29:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47fa7f0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f414a2d0 con 0x7f47f4145880 2023-10-14T12:29:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47fa7f0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f41496c0 con 0x7f47f4159c00 2023-10-14T12:29:02.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47f97ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47f97ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f415b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48844/0 (socket says 172.21.15.64:48844) 2023-10-14T12:29:02.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.425+0000 7f47f97ee640 1 -- 172.21.15.64:0/3075387029 learned_addr learned my addr 172.21.15.64:0/3075387029 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:02.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f8fed640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47f4159c00 0x7f47f406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f97ee640 1 -- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47f4159c00 msgr2=0x7f47f406fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f97ee640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47f4159c00 0x7f47f406fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f97ee640 1 -- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47f4145880 msgr2=0x7f47f40702d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f9fef640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47f4145880 0x7f47f40702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f97ee640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47f4145880 0x7f47f40702d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f97ee640 1 -- 172.21.15.64:0/3075387029 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f0009470 con 0x7f47f40cd980 2023-10-14T12:29:02.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f9fef640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47f4145880 0x7f47f40702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:02.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47f97ee640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f415b620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47f002b9e0 tx=0x7f47f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:02.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.426+0000 7f47e9ffb640 1 -- 172.21.15.64:0/3075387029 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f0039d60 con 0x7f47f40cd980 2023-10-14T12:29:02.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.427+0000 7f47e9ffb640 1 -- 172.21.15.64:0/3075387029 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47f0043400 con 0x7f47f40cd980 2023-10-14T12:29:02.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.427+0000 7f47e9ffb640 1 -- 172.21.15.64:0/3075387029 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f00437b0 con 0x7f47f40cd980 2023-10-14T12:29:02.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.427+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f41499a0 con 0x7f47f40cd980 2023-10-14T12:29:02.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.427+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f4149f60 con 0x7f47f40cd980 2023-10-14T12:29:02.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.428+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f404e9b0 con 0x7f47f40cd980 2023-10-14T12:29:02.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.429+0000 7f47e9ffb640 1 -- 172.21.15.64:0/3075387029 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f47f0043910 con 0x7f47f40cd980 2023-10-14T12:29:02.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.430+0000 7f47e9ffb640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47d806ae70 0x7f47d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.430+0000 7f47e9ffb640 1 -- 172.21.15.64:0/3075387029 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f47f003e070 con 0x7f47f40cd980 2023-10-14T12:29:02.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.431+0000 7f47f8fed640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47d806ae70 0x7f47d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.432+0000 7f47f8fed640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47d806ae70 0x7f47d806d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47f40b23e0 tx=0x7f47e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:02.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.435+0000 7f47e9ffb640 1 -- 172.21.15.64:0/3075387029 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47f0077a80 con 0x7f47f40cd980 2023-10-14T12:29:02.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.628+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f40b0930 con 0x7f47f40cd980 2023-10-14T12:29:02.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.631+0000 7f47e9ffb640 1 -- 172.21.15.64:0/3075387029 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f47f00ac090 con 0x7f47f40cd980 2023-10-14T12:29:02.633 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:02.633 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47d806ae70 msgr2=0x7f47d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47d806ae70 0x7f47d806d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f47f40b23e0 tx=0x7f47e4008040 comp rx=0 tx=0).stop 2023-10-14T12:29:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 msgr2=0x7f47f415b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f415b620 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f47f002b9e0 tx=0x7f47f0004730 comp rx=0 tx=0).stop 2023-10-14T12:29:02.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 shutdown_connections 2023-10-14T12:29:02.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47d806ae70 0x7f47d806d330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f47f4145880 0x7f47f40702d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f47f4159c00 0x7f47f406fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 --2- 172.21.15.64:0/3075387029 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f47f40cd980 0x7f47f415b620 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 >> 172.21.15.64:0/3075387029 conn(0x7f47f406a470 msgr2=0x7f47f40af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:02.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 shutdown_connections 2023-10-14T12:29:02.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.634+0000 7f47fa7f0640 1 -- 172.21.15.64:0/3075387029 wait complete. 2023-10-14T12:29:02.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:02.654 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:02.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.883+0000 7f4c4ffff640 1 Processor -- start 2023-10-14T12:29:02.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.883+0000 7f4c4ffff640 1 -- start start 2023-10-14T12:29:02.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.885+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c5015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.885+0000 7f4c4ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4c500c8930 0x7f4c500707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.885+0000 7f4c4ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4c500ca640 0x7f4c500cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.885+0000 7f4c4ffff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500c8e40 con 0x7f4c500ca640 2023-10-14T12:29:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4ffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c500c9090 con 0x7f4c500c8930 2023-10-14T12:29:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500c9370 con 0x7f4c50070400 2023-10-14T12:29:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4c500ca640 0x7f4c500cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4c500ca640 0x7f4c500cacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48852/0 (socket says 172.21.15.64:48852) 2023-10-14T12:29:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 -- 172.21.15.64:0/156176282 learned_addr learned my addr 172.21.15.64:0/156176282 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:02.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4effd640 1 --2- 172.21.15.64:0/156176282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c5015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c47fff640 1 --2- 172.21.15.64:0/156176282 >> v2:172.21.15.177:3300/0 conn(0x7f4c500c8930 0x7f4c500707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 -- 172.21.15.64:0/156176282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 msgr2=0x7f4c5015e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:02.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 --2- 172.21.15.64:0/156176282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c5015e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 -- 172.21.15.64:0/156176282 >> v2:172.21.15.177:3300/0 conn(0x7f4c500c8930 msgr2=0x7f4c500707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:02.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 --2- 172.21.15.64:0/156176282 >> v2:172.21.15.177:3300/0 conn(0x7f4c500c8930 0x7f4c500707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.886+0000 7f4c4f7fe640 1 -- 172.21.15.64:0/156176282 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c500c9650 con 0x7f4c500ca640 2023-10-14T12:29:02.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.887+0000 7f4c4f7fe640 1 --2- 172.21.15.64:0/156176282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500ca640 0x7f4c500cacf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c500ce240 tx=0x7f4c4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cf43809d7812eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:02.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.888+0000 7f4c4e7fc640 1 -- 172.21.15.64:0/156176282 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4802ca70 con 0x7f4c500ca640 2023-10-14T12:29:02.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.888+0000 7f4c4e7fc640 1 -- 172.21.15.64:0/156176282 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4802cbd0 con 0x7f4c500ca640 2023-10-14T12:29:02.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.888+0000 7f4c4e7fc640 1 -- 172.21.15.64:0/156176282 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c480343f0 con 0x7f4c500ca640 2023-10-14T12:29:02.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.888+0000 7f4c4ffff640 1 -- 172.21.15.64:0/156176282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500ca640 msgr2=0x7f4c500cacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.888+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/156176282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500ca640 0x7f4c500cacf0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4c500ce240 tx=0x7f4c4802bed0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.889+0000 7f4c4ffff640 1 -- 172.21.15.64:0/156176282 shutdown_connections 2023-10-14T12:29:02.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.889+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/156176282 >> v2:172.21.15.177:3300/0 conn(0x7f4c500c8930 0x7f4c500707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.889+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/156176282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500ca640 0x7f4c500cacf0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.889+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/156176282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c5015e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.889+0000 7f4c4ffff640 1 -- 172.21.15.64:0/156176282 >> 172.21.15.64:0/156176282 conn(0x7f4c5006a470 msgr2=0x7f4c500afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:02.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.889+0000 7f4c4ffff640 1 -- 172.21.15.64:0/156176282 shutdown_connections 2023-10-14T12:29:02.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.889+0000 7f4c4ffff640 1 -- 172.21.15.64:0/156176282 wait complete. 2023-10-14T12:29:02.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.890+0000 7f4c4ffff640 1 Processor -- start 2023-10-14T12:29:02.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.891+0000 7f4c4ffff640 1 -- start start 2023-10-14T12:29:02.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.891+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c500c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.891+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500c8930 0x7f4c501f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c500ca640 0x7f4c501594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4ffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500cd740 con 0x7f4c500c8930 2023-10-14T12:29:02.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4ffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500ccbe0 con 0x7f4c500ca640 2023-10-14T12:29:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c500ccea0 con 0x7f4c50070400 2023-10-14T12:29:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500c8930 0x7f4c501f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500c8930 0x7f4c501f23a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48860/0 (socket says 172.21.15.64:48860) 2023-10-14T12:29:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 -- 172.21.15.64:0/3817531557 learned_addr learned my addr 172.21.15.64:0/3817531557 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:02.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4f7fe640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c500ca640 0x7f4c501594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4effd640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c500c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 -- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 msgr2=0x7f4c500c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c500c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 -- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c500ca640 msgr2=0x7f4c501594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:02.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c500ca640 0x7f4c501594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:02.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c47fff640 1 -- 172.21.15.64:0/3817531557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c48009b30 con 0x7f4c500c8930 2023-10-14T12:29:02.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4f7fe640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c500ca640 0x7f4c501594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:02.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.892+0000 7f4c4effd640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c500c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:02.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.893+0000 7f4c47fff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500c8930 0x7f4c501f23a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800d7d0 tx=0x7f4c3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:02.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.893+0000 7f4c477fe640 1 -- 172.21.15.64:0/3817531557 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c38018070 con 0x7f4c500c8930 2023-10-14T12:29:02.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.893+0000 7f4c477fe640 1 -- 172.21.15.64:0/3817531557 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c38004020 con 0x7f4c500c8930 2023-10-14T12:29:02.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.893+0000 7f4c477fe640 1 -- 172.21.15.64:0/3817531557 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c380041b0 con 0x7f4c500c8930 2023-10-14T12:29:02.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.893+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c500cd180 con 0x7f4c500c8930 2023-10-14T12:29:02.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.893+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c501f1e80 con 0x7f4c500c8930 2023-10-14T12:29:02.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.894+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c501f1ce0 con 0x7f4c500c8930 2023-10-14T12:29:02.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.895+0000 7f4c477fe640 1 -- 172.21.15.64:0/3817531557 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4c38004310 con 0x7f4c500c8930 2023-10-14T12:29:02.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.896+0000 7f4c477fe640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4c3006ae70 0x7f4c3006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:02.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.896+0000 7f4c477fe640 1 -- 172.21.15.64:0/3817531557 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c38089830 con 0x7f4c500c8930 2023-10-14T12:29:02.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.897+0000 7f4c4effd640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4c3006ae70 0x7f4c3006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:02.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.898+0000 7f4c4effd640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4c3006ae70 0x7f4c3006d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006fd0 tx=0x7f4c40008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:02.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:02.901+0000 7f4c477fe640 1 -- 172.21.15.64:0/3817531557 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4c501f1ce0 con 0x7f4c500c8930 2023-10-14T12:29:03.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.097+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c501f1ce0 con 0x7f4c500c8930 2023-10-14T12:29:03.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.098+0000 7f4c477fe640 1 -- 172.21.15.64:0/3817531557 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c501f1ce0 con 0x7f4c500c8930 2023-10-14T12:29:03.100 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:03.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.100+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4c3006ae70 msgr2=0x7f4c3006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.100+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4c3006ae70 0x7f4c3006d330 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006fd0 tx=0x7f4c40008040 comp rx=0 tx=0).stop 2023-10-14T12:29:03.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.100+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500c8930 msgr2=0x7f4c501f23a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.100+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500c8930 0x7f4c501f23a0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4c3800d7d0 tx=0x7f4c3800dc90 comp rx=0 tx=0).stop 2023-10-14T12:29:03.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.100+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 shutdown_connections 2023-10-14T12:29:03.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.100+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4c3006ae70 0x7f4c3006d330 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.100+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4c500ca640 0x7f4c501594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.101+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4c500c8930 0x7f4c501f23a0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.101+0000 7f4c4ffff640 1 --2- 172.21.15.64:0/3817531557 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4c50070400 0x7f4c500c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.101+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 >> 172.21.15.64:0/3817531557 conn(0x7f4c5006a470 msgr2=0x7f4c500cea20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:03.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.101+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 shutdown_connections 2023-10-14T12:29:03.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.101+0000 7f4c4ffff640 1 -- 172.21.15.64:0/3817531557 wait complete. 2023-10-14T12:29:03.121 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:03.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.347+0000 7f520aae7640 1 Processor -- start 2023-10-14T12:29:03.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.348+0000 7f520aae7640 1 -- start start 2023-10-14T12:29:03.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.349+0000 7f520aae7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040d30b0 0x7f52040cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.349+0000 7f520aae7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f52040cd890 0x7f52040b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.349+0000 7f520aae7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52040d0e80 con 0x7f520415ca80 2023-10-14T12:29:03.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.349+0000 7f520aae7640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52040cdd00 con 0x7f52040cd890 2023-10-14T12:29:03.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.349+0000 7f520aae7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040d1160 con 0x7f52040d30b0 2023-10-14T12:29:03.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5209084640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f52040cd890 0x7f52040b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5209084640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f52040cd890 0x7f52040b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48862/0 (socket says 172.21.15.64:48862) 2023-10-14T12:29:03.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5209084640 1 -- 172.21.15.64:0/2363852983 learned_addr learned my addr 172.21.15.64:0/2363852983 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:03.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5203fff640 1 --2- 172.21.15.64:0/2363852983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040d30b0 0x7f52040cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5209084640 1 -- 172.21.15.64:0/2363852983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040d30b0 msgr2=0x7f52040cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:03.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5209084640 1 --2- 172.21.15.64:0/2363852983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040d30b0 0x7f52040cd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5209084640 1 -- 172.21.15.64:0/2363852983 >> v1:172.21.15.177:6789/0 conn(0x7f520415ca80 legacy=0x7f52040d05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.350+0000 7f5209084640 1 -- 172.21.15.64:0/2363852983 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040d1440 con 0x7f52040cd890 2023-10-14T12:29:03.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.351+0000 7f5209084640 1 --2- 172.21.15.64:0/2363852983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040cd890 0x7f52040b5da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009870 tx=0x7f51fc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a820eb7f7212880 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:03.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f52037fe640 1 -- 172.21.15.64:0/2363852983 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc030840 con 0x7f52040cd890 2023-10-14T12:29:03.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f52037fe640 1 -- 172.21.15.64:0/2363852983 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc0309a0 con 0x7f52040cd890 2023-10-14T12:29:03.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f52037fe640 1 -- 172.21.15.64:0/2363852983 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc030d30 con 0x7f52040cd890 2023-10-14T12:29:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f520aae7640 1 -- 172.21.15.64:0/2363852983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040cd890 msgr2=0x7f52040b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f520aae7640 1 --2- 172.21.15.64:0/2363852983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040cd890 0x7f52040b5da0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f51fc009870 tx=0x7f51fc02b980 comp rx=0 tx=0).stop 2023-10-14T12:29:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f520aae7640 1 -- 172.21.15.64:0/2363852983 shutdown_connections 2023-10-14T12:29:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f520aae7640 1 --2- 172.21.15.64:0/2363852983 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040cd890 0x7f52040b5da0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f520aae7640 1 --2- 172.21.15.64:0/2363852983 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040d30b0 0x7f52040cd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.352+0000 7f520aae7640 1 -- 172.21.15.64:0/2363852983 >> 172.21.15.64:0/2363852983 conn(0x7f5204071900 msgr2=0x7f5204071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:03.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.353+0000 7f520aae7640 1 -- 172.21.15.64:0/2363852983 shutdown_connections 2023-10-14T12:29:03.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.353+0000 7f520aae7640 1 -- 172.21.15.64:0/2363852983 wait complete. 2023-10-14T12:29:03.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.354+0000 7f520aae7640 1 Processor -- start 2023-10-14T12:29:03.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.354+0000 7f520aae7640 1 -- start start 2023-10-14T12:29:03.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.355+0000 7f520aae7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040cd890 0x7f520414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.355+0000 7f520aae7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040d30b0 0x7f52040b2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.355+0000 7f520aae7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f520415ca80 0x7f52040b2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.355+0000 7f520aae7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52040ca000 con 0x7f52040d30b0 2023-10-14T12:29:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.355+0000 7f520aae7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520415e480 con 0x7f520415ca80 2023-10-14T12:29:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.355+0000 7f520aae7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52040c64e0 con 0x7f52040cd890 2023-10-14T12:29:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040d30b0 0x7f52040b2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040d30b0 0x7f52040b2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48864/0 (socket says 172.21.15.64:48864) 2023-10-14T12:29:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 -- 172.21.15.64:0/3285106377 learned_addr learned my addr 172.21.15.64:0/3285106377 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:03.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5209084640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f520415ca80 0x7f52040b2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5208883640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040cd890 0x7f520414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 -- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040cd890 msgr2=0x7f520414dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040cd890 0x7f520414dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 -- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f520415ca80 msgr2=0x7f52040b2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f520415ca80 0x7f52040b2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 -- 172.21.15.64:0/3285106377 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc0094d0 con 0x7f52040d30b0 2023-10-14T12:29:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5208883640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040cd890 0x7f520414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.356+0000 7f5203fff640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040d30b0 0x7f52040b2430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00d800 tx=0x7f51ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.357+0000 7f52017fa640 1 -- 172.21.15.64:0/3285106377 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00b6c0 con 0x7f52040d30b0 2023-10-14T12:29:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.357+0000 7f52017fa640 1 -- 172.21.15.64:0/3285106377 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ec00b820 con 0x7f52040d30b0 2023-10-14T12:29:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.357+0000 7f52017fa640 1 -- 172.21.15.64:0/3285106377 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ec00bbd0 con 0x7f52040d30b0 2023-10-14T12:29:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.357+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52040c6780 con 0x7f52040d30b0 2023-10-14T12:29:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.357+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52040c6d40 con 0x7f52040d30b0 2023-10-14T12:29:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.358+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5204067180 con 0x7f52040d30b0 2023-10-14T12:29:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.359+0000 7f52017fa640 1 -- 172.21.15.64:0/3285106377 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f51ec00bd30 con 0x7f52040d30b0 2023-10-14T12:29:03.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.360+0000 7f52017fa640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f51e406ae70 0x7f51e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.360+0000 7f52017fa640 1 -- 172.21.15.64:0/3285106377 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f51ec089f40 con 0x7f52040d30b0 2023-10-14T12:29:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.361+0000 7f5208883640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f51e406ae70 0x7f51e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.362+0000 7f5208883640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f51e406ae70 0x7f51e406d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51f40012e0 tx=0x7f51f4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.364+0000 7f52017fa640 1 -- 172.21.15.64:0/3285106377 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f51ec054c60 con 0x7f52040d30b0 2023-10-14T12:29:03.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.567+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f52040ce810 con 0x7f52040d30b0 2023-10-14T12:29:03.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.568+0000 7f52017fa640 1 -- 172.21.15.64:0/3285106377 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51ec058280 con 0x7f52040d30b0 2023-10-14T12:29:03.570 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:03.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.570+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f51e406ae70 msgr2=0x7f51e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.570+0000 7f520aae7640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f51e406ae70 0x7f51e406d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f51f40012e0 tx=0x7f51f4009040 comp rx=0 tx=0).stop 2023-10-14T12:29:03.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.570+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040d30b0 msgr2=0x7f52040b2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.570+0000 7f520aae7640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040d30b0 0x7f52040b2430 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f51ec00d800 tx=0x7f51ec00dcc0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 shutdown_connections 2023-10-14T12:29:03.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f51e406ae70 0x7f51e406d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f520415ca80 0x7f52040b2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52040d30b0 0x7f52040b2430 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 --2- 172.21.15.64:0/3285106377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52040cd890 0x7f520414dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 >> 172.21.15.64:0/3285106377 conn(0x7f5204071900 msgr2=0x7f5204157b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:03.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 shutdown_connections 2023-10-14T12:29:03.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.571+0000 7f520aae7640 1 -- 172.21.15.64:0/3285106377 wait complete. 2023-10-14T12:29:03.592 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:03.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.822+0000 7fb487a90640 1 Processor -- start 2023-10-14T12:29:03.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.823+0000 7fb487a90640 1 -- start start 2023-10-14T12:29:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb487a90640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb4800cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb487a90640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb4800ca550 0x7fb480070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb487a90640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4800cf040 con 0x7fb480070860 2023-10-14T12:29:03.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb487a90640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb480070cf0 con 0x7fb4800ca550 2023-10-14T12:29:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb487a90640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4800ce430 con 0x7fb48015a830 2023-10-14T12:29:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb48502b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb4800ca550 0x7fb480070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb48602d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fb480070860 0x7fb48015e420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:48276/0 (socket says 172.21.15.64:48276) 2023-10-14T12:29:03.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb48602d640 1 -- 172.21.15.64:0/1020294245 learned_addr learned my addr 172.21.15.64:0/1020294245 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:03.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.824+0000 7fb48582c640 1 --2- 172.21.15.64:0/1020294245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb4800cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.825+0000 7fb48502b640 1 -- 172.21.15.64:0/1020294245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 msgr2=0x7fb4800cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:03.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.825+0000 7fb48502b640 1 --2- 172.21.15.64:0/1020294245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb4800cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.825+0000 7fb48502b640 1 -- 172.21.15.64:0/1020294245 >> v1:172.21.15.64:6789/0 conn(0x7fb480070860 legacy=0x7fb48015e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.825+0000 7fb48502b640 1 -- 172.21.15.64:0/1020294245 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4800ce710 con 0x7fb4800ca550 2023-10-14T12:29:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.826+0000 7fb48502b640 1 --2- 172.21.15.64:0/1020294245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4800ca550 0x7fb480070320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4700097a0 tx=0x7fb47002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba4afede3a568a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.826+0000 7fb48482a640 1 -- 172.21.15.64:0/1020294245 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47002d040 con 0x7fb4800ca550 2023-10-14T12:29:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.826+0000 7fb48482a640 1 -- 172.21.15.64:0/1020294245 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb470031810 con 0x7fb4800ca550 2023-10-14T12:29:03.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.826+0000 7fb48482a640 1 -- 172.21.15.64:0/1020294245 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb470031ba0 con 0x7fb4800ca550 2023-10-14T12:29:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 -- 172.21.15.64:0/1020294245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4800ca550 msgr2=0x7fb480070320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 --2- 172.21.15.64:0/1020294245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4800ca550 0x7fb480070320 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb4700097a0 tx=0x7fb47002b8b0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 -- 172.21.15.64:0/1020294245 shutdown_connections 2023-10-14T12:29:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 --2- 172.21.15.64:0/1020294245 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb4800ca550 0x7fb480070320 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 --2- 172.21.15.64:0/1020294245 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb4800cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 -- 172.21.15.64:0/1020294245 >> 172.21.15.64:0/1020294245 conn(0x7fb4800b0030 msgr2=0x7fb4800b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 -- 172.21.15.64:0/1020294245 shutdown_connections 2023-10-14T12:29:03.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.827+0000 7fb487a90640 1 -- 172.21.15.64:0/1020294245 wait complete. 2023-10-14T12:29:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.829+0000 7fb487a90640 1 Processor -- start 2023-10-14T12:29:03.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.829+0000 7fb487a90640 1 -- start start 2023-10-14T12:29:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb487a90640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb480070860 0x7fb4801570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb487a90640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4800ca550 0x7fb4800aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb487a90640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb480152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb487a90640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb480157620 con 0x7fb480070860 2023-10-14T12:29:03.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb487a90640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4801548a0 con 0x7fb4800ca550 2023-10-14T12:29:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb487a90640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb480154b80 con 0x7fb48015a830 2023-10-14T12:29:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb48582c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb480070860 0x7fb4801570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb48582c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb480070860 0x7fb4801570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48878/0 (socket says 172.21.15.64:48878) 2023-10-14T12:29:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.830+0000 7fb48582c640 1 -- 172.21.15.64:0/2562659323 learned_addr learned my addr 172.21.15.64:0/2562659323 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:03.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48602d640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb480152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48502b640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4800ca550 0x7fb4800aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48582c640 1 -- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 msgr2=0x7fb480152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48582c640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb480152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48582c640 1 -- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4800ca550 msgr2=0x7fb4800aee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:03.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48582c640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4800ca550 0x7fb4800aee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48582c640 1 -- 172.21.15.64:0/2562659323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb470009400 con 0x7fb480070860 2023-10-14T12:29:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb48582c640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb480070860 0x7fb4801570e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00e870 tx=0x7fb47c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.831+0000 7fb4767fc640 1 -- 172.21.15.64:0/2562659323 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c0094f0 con 0x7fb480070860 2023-10-14T12:29:03.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.832+0000 7fb4767fc640 1 -- 172.21.15.64:0/2562659323 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb47c00c940 con 0x7fb480070860 2023-10-14T12:29:03.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.832+0000 7fb4767fc640 1 -- 172.21.15.64:0/2562659323 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb47c00ccf0 con 0x7fb480070860 2023-10-14T12:29:03.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.832+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb480154e60 con 0x7fb480070860 2023-10-14T12:29:03.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.832+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb480155420 con 0x7fb480070860 2023-10-14T12:29:03.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.833+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4801555b0 con 0x7fb480070860 2023-10-14T12:29:03.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.834+0000 7fb4767fc640 1 -- 172.21.15.64:0/2562659323 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb47c013470 con 0x7fb480070860 2023-10-14T12:29:03.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.835+0000 7fb4767fc640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:03.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.835+0000 7fb4767fc640 1 -- 172.21.15.64:0/2562659323 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb47c089990 con 0x7fb480070860 2023-10-14T12:29:03.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.836+0000 7fb48502b640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:03.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.837+0000 7fb48502b640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb46406ae70 0x7fb46406d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb470036000 tx=0x7fb47003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:03.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:03.839+0000 7fb4767fc640 1 -- 172.21.15.64:0/2562659323 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb47c0547e0 con 0x7fb480070860 2023-10-14T12:29:04.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.031+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4800c1e20 con 0x7fb480070860 2023-10-14T12:29:04.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.032+0000 7fb4767fc640 1 -- 172.21.15.64:0/2562659323 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb47c0170a0 con 0x7fb480070860 2023-10-14T12:29:04.034 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:04.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.034+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb46406ae70 msgr2=0x7fb46406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.034+0000 7fb487a90640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb46406ae70 0x7fb46406d330 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fb470036000 tx=0x7fb47003c040 comp rx=0 tx=0).stop 2023-10-14T12:29:04.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.034+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb480070860 msgr2=0x7fb4801570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.034+0000 7fb487a90640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb480070860 0x7fb4801570e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb47c00e870 tx=0x7fb47c00ed30 comp rx=0 tx=0).stop 2023-10-14T12:29:04.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 shutdown_connections 2023-10-14T12:29:04.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb46406ae70 0x7fb46406d330 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb48015a830 0x7fb480152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb4800ca550 0x7fb4800aee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 --2- 172.21.15.64:0/2562659323 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb480070860 0x7fb4801570e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 >> 172.21.15.64:0/2562659323 conn(0x7fb4800b0030 msgr2=0x7fb4800adfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:04.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 shutdown_connections 2023-10-14T12:29:04.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.035+0000 7fb487a90640 1 -- 172.21.15.64:0/2562659323 wait complete. 2023-10-14T12:29:04.057 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:04.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.294+0000 7f86a7fff640 1 Processor -- start 2023-10-14T12:29:04.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.294+0000 7f86a7fff640 1 -- start start 2023-10-14T12:29:04.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.296+0000 7f86a7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86a80cf030 0x7f86a8070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.296+0000 7f86a7fff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a80cdac0 con 0x7f86a80cdf50 2023-10-14T12:29:04.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.296+0000 7f86a7fff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86a80cd1f0 con 0x7f86a815c8e0 2023-10-14T12:29:04.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.296+0000 7f86a7fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86a806df90 con 0x7f86a80cf030 2023-10-14T12:29:04.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.296+0000 7f869ffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f86a80cdf50 0x7f86a80ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:48286/0 (socket says 172.21.15.64:48286) 2023-10-14T12:29:04.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.296+0000 7f869ffff640 1 -- 172.21.15.64:0/2104263979 learned_addr learned my addr 172.21.15.64:0/2104263979 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:04.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a77fe640 1 --2- 172.21.15.64:0/2104263979 >> v2:172.21.15.177:3300/0 conn(0x7f86a80cf030 0x7f86a8070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1393699038 0 0) 0x7f86a80cdac0 con 0x7f86a80cdf50 2023-10-14T12:29:04.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8694003520 con 0x7f86a80cdf50 2023-10-14T12:29:04.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075129512 0 0) 0x7f8694003520 con 0x7f86a80cdf50 2023-10-14T12:29:04.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 >> v2:172.21.15.177:3300/0 conn(0x7f86a80cf030 msgr2=0x7f86a8070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:04.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 --2- 172.21.15.64:0/2104263979 >> v2:172.21.15.177:3300/0 conn(0x7f86a80cf030 0x7f86a8070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 >> v1:172.21.15.177:6789/0 conn(0x7f86a815c8e0 legacy=0x7f86a806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a806dcb0 con 0x7f86a80cdf50 2023-10-14T12:29:04.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.297+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f8690001670 con 0x7f86a80cdf50 2023-10-14T12:29:04.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 >> v1:172.21.15.64:6789/0 conn(0x7f86a80cdf50 legacy=0x7f86a80ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a67fc640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86940039e0 0x7f8694003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a67fc640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86940047c0 0x7f8694004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a67fc640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8694005180 0x7f869400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a806df90 con 0x7f8694005180 2023-10-14T12:29:04.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869400c0b0 con 0x7f86940047c0 2023-10-14T12:29:04.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869400c270 con 0x7f86940039e0 2023-10-14T12:29:04.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a77fe640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8694005180 0x7f869400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a6ffd640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86940039e0 0x7f8694003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f869ffff640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86940047c0 0x7f8694004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a77fe640 1 -- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86940039e0 msgr2=0x7f8694003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:04.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a77fe640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86940039e0 0x7f8694003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a77fe640 1 -- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86940047c0 msgr2=0x7f8694004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:04.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.298+0000 7f86a77fe640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86940047c0 0x7f8694004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.299+0000 7f86a77fe640 1 -- 172.21.15.64:0/2104263979 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8694003520 con 0x7f8694005180 2023-10-14T12:29:04.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.300+0000 7f86a77fe640 1 -- 172.21.15.64:0/2104263979 reap_dead start 2023-10-14T12:29:04.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.300+0000 7f86a77fe640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8694005180 0x7f869400b980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009fc0 tx=0x7f86940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879d2a8f2037d0fc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:04.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.300+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a002cc30 con 0x7f8694005180 2023-10-14T12:29:04.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.300+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86a000f040 con 0x7f8694005180 2023-10-14T12:29:04.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.300+0000 7f86a67fc640 1 -- 172.21.15.64:0/2104263979 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86a0003990 con 0x7f8694005180 2023-10-14T12:29:04.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.301+0000 7f86a7fff640 1 -- 172.21.15.64:0/2104263979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8694005180 msgr2=0x7f869400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.301+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8694005180 0x7f869400b980 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86a0009fc0 tx=0x7f86940057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.301+0000 7f86a7fff640 1 -- 172.21.15.64:0/2104263979 shutdown_connections 2023-10-14T12:29:04.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.301+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2104263979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8694005180 0x7f869400b980 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.301+0000 7f86a7fff640 1 -- 172.21.15.64:0/2104263979 >> 172.21.15.64:0/2104263979 conn(0x7f86a806a200 msgr2=0x7f86a806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.301+0000 7f86a7fff640 1 -- 172.21.15.64:0/2104263979 shutdown_connections 2023-10-14T12:29:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.301+0000 7f86a7fff640 1 -- 172.21.15.64:0/2104263979 wait complete. 2023-10-14T12:29:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.303+0000 7f86a7fff640 1 Processor -- start 2023-10-14T12:29:04.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.303+0000 7f86a7fff640 1 -- start start 2023-10-14T12:29:04.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8694005180 0x7f86a809b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86a8160d10 0x7f86a8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f86a7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86a8071050 0x7f86a80714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f86a7fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a809c220 con 0x7f86a8160d10 2023-10-14T12:29:04.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f86a7fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a81f1e90 con 0x7f86a8071050 2023-10-14T12:29:04.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f86a7fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a8071a10 con 0x7f8694005180 2023-10-14T12:29:04.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f869ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86a8160d10 0x7f86a8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.304+0000 7f869ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86a8160d10 0x7f86a8155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48896/0 (socket says 172.21.15.64:48896) 2023-10-14T12:29:04.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f869ffff640 1 -- 172.21.15.64:0/2699866099 learned_addr learned my addr 172.21.15.64:0/2699866099 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:04.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f86a6ffd640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8694005180 0x7f86a809b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f86a77fe640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86a8071050 0x7f86a80714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f869ffff640 1 -- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8694005180 msgr2=0x7f86a809b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f869ffff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8694005180 0x7f86a809b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f869ffff640 1 -- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86a8071050 msgr2=0x7f86a80714d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f869ffff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86a8071050 0x7f86a80714d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f869ffff640 1 -- 172.21.15.64:0/2699866099 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a81f29d0 con 0x7f86a8160d10 2023-10-14T12:29:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.305+0000 7f869ffff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86a8160d10 0x7f86a8155ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f869000e700 tx=0x7f869000ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.306+0000 7f869f7fe640 1 -- 172.21.15.64:0/2699866099 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869000c660 con 0x7f86a8160d10 2023-10-14T12:29:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.306+0000 7f869f7fe640 1 -- 172.21.15.64:0/2699866099 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f869000c7e0 con 0x7f86a8160d10 2023-10-14T12:29:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.306+0000 7f869f7fe640 1 -- 172.21.15.64:0/2699866099 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f869000cb90 con 0x7f86a8160d10 2023-10-14T12:29:04.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.306+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86a81f42a0 con 0x7f86a8160d10 2023-10-14T12:29:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.306+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86a81f2380 con 0x7f86a8160d10 2023-10-14T12:29:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.307+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86a81f2b60 con 0x7f86a8160d10 2023-10-14T12:29:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.308+0000 7f869f7fe640 1 -- 172.21.15.64:0/2699866099 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f869000ccf0 con 0x7f86a8160d10 2023-10-14T12:29:04.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.309+0000 7f869f7fe640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f868806aea0 0x7f868806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.309+0000 7f869f7fe640 1 -- 172.21.15.64:0/2699866099 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8690089700 con 0x7f86a8160d10 2023-10-14T12:29:04.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.309+0000 7f86a6ffd640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f868806aea0 0x7f868806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.311+0000 7f86a6ffd640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f868806aea0 0x7f868806d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8698000c00 tx=0x7f8698009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:04.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.313+0000 7f869f7fe640 1 -- 172.21.15.64:0/2699866099 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8690054550 con 0x7f86a8160d10 2023-10-14T12:29:04.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.505+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f86a80cd440 con 0x7f86a8160d10 2023-10-14T12:29:04.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.506+0000 7f869f7fe640 1 -- 172.21.15.64:0/2699866099 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8690057b70 con 0x7f86a8160d10 2023-10-14T12:29:04.508 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:04.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f868806aea0 msgr2=0x7f868806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f868806aea0 0x7f868806d360 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8698000c00 tx=0x7f8698009040 comp rx=0 tx=0).stop 2023-10-14T12:29:04.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86a8160d10 msgr2=0x7f86a8155ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86a8160d10 0x7f86a8155ab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f869000e700 tx=0x7f869000ebc0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 shutdown_connections 2023-10-14T12:29:04.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f868806aea0 0x7f868806d360 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f86a8071050 0x7f86a80714d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86a8160d10 0x7f86a8155ab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 --2- 172.21.15.64:0/2699866099 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8694005180 0x7f86a809b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 >> 172.21.15.64:0/2699866099 conn(0x7f86a806a200 msgr2=0x7f86a80ac7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:04.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 shutdown_connections 2023-10-14T12:29:04.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.509+0000 7f86a7fff640 1 -- 172.21.15.64:0/2699866099 wait complete. 2023-10-14T12:29:04.531 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:29:04.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.747+0000 7f481994c640 1 Processor -- start 2023-10-14T12:29:04.749 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.747+0000 7f481994c640 1 -- start start 2023-10-14T12:29:04.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f481994c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4814158560 0x7f48140cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f481994c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f481415af80 0x7f48140ce320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f481994c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f48140b21d0 0x7f48140b2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f481994c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4814158940 con 0x7f481415af80 2023-10-14T12:29:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f481994c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48140ccb40 con 0x7f48140b21d0 2023-10-14T12:29:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f481994c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f481406fd70 con 0x7f4814158560 2023-10-14T12:29:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f48127fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f481415af80 0x7f48140ce320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f48127fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f481415af80 0x7f48140ce320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48898/0 (socket says 172.21.15.64:48898) 2023-10-14T12:29:04.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f48127fc640 1 -- 172.21.15.64:0/3586045424 learned_addr learned my addr 172.21.15.64:0/3586045424 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:04.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f48137fe640 1 --2- 172.21.15.64:0/3586045424 >> v2:172.21.15.177:3300/0 conn(0x7f48140b21d0 0x7f48140b2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.749+0000 7f4812ffd640 1 --2- 172.21.15.64:0/3586045424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4814158560 0x7f48140cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.750+0000 7f48127fc640 1 -- 172.21.15.64:0/3586045424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4814158560 msgr2=0x7f48140cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:04.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.750+0000 7f48127fc640 1 --2- 172.21.15.64:0/3586045424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4814158560 0x7f48140cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.750+0000 7f48127fc640 1 -- 172.21.15.64:0/3586045424 >> v2:172.21.15.177:3300/0 conn(0x7f48140b21d0 msgr2=0x7f48140b2600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:04.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.750+0000 7f48127fc640 1 --2- 172.21.15.64:0/3586045424 >> v2:172.21.15.177:3300/0 conn(0x7f48140b21d0 0x7f48140b2600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.750+0000 7f48127fc640 1 -- 172.21.15.64:0/3586045424 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140b2b40 con 0x7f481415af80 2023-10-14T12:29:04.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.750+0000 7f48137fe640 1 --2- 172.21.15.64:0/3586045424 >> v2:172.21.15.177:3300/0 conn(0x7f48140b21d0 0x7f48140b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:04.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.751+0000 7f48127fc640 1 --2- 172.21.15.64:0/3586045424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f481415af80 0x7f48140ce320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f481406f770 tx=0x7f47fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7c92ab51119ced server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:04.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.751+0000 7f4811ffb640 1 -- 172.21.15.64:0/3586045424 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc031870 con 0x7f481415af80 2023-10-14T12:29:04.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.751+0000 7f4811ffb640 1 -- 172.21.15.64:0/3586045424 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47fc0319d0 con 0x7f481415af80 2023-10-14T12:29:04.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.751+0000 7f4811ffb640 1 -- 172.21.15.64:0/3586045424 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47fc031d60 con 0x7f481415af80 2023-10-14T12:29:04.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 -- 172.21.15.64:0/3586045424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f481415af80 msgr2=0x7f48140ce320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 --2- 172.21.15.64:0/3586045424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f481415af80 0x7f48140ce320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f481406f770 tx=0x7f47fc02b910 comp rx=0 tx=0).stop 2023-10-14T12:29:04.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 -- 172.21.15.64:0/3586045424 shutdown_connections 2023-10-14T12:29:04.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 --2- 172.21.15.64:0/3586045424 >> v2:172.21.15.177:3300/0 conn(0x7f48140b21d0 0x7f48140b2600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 --2- 172.21.15.64:0/3586045424 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f481415af80 0x7f48140ce320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 --2- 172.21.15.64:0/3586045424 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4814158560 0x7f48140cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 -- 172.21.15.64:0/3586045424 >> 172.21.15.64:0/3586045424 conn(0x7f48140cd1d0 msgr2=0x7f48140cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:04.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 -- 172.21.15.64:0/3586045424 shutdown_connections 2023-10-14T12:29:04.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.752+0000 7f481994c640 1 -- 172.21.15.64:0/3586045424 wait complete. 2023-10-14T12:29:04.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.754+0000 7f481994c640 1 Processor -- start 2023-10-14T12:29:04.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.754+0000 7f481994c640 1 -- start start 2023-10-14T12:29:04.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f481994c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48140b21d0 0x7f4814150c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f481994c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4814158560 0x7f48140c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f481994c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f481415af80 0x7f48141f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f481994c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48141511a0 con 0x7f48140b21d0 2023-10-14T12:29:04.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f481994c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48140c7ec0 con 0x7f4814158560 2023-10-14T12:29:04.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f481994c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48141f6b20 con 0x7f481415af80 2023-10-14T12:29:04.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f4812ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48140b21d0 0x7f4814150c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f4812ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48140b21d0 0x7f4814150c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48900/0 (socket says 172.21.15.64:48900) 2023-10-14T12:29:04.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.755+0000 7f4812ffd640 1 -- 172.21.15.64:0/3538971633 learned_addr learned my addr 172.21.15.64:0/3538971633 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:04.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f48127fc640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4814158560 0x7f48140c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f48137fe640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f481415af80 0x7f48141f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f4812ffd640 1 -- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f481415af80 msgr2=0x7f48141f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f4812ffd640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f481415af80 0x7f48141f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f4812ffd640 1 -- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4814158560 msgr2=0x7f48140c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f4812ffd640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4814158560 0x7f48140c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f4812ffd640 1 -- 172.21.15.64:0/3538971633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47fc0094d0 con 0x7f48140b21d0 2023-10-14T12:29:04.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f48137fe640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f481415af80 0x7f48141f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:04.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f48127fc640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4814158560 0x7f48140c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:04.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f4812ffd640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48140b21d0 0x7f4814150c60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4804007ef0 tx=0x7f480400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:04.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.756+0000 7f480bfff640 1 -- 172.21.15.64:0/3538971633 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804014620 con 0x7f48140b21d0 2023-10-14T12:29:04.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.757+0000 7f480bfff640 1 -- 172.21.15.64:0/3538971633 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f480400ee90 con 0x7f48140b21d0 2023-10-14T12:29:04.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.757+0000 7f480bfff640 1 -- 172.21.15.64:0/3538971633 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48040149c0 con 0x7f48140b21d0 2023-10-14T12:29:04.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.757+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48140c7be0 con 0x7f48140b21d0 2023-10-14T12:29:04.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.757+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48140ca300 con 0x7f48140b21d0 2023-10-14T12:29:04.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.758+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4814067180 con 0x7f48140b21d0 2023-10-14T12:29:04.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.759+0000 7f480bfff640 1 -- 172.21.15.64:0/3538971633 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4804014b20 con 0x7f48140b21d0 2023-10-14T12:29:04.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.760+0000 7f480bfff640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47f406ae70 0x7f47f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:04.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.760+0000 7f480bfff640 1 -- 172.21.15.64:0/3538971633 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f480408a370 con 0x7f48140b21d0 2023-10-14T12:29:04.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.761+0000 7f48127fc640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47f406ae70 0x7f47f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:04.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.762+0000 7f48127fc640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47f406ae70 0x7f47f406d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47fc036000 tx=0x7f47fc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:04.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.764+0000 7f480bfff640 1 -- 172.21.15.64:0/3538971633 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4804055090 con 0x7f48140b21d0 2023-10-14T12:29:04.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.971+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f48140b1fb0 con 0x7f48140b21d0 2023-10-14T12:29:04.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.972+0000 7f480bfff640 1 -- 172.21.15.64:0/3538971633 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f48040586b0 con 0x7f48140b21d0 2023-10-14T12:29:04.974 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:29:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47f406ae70 msgr2=0x7f47f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47f406ae70 0x7f47f406d330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f47fc036000 tx=0x7f47fc03c040 comp rx=0 tx=0).stop 2023-10-14T12:29:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48140b21d0 msgr2=0x7f4814150c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:04.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48140b21d0 0x7f4814150c60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4804007ef0 tx=0x7f480400e4b0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 shutdown_connections 2023-10-14T12:29:04.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f47f406ae70 0x7f47f406d330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f481415af80 0x7f48141f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4814158560 0x7f48140c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 --2- 172.21.15.64:0/3538971633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48140b21d0 0x7f4814150c60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:04.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 >> 172.21.15.64:0/3538971633 conn(0x7f48140cd1d0 msgr2=0x7f4814070100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:04.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 shutdown_connections 2023-10-14T12:29:04.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:04.975+0000 7f481994c640 1 -- 172.21.15.64:0/3538971633 wait complete. 2023-10-14T12:29:04.996 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi064.front.sepia.ceph.com... 2023-10-14T12:29:04.996 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:04.997 DEBUG:teuthology.orchestra.run.smithi064:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-10-14T12:29:05.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi064.stderr:ceph-fuse[92997]: fuse finished with error 0 and tester_r 0 2023-10-14T12:29:05.094 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:29:05.130 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:29:05.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:05.131 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-10-14T12:29:05.245 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:05.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.478+0000 7ff54d7ff640 1 Processor -- start 2023-10-14T12:29:05.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.478+0000 7ff54d7ff640 1 -- start start 2023-10-14T12:29:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.479+0000 7ff54d7ff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 0x7ff5480cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.479+0000 7ff54d7ff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff54806ff40 0x7ff5480cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.479+0000 7ff54d7ff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff54815acb0 con 0x7ff5480ca660 2023-10-14T12:29:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.479+0000 7ff54d7ff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5480c1c60 con 0x7ff54806ff40 2023-10-14T12:29:05.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.479+0000 7ff54d7ff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff54815e350 con 0x7ff54815a8d0 2023-10-14T12:29:05.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff5477fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ff5480ca660 0x7ff54806bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:48302/0 (socket says 172.21.15.64:48302) 2023-10-14T12:29:05.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff5477fe640 1 -- 172.21.15.64:0/3994291744 learned_addr learned my addr 172.21.15.64:0/3994291744 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:05.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff54cffe640 1 --2- 172.21.15.64:0/3994291744 >> v2:172.21.15.177:3300/0 conn(0x7ff54806ff40 0x7ff5480cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff547fff640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 0x7ff5480cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498555074 0 0) 0x7ff53c001110 con 0x7ff5480ca660 2023-10-14T12:29:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff530003520 con 0x7ff5480ca660 2023-10-14T12:29:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3542167848 0 0) 0x7ff530003520 con 0x7ff5480ca660 2023-10-14T12:29:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 msgr2=0x7ff5480cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:05.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 0x7ff5480cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 >> v2:172.21.15.177:3300/0 conn(0x7ff54806ff40 msgr2=0x7ff5480cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 --2- 172.21.15.64:0/3994291744 >> v2:172.21.15.177:3300/0 conn(0x7ff54806ff40 0x7ff5480cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.480+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff54815e630 con 0x7ff5480ca660 2023-10-14T12:29:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7ff53c001800 con 0x7ff5480ca660 2023-10-14T12:29:05.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 >> v1:172.21.15.64:6789/0 conn(0x7ff5480ca660 legacy=0x7ff54806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff530003970 0x7ff530003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 0x7ff5300047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff530005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480c1c60 con 0x7ff530004d00 2023-10-14T12:29:05.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff54815e350 con 0x7ff530003970 2023-10-14T12:29:05.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53000b980 con 0x7ff54815a8d0 2023-10-14T12:29:05.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff54cffe640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff530005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff547fff640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff530003970 0x7ff530003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.481+0000 7ff5477fe640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 0x7ff5300047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.482+0000 7ff54cffe640 1 -- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 msgr2=0x7ff5300047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:05.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.482+0000 7ff54cffe640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff54815a8d0 0x7ff5300047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.482+0000 7ff54cffe640 1 -- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff530003970 msgr2=0x7ff530003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.482+0000 7ff54cffe640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff530003970 0x7ff530003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.482+0000 7ff54cffe640 1 -- 172.21.15.64:0/3994291744 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff530003520 con 0x7ff530004d00 2023-10-14T12:29:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.483+0000 7ff54cffe640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff530005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff540009ac0 tx=0x7ff5300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ea2480ba60c34 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.483+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54002c6f0 con 0x7ff530004d00 2023-10-14T12:29:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.483+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff54002c850 con 0x7ff530004d00 2023-10-14T12:29:05.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.483+0000 7ff546ffd640 1 -- 172.21.15.64:0/3994291744 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff54002cbe0 con 0x7ff530004d00 2023-10-14T12:29:05.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.484+0000 7ff54d7ff640 1 -- 172.21.15.64:0/3994291744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 msgr2=0x7ff530005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.484+0000 7ff54d7ff640 1 --2- 172.21.15.64:0/3994291744 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff530005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff540009ac0 tx=0x7ff5300057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.484+0000 7ff54cffe640 1 -- 172.21.15.64:0/3994291744 reap_dead start 2023-10-14T12:29:05.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.484+0000 7ff54d7ff640 1 -- 172.21.15.64:0/3994291744 shutdown_connections 2023-10-14T12:29:05.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.484+0000 7ff54d7ff640 1 -- 172.21.15.64:0/3994291744 >> 172.21.15.64:0/3994291744 conn(0x7ff54806a470 msgr2=0x7ff5480afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.484+0000 7ff54d7ff640 1 -- 172.21.15.64:0/3994291744 shutdown_connections 2023-10-14T12:29:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.484+0000 7ff54d7ff640 1 -- 172.21.15.64:0/3994291744 wait complete. 2023-10-14T12:29:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.486+0000 7ff54d7ff640 1 Processor -- start 2023-10-14T12:29:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.486+0000 7ff54d7ff640 1 -- start start 2023-10-14T12:29:05.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.487+0000 7ff54d7ff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff548151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.487+0000 7ff54d7ff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5480ccd00 0x7ff5480cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.487+0000 7ff54d7ff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff5480cd8e0 0x7ff5480c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.487+0000 7ff54d7ff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480cde60 con 0x7ff530004d00 2023-10-14T12:29:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.487+0000 7ff54d7ff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480cbf40 con 0x7ff5480ccd00 2023-10-14T12:29:05.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.487+0000 7ff54d7ff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5480cc220 con 0x7ff5480cd8e0 2023-10-14T12:29:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.487+0000 7ff547fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff548151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff548151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48908/0 (socket says 172.21.15.64:48908) 2023-10-14T12:29:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 -- 172.21.15.64:0/2407841559 learned_addr learned my addr 172.21.15.64:0/2407841559 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:05.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff5477fe640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5480ccd00 0x7ff5480cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff54cffe640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff5480cd8e0 0x7ff5480c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 -- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff5480cd8e0 msgr2=0x7ff5480c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff5480cd8e0 0x7ff5480c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 -- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5480ccd00 msgr2=0x7ff5480cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5480ccd00 0x7ff5480cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 -- 172.21.15.64:0/2407841559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5480cc500 con 0x7ff530004d00 2023-10-14T12:29:05.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.488+0000 7ff547fff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff548151c90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff538011e80 tx=0x7ff53800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:05.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.489+0000 7ff544ff9640 1 -- 172.21.15.64:0/2407841559 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53800e040 con 0x7ff530004d00 2023-10-14T12:29:05.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.489+0000 7ff544ff9640 1 -- 172.21.15.64:0/2407841559 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53800f040 con 0x7ff530004d00 2023-10-14T12:29:05.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.489+0000 7ff544ff9640 1 -- 172.21.15.64:0/2407841559 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff538015850 con 0x7ff530004d00 2023-10-14T12:29:05.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.489+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5480cc7e0 con 0x7ff530004d00 2023-10-14T12:29:05.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.489+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5480c3c50 con 0x7ff530004d00 2023-10-14T12:29:05.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.490+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5480cc9a0 con 0x7ff530004d00 2023-10-14T12:29:05.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.491+0000 7ff544ff9640 1 -- 172.21.15.64:0/2407841559 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff5380159b0 con 0x7ff530004d00 2023-10-14T12:29:05.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.492+0000 7ff544ff9640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff53406aea0 0x7ff53406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.493+0000 7ff544ff9640 1 -- 172.21.15.64:0/2407841559 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff53808a740 con 0x7ff530004d00 2023-10-14T12:29:05.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.493+0000 7ff5477fe640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff53406aea0 0x7ff53406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.494+0000 7ff5477fe640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff53406aea0 0x7ff53406d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff53c001050 tx=0x7ff53c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:05.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.497+0000 7ff544ff9640 1 -- 172.21.15.64:0/2407841559 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff538055500 con 0x7ff530004d00 2023-10-14T12:29:05.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.693+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5480cdfa0 con 0x7ff530004d00 2023-10-14T12:29:05.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.695+0000 7ff544ff9640 1 -- 172.21.15.64:0/2407841559 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7ff538058b20 con 0x7ff530004d00 2023-10-14T12:29:05.699 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:05.700 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:05.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff53406aea0 msgr2=0x7ff53406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff53406aea0 0x7ff53406d360 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff53c001050 tx=0x7ff53c009040 comp rx=0 tx=0).stop 2023-10-14T12:29:05.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 msgr2=0x7ff548151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff548151c90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff538011e80 tx=0x7ff53800f580 comp rx=0 tx=0).stop 2023-10-14T12:29:05.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 shutdown_connections 2023-10-14T12:29:05.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff53406aea0 0x7ff53406d360 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff5480cd8e0 0x7ff5480c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff5480ccd00 0x7ff5480cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 --2- 172.21.15.64:0/2407841559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff530004d00 0x7ff548151c90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 >> 172.21.15.64:0/2407841559 conn(0x7ff54806a470 msgr2=0x7ff5480ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:05.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 shutdown_connections 2023-10-14T12:29:05.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.698+0000 7ff54d7ff640 1 -- 172.21.15.64:0/2407841559 wait complete. 2023-10-14T12:29:05.720 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:05.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.944+0000 7f79c70bb640 1 Processor -- start 2023-10-14T12:29:05.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.944+0000 7f79c70bb640 1 -- start start 2023-10-14T12:29:05.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c70bb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f79c00cb250 0x7f79c00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c70bb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f79c00ca660 0x7f79c00c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c70bb640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79c015acb0 con 0x7f79c015a8d0 2023-10-14T12:29:05.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c70bb640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c00c1c60 con 0x7f79c00cb250 2023-10-14T12:29:05.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c70bb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79c015e350 con 0x7f79c00ca660 2023-10-14T12:29:05.949 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c58b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f79c00cb250 0x7f79c00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c60b9640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f79c015a8d0 0x7f79c00cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42466/0 (socket says 172.21.15.64:42466) 2023-10-14T12:29:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.946+0000 7f79c60b9640 1 -- 172.21.15.64:0/2378652891 learned_addr learned my addr 172.21.15.64:0/2378652891 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c68ba640 1 --2- 172.21.15.64:0/2378652891 >> v2:172.21.15.177:3300/0 conn(0x7f79c00ca660 0x7f79c00c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c50b7640 1 -- 172.21.15.64:0/2378652891 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146197308 0 0) 0x7f79bc001290 con 0x7f79c015a8d0 2023-10-14T12:29:05.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c50b7640 1 -- 172.21.15.64:0/2378652891 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ac003520 con 0x7f79c015a8d0 2023-10-14T12:29:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c58b8640 1 -- 172.21.15.64:0/2378652891 >> v2:172.21.15.177:3300/0 conn(0x7f79c00ca660 msgr2=0x7f79c00c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c58b8640 1 --2- 172.21.15.64:0/2378652891 >> v2:172.21.15.177:3300/0 conn(0x7f79c00ca660 0x7f79c00c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c58b8640 1 -- 172.21.15.64:0/2378652891 >> v1:172.21.15.64:6789/0 conn(0x7f79c015a8d0 legacy=0x7f79c00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c58b8640 1 -- 172.21.15.64:0/2378652891 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79c015e630 con 0x7f79c00cb250 2023-10-14T12:29:05.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.947+0000 7f79c68ba640 1 --2- 172.21.15.64:0/2378652891 >> v2:172.21.15.177:3300/0 conn(0x7f79c00ca660 0x7f79c00c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:05.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.948+0000 7f79c58b8640 1 --2- 172.21.15.64:0/2378652891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00c8e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79c00addb0 tx=0x7f79b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90abb3702e768e50 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:05.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.948+0000 7f79c50b7640 1 -- 172.21.15.64:0/2378652891 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0031830 con 0x7f79c00cb250 2023-10-14T12:29:05.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.948+0000 7f79c50b7640 1 -- 172.21.15.64:0/2378652891 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b0031990 con 0x7f79c00cb250 2023-10-14T12:29:05.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.948+0000 7f79c50b7640 1 -- 172.21.15.64:0/2378652891 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0031d20 con 0x7f79c00cb250 2023-10-14T12:29:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 -- 172.21.15.64:0/2378652891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 msgr2=0x7f79c00c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 --2- 172.21.15.64:0/2378652891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00c8e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f79c00addb0 tx=0x7f79b002b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 -- 172.21.15.64:0/2378652891 shutdown_connections 2023-10-14T12:29:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 --2- 172.21.15.64:0/2378652891 >> v2:172.21.15.177:3300/0 conn(0x7f79c00ca660 0x7f79c00c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 --2- 172.21.15.64:0/2378652891 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00c8e10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 -- 172.21.15.64:0/2378652891 >> 172.21.15.64:0/2378652891 conn(0x7f79c006a470 msgr2=0x7f79c00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 -- 172.21.15.64:0/2378652891 shutdown_connections 2023-10-14T12:29:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.949+0000 7f79c70bb640 1 -- 172.21.15.64:0/2378652891 wait complete. 2023-10-14T12:29:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.951+0000 7f79c70bb640 1 Processor -- start 2023-10-14T12:29:05.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.951+0000 7f79c70bb640 1 -- start start 2023-10-14T12:29:05.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.952+0000 7f79c70bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c00ca660 0x7f79c00c73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.952+0000 7f79c70bb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00aef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.952+0000 7f79c70bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79c015a8d0 0x7f79c00af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.952+0000 7f79c70bb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01f5c40 con 0x7f79c00cb250 2023-10-14T12:29:05.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.952+0000 7f79c70bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01f52a0 con 0x7f79c00ca660 2023-10-14T12:29:05.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.952+0000 7f79c70bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01f5580 con 0x7f79c015a8d0 2023-10-14T12:29:05.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00aef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00aef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37474/0 (socket says 172.21.15.64:37474) 2023-10-14T12:29:05.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 -- 172.21.15.64:0/1203815594 learned_addr learned my addr 172.21.15.64:0/1203815594 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:05.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c60b9640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c00ca660 0x7f79c00c73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c68ba640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79c015a8d0 0x7f79c00af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 -- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79c015a8d0 msgr2=0x7f79c00af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79c015a8d0 0x7f79c00af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 -- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c00ca660 msgr2=0x7f79c00c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:05.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c00ca660 0x7f79c00c73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:05.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c58b8640 1 -- 172.21.15.64:0/1203815594 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b0009400 con 0x7f79c00cb250 2023-10-14T12:29:05.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.953+0000 7f79c60b9640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c00ca660 0x7f79c00c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:05.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.954+0000 7f79c58b8640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00aef50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009890 tx=0x7f79b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:05.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.954+0000 7f79b6ffd640 1 -- 172.21.15.64:0/1203815594 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b003a6f0 con 0x7f79c00cb250 2023-10-14T12:29:05.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.954+0000 7f79b6ffd640 1 -- 172.21.15.64:0/1203815594 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b003a870 con 0x7f79c00cb250 2023-10-14T12:29:05.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.954+0000 7f79b6ffd640 1 -- 172.21.15.64:0/1203815594 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b003ac20 con 0x7f79c00cb250 2023-10-14T12:29:05.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.954+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c01f5860 con 0x7f79c00cb250 2023-10-14T12:29:05.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.954+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c00c3e00 con 0x7f79c00cb250 2023-10-14T12:29:05.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.955+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c01f5d80 con 0x7f79c00cb250 2023-10-14T12:29:05.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.956+0000 7f79b6ffd640 1 -- 172.21.15.64:0/1203815594 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79b0043410 con 0x7f79c00cb250 2023-10-14T12:29:05.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.957+0000 7f79b6ffd640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79a406ae70 0x7f79a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:05.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.957+0000 7f79b6ffd640 1 -- 172.21.15.64:0/1203815594 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f79b00ab5a0 con 0x7f79c00cb250 2023-10-14T12:29:05.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.958+0000 7f79c60b9640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79a406ae70 0x7f79a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:05.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.959+0000 7f79c60b9640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79a406ae70 0x7f79a406d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0010e0 tx=0x7f79bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:05.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:05.961+0000 7f79b6ffd640 1 -- 172.21.15.64:0/1203815594 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79c01f5d80 con 0x7f79c00cb250 2023-10-14T12:29:06.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.156+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79c01f5d80 con 0x7f79c00cb250 2023-10-14T12:29:06.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.159+0000 7f79b6ffd640 1 -- 172.21.15.64:0/1203815594 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f79c01f5d80 con 0x7f79c00cb250 2023-10-14T12:29:06.161 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:06.161 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:06.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79a406ae70 msgr2=0x7f79a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:06.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79a406ae70 0x7f79a406d330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79bc0010e0 tx=0x7f79bc009040 comp rx=0 tx=0).stop 2023-10-14T12:29:06.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 msgr2=0x7f79c00aef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:06.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00aef50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f79b0009890 tx=0x7f79b00046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 shutdown_connections 2023-10-14T12:29:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79a406ae70 0x7f79a406d330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79c015a8d0 0x7f79c00af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79c00cb250 0x7f79c00aef50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 --2- 172.21.15.64:0/1203815594 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79c00ca660 0x7f79c00c73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 >> 172.21.15.64:0/1203815594 conn(0x7f79c006a470 msgr2=0x7f79c00ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 shutdown_connections 2023-10-14T12:29:06.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.162+0000 7f79c70bb640 1 -- 172.21.15.64:0/1203815594 wait complete. 2023-10-14T12:29:06.181 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-14T12:29:06.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.411+0000 7f46bcfcc640 1 Processor -- start 2023-10-14T12:29:06.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.411+0000 7f46bcfcc640 1 -- start start 2023-10-14T12:29:06.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.412+0000 7f46bcfcc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:06.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.412+0000 7f46bcfcc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f46b8159cf0 0x7f46b80ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:06.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.412+0000 7f46bcfcc640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46b815a210 con 0x7f46b80aec10 2023-10-14T12:29:06.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.412+0000 7f46bcfcc640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46b80cb2d0 con 0x7f46b8159cf0 2023-10-14T12:29:06.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.412+0000 7f46bcfcc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80ccd40 con 0x7f46b8159910 2023-10-14T12:29:06.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b5d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f46b8159cf0 0x7f46b80ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:06.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b5d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f46b8159cf0 0x7f46b80ae6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37478/0 (socket says 172.21.15.64:37478) 2023-10-14T12:29:06.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b5d9b640 1 -- 172.21.15.64:0/2597548104 learned_addr learned my addr 172.21.15.64:0/2597548104 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b659c640 1 --2- 172.21.15.64:0/2597548104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b5d9b640 1 -- 172.21.15.64:0/2597548104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 msgr2=0x7f46b80cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b5d9b640 1 --2- 172.21.15.64:0/2597548104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80cad90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b5d9b640 1 -- 172.21.15.64:0/2597548104 >> v1:172.21.15.177:6789/0 conn(0x7f46b80aec10 legacy=0x7f46b80b1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.413+0000 7f46b5d9b640 1 -- 172.21.15.64:0/2597548104 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b815a4f0 con 0x7f46b8159cf0 2023-10-14T12:29:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.415+0000 7f46b5d9b640 1 --2- 172.21.15.64:0/2597548104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80ae6d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009870 tx=0x7f46ac02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0a8aedde276812 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.415+0000 7f46b559a640 1 -- 172.21.15.64:0/2597548104 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac0317c0 con 0x7f46b8159cf0 2023-10-14T12:29:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.415+0000 7f46b559a640 1 -- 172.21.15.64:0/2597548104 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46ac031920 con 0x7f46b8159cf0 2023-10-14T12:29:06.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.415+0000 7f46b559a640 1 -- 172.21.15.64:0/2597548104 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46ac031cb0 con 0x7f46b8159cf0 2023-10-14T12:29:06.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 -- 172.21.15.64:0/2597548104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 msgr2=0x7f46b80ae6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:06.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/2597548104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80ae6d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f46ac009870 tx=0x7f46ac02b860 comp rx=0 tx=0).stop 2023-10-14T12:29:06.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 -- 172.21.15.64:0/2597548104 shutdown_connections 2023-10-14T12:29:06.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/2597548104 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80ae6d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/2597548104 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 -- 172.21.15.64:0/2597548104 >> 172.21.15.64:0/2597548104 conn(0x7f46b80cc080 msgr2=0x7f46b80cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:06.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 -- 172.21.15.64:0/2597548104 shutdown_connections 2023-10-14T12:29:06.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.416+0000 7f46bcfcc640 1 -- 172.21.15.64:0/2597548104 wait complete. 2023-10-14T12:29:06.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.418+0000 7f46bcfcc640 1 Processor -- start 2023-10-14T12:29:06.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.418+0000 7f46bcfcc640 1 -- start start 2023-10-14T12:29:06.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46bcfcc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46b80aec10 0x7f46b80c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:06.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46bcfcc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:06.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46bcfcc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46bcfcc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b80c32d0 con 0x7f46b8159cf0 2023-10-14T12:29:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46bcfcc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8151bd0 con 0x7f46b80aec10 2023-10-14T12:29:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46bcfcc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46b8151330 con 0x7f46b8159910 2023-10-14T12:29:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46b6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:06.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46b6d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80c3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37482/0 (socket says 172.21.15.64:37482) 2023-10-14T12:29:06.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46b6d9d640 1 -- 172.21.15.64:0/3234938762 learned_addr learned my addr 172.21.15.64:0/3234938762 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:06.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46b659c640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46b80aec10 0x7f46b80c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.419+0000 7f46b5d9b640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46b6d9d640 1 -- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 msgr2=0x7f46b80c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46b6d9d640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80c3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46b6d9d640 1 -- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46b80aec10 msgr2=0x7f46b80c7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:06.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46b6d9d640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46b80aec10 0x7f46b80c7330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46b6d9d640 1 -- 172.21.15.64:0/3234938762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46ac0094d0 con 0x7f46b8159cf0 2023-10-14T12:29:06.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46b659c640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46b80aec10 0x7f46b80c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:06.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46b6d9d640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80c3ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b970 tx=0x7f46b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:06.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46a6ffd640 1 -- 172.21.15.64:0/3234938762 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000cb40 con 0x7f46b8159cf0 2023-10-14T12:29:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46a6ffd640 1 -- 172.21.15.64:0/3234938762 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46b000cca0 con 0x7f46b8159cf0 2023-10-14T12:29:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46a6ffd640 1 -- 172.21.15.64:0/3234938762 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0014680 con 0x7f46b8159cf0 2023-10-14T12:29:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46b8151610 con 0x7f46b8159cf0 2023-10-14T12:29:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.420+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46b8152080 con 0x7f46b8159cf0 2023-10-14T12:29:06.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.422+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46b80c3440 con 0x7f46b8159cf0 2023-10-14T12:29:06.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.423+0000 7f46a6ffd640 1 -- 172.21.15.64:0/3234938762 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f46b001d3b0 con 0x7f46b8159cf0 2023-10-14T12:29:06.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.424+0000 7f46a6ffd640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f469806ae70 0x7f469806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:06.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.424+0000 7f46a6ffd640 1 -- 172.21.15.64:0/3234938762 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f46b0089740 con 0x7f46b8159cf0 2023-10-14T12:29:06.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.424+0000 7f46b659c640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f469806ae70 0x7f469806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:06.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.425+0000 7f46b659c640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f469806ae70 0x7f469806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006fd0 tx=0x7f46a8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:06.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.428+0000 7f46a6ffd640 1 -- 172.21.15.64:0/3234938762 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f46b00544f0 con 0x7f46b8159cf0 2023-10-14T12:29:06.663 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.661+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f46b8073ef0 con 0x7f46b8159cf0 2023-10-14T12:29:06.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.819+0000 7f46a6ffd640 1 -- 172.21.15.64:0/3234938762 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f46b0057b10 con 0x7f46b8159cf0 2023-10-14T12:29:06.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f469806ae70 msgr2=0x7f469806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:06.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f469806ae70 0x7f469806d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f46a8006fd0 tx=0x7f46a8008040 comp rx=0 tx=0).stop 2023-10-14T12:29:06.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 msgr2=0x7f46b80c3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:06.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80c3ca0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b970 tx=0x7f46b000be30 comp rx=0 tx=0).stop 2023-10-14T12:29:06.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 shutdown_connections 2023-10-14T12:29:06.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f469806ae70 0x7f469806d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f46b8159cf0 0x7f46b80c3ca0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f46b8159910 0x7f46b80c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 --2- 172.21.15.64:0/3234938762 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f46b80aec10 0x7f46b80c7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:06.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.823+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 >> 172.21.15.64:0/3234938762 conn(0x7f46b80cc080 msgr2=0x7f46b8071a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:06.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.824+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 shutdown_connections 2023-10-14T12:29:06.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:06.824+0000 7f46bcfcc640 1 -- 172.21.15.64:0/3234938762 wait complete. 2023-10-14T12:29:06.846 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-10-14T12:29:06.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-14T12:29:07.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.075+0000 7fa3c9eda640 1 Processor -- start 2023-10-14T12:29:07.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.075+0000 7fa3c9eda640 1 -- start start 2023-10-14T12:29:07.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c9eda640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa3c4154d10 0x7fa3c40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:07.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c9eda640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa3c406d530 0x7fa3c40ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:07.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c9eda640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c41550f0 con 0x7fa3c40cee60 2023-10-14T12:29:07.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c9eda640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c40cf310 con 0x7fa3c4154d10 2023-10-14T12:29:07.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c9eda640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c406d940 con 0x7fa3c406d530 2023-10-14T12:29:07.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c8ed8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa3c4154d10 0x7fa3c40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:07.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c3fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fa3c40cee60 0x7fa3c406ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42470/0 (socket says 172.21.15.64:42470) 2023-10-14T12:29:07.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.076+0000 7fa3c3fff640 1 -- 172.21.15.64:0/830008495 learned_addr learned my addr 172.21.15.64:0/830008495 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:07.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.077+0000 7fa3c96d9640 1 --2- 172.21.15.64:0/830008495 >> v2:172.21.15.177:3300/0 conn(0x7fa3c406d530 0x7fa3c40ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:07.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.077+0000 7fa3c8ed8640 1 -- 172.21.15.64:0/830008495 >> v2:172.21.15.177:3300/0 conn(0x7fa3c406d530 msgr2=0x7fa3c40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:07.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.077+0000 7fa3c8ed8640 1 --2- 172.21.15.64:0/830008495 >> v2:172.21.15.177:3300/0 conn(0x7fa3c406d530 0x7fa3c40ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.077+0000 7fa3c8ed8640 1 -- 172.21.15.64:0/830008495 >> v1:172.21.15.64:6789/0 conn(0x7fa3c40cee60 legacy=0x7fa3c406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.077+0000 7fa3c8ed8640 1 -- 172.21.15.64:0/830008495 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c406db50 con 0x7fa3c4154d10 2023-10-14T12:29:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.077+0000 7fa3c37fe640 1 -- 172.21.15.64:0/830008495 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290609496 0 0) 0x7fa3c41550f0 con 0x7fa3c40cee60 2023-10-14T12:29:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.078+0000 7fa3c8ed8640 1 --2- 172.21.15.64:0/830008495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c40ce920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40c5560 tx=0x7fa3b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4388fcb91eed0459 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.078+0000 7fa3c37fe640 1 -- 172.21.15.64:0/830008495 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4031830 con 0x7fa3c4154d10 2023-10-14T12:29:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c37fe640 1 -- 172.21.15.64:0/830008495 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b4031990 con 0x7fa3c4154d10 2023-10-14T12:29:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c37fe640 1 -- 172.21.15.64:0/830008495 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4031d20 con 0x7fa3c4154d10 2023-10-14T12:29:07.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 -- 172.21.15.64:0/830008495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 msgr2=0x7fa3c40ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:07.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/830008495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c40ce920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3c40c5560 tx=0x7fa3b402b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 -- 172.21.15.64:0/830008495 shutdown_connections 2023-10-14T12:29:07.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/830008495 >> v2:172.21.15.177:3300/0 conn(0x7fa3c406d530 0x7fa3c40ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/830008495 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c40ce920 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 -- 172.21.15.64:0/830008495 >> 172.21.15.64:0/830008495 conn(0x7fa3c406a200 msgr2=0x7fa3c406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:07.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 -- 172.21.15.64:0/830008495 shutdown_connections 2023-10-14T12:29:07.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.079+0000 7fa3c9eda640 1 -- 172.21.15.64:0/830008495 wait complete. 2023-10-14T12:29:07.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.081+0000 7fa3c9eda640 1 Processor -- start 2023-10-14T12:29:07.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.081+0000 7fa3c9eda640 1 -- start start 2023-10-14T12:29:07.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.082+0000 7fa3c9eda640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c406d530 0x7fa3c415e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:07.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.082+0000 7fa3c9eda640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c40cee60 0x7fa3c41f0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:07.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.082+0000 7fa3c9eda640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c4154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:07.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.082+0000 7fa3c9eda640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41f0d60 con 0x7fa3c4154d10 2023-10-14T12:29:07.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.082+0000 7fa3c9eda640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41f34a0 con 0x7fa3c40cee60 2023-10-14T12:29:07.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.082+0000 7fa3c9eda640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41f3780 con 0x7fa3c406d530 2023-10-14T12:29:07.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c4154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:07.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c4154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37498/0 (socket says 172.21.15.64:37498) 2023-10-14T12:29:07.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 -- 172.21.15.64:0/3148684413 learned_addr learned my addr 172.21.15.64:0/3148684413 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:07.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c8ed8640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c406d530 0x7fa3c415e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:07.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c3fff640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c40cee60 0x7fa3c41f0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:07.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 -- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c406d530 msgr2=0x7fa3c415e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:07.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c406d530 0x7fa3c415e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 -- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c40cee60 msgr2=0x7fa3c41f0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:07.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c40cee60 0x7fa3c41f0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 -- 172.21.15.64:0/3148684413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b4009400 con 0x7fa3c4154d10 2023-10-14T12:29:07.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.083+0000 7fa3c96d9640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c4154050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00d5d0 tx=0x7fa3bc00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:07.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.084+0000 7fa3c17fa640 1 -- 172.21.15.64:0/3148684413 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0125f0 con 0x7fa3c4154d10 2023-10-14T12:29:07.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.084+0000 7fa3c17fa640 1 -- 172.21.15.64:0/3148684413 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc012770 con 0x7fa3c4154d10 2023-10-14T12:29:07.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.084+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c41f3a60 con 0x7fa3c4154d10 2023-10-14T12:29:07.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.084+0000 7fa3c17fa640 1 -- 172.21.15.64:0/3148684413 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc012b20 con 0x7fa3c4154d10 2023-10-14T12:29:07.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.084+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c41f4020 con 0x7fa3c4154d10 2023-10-14T12:29:07.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.085+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c404e9b0 con 0x7fa3c4154d10 2023-10-14T12:29:07.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.086+0000 7fa3c17fa640 1 -- 172.21.15.64:0/3148684413 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa3bc012c80 con 0x7fa3c4154d10 2023-10-14T12:29:07.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.088+0000 7fa3c17fa640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3a406ae70 0x7fa3a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:07.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.088+0000 7fa3c17fa640 1 -- 172.21.15.64:0/3148684413 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3bc089e70 con 0x7fa3c4154d10 2023-10-14T12:29:07.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.088+0000 7fa3c8ed8640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3a406ae70 0x7fa3a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:07.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.089+0000 7fa3c8ed8640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3a406ae70 0x7fa3a406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4036000 tx=0x7fa3b403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:07.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.093+0000 7fa3c17fa640 1 -- 172.21.15.64:0/3148684413 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa3bc054ba0 con 0x7fa3c4154d10 2023-10-14T12:29:07.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.330+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa3c40acf40 con 0x7fa3c4154d10 2023-10-14T12:29:07.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.823+0000 7fa3c17fa640 1 -- 172.21.15.64:0/3148684413 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa3bc0581c0 con 0x7fa3c4154d10 2023-10-14T12:29:07.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3a406ae70 msgr2=0x7fa3a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:07.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3a406ae70 0x7fa3a406d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3b4036000 tx=0x7fa3b403c040 comp rx=0 tx=0).stop 2023-10-14T12:29:07.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 msgr2=0x7fa3c4154050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:07.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c4154050 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00d5d0 tx=0x7fa3bc00da90 comp rx=0 tx=0).stop 2023-10-14T12:29:07.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 shutdown_connections 2023-10-14T12:29:07.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa3a406ae70 0x7fa3a406d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa3c4154d10 0x7fa3c4154050 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa3c40cee60 0x7fa3c41f0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 --2- 172.21.15.64:0/3148684413 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa3c406d530 0x7fa3c415e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:07.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.826+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 >> 172.21.15.64:0/3148684413 conn(0x7fa3c406a200 msgr2=0x7fa3c406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:07.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.827+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 shutdown_connections 2023-10-14T12:29:07.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:07.827+0000 7fa3c9eda640 1 -- 172.21.15.64:0/3148684413 wait complete. 2023-10-14T12:29:07.849 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-10-14T12:29:07.850 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:29:08.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.079+0000 7f6c47fff640 1 Processor -- start 2023-10-14T12:29:08.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.079+0000 7f6c47fff640 1 -- start start 2023-10-14T12:29:08.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 0x7f6c48167860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c47fff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c480b2f90 con 0x7f6c480d16a0 2023-10-14T12:29:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c47fff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c480d0320 con 0x7f6c4815c9d0 2023-10-14T12:29:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c47fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480d0600 con 0x7f6c480cf850 2023-10-14T12:29:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c467fc640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f6c480d16a0 0x7f6c480cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42482/0 (socket says 172.21.15.64:42482) 2023-10-14T12:29:08.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c467fc640 1 -- 172.21.15.64:0/1170547452 learned_addr learned my addr 172.21.15.64:0/1170547452 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:08.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c477fe640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 0x7f6c48167860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2622618772 0 0) 0x7f6c480b2f90 con 0x7f6c480d16a0 2023-10-14T12:29:08.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.081+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c34003520 con 0x7f6c480d16a0 2023-10-14T12:29:08.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1747221524 0 0) 0x7f6c34003520 con 0x7f6c480d16a0 2023-10-14T12:29:08.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 msgr2=0x7f6c48167860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:08.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 0x7f6c48167860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 >> v1:172.21.15.177:6789/0 conn(0x7f6c4815c9d0 legacy=0x7f6c480cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c480d08e0 con 0x7f6c480d16a0 2023-10-14T12:29:08.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f6c30001670 con 0x7f6c480d16a0 2023-10-14T12:29:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 >> v1:172.21.15.64:6789/0 conn(0x7f6c480d16a0 legacy=0x7f6c480cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c340039a0 0x7f6c34003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 0x7f6c340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c34004d00 0x7f6c34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c480d0600 con 0x7f6c34004d00 2023-10-14T12:29:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3400ba60 con 0x7f6c340039a0 2023-10-14T12:29:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3400bc20 con 0x7f6c480cf850 2023-10-14T12:29:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.082+0000 7f6c477fe640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c34004d00 0x7f6c34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c467fc640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 0x7f6c340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c46ffd640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c340039a0 0x7f6c34003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c477fe640 1 -- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 msgr2=0x7f6c340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c477fe640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c480cf850 0x7f6c340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c477fe640 1 -- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c340039a0 msgr2=0x7f6c34003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:08.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c477fe640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c340039a0 0x7f6c34003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c477fe640 1 -- 172.21.15.64:0/1170547452 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c34003520 con 0x7f6c34004d00 2023-10-14T12:29:08.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.083+0000 7f6c46ffd640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c340039a0 0x7f6c34003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:08.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.084+0000 7f6c477fe640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c34004d00 0x7f6c34005180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009a90 tx=0x7f6c340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c56289c07b21de server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:08.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.084+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4002c680 con 0x7f6c34004d00 2023-10-14T12:29:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.084+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c4002c7e0 con 0x7f6c34004d00 2023-10-14T12:29:08.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.084+0000 7f6c45ffb640 1 -- 172.21.15.64:0/1170547452 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c4002cb70 con 0x7f6c34004d00 2023-10-14T12:29:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.085+0000 7f6c47fff640 1 -- 172.21.15.64:0/1170547452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c34004d00 msgr2=0x7f6c34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.085+0000 7f6c47fff640 1 --2- 172.21.15.64:0/1170547452 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c34004d00 0x7f6c34005180 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6c40009a90 tx=0x7f6c340057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.085+0000 7f6c477fe640 1 -- 172.21.15.64:0/1170547452 reap_dead start 2023-10-14T12:29:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.085+0000 7f6c47fff640 1 -- 172.21.15.64:0/1170547452 shutdown_connections 2023-10-14T12:29:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.085+0000 7f6c47fff640 1 -- 172.21.15.64:0/1170547452 >> 172.21.15.64:0/1170547452 conn(0x7f6c4809bad0 msgr2=0x7f6c480d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.085+0000 7f6c47fff640 1 -- 172.21.15.64:0/1170547452 shutdown_connections 2023-10-14T12:29:08.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.085+0000 7f6c47fff640 1 -- 172.21.15.64:0/1170547452 wait complete. 2023-10-14T12:29:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.087+0000 7f6c47fff640 1 Processor -- start 2023-10-14T12:29:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.087+0000 7f6c47fff640 1 -- start start 2023-10-14T12:29:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34004d00 0x7f6c4815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c4815e6a0 0x7f6c4815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c47fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c481f2df0 0x7f6c4815ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c47fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4815e210 con 0x7f6c4815e6a0 2023-10-14T12:29:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c47fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4815d600 con 0x7f6c34004d00 2023-10-14T12:29:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c47fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4815d8e0 con 0x7f6c481f2df0 2023-10-14T12:29:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c4815e6a0 0x7f6c4815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c467fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c4815e6a0 0x7f6c4815ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37516/0 (socket says 172.21.15.64:37516) 2023-10-14T12:29:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.088+0000 7f6c467fc640 1 -- 172.21.15.64:0/2890983776 learned_addr learned my addr 172.21.15.64:0/2890983776 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c46ffd640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34004d00 0x7f6c4815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c477fe640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c481f2df0 0x7f6c4815ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c467fc640 1 -- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c481f2df0 msgr2=0x7f6c4815ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c467fc640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c481f2df0 0x7f6c4815ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c467fc640 1 -- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34004d00 msgr2=0x7f6c4815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c467fc640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34004d00 0x7f6c4815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c467fc640 1 -- 172.21.15.64:0/2890983776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c4815dbc0 con 0x7f6c4815e6a0 2023-10-14T12:29:08.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c46ffd640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34004d00 0x7f6c4815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c467fc640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c4815e6a0 0x7f6c4815ab40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000e8c0 tx=0x7f6c3000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c3ffff640 1 -- 172.21.15.64:0/2890983776 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000c8d0 con 0x7f6c4815e6a0 2023-10-14T12:29:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c3ffff640 1 -- 172.21.15.64:0/2890983776 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c3000ca30 con 0x7f6c4815e6a0 2023-10-14T12:29:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c4815dea0 con 0x7f6c4815e6a0 2023-10-14T12:29:08.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.089+0000 7f6c3ffff640 1 -- 172.21.15.64:0/2890983776 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3000cde0 con 0x7f6c4815e6a0 2023-10-14T12:29:08.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.090+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c4815b080 con 0x7f6c4815e6a0 2023-10-14T12:29:08.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.091+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c4804e9b0 con 0x7f6c4815e6a0 2023-10-14T12:29:08.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.092+0000 7f6c3ffff640 1 -- 172.21.15.64:0/2890983776 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c3001d460 con 0x7f6c4815e6a0 2023-10-14T12:29:08.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.093+0000 7f6c3ffff640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c2806ae70 0x7f6c2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.093+0000 7f6c3ffff640 1 -- 172.21.15.64:0/2890983776 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c30089a00 con 0x7f6c4815e6a0 2023-10-14T12:29:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.093+0000 7f6c46ffd640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c2806ae70 0x7f6c2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.094+0000 7f6c46ffd640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c2806ae70 0x7f6c2806d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007fd0 tx=0x7f6c38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:08.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.097+0000 7f6c3ffff640 1 -- 172.21.15.64:0/2890983776 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c300547b0 con 0x7f6c4815e6a0 2023-10-14T12:29:08.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.326+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c4815e350 con 0x7f6c4815e6a0 2023-10-14T12:29:08.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.327+0000 7f6c3ffff640 1 -- 172.21.15.64:0/2890983776 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f6c30001610 con 0x7f6c4815e6a0 2023-10-14T12:29:08.329 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:08.329 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:29:08.330 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:29:08.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.329+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c2806ae70 msgr2=0x7f6c2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.329+0000 7f6c47fff640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c2806ae70 0x7f6c2806d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6c38007fd0 tx=0x7f6c38009040 comp rx=0 tx=0).stop 2023-10-14T12:29:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.329+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c4815e6a0 msgr2=0x7f6c4815ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.329+0000 7f6c47fff640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c4815e6a0 0x7f6c4815ab40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6c3000e8c0 tx=0x7f6c3000ed80 comp rx=0 tx=0).stop 2023-10-14T12:29:08.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 shutdown_connections 2023-10-14T12:29:08.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c2806ae70 0x7f6c2806d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c481f2df0 0x7f6c4815ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c4815e6a0 0x7f6c4815ab40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 --2- 172.21.15.64:0/2890983776 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c34004d00 0x7f6c4815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 >> 172.21.15.64:0/2890983776 conn(0x7f6c4809bad0 msgr2=0x7f6c480ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:08.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 shutdown_connections 2023-10-14T12:29:08.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.330+0000 7f6c47fff640 1 -- 172.21.15.64:0/2890983776 wait complete. 2023-10-14T12:29:08.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:08.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.559+0000 7efecb59e640 1 Processor -- start 2023-10-14T12:29:08.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.559+0000 7efecb59e640 1 -- start start 2023-10-14T12:29:08.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efecb59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efecc15aa70 0x7efecc0d0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efecb59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc0cd760 0x7efecc0b0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efecb59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc0cee50 con 0x7efecc0afa00 2023-10-14T12:29:08.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efecb59e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc0cec40 con 0x7efecc15aa70 2023-10-14T12:29:08.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efecb59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc15ae50 con 0x7efecc0cd760 2023-10-14T12:29:08.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efeca59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efecc15aa70 0x7efecc0d0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efeca59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efecc15aa70 0x7efecc0d0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37522/0 (socket says 172.21.15.64:37522) 2023-10-14T12:29:08.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.560+0000 7efeca59c640 1 -- 172.21.15.64:0/1051451421 learned_addr learned my addr 172.21.15.64:0/1051451421 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:08.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.561+0000 7efecad9d640 1 --2- 172.21.15.64:0/1051451421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc0cd760 0x7efecc0b0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.561+0000 7efeca59c640 1 -- 172.21.15.64:0/1051451421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc0cd760 msgr2=0x7efecc0b0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:08.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.561+0000 7efeca59c640 1 --2- 172.21.15.64:0/1051451421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc0cd760 0x7efecc0b0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.561+0000 7efeca59c640 1 -- 172.21.15.64:0/1051451421 >> v1:172.21.15.64:6789/0 conn(0x7efecc0afa00 legacy=0x7efecc0cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:08.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.561+0000 7efeca59c640 1 -- 172.21.15.64:0/1051451421 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc0cf130 con 0x7efecc15aa70 2023-10-14T12:29:08.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.562+0000 7efeca59c640 1 --2- 172.21.15.64:0/1051451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc15aa70 0x7efecc0d0ec0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efebc009ed0 tx=0x7efebc02c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=559063cc9ecfdcfa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:08.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efec959a640 1 -- 172.21.15.64:0/1051451421 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc02cbd0 con 0x7efecc15aa70 2023-10-14T12:29:08.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efec959a640 1 -- 172.21.15.64:0/1051451421 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc02cd30 con 0x7efecc15aa70 2023-10-14T12:29:08.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efec959a640 1 -- 172.21.15.64:0/1051451421 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc02cea0 con 0x7efecc15aa70 2023-10-14T12:29:08.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 -- 172.21.15.64:0/1051451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc15aa70 msgr2=0x7efecc0d0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 --2- 172.21.15.64:0/1051451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc15aa70 0x7efecc0d0ec0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7efebc009ed0 tx=0x7efebc02c030 comp rx=0 tx=0).stop 2023-10-14T12:29:08.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 -- 172.21.15.64:0/1051451421 shutdown_connections 2023-10-14T12:29:08.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 --2- 172.21.15.64:0/1051451421 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc0cd760 0x7efecc0b0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 --2- 172.21.15.64:0/1051451421 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc15aa70 0x7efecc0d0ec0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 -- 172.21.15.64:0/1051451421 >> 172.21.15.64:0/1051451421 conn(0x7efecc0999a0 msgr2=0x7efecc0d0660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:08.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 -- 172.21.15.64:0/1051451421 shutdown_connections 2023-10-14T12:29:08.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.563+0000 7efecb59e640 1 -- 172.21.15.64:0/1051451421 wait complete. 2023-10-14T12:29:08.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.565+0000 7efecb59e640 1 Processor -- start 2023-10-14T12:29:08.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.565+0000 7efecb59e640 1 -- start start 2023-10-14T12:29:08.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.566+0000 7efecb59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc0afa00 0x7efecc1516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.566+0000 7efecb59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efecc0cd760 0x7efecc06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.566+0000 7efecb59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc15aa70 0x7efecc15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.566+0000 7efecb59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc151530 con 0x7efecc0afa00 2023-10-14T12:29:08.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.566+0000 7efecb59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc15d620 con 0x7efecc0cd760 2023-10-14T12:29:08.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.566+0000 7efecb59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc15de30 con 0x7efecc15aa70 2023-10-14T12:29:08.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.566+0000 7efeca59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc0afa00 0x7efecc1516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc0afa00 0x7efecc1516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37538/0 (socket says 172.21.15.64:37538) 2023-10-14T12:29:08.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 -- 172.21.15.64:0/1009992828 learned_addr learned my addr 172.21.15.64:0/1009992828 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:08.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 -- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc15aa70 msgr2=0x7efecc15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc15aa70 0x7efecc15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 -- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efecc0cd760 msgr2=0x7efecc06aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efec9d9b640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efecc0cd760 0x7efecc06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efecc0cd760 0x7efecc06aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 -- 172.21.15.64:0/1009992828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009b30 con 0x7efecc0afa00 2023-10-14T12:29:08.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.567+0000 7efeca59c640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc0afa00 0x7efecc1516d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efebc036040 tx=0x7efebc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:08.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.568+0000 7efec2ffd640 1 -- 172.21.15.64:0/1009992828 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc02cea0 con 0x7efecc0afa00 2023-10-14T12:29:08.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.568+0000 7efec2ffd640 1 -- 172.21.15.64:0/1009992828 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc009510 con 0x7efecc0afa00 2023-10-14T12:29:08.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.568+0000 7efec2ffd640 1 -- 172.21.15.64:0/1009992828 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc03e690 con 0x7efecc0afa00 2023-10-14T12:29:08.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.568+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc15d870 con 0x7efecc0afa00 2023-10-14T12:29:08.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.568+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc15baf0 con 0x7efecc0afa00 2023-10-14T12:29:08.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.569+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc04e9b0 con 0x7efecc0afa00 2023-10-14T12:29:08.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.570+0000 7efec2ffd640 1 -- 172.21.15.64:0/1009992828 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efebc03e7f0 con 0x7efecc0afa00 2023-10-14T12:29:08.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.571+0000 7efec2ffd640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efeac06ae70 0x7efeac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:08.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.571+0000 7efec2ffd640 1 -- 172.21.15.64:0/1009992828 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efebc0ac570 con 0x7efecc0afa00 2023-10-14T12:29:08.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.572+0000 7efec9d9b640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efeac06ae70 0x7efeac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:08.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.573+0000 7efec9d9b640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efeac06ae70 0x7efeac06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efecc09e5e0 tx=0x7efeb4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:08.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.576+0000 7efec2ffd640 1 -- 172.21.15.64:0/1009992828 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efebc077450 con 0x7efecc0afa00 2023-10-14T12:29:08.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.774+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efecc0d1570 con 0x7efecc0afa00 2023-10-14T12:29:08.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.777+0000 7efec2ffd640 1 -- 172.21.15.64:0/1009992828 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7efebc07aa70 con 0x7efecc0afa00 2023-10-14T12:29:08.780 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:08.780 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:08.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efeac06ae70 msgr2=0x7efeac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efeac06ae70 0x7efeac06d330 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7efecc09e5e0 tx=0x7efeb4009040 comp rx=0 tx=0).stop 2023-10-14T12:29:08.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc0afa00 msgr2=0x7efecc1516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:08.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc0afa00 0x7efecc1516d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7efebc036040 tx=0x7efebc004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:08.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 shutdown_connections 2023-10-14T12:29:08.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efeac06ae70 0x7efeac06d330 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efecc15aa70 0x7efecc15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efecc0cd760 0x7efecc06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 --2- 172.21.15.64:0/1009992828 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efecc0afa00 0x7efecc1516d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:08.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.780+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 >> 172.21.15.64:0/1009992828 conn(0x7efecc0999a0 msgr2=0x7efecc0b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:08.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.781+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 shutdown_connections 2023-10-14T12:29:08.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:08.781+0000 7efecb59e640 1 -- 172.21.15.64:0/1009992828 wait complete. 2023-10-14T12:29:08.802 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T12:29:08.805 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:29:09.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.026+0000 7f0e6f59e640 1 Processor -- start 2023-10-14T12:29:09.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.026+0000 7f0e6f59e640 1 -- start start 2023-10-14T12:29:09.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.028+0000 7f0e6f59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0e7015cba0 0x7f0e7015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.028+0000 7f0e6f59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7015d570 con 0x7f0e700cdd90 2023-10-14T12:29:09.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.028+0000 7f0e6f59e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e700ccd60 con 0x7f0e700cad30 2023-10-14T12:29:09.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.028+0000 7f0e6f59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7015cf80 con 0x7f0e7015cba0 2023-10-14T12:29:09.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.028+0000 7f0e67fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f0e700cdd90 0x7f0e700cc650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42510/0 (socket says 172.21.15.64:42510) 2023-10-14T12:29:09.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.028+0000 7f0e67fff640 1 -- 172.21.15.64:0/3162115011 learned_addr learned my addr 172.21.15.64:0/3162115011 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:09.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.028+0000 7f0e6e59c640 1 --2- 172.21.15.64:0/3162115011 >> v2:172.21.15.177:3300/0 conn(0x7f0e7015cba0 0x7f0e7015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765534606 0 0) 0x7f0e7015d570 con 0x7f0e700cdd90 2023-10-14T12:29:09.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e5c003520 con 0x7f0e700cdd90 2023-10-14T12:29:09.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 155338279 0 0) 0x7f0e5c003520 con 0x7f0e700cdd90 2023-10-14T12:29:09.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 >> v2:172.21.15.177:3300/0 conn(0x7f0e7015cba0 msgr2=0x7f0e7015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:09.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 --2- 172.21.15.64:0/3162115011 >> v2:172.21.15.177:3300/0 conn(0x7f0e7015cba0 0x7f0e7015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 >> v1:172.21.15.177:6789/0 conn(0x7f0e700cad30 legacy=0x7f0e701605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7015df40 con 0x7f0e700cdd90 2023-10-14T12:29:09.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f0e58001670 con 0x7f0e700cdd90 2023-10-14T12:29:09.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 >> v1:172.21.15.64:6789/0 conn(0x7f0e700cdd90 legacy=0x7f0e700cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c003970 0x7f0e5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e5c0047c0 0x7f0e5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c005180 0x7f0e5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7015cf80 con 0x7f0e5c005180 2023-10-14T12:29:09.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c00c020 con 0x7f0e5c003970 2023-10-14T12:29:09.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.029+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c00c1e0 con 0x7f0e5c0047c0 2023-10-14T12:29:09.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.030+0000 7f0e6ed9d640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c005180 0x7f0e5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.030+0000 7f0e6e59c640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c003970 0x7f0e5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.030+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3162115011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e5c0047c0 msgr2=0x7f0e5c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:09.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.030+0000 7f0e6ed9d640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e5c0047c0 0x7f0e5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.030+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3162115011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c003970 msgr2=0x7f0e5c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:09.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.030+0000 7f0e6ed9d640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c003970 0x7f0e5c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.030+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3162115011 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5c003520 con 0x7f0e5c005180 2023-10-14T12:29:09.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.031+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3162115011 reap_dead start 2023-10-14T12:29:09.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.031+0000 7f0e6ed9d640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c005180 0x7f0e5c00b980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e68001e50 tx=0x7f0e5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1033de09b99d5d84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:09.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.031+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68003b70 con 0x7f0e5c005180 2023-10-14T12:29:09.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e68003cf0 con 0x7f0e5c005180 2023-10-14T12:29:09.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6dd9b640 1 -- 172.21.15.64:0/3162115011 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68005310 con 0x7f0e5c005180 2023-10-14T12:29:09.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3162115011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c005180 msgr2=0x7f0e5c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c005180 0x7f0e5c00b980 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0e68001e50 tx=0x7f0e5c0057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3162115011 shutdown_connections 2023-10-14T12:29:09.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3162115011 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e5c005180 0x7f0e5c00b980 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3162115011 >> 172.21.15.64:0/3162115011 conn(0x7f0e7006a470 msgr2=0x7f0e700afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:09.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3162115011 shutdown_connections 2023-10-14T12:29:09.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.032+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3162115011 wait complete. 2023-10-14T12:29:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.034+0000 7f0e6f59e640 1 Processor -- start 2023-10-14T12:29:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.034+0000 7f0e6f59e640 1 -- start start 2023-10-14T12:29:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c005180 0x7f0e70156970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6f59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e7015eae0 0x7f0e70160950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6f59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e70160e90 0x7f0e700ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6f59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e70156eb0 con 0x7f0e70160e90 2023-10-14T12:29:09.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6f59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7015f840 con 0x7f0e5c005180 2023-10-14T12:29:09.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6f59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7015efa0 con 0x7f0e7015eae0 2023-10-14T12:29:09.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e70160e90 0x7f0e700ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e70160e90 0x7f0e700ade30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37552/0 (socket says 172.21.15.64:37552) 2023-10-14T12:29:09.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.035+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3281104162 learned_addr learned my addr 172.21.15.64:0/3281104162 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:09.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e67fff640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e7015eae0 0x7f0e70160950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6e59c640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c005180 0x7f0e70156970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e7015eae0 msgr2=0x7f0e70160950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6ed9d640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e7015eae0 0x7f0e70160950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c005180 msgr2=0x7f0e70156970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6ed9d640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c005180 0x7f0e70156970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6ed9d640 1 -- 172.21.15.64:0/3281104162 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7015f280 con 0x7f0e70160e90 2023-10-14T12:29:09.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6ed9d640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e70160e90 0x7f0e700ade30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e6802c060 tx=0x7f0e680014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:09.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e66ffd640 1 -- 172.21.15.64:0/3281104162 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68006d50 con 0x7f0e70160e90 2023-10-14T12:29:09.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e66ffd640 1 -- 172.21.15.64:0/3281104162 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e68003b80 con 0x7f0e70160e90 2023-10-14T12:29:09.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e66ffd640 1 -- 172.21.15.64:0/3281104162 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e68007270 con 0x7f0e70160e90 2023-10-14T12:29:09.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7015f560 con 0x7f0e70160e90 2023-10-14T12:29:09.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.036+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e700ae370 con 0x7f0e70160e90 2023-10-14T12:29:09.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.038+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e700b28d0 con 0x7f0e70160e90 2023-10-14T12:29:09.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.038+0000 7f0e66ffd640 1 -- 172.21.15.64:0/3281104162 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e680073d0 con 0x7f0e70160e90 2023-10-14T12:29:09.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.039+0000 7f0e66ffd640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e5006ae70 0x7f0e5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.039+0000 7f0e66ffd640 1 -- 172.21.15.64:0/3281104162 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e680aa8c0 con 0x7f0e70160e90 2023-10-14T12:29:09.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.040+0000 7f0e6e59c640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e5006ae70 0x7f0e5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.041+0000 7f0e6e59c640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e5006ae70 0x7f0e5006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e600098c0 tx=0x7f0e60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:09.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.043+0000 7f0e66ffd640 1 -- 172.21.15.64:0/3281104162 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e700b28d0 con 0x7f0e70160e90 2023-10-14T12:29:09.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.234+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0e70156eb0 con 0x7f0e5006ae70 2023-10-14T12:29:09.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.268+0000 7f0e66ffd640 1 -- 172.21.15.64:0/3281104162 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345174 (secure 0 0 0) 0x7f0e70156eb0 con 0x7f0e5006ae70 2023-10-14T12:29:09.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:09.277 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:29:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e5006ae70 msgr2=0x7f0e5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e5006ae70 0x7f0e5006d330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0e600098c0 tx=0x7f0e60008040 comp rx=0 tx=0).stop 2023-10-14T12:29:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e70160e90 msgr2=0x7f0e700ade30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e70160e90 0x7f0e700ade30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e6802c060 tx=0x7f0e680014a0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 shutdown_connections 2023-10-14T12:29:09.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e5006ae70 0x7f0e5006d330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e70160e90 0x7f0e700ade30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e7015eae0 0x7f0e70160950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 --2- 172.21.15.64:0/3281104162 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e5c005180 0x7f0e70156970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 >> 172.21.15.64:0/3281104162 conn(0x7f0e7006a470 msgr2=0x7f0e700afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:09.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 shutdown_connections 2023-10-14T12:29:09.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.275+0000 7f0e6f59e640 1 -- 172.21.15.64:0/3281104162 wait complete. 2023-10-14T12:29:09.296 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2023-10-14T12:29:07.731931+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594866,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219632,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755088,"statfs":{"total":773094113280,"available":772869210112,"internally_reserved":0,"allocated":3547136,"data_stored":2107628,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2088,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005748"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.913373+0000","last_change":"2023-10-14T12:28:46.080407+0000","last_active":"2023-10-14T12:28:51.913373+0000","last_peered":"2023-10-14T12:28:51.913373+0000","last_clean":"2023-10-14T12:28:51.913373+0000","last_became_active":"2023-10-14T12:28:46.080075+0000","last_became_peered":"2023-10-14T12:28:46.080075+0000","last_unstale":"2023-10-14T12:28:51.913373+0000","last_undegraded":"2023-10-14T12:28:51.913373+0000","last_fullsized":"2023-10-14T12:28:51.913373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:34:41.571338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762559+0000","last_change":"2023-10-14T12:28:46.798279+0000","last_active":"2023-10-14T12:28:51.762559+0000","last_peered":"2023-10-14T12:28:51.762559+0000","last_clean":"2023-10-14T12:28:51.762559+0000","last_became_active":"2023-10-14T12:28:46.797918+0000","last_became_peered":"2023-10-14T12:28:46.797918+0000","last_unstale":"2023-10-14T12:28:51.762559+0000","last_undegraded":"2023-10-14T12:28:51.762559+0000","last_fullsized":"2023-10-14T12:28:51.762559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765687+0000","last_change":"2023-10-14T12:28:51.919038+0000","last_active":"2023-10-14T12:28:52.765687+0000","last_peered":"2023-10-14T12:28:52.765687+0000","last_clean":"2023-10-14T12:28:52.765687+0000","last_became_active":"2023-10-14T12:28:51.917610+0000","last_became_peered":"2023-10-14T12:28:51.917610+0000","last_unstale":"2023-10-14T12:28:52.765687+0000","last_undegraded":"2023-10-14T12:28:52.765687+0000","last_fullsized":"2023-10-14T12:28:52.765687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:07.544233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762860+0000","last_change":"2023-10-14T12:28:46.085671+0000","last_active":"2023-10-14T12:28:51.762860+0000","last_peered":"2023-10-14T12:28:51.762860+0000","last_clean":"2023-10-14T12:28:51.762860+0000","last_became_active":"2023-10-14T12:28:46.085352+0000","last_became_peered":"2023-10-14T12:28:46.085352+0000","last_unstale":"2023-10-14T12:28:51.762860+0000","last_undegraded":"2023-10-14T12:28:51.762860+0000","last_fullsized":"2023-10-14T12:28:51.762860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908566+0000","last_change":"2023-10-14T12:28:46.797554+0000","last_active":"2023-10-14T12:28:51.908566+0000","last_peered":"2023-10-14T12:28:51.908566+0000","last_clean":"2023-10-14T12:28:51.908566+0000","last_became_active":"2023-10-14T12:28:46.794880+0000","last_became_peered":"2023-10-14T12:28:46.794880+0000","last_unstale":"2023-10-14T12:28:51.908566+0000","last_undegraded":"2023-10-14T12:28:51.908566+0000","last_fullsized":"2023-10-14T12:28:51.908566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:52.797863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748815+0000","last_change":"2023-10-14T12:28:51.142417+0000","last_active":"2023-10-14T12:28:53.748815+0000","last_peered":"2023-10-14T12:28:53.748815+0000","last_clean":"2023-10-14T12:28:53.748815+0000","last_became_active":"2023-10-14T12:28:51.141839+0000","last_became_peered":"2023-10-14T12:28:51.141839+0000","last_unstale":"2023-10-14T12:28:53.748815+0000","last_undegraded":"2023-10-14T12:28:53.748815+0000","last_fullsized":"2023-10-14T12:28:53.748815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:41.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903557+0000","last_change":"2023-10-14T12:28:46.086064+0000","last_active":"2023-10-14T12:28:51.903557+0000","last_peered":"2023-10-14T12:28:51.903557+0000","last_clean":"2023-10-14T12:28:51.903557+0000","last_became_active":"2023-10-14T12:28:46.083071+0000","last_became_peered":"2023-10-14T12:28:46.083071+0000","last_unstale":"2023-10-14T12:28:51.903557+0000","last_undegraded":"2023-10-14T12:28:51.903557+0000","last_fullsized":"2023-10-14T12:28:51.903557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922469+0000","last_change":"2023-10-14T12:28:46.784072+0000","last_active":"2023-10-14T12:28:51.922469+0000","last_peered":"2023-10-14T12:28:51.922469+0000","last_clean":"2023-10-14T12:28:51.922469+0000","last_became_active":"2023-10-14T12:28:46.783653+0000","last_became_peered":"2023-10-14T12:28:46.783653+0000","last_unstale":"2023-10-14T12:28:51.922469+0000","last_undegraded":"2023-10-14T12:28:51.922469+0000","last_fullsized":"2023-10-14T12:28:51.922469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749295+0000","last_change":"2023-10-14T12:28:51.141444+0000","last_active":"2023-10-14T12:28:53.749295+0000","last_peered":"2023-10-14T12:28:53.749295+0000","last_clean":"2023-10-14T12:28:53.749295+0000","last_became_active":"2023-10-14T12:28:51.140883+0000","last_became_peered":"2023-10-14T12:28:51.140883+0000","last_unstale":"2023-10-14T12:28:53.749295+0000","last_undegraded":"2023-10-14T12:28:53.749295+0000","last_fullsized":"2023-10-14T12:28:53.749295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902128+0000","last_change":"2023-10-14T12:28:46.090824+0000","last_active":"2023-10-14T12:28:51.902128+0000","last_peered":"2023-10-14T12:28:51.902128+0000","last_clean":"2023-10-14T12:28:51.902128+0000","last_became_active":"2023-10-14T12:28:46.090494+0000","last_became_peered":"2023-10-14T12:28:46.090494+0000","last_unstale":"2023-10-14T12:28:51.902128+0000","last_undegraded":"2023-10-14T12:28:51.902128+0000","last_fullsized":"2023-10-14T12:28:51.902128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922922+0000","last_change":"2023-10-14T12:28:46.795518+0000","last_active":"2023-10-14T12:28:51.922922+0000","last_peered":"2023-10-14T12:28:51.922922+0000","last_clean":"2023-10-14T12:28:51.922922+0000","last_became_active":"2023-10-14T12:28:46.794866+0000","last_became_peered":"2023-10-14T12:28:46.794866+0000","last_unstale":"2023-10-14T12:28:51.922922+0000","last_undegraded":"2023-10-14T12:28:51.922922+0000","last_fullsized":"2023-10-14T12:28:51.922922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748983+0000","last_change":"2023-10-14T12:28:51.145294+0000","last_active":"2023-10-14T12:28:53.748983+0000","last_peered":"2023-10-14T12:28:53.748983+0000","last_clean":"2023-10-14T12:28:53.748983+0000","last_became_active":"2023-10-14T12:28:51.144881+0000","last_became_peered":"2023-10-14T12:28:51.144881+0000","last_unstale":"2023-10-14T12:28:53.748983+0000","last_undegraded":"2023-10-14T12:28:53.748983+0000","last_fullsized":"2023-10-14T12:28:53.748983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.171951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763978+0000","last_change":"2023-10-14T12:28:46.787464+0000","last_active":"2023-10-14T12:28:51.763978+0000","last_peered":"2023-10-14T12:28:51.763978+0000","last_clean":"2023-10-14T12:28:51.763978+0000","last_became_active":"2023-10-14T12:28:46.787118+0000","last_became_peered":"2023-10-14T12:28:46.787118+0000","last_unstale":"2023-10-14T12:28:51.763978+0000","last_undegraded":"2023-10-14T12:28:51.763978+0000","last_fullsized":"2023-10-14T12:28:51.763978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901958+0000","last_change":"2023-10-14T12:28:46.080330+0000","last_active":"2023-10-14T12:28:51.901958+0000","last_peered":"2023-10-14T12:28:51.901958+0000","last_clean":"2023-10-14T12:28:51.901958+0000","last_became_active":"2023-10-14T12:28:46.079439+0000","last_became_peered":"2023-10-14T12:28:46.079439+0000","last_unstale":"2023-10-14T12:28:51.901958+0000","last_undegraded":"2023-10-14T12:28:51.901958+0000","last_fullsized":"2023-10-14T12:28:51.901958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:34.159395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.750153+0000","last_change":"2023-10-14T12:28:51.140074+0000","last_active":"2023-10-14T12:28:53.750153+0000","last_peered":"2023-10-14T12:28:53.750153+0000","last_clean":"2023-10-14T12:28:53.750153+0000","last_became_active":"2023-10-14T12:28:51.139545+0000","last_became_peered":"2023-10-14T12:28:51.139545+0000","last_unstale":"2023-10-14T12:28:53.750153+0000","last_undegraded":"2023-10-14T12:28:53.750153+0000","last_fullsized":"2023-10-14T12:28:53.750153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762014+0000","last_change":"2023-10-14T12:28:46.798887+0000","last_active":"2023-10-14T12:28:51.762014+0000","last_peered":"2023-10-14T12:28:51.762014+0000","last_clean":"2023-10-14T12:28:51.762014+0000","last_became_active":"2023-10-14T12:28:46.797610+0000","last_became_peered":"2023-10-14T12:28:46.797610+0000","last_unstale":"2023-10-14T12:28:51.762014+0000","last_undegraded":"2023-10-14T12:28:51.762014+0000","last_fullsized":"2023-10-14T12:28:51.762014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920774+0000","last_change":"2023-10-14T12:28:46.082663+0000","last_active":"2023-10-14T12:28:51.920774+0000","last_peered":"2023-10-14T12:28:51.920774+0000","last_clean":"2023-10-14T12:28:51.920774+0000","last_became_active":"2023-10-14T12:28:46.081809+0000","last_became_peered":"2023-10-14T12:28:46.081809+0000","last_unstale":"2023-10-14T12:28:51.920774+0000","last_undegraded":"2023-10-14T12:28:51.920774+0000","last_fullsized":"2023-10-14T12:28:51.920774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749519+0000","last_change":"2023-10-14T12:28:51.146584+0000","last_active":"2023-10-14T12:28:53.749519+0000","last_peered":"2023-10-14T12:28:53.749519+0000","last_clean":"2023-10-14T12:28:53.749519+0000","last_became_active":"2023-10-14T12:28:51.146146+0000","last_became_peered":"2023-10-14T12:28:51.146146+0000","last_unstale":"2023-10-14T12:28:53.749519+0000","last_undegraded":"2023-10-14T12:28:53.749519+0000","last_fullsized":"2023-10-14T12:28:53.749519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761572+0000","last_change":"2023-10-14T12:28:46.789261+0000","last_active":"2023-10-14T12:28:51.761572+0000","last_peered":"2023-10-14T12:28:51.761572+0000","last_clean":"2023-10-14T12:28:51.761572+0000","last_became_active":"2023-10-14T12:28:46.788031+0000","last_became_peered":"2023-10-14T12:28:46.788031+0000","last_unstale":"2023-10-14T12:28:51.761572+0000","last_undegraded":"2023-10-14T12:28:51.761572+0000","last_fullsized":"2023-10-14T12:28:51.761572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.918090+0000","last_change":"2023-10-14T12:28:46.079896+0000","last_active":"2023-10-14T12:28:51.918090+0000","last_peered":"2023-10-14T12:28:51.918090+0000","last_clean":"2023-10-14T12:28:51.918090+0000","last_became_active":"2023-10-14T12:28:46.079498+0000","last_became_peered":"2023-10-14T12:28:46.079498+0000","last_unstale":"2023-10-14T12:28:51.918090+0000","last_undegraded":"2023-10-14T12:28:51.918090+0000","last_fullsized":"2023-10-14T12:28:51.918090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549998+0000","last_change":"2023-10-14T12:28:51.923834+0000","last_active":"2023-10-14T12:28:54.549998+0000","last_peered":"2023-10-14T12:28:54.549998+0000","last_clean":"2023-10-14T12:28:54.549998+0000","last_became_active":"2023-10-14T12:28:51.916869+0000","last_became_peered":"2023-10-14T12:28:51.916869+0000","last_unstale":"2023-10-14T12:28:54.549998+0000","last_undegraded":"2023-10-14T12:28:54.549998+0000","last_fullsized":"2023-10-14T12:28:54.549998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765552+0000","last_change":"2023-10-14T12:28:46.786929+0000","last_active":"2023-10-14T12:28:51.765552+0000","last_peered":"2023-10-14T12:28:51.765552+0000","last_clean":"2023-10-14T12:28:51.765552+0000","last_became_active":"2023-10-14T12:28:46.785285+0000","last_became_peered":"2023-10-14T12:28:46.785285+0000","last_unstale":"2023-10-14T12:28:51.765552+0000","last_undegraded":"2023-10-14T12:28:51.765552+0000","last_fullsized":"2023-10-14T12:28:51.765552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:14.608032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901022+0000","last_change":"2023-10-14T12:28:46.085793+0000","last_active":"2023-10-14T12:28:51.901022+0000","last_peered":"2023-10-14T12:28:51.901022+0000","last_clean":"2023-10-14T12:28:51.901022+0000","last_became_active":"2023-10-14T12:28:46.085539+0000","last_became_peered":"2023-10-14T12:28:46.085539+0000","last_unstale":"2023-10-14T12:28:51.901022+0000","last_undegraded":"2023-10-14T12:28:51.901022+0000","last_fullsized":"2023-10-14T12:28:51.901022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749922+0000","last_change":"2023-10-14T12:28:51.142284+0000","last_active":"2023-10-14T12:28:53.749922+0000","last_peered":"2023-10-14T12:28:53.749922+0000","last_clean":"2023-10-14T12:28:53.749922+0000","last_became_active":"2023-10-14T12:28:51.141786+0000","last_became_peered":"2023-10-14T12:28:51.141786+0000","last_unstale":"2023-10-14T12:28:53.749922+0000","last_undegraded":"2023-10-14T12:28:53.749922+0000","last_fullsized":"2023-10-14T12:28:53.749922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908548+0000","last_change":"2023-10-14T12:28:46.784288+0000","last_active":"2023-10-14T12:28:51.908548+0000","last_peered":"2023-10-14T12:28:51.908548+0000","last_clean":"2023-10-14T12:28:51.908548+0000","last_became_active":"2023-10-14T12:28:46.783048+0000","last_became_peered":"2023-10-14T12:28:46.783048+0000","last_unstale":"2023-10-14T12:28:51.908548+0000","last_undegraded":"2023-10-14T12:28:51.908548+0000","last_fullsized":"2023-10-14T12:28:51.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:10.556463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766748+0000","last_change":"2023-10-14T12:28:46.077038+0000","last_active":"2023-10-14T12:28:51.766748+0000","last_peered":"2023-10-14T12:28:51.766748+0000","last_clean":"2023-10-14T12:28:51.766748+0000","last_became_active":"2023-10-14T12:28:46.075513+0000","last_became_peered":"2023-10-14T12:28:46.075513+0000","last_unstale":"2023-10-14T12:28:51.766748+0000","last_undegraded":"2023-10-14T12:28:51.766748+0000","last_fullsized":"2023-10-14T12:28:51.766748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748977+0000","last_change":"2023-10-14T12:28:51.911158+0000","last_active":"2023-10-14T12:28:53.748977+0000","last_peered":"2023-10-14T12:28:53.748977+0000","last_clean":"2023-10-14T12:28:53.748977+0000","last_became_active":"2023-10-14T12:28:51.910002+0000","last_became_peered":"2023-10-14T12:28:51.910002+0000","last_unstale":"2023-10-14T12:28:53.748977+0000","last_undegraded":"2023-10-14T12:28:53.748977+0000","last_fullsized":"2023-10-14T12:28:53.748977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:00.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763687+0000","last_change":"2023-10-14T12:28:46.796917+0000","last_active":"2023-10-14T12:28:51.763687+0000","last_peered":"2023-10-14T12:28:51.763687+0000","last_clean":"2023-10-14T12:28:51.763687+0000","last_became_active":"2023-10-14T12:28:46.796090+0000","last_became_peered":"2023-10-14T12:28:46.796090+0000","last_unstale":"2023-10-14T12:28:51.763687+0000","last_undegraded":"2023-10-14T12:28:51.763687+0000","last_fullsized":"2023-10-14T12:28:51.763687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920525+0000","last_change":"2023-10-14T12:28:46.072468+0000","last_active":"2023-10-14T12:28:51.920525+0000","last_peered":"2023-10-14T12:28:51.920525+0000","last_clean":"2023-10-14T12:28:51.920525+0000","last_became_active":"2023-10-14T12:28:46.071827+0000","last_became_peered":"2023-10-14T12:28:46.071827+0000","last_unstale":"2023-10-14T12:28:51.920525+0000","last_undegraded":"2023-10-14T12:28:51.920525+0000","last_fullsized":"2023-10-14T12:28:51.920525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765187+0000","last_change":"2023-10-14T12:28:51.903366+0000","last_active":"2023-10-14T12:28:52.765187+0000","last_peered":"2023-10-14T12:28:52.765187+0000","last_clean":"2023-10-14T12:28:52.765187+0000","last_became_active":"2023-10-14T12:28:51.902191+0000","last_became_peered":"2023-10-14T12:28:51.902191+0000","last_unstale":"2023-10-14T12:28:52.765187+0000","last_undegraded":"2023-10-14T12:28:52.765187+0000","last_fullsized":"2023-10-14T12:28:52.765187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920090+0000","last_change":"2023-10-14T12:28:46.786490+0000","last_active":"2023-10-14T12:28:51.920090+0000","last_peered":"2023-10-14T12:28:51.920090+0000","last_clean":"2023-10-14T12:28:51.920090+0000","last_became_active":"2023-10-14T12:28:46.785976+0000","last_became_peered":"2023-10-14T12:28:46.785976+0000","last_unstale":"2023-10-14T12:28:51.920090+0000","last_undegraded":"2023-10-14T12:28:51.920090+0000","last_fullsized":"2023-10-14T12:28:51.920090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905284+0000","last_change":"2023-10-14T12:28:46.087365+0000","last_active":"2023-10-14T12:28:51.905284+0000","last_peered":"2023-10-14T12:28:51.905284+0000","last_clean":"2023-10-14T12:28:51.905284+0000","last_became_active":"2023-10-14T12:28:46.087090+0000","last_became_peered":"2023-10-14T12:28:46.087090+0000","last_unstale":"2023-10-14T12:28:51.905284+0000","last_undegraded":"2023-10-14T12:28:51.905284+0000","last_fullsized":"2023-10-14T12:28:51.905284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409835+0000","last_change":"2023-10-14T12:28:51.909277+0000","last_active":"2023-10-14T12:28:54.409835+0000","last_peered":"2023-10-14T12:28:54.409835+0000","last_clean":"2023-10-14T12:28:54.409835+0000","last_became_active":"2023-10-14T12:28:51.907121+0000","last_became_peered":"2023-10-14T12:28:51.907121+0000","last_unstale":"2023-10-14T12:28:54.409835+0000","last_undegraded":"2023-10-14T12:28:54.409835+0000","last_fullsized":"2023-10-14T12:28:54.409835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:31.934707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923040+0000","last_change":"2023-10-14T12:28:46.805297+0000","last_active":"2023-10-14T12:28:51.923040+0000","last_peered":"2023-10-14T12:28:51.923040+0000","last_clean":"2023-10-14T12:28:51.923040+0000","last_became_active":"2023-10-14T12:28:46.805000+0000","last_became_peered":"2023-10-14T12:28:46.805000+0000","last_unstale":"2023-10-14T12:28:51.923040+0000","last_undegraded":"2023-10-14T12:28:51.923040+0000","last_fullsized":"2023-10-14T12:28:51.923040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920314+0000","last_change":"2023-10-14T12:28:46.078052+0000","last_active":"2023-10-14T12:28:51.920314+0000","last_peered":"2023-10-14T12:28:51.920314+0000","last_clean":"2023-10-14T12:28:51.920314+0000","last_became_active":"2023-10-14T12:28:46.077730+0000","last_became_peered":"2023-10-14T12:28:46.077730+0000","last_unstale":"2023-10-14T12:28:51.920314+0000","last_undegraded":"2023-10-14T12:28:51.920314+0000","last_fullsized":"2023-10-14T12:28:51.920314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549170+0000","last_change":"2023-10-14T12:28:51.141425+0000","last_active":"2023-10-14T12:28:54.549170+0000","last_peered":"2023-10-14T12:28:54.549170+0000","last_clean":"2023-10-14T12:28:54.549170+0000","last_became_active":"2023-10-14T12:28:51.140998+0000","last_became_peered":"2023-10-14T12:28:51.140998+0000","last_unstale":"2023-10-14T12:28:54.549170+0000","last_undegraded":"2023-10-14T12:28:54.549170+0000","last_fullsized":"2023-10-14T12:28:54.549170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766791+0000","last_change":"2023-10-14T12:28:46.791914+0000","last_active":"2023-10-14T12:28:51.766791+0000","last_peered":"2023-10-14T12:28:51.766791+0000","last_clean":"2023-10-14T12:28:51.766791+0000","last_became_active":"2023-10-14T12:28:46.790081+0000","last_became_peered":"2023-10-14T12:28:46.790081+0000","last_unstale":"2023-10-14T12:28:51.766791+0000","last_undegraded":"2023-10-14T12:28:51.766791+0000","last_fullsized":"2023-10-14T12:28:51.766791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:51.665543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919424+0000","last_change":"2023-10-14T12:28:46.087850+0000","last_active":"2023-10-14T12:28:51.919424+0000","last_peered":"2023-10-14T12:28:51.919424+0000","last_clean":"2023-10-14T12:28:51.919424+0000","last_became_active":"2023-10-14T12:28:46.087568+0000","last_became_peered":"2023-10-14T12:28:46.087568+0000","last_unstale":"2023-10-14T12:28:51.919424+0000","last_undegraded":"2023-10-14T12:28:51.919424+0000","last_fullsized":"2023-10-14T12:28:51.919424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:00.886203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549701+0000","last_change":"2023-10-14T12:28:51.140452+0000","last_active":"2023-10-14T12:28:54.549701+0000","last_peered":"2023-10-14T12:28:54.549701+0000","last_clean":"2023-10-14T12:28:54.549701+0000","last_became_active":"2023-10-14T12:28:51.140047+0000","last_became_peered":"2023-10-14T12:28:51.140047+0000","last_unstale":"2023-10-14T12:28:54.549701+0000","last_undegraded":"2023-10-14T12:28:54.549701+0000","last_fullsized":"2023-10-14T12:28:54.549701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.915866+0000","last_change":"2023-10-14T12:28:46.785632+0000","last_active":"2023-10-14T12:28:51.915866+0000","last_peered":"2023-10-14T12:28:51.915866+0000","last_clean":"2023-10-14T12:28:51.915866+0000","last_became_active":"2023-10-14T12:28:46.785306+0000","last_became_peered":"2023-10-14T12:28:46.785306+0000","last_unstale":"2023-10-14T12:28:51.915866+0000","last_undegraded":"2023-10-14T12:28:51.915866+0000","last_fullsized":"2023-10-14T12:28:51.915866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140904+0000","last_change":"2023-10-14T12:28:46.079395+0000","last_active":"2023-10-14T12:28:52.140904+0000","last_peered":"2023-10-14T12:28:52.140904+0000","last_clean":"2023-10-14T12:28:52.140904+0000","last_became_active":"2023-10-14T12:28:46.079066+0000","last_became_peered":"2023-10-14T12:28:46.079066+0000","last_unstale":"2023-10-14T12:28:52.140904+0000","last_undegraded":"2023-10-14T12:28:52.140904+0000","last_fullsized":"2023-10-14T12:28:52.140904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:14.299609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.550104+0000","last_change":"2023-10-14T12:28:51.146682+0000","last_active":"2023-10-14T12:28:54.550104+0000","last_peered":"2023-10-14T12:28:54.550104+0000","last_clean":"2023-10-14T12:28:54.550104+0000","last_became_active":"2023-10-14T12:28:51.146103+0000","last_became_peered":"2023-10-14T12:28:51.146103+0000","last_unstale":"2023-10-14T12:28:54.550104+0000","last_undegraded":"2023-10-14T12:28:54.550104+0000","last_fullsized":"2023-10-14T12:28:54.550104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906672+0000","last_change":"2023-10-14T12:28:46.787997+0000","last_active":"2023-10-14T12:28:51.906672+0000","last_peered":"2023-10-14T12:28:51.906672+0000","last_clean":"2023-10-14T12:28:51.906672+0000","last_became_active":"2023-10-14T12:28:46.787646+0000","last_became_peered":"2023-10-14T12:28:46.787646+0000","last_unstale":"2023-10-14T12:28:51.906672+0000","last_undegraded":"2023-10-14T12:28:51.906672+0000","last_fullsized":"2023-10-14T12:28:51.906672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:23.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901433+0000","last_change":"2023-10-14T12:28:46.088704+0000","last_active":"2023-10-14T12:28:51.901433+0000","last_peered":"2023-10-14T12:28:51.901433+0000","last_clean":"2023-10-14T12:28:51.901433+0000","last_became_active":"2023-10-14T12:28:46.088429+0000","last_became_peered":"2023-10-14T12:28:46.088429+0000","last_unstale":"2023-10-14T12:28:51.901433+0000","last_undegraded":"2023-10-14T12:28:51.901433+0000","last_fullsized":"2023-10-14T12:28:51.901433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:08.064671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.411094+0000","last_change":"2023-10-14T12:28:51.920214+0000","last_active":"2023-10-14T12:28:54.411094+0000","last_peered":"2023-10-14T12:28:54.411094+0000","last_clean":"2023-10-14T12:28:54.411094+0000","last_became_active":"2023-10-14T12:28:51.918279+0000","last_became_peered":"2023-10-14T12:28:51.918279+0000","last_unstale":"2023-10-14T12:28:54.411094+0000","last_undegraded":"2023-10-14T12:28:54.411094+0000","last_fullsized":"2023-10-14T12:28:54.411094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:32.336264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762038+0000","last_change":"2023-10-14T12:28:46.793764+0000","last_active":"2023-10-14T12:28:51.762038+0000","last_peered":"2023-10-14T12:28:51.762038+0000","last_clean":"2023-10-14T12:28:51.762038+0000","last_became_active":"2023-10-14T12:28:46.793460+0000","last_became_peered":"2023-10-14T12:28:46.793460+0000","last_unstale":"2023-10-14T12:28:51.762038+0000","last_undegraded":"2023-10-14T12:28:51.762038+0000","last_fullsized":"2023-10-14T12:28:51.762038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922056+0000","last_change":"2023-10-14T12:28:46.082037+0000","last_active":"2023-10-14T12:28:51.922056+0000","last_peered":"2023-10-14T12:28:51.922056+0000","last_clean":"2023-10-14T12:28:51.922056+0000","last_became_active":"2023-10-14T12:28:46.081174+0000","last_became_peered":"2023-10-14T12:28:46.081174+0000","last_unstale":"2023-10-14T12:28:51.922056+0000","last_undegraded":"2023-10-14T12:28:51.922056+0000","last_fullsized":"2023-10-14T12:28:51.922056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901828+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:28:51.901828+0000","last_peered":"2023-10-14T12:28:51.901828+0000","last_clean":"2023-10-14T12:28:51.901828+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:28:51.901828+0000","last_undegraded":"2023-10-14T12:28:51.901828+0000","last_fullsized":"2023-10-14T12:28:51.901828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.768326+0000","last_change":"2023-10-14T12:28:51.910300+0000","last_active":"2023-10-14T12:28:52.768326+0000","last_peered":"2023-10-14T12:28:52.768326+0000","last_clean":"2023-10-14T12:28:52.768326+0000","last_became_active":"2023-10-14T12:28:51.909121+0000","last_became_peered":"2023-10-14T12:28:51.909121+0000","last_unstale":"2023-10-14T12:28:52.768326+0000","last_undegraded":"2023-10-14T12:28:52.768326+0000","last_fullsized":"2023-10-14T12:28:52.768326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:43.101212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902148+0000","last_change":"2023-10-14T12:28:46.801572+0000","last_active":"2023-10-14T12:28:51.902148+0000","last_peered":"2023-10-14T12:28:51.902148+0000","last_clean":"2023-10-14T12:28:51.902148+0000","last_became_active":"2023-10-14T12:28:46.801273+0000","last_became_peered":"2023-10-14T12:28:46.801273+0000","last_unstale":"2023-10-14T12:28:51.902148+0000","last_undegraded":"2023-10-14T12:28:51.902148+0000","last_fullsized":"2023-10-14T12:28:51.902148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.142466+0000","last_change":"2023-10-14T12:28:46.089021+0000","last_active":"2023-10-14T12:28:52.142466+0000","last_peered":"2023-10-14T12:28:52.142466+0000","last_clean":"2023-10-14T12:28:52.142466+0000","last_became_active":"2023-10-14T12:28:46.088640+0000","last_became_peered":"2023-10-14T12:28:46.088640+0000","last_unstale":"2023-10-14T12:28:52.142466+0000","last_undegraded":"2023-10-14T12:28:52.142466+0000","last_fullsized":"2023-10-14T12:28:52.142466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:07:19.614243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766407+0000","last_change":"2023-10-14T12:28:51.909391+0000","last_active":"2023-10-14T12:28:52.766407+0000","last_peered":"2023-10-14T12:28:52.766407+0000","last_clean":"2023-10-14T12:28:52.766407+0000","last_became_active":"2023-10-14T12:28:51.908099+0000","last_became_peered":"2023-10-14T12:28:51.908099+0000","last_unstale":"2023-10-14T12:28:52.766407+0000","last_undegraded":"2023-10-14T12:28:52.766407+0000","last_fullsized":"2023-10-14T12:28:52.766407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:28.364649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922641+0000","last_change":"2023-10-14T12:28:46.800329+0000","last_active":"2023-10-14T12:28:51.922641+0000","last_peered":"2023-10-14T12:28:51.922641+0000","last_clean":"2023-10-14T12:28:51.922641+0000","last_became_active":"2023-10-14T12:28:46.800007+0000","last_became_peered":"2023-10-14T12:28:46.800007+0000","last_unstale":"2023-10-14T12:28:51.922641+0000","last_undegraded":"2023-10-14T12:28:51.922641+0000","last_fullsized":"2023-10-14T12:28:51.922641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921828+0000","last_change":"2023-10-14T12:28:46.078949+0000","last_active":"2023-10-14T12:28:51.921828+0000","last_peered":"2023-10-14T12:28:51.921828+0000","last_clean":"2023-10-14T12:28:51.921828+0000","last_became_active":"2023-10-14T12:28:46.078670+0000","last_became_peered":"2023-10-14T12:28:46.078670+0000","last_unstale":"2023-10-14T12:28:51.921828+0000","last_undegraded":"2023-10-14T12:28:51.921828+0000","last_fullsized":"2023-10-14T12:28:51.921828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409867+0000","last_change":"2023-10-14T12:28:51.150655+0000","last_active":"2023-10-14T12:28:54.409867+0000","last_peered":"2023-10-14T12:28:54.409867+0000","last_clean":"2023-10-14T12:28:54.409867+0000","last_became_active":"2023-10-14T12:28:51.150108+0000","last_became_peered":"2023-10-14T12:28:51.150108+0000","last_unstale":"2023-10-14T12:28:54.409867+0000","last_undegraded":"2023-10-14T12:28:54.409867+0000","last_fullsized":"2023-10-14T12:28:54.409867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:26.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905515+0000","last_change":"2023-10-14T12:28:46.799576+0000","last_active":"2023-10-14T12:28:51.905515+0000","last_peered":"2023-10-14T12:28:51.905515+0000","last_clean":"2023-10-14T12:28:51.905515+0000","last_became_active":"2023-10-14T12:28:46.798883+0000","last_became_peered":"2023-10-14T12:28:46.798883+0000","last_unstale":"2023-10-14T12:28:51.905515+0000","last_undegraded":"2023-10-14T12:28:51.905515+0000","last_fullsized":"2023-10-14T12:28:51.905515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:44.311419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141623+0000","last_change":"2023-10-14T12:28:46.082303+0000","last_active":"2023-10-14T12:28:52.141623+0000","last_peered":"2023-10-14T12:28:52.141623+0000","last_clean":"2023-10-14T12:28:52.141623+0000","last_became_active":"2023-10-14T12:28:46.081916+0000","last_became_peered":"2023-10-14T12:28:46.081916+0000","last_unstale":"2023-10-14T12:28:52.141623+0000","last_undegraded":"2023-10-14T12:28:52.141623+0000","last_fullsized":"2023-10-14T12:28:52.141623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:58.702563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765960+0000","last_change":"2023-10-14T12:28:51.922025+0000","last_active":"2023-10-14T12:28:52.765960+0000","last_peered":"2023-10-14T12:28:52.765960+0000","last_clean":"2023-10-14T12:28:52.765960+0000","last_became_active":"2023-10-14T12:28:51.918049+0000","last_became_peered":"2023-10-14T12:28:51.918049+0000","last_unstale":"2023-10-14T12:28:52.765960+0000","last_undegraded":"2023-10-14T12:28:52.765960+0000","last_fullsized":"2023-10-14T12:28:52.765960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905811+0000","last_change":"2023-10-14T12:28:46.795831+0000","last_active":"2023-10-14T12:28:51.905811+0000","last_peered":"2023-10-14T12:28:51.905811+0000","last_clean":"2023-10-14T12:28:51.905811+0000","last_became_active":"2023-10-14T12:28:46.795571+0000","last_became_peered":"2023-10-14T12:28:46.795571+0000","last_unstale":"2023-10-14T12:28:51.905811+0000","last_undegraded":"2023-10-14T12:28:51.905811+0000","last_fullsized":"2023-10-14T12:28:51.905811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:29.280284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766935+0000","last_change":"2023-10-14T12:28:46.084244+0000","last_active":"2023-10-14T12:28:51.766935+0000","last_peered":"2023-10-14T12:28:51.766935+0000","last_clean":"2023-10-14T12:28:51.766935+0000","last_became_active":"2023-10-14T12:28:46.083772+0000","last_became_peered":"2023-10-14T12:28:46.083772+0000","last_unstale":"2023-10-14T12:28:51.766935+0000","last_undegraded":"2023-10-14T12:28:51.766935+0000","last_fullsized":"2023-10-14T12:28:51.766935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748760+0000","last_change":"2023-10-14T12:28:51.141542+0000","last_active":"2023-10-14T12:28:53.748760+0000","last_peered":"2023-10-14T12:28:53.748760+0000","last_clean":"2023-10-14T12:28:53.748760+0000","last_became_active":"2023-10-14T12:28:51.141066+0000","last_became_peered":"2023-10-14T12:28:51.141066+0000","last_unstale":"2023-10-14T12:28:53.748760+0000","last_undegraded":"2023-10-14T12:28:53.748760+0000","last_fullsized":"2023-10-14T12:28:53.748760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902142+0000","last_change":"2023-10-14T12:28:46.799195+0000","last_active":"2023-10-14T12:28:51.902142+0000","last_peered":"2023-10-14T12:28:51.902142+0000","last_clean":"2023-10-14T12:28:51.902142+0000","last_became_active":"2023-10-14T12:28:46.798850+0000","last_became_peered":"2023-10-14T12:28:46.798850+0000","last_unstale":"2023-10-14T12:28:51.902142+0000","last_undegraded":"2023-10-14T12:28:51.902142+0000","last_fullsized":"2023-10-14T12:28:51.902142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140517+0000","last_change":"2023-10-14T12:28:46.074743+0000","last_active":"2023-10-14T12:28:52.140517+0000","last_peered":"2023-10-14T12:28:52.140517+0000","last_clean":"2023-10-14T12:28:52.140517+0000","last_became_active":"2023-10-14T12:28:46.074430+0000","last_became_peered":"2023-10-14T12:28:46.074430+0000","last_unstale":"2023-10-14T12:28:52.140517+0000","last_undegraded":"2023-10-14T12:28:52.140517+0000","last_fullsized":"2023-10-14T12:28:52.140517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:44.943766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410859+0000","last_change":"2023-10-14T12:28:51.147740+0000","last_active":"2023-10-14T12:28:54.410859+0000","last_peered":"2023-10-14T12:28:54.410859+0000","last_clean":"2023-10-14T12:28:54.410859+0000","last_became_active":"2023-10-14T12:28:51.147168+0000","last_became_peered":"2023-10-14T12:28:51.147168+0000","last_unstale":"2023-10-14T12:28:54.410859+0000","last_undegraded":"2023-10-14T12:28:54.410859+0000","last_fullsized":"2023-10-14T12:28:54.410859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:27.739547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763688+0000","last_change":"2023-10-14T12:28:46.796316+0000","last_active":"2023-10-14T12:28:51.763688+0000","last_peered":"2023-10-14T12:28:51.763688+0000","last_clean":"2023-10-14T12:28:51.763688+0000","last_became_active":"2023-10-14T12:28:46.795991+0000","last_became_peered":"2023-10-14T12:28:46.795991+0000","last_unstale":"2023-10-14T12:28:51.763688+0000","last_undegraded":"2023-10-14T12:28:51.763688+0000","last_fullsized":"2023-10-14T12:28:51.763688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763934+0000","last_change":"2023-10-14T12:28:46.078905+0000","last_active":"2023-10-14T12:28:51.763934+0000","last_peered":"2023-10-14T12:28:51.763934+0000","last_clean":"2023-10-14T12:28:51.763934+0000","last_became_active":"2023-10-14T12:28:46.078601+0000","last_became_peered":"2023-10-14T12:28:46.078601+0000","last_unstale":"2023-10-14T12:28:51.763934+0000","last_undegraded":"2023-10-14T12:28:51.763934+0000","last_fullsized":"2023-10-14T12:28:51.763934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767902+0000","last_change":"2023-10-14T12:28:51.912591+0000","last_active":"2023-10-14T12:28:52.767902+0000","last_peered":"2023-10-14T12:28:52.767902+0000","last_clean":"2023-10-14T12:28:52.767902+0000","last_became_active":"2023-10-14T12:28:51.911444+0000","last_became_peered":"2023-10-14T12:28:51.911444+0000","last_unstale":"2023-10-14T12:28:52.767902+0000","last_undegraded":"2023-10-14T12:28:52.767902+0000","last_fullsized":"2023-10-14T12:28:52.767902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:01.865763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901725+0000","last_change":"2023-10-14T12:28:46.794280+0000","last_active":"2023-10-14T12:28:51.901725+0000","last_peered":"2023-10-14T12:28:51.901725+0000","last_clean":"2023-10-14T12:28:51.901725+0000","last_became_active":"2023-10-14T12:28:46.794011+0000","last_became_peered":"2023-10-14T12:28:46.794011+0000","last_unstale":"2023-10-14T12:28:51.901725+0000","last_undegraded":"2023-10-14T12:28:51.901725+0000","last_fullsized":"2023-10-14T12:28:51.901725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921941+0000","last_change":"2023-10-14T12:28:46.087268+0000","last_active":"2023-10-14T12:28:51.921941+0000","last_peered":"2023-10-14T12:28:51.921941+0000","last_clean":"2023-10-14T12:28:51.921941+0000","last_became_active":"2023-10-14T12:28:46.086933+0000","last_became_peered":"2023-10-14T12:28:46.086933+0000","last_unstale":"2023-10-14T12:28:51.921941+0000","last_undegraded":"2023-10-14T12:28:51.921941+0000","last_fullsized":"2023-10-14T12:28:51.921941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:49.643084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766946+0000","last_change":"2023-10-14T12:28:51.914988+0000","last_active":"2023-10-14T12:28:52.766946+0000","last_peered":"2023-10-14T12:28:52.766946+0000","last_clean":"2023-10-14T12:28:52.766946+0000","last_became_active":"2023-10-14T12:28:51.913882+0000","last_became_peered":"2023-10-14T12:28:51.913882+0000","last_unstale":"2023-10-14T12:28:52.766946+0000","last_undegraded":"2023-10-14T12:28:52.766946+0000","last_fullsized":"2023-10-14T12:28:52.766946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:08:30.117146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908486+0000","last_change":"2023-10-14T12:28:46.788853+0000","last_active":"2023-10-14T12:28:51.908486+0000","last_peered":"2023-10-14T12:28:51.908486+0000","last_clean":"2023-10-14T12:28:51.908486+0000","last_became_active":"2023-10-14T12:28:46.788458+0000","last_became_peered":"2023-10-14T12:28:46.788458+0000","last_unstale":"2023-10-14T12:28:51.908486+0000","last_undegraded":"2023-10-14T12:28:51.908486+0000","last_fullsized":"2023-10-14T12:28:51.908486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:34:10.344432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908891+0000","last_change":"2023-10-14T12:28:46.076853+0000","last_active":"2023-10-14T12:28:51.908891+0000","last_peered":"2023-10-14T12:28:51.908891+0000","last_clean":"2023-10-14T12:28:51.908891+0000","last_became_active":"2023-10-14T12:28:46.076541+0000","last_became_peered":"2023-10-14T12:28:46.076541+0000","last_unstale":"2023-10-14T12:28:51.908891+0000","last_undegraded":"2023-10-14T12:28:51.908891+0000","last_fullsized":"2023-10-14T12:28:51.908891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:17.061278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769108+0000","last_change":"2023-10-14T12:28:51.920296+0000","last_active":"2023-10-14T12:28:52.769108+0000","last_peered":"2023-10-14T12:28:52.769108+0000","last_clean":"2023-10-14T12:28:52.769108+0000","last_became_active":"2023-10-14T12:28:51.917580+0000","last_became_peered":"2023-10-14T12:28:51.917580+0000","last_unstale":"2023-10-14T12:28:52.769108+0000","last_undegraded":"2023-10-14T12:28:52.769108+0000","last_fullsized":"2023-10-14T12:28:52.769108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903467+0000","last_change":"2023-10-14T12:28:46.801997+0000","last_active":"2023-10-14T12:28:51.903467+0000","last_peered":"2023-10-14T12:28:51.903467+0000","last_clean":"2023-10-14T12:28:51.903467+0000","last_became_active":"2023-10-14T12:28:46.801720+0000","last_became_peered":"2023-10-14T12:28:46.801720+0000","last_unstale":"2023-10-14T12:28:51.903467+0000","last_undegraded":"2023-10-14T12:28:51.903467+0000","last_fullsized":"2023-10-14T12:28:51.903467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'9","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:59.248401+0000","last_change":"2023-10-14T12:28:46.076997+0000","last_active":"2023-10-14T12:28:59.248401+0000","last_peered":"2023-10-14T12:28:59.248401+0000","last_clean":"2023-10-14T12:28:59.248401+0000","last_became_active":"2023-10-14T12:28:46.076345+0000","last_became_peered":"2023-10-14T12:28:46.076345+0000","last_unstale":"2023-10-14T12:28:59.248401+0000","last_undegraded":"2023-10-14T12:28:59.248401+0000","last_fullsized":"2023-10-14T12:28:59.248401+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3700,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549272+0000","last_change":"2023-10-14T12:28:51.138516+0000","last_active":"2023-10-14T12:28:54.549272+0000","last_peered":"2023-10-14T12:28:54.549272+0000","last_clean":"2023-10-14T12:28:54.549272+0000","last_became_active":"2023-10-14T12:28:51.137516+0000","last_became_peered":"2023-10-14T12:28:51.137516+0000","last_unstale":"2023-10-14T12:28:54.549272+0000","last_undegraded":"2023-10-14T12:28:54.549272+0000","last_fullsized":"2023-10-14T12:28:54.549272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767066+0000","last_change":"2023-10-14T12:28:46.792271+0000","last_active":"2023-10-14T12:28:51.767066+0000","last_peered":"2023-10-14T12:28:51.767066+0000","last_clean":"2023-10-14T12:28:51.767066+0000","last_became_active":"2023-10-14T12:28:46.789471+0000","last_became_peered":"2023-10-14T12:28:46.789471+0000","last_unstale":"2023-10-14T12:28:51.767066+0000","last_undegraded":"2023-10-14T12:28:51.767066+0000","last_fullsized":"2023-10-14T12:28:51.767066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:36.235202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921217+0000","last_change":"2023-10-14T12:28:46.088735+0000","last_active":"2023-10-14T12:28:51.921217+0000","last_peered":"2023-10-14T12:28:51.921217+0000","last_clean":"2023-10-14T12:28:51.921217+0000","last_became_active":"2023-10-14T12:28:46.088457+0000","last_became_peered":"2023-10-14T12:28:46.088457+0000","last_unstale":"2023-10-14T12:28:51.921217+0000","last_undegraded":"2023-10-14T12:28:51.921217+0000","last_fullsized":"2023-10-14T12:28:51.921217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749567+0000","last_change":"2023-10-14T12:28:51.139023+0000","last_active":"2023-10-14T12:28:53.749567+0000","last_peered":"2023-10-14T12:28:53.749567+0000","last_clean":"2023-10-14T12:28:53.749567+0000","last_became_active":"2023-10-14T12:28:51.138588+0000","last_became_peered":"2023-10-14T12:28:51.138588+0000","last_unstale":"2023-10-14T12:28:53.749567+0000","last_undegraded":"2023-10-14T12:28:53.749567+0000","last_fullsized":"2023-10-14T12:28:53.749567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.909074+0000","last_change":"2023-10-14T12:28:46.795155+0000","last_active":"2023-10-14T12:28:51.909074+0000","last_peered":"2023-10-14T12:28:51.909074+0000","last_clean":"2023-10-14T12:28:51.909074+0000","last_became_active":"2023-10-14T12:28:46.794637+0000","last_became_peered":"2023-10-14T12:28:46.794637+0000","last_unstale":"2023-10-14T12:28:51.909074+0000","last_undegraded":"2023-10-14T12:28:51.909074+0000","last_fullsized":"2023-10-14T12:28:51.909074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:28.917771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.086906+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.078677+0000","last_became_peered":"2023-10-14T12:28:46.078677+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765685+0000","last_change":"2023-10-14T12:28:51.150961+0000","last_active":"2023-10-14T12:28:52.765685+0000","last_peered":"2023-10-14T12:28:52.765685+0000","last_clean":"2023-10-14T12:28:52.765685+0000","last_became_active":"2023-10-14T12:28:51.147298+0000","last_became_peered":"2023-10-14T12:28:51.147298+0000","last_unstale":"2023-10-14T12:28:52.765685+0000","last_undegraded":"2023-10-14T12:28:52.765685+0000","last_fullsized":"2023-10-14T12:28:52.765685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:44.659889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922854+0000","last_change":"2023-10-14T12:28:46.791198+0000","last_active":"2023-10-14T12:28:51.922854+0000","last_peered":"2023-10-14T12:28:51.922854+0000","last_clean":"2023-10-14T12:28:51.922854+0000","last_became_active":"2023-10-14T12:28:46.790867+0000","last_became_peered":"2023-10-14T12:28:46.790867+0000","last_unstale":"2023-10-14T12:28:51.922854+0000","last_undegraded":"2023-10-14T12:28:51.922854+0000","last_fullsized":"2023-10-14T12:28:51.922854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766297+0000","last_change":"2023-10-14T12:28:46.082839+0000","last_active":"2023-10-14T12:28:51.766297+0000","last_peered":"2023-10-14T12:28:51.766297+0000","last_clean":"2023-10-14T12:28:51.766297+0000","last_became_active":"2023-10-14T12:28:46.082602+0000","last_became_peered":"2023-10-14T12:28:46.082602+0000","last_unstale":"2023-10-14T12:28:51.766297+0000","last_undegraded":"2023-10-14T12:28:51.766297+0000","last_fullsized":"2023-10-14T12:28:51.766297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:50.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765534+0000","last_change":"2023-10-14T12:28:51.907147+0000","last_active":"2023-10-14T12:28:52.765534+0000","last_peered":"2023-10-14T12:28:52.765534+0000","last_clean":"2023-10-14T12:28:52.765534+0000","last_became_active":"2023-10-14T12:28:51.905096+0000","last_became_peered":"2023-10-14T12:28:51.905096+0000","last_unstale":"2023-10-14T12:28:52.765534+0000","last_undegraded":"2023-10-14T12:28:52.765534+0000","last_fullsized":"2023-10-14T12:28:52.765534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410456+0000","last_change":"2023-10-14T12:28:51.924721+0000","last_active":"2023-10-14T12:28:54.410456+0000","last_peered":"2023-10-14T12:28:54.410456+0000","last_clean":"2023-10-14T12:28:54.410456+0000","last_became_active":"2023-10-14T12:28:51.922270+0000","last_became_peered":"2023-10-14T12:28:51.922270+0000","last_unstale":"2023-10-14T12:28:54.410456+0000","last_undegraded":"2023-10-14T12:28:54.410456+0000","last_fullsized":"2023-10-14T12:28:54.410456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:45.274534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.916174+0000","last_change":"2023-10-14T12:28:46.787783+0000","last_active":"2023-10-14T12:28:51.916174+0000","last_peered":"2023-10-14T12:28:51.916174+0000","last_clean":"2023-10-14T12:28:51.916174+0000","last_became_active":"2023-10-14T12:28:46.787485+0000","last_became_peered":"2023-10-14T12:28:46.787485+0000","last_unstale":"2023-10-14T12:28:51.916174+0000","last_undegraded":"2023-10-14T12:28:51.916174+0000","last_fullsized":"2023-10-14T12:28:51.916174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919246+0000","last_change":"2023-10-14T12:28:46.081339+0000","last_active":"2023-10-14T12:28:51.919246+0000","last_peered":"2023-10-14T12:28:51.919246+0000","last_clean":"2023-10-14T12:28:51.919246+0000","last_became_active":"2023-10-14T12:28:46.080996+0000","last_became_peered":"2023-10-14T12:28:46.080996+0000","last_unstale":"2023-10-14T12:28:51.919246+0000","last_undegraded":"2023-10-14T12:28:51.919246+0000","last_fullsized":"2023-10-14T12:28:51.919246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:02.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769101+0000","last_change":"2023-10-14T12:28:51.140428+0000","last_active":"2023-10-14T12:28:52.769101+0000","last_peered":"2023-10-14T12:28:52.769101+0000","last_clean":"2023-10-14T12:28:52.769101+0000","last_became_active":"2023-10-14T12:28:51.139878+0000","last_became_peered":"2023-10-14T12:28:51.139878+0000","last_unstale":"2023-10-14T12:28:52.769101+0000","last_undegraded":"2023-10-14T12:28:52.769101+0000","last_fullsized":"2023-10-14T12:28:52.769101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761342+0000","last_change":"2023-10-14T12:28:46.796221+0000","last_active":"2023-10-14T12:28:51.761342+0000","last_peered":"2023-10-14T12:28:51.761342+0000","last_clean":"2023-10-14T12:28:51.761342+0000","last_became_active":"2023-10-14T12:28:46.795708+0000","last_became_peered":"2023-10-14T12:28:46.795708+0000","last_unstale":"2023-10-14T12:28:51.761342+0000","last_undegraded":"2023-10-14T12:28:51.761342+0000","last_fullsized":"2023-10-14T12:28:51.761342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763958+0000","last_change":"2023-10-14T12:28:46.079635+0000","last_active":"2023-10-14T12:28:51.763958+0000","last_peered":"2023-10-14T12:28:51.763958+0000","last_clean":"2023-10-14T12:28:51.763958+0000","last_became_active":"2023-10-14T12:28:46.079237+0000","last_became_peered":"2023-10-14T12:28:46.079237+0000","last_unstale":"2023-10-14T12:28:51.763958+0000","last_undegraded":"2023-10-14T12:28:51.763958+0000","last_fullsized":"2023-10-14T12:28:51.763958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.764406+0000","last_change":"2023-10-14T12:28:46.082807+0000","last_active":"2023-10-14T12:28:51.764406+0000","last_peered":"2023-10-14T12:28:51.764406+0000","last_clean":"2023-10-14T12:28:51.764406+0000","last_became_active":"2023-10-14T12:28:46.082446+0000","last_became_peered":"2023-10-14T12:28:46.082446+0000","last_unstale":"2023-10-14T12:28:51.764406+0000","last_undegraded":"2023-10-14T12:28:51.764406+0000","last_fullsized":"2023-10-14T12:28:51.764406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908770+0000","last_change":"2023-10-14T12:28:46.789200+0000","last_active":"2023-10-14T12:28:51.908770+0000","last_peered":"2023-10-14T12:28:51.908770+0000","last_clean":"2023-10-14T12:28:51.908770+0000","last_became_active":"2023-10-14T12:28:46.788290+0000","last_became_peered":"2023-10-14T12:28:46.788290+0000","last_unstale":"2023-10-14T12:28:51.908770+0000","last_undegraded":"2023-10-14T12:28:51.908770+0000","last_fullsized":"2023-10-14T12:28:51.908770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:53:29.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.405050+0000","last_change":"2023-10-14T12:28:51.139776+0000","last_active":"2023-10-14T12:28:54.405050+0000","last_peered":"2023-10-14T12:28:54.405050+0000","last_clean":"2023-10-14T12:28:54.405050+0000","last_became_active":"2023-10-14T12:28:51.139357+0000","last_became_peered":"2023-10-14T12:28:51.139357+0000","last_unstale":"2023-10-14T12:28:54.405050+0000","last_undegraded":"2023-10-14T12:28:54.405050+0000","last_fullsized":"2023-10-14T12:28:54.405050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:32.967798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762275+0000","last_change":"2023-10-14T12:28:46.080941+0000","last_active":"2023-10-14T12:28:51.762275+0000","last_peered":"2023-10-14T12:28:51.762275+0000","last_clean":"2023-10-14T12:28:51.762275+0000","last_became_active":"2023-10-14T12:28:46.080441+0000","last_became_peered":"2023-10-14T12:28:46.080441+0000","last_unstale":"2023-10-14T12:28:51.762275+0000","last_undegraded":"2023-10-14T12:28:51.762275+0000","last_fullsized":"2023-10-14T12:28:51.762275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765820+0000","last_change":"2023-10-14T12:28:46.783353+0000","last_active":"2023-10-14T12:28:51.765820+0000","last_peered":"2023-10-14T12:28:51.765820+0000","last_clean":"2023-10-14T12:28:51.765820+0000","last_became_active":"2023-10-14T12:28:46.780547+0000","last_became_peered":"2023-10-14T12:28:46.780547+0000","last_unstale":"2023-10-14T12:28:51.765820+0000","last_undegraded":"2023-10-14T12:28:51.765820+0000","last_fullsized":"2023-10-14T12:28:51.765820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.312389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767132+0000","last_change":"2023-10-14T12:28:51.148240+0000","last_active":"2023-10-14T12:28:52.767132+0000","last_peered":"2023-10-14T12:28:52.767132+0000","last_clean":"2023-10-14T12:28:52.767132+0000","last_became_active":"2023-10-14T12:28:51.147866+0000","last_became_peered":"2023-10-14T12:28:51.147866+0000","last_unstale":"2023-10-14T12:28:52.767132+0000","last_undegraded":"2023-10-14T12:28:52.767132+0000","last_fullsized":"2023-10-14T12:28:52.767132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:58.023924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763203+0000","last_change":"2023-10-14T12:28:46.796117+0000","last_active":"2023-10-14T12:28:51.763203+0000","last_peered":"2023-10-14T12:28:51.763203+0000","last_clean":"2023-10-14T12:28:51.763203+0000","last_became_active":"2023-10-14T12:28:46.795584+0000","last_became_peered":"2023-10-14T12:28:46.795584+0000","last_unstale":"2023-10-14T12:28:51.763203+0000","last_undegraded":"2023-10-14T12:28:51.763203+0000","last_fullsized":"2023-10-14T12:28:51.763203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140779+0000","last_change":"2023-10-14T12:28:46.792780+0000","last_active":"2023-10-14T12:28:52.140779+0000","last_peered":"2023-10-14T12:28:52.140779+0000","last_clean":"2023-10-14T12:28:52.140779+0000","last_became_active":"2023-10-14T12:28:46.792468+0000","last_became_peered":"2023-10-14T12:28:46.792468+0000","last_unstale":"2023-10-14T12:28:52.140779+0000","last_undegraded":"2023-10-14T12:28:52.140779+0000","last_fullsized":"2023-10-14T12:28:52.140779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:12:50.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919258+0000","last_change":"2023-10-14T12:28:46.800621+0000","last_active":"2023-10-14T12:28:51.919258+0000","last_peered":"2023-10-14T12:28:51.919258+0000","last_clean":"2023-10-14T12:28:51.919258+0000","last_became_active":"2023-10-14T12:28:46.800259+0000","last_became_peered":"2023-10-14T12:28:46.800259+0000","last_unstale":"2023-10-14T12:28:51.919258+0000","last_undegraded":"2023-10-14T12:28:51.919258+0000","last_fullsized":"2023-10-14T12:28:51.919258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908609+0000","last_change":"2023-10-14T12:28:46.798651+0000","last_active":"2023-10-14T12:28:51.908609+0000","last_peered":"2023-10-14T12:28:51.908609+0000","last_clean":"2023-10-14T12:28:51.908609+0000","last_became_active":"2023-10-14T12:28:46.798154+0000","last_became_peered":"2023-10-14T12:28:46.798154+0000","last_unstale":"2023-10-14T12:28:51.908609+0000","last_undegraded":"2023-10-14T12:28:51.908609+0000","last_fullsized":"2023-10-14T12:28:51.908609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:51.310465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762274+0000","last_change":"2023-10-14T12:28:46.800534+0000","last_active":"2023-10-14T12:28:51.762274+0000","last_peered":"2023-10-14T12:28:51.762274+0000","last_clean":"2023-10-14T12:28:51.762274+0000","last_became_active":"2023-10-14T12:28:46.800209+0000","last_became_peered":"2023-10-14T12:28:46.800209+0000","last_unstale":"2023-10-14T12:28:51.762274+0000","last_undegraded":"2023-10-14T12:28:51.762274+0000","last_fullsized":"2023-10-14T12:28:51.762274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920892+0000","last_change":"2023-10-14T12:28:46.801224+0000","last_active":"2023-10-14T12:28:51.920892+0000","last_peered":"2023-10-14T12:28:51.920892+0000","last_clean":"2023-10-14T12:28:51.920892+0000","last_became_active":"2023-10-14T12:28:46.799754+0000","last_became_peered":"2023-10-14T12:28:46.799754+0000","last_unstale":"2023-10-14T12:28:51.920892+0000","last_undegraded":"2023-10-14T12:28:51.920892+0000","last_fullsized":"2023-10-14T12:28:51.920892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765879+0000","last_change":"2023-10-14T12:28:46.789306+0000","last_active":"2023-10-14T12:28:51.765879+0000","last_peered":"2023-10-14T12:28:51.765879+0000","last_clean":"2023-10-14T12:28:51.765879+0000","last_became_active":"2023-10-14T12:28:46.788994+0000","last_became_peered":"2023-10-14T12:28:46.788994+0000","last_unstale":"2023-10-14T12:28:51.765879+0000","last_undegraded":"2023-10-14T12:28:51.765879+0000","last_fullsized":"2023-10-14T12:28:51.765879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763488+0000","last_change":"2023-10-14T12:28:46.800979+0000","last_active":"2023-10-14T12:28:51.763488+0000","last_peered":"2023-10-14T12:28:51.763488+0000","last_clean":"2023-10-14T12:28:51.763488+0000","last_became_active":"2023-10-14T12:28:46.800583+0000","last_became_peered":"2023-10-14T12:28:46.800583+0000","last_unstale":"2023-10-14T12:28:51.763488+0000","last_undegraded":"2023-10-14T12:28:51.763488+0000","last_fullsized":"2023-10-14T12:28:51.763488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919108+0000","last_change":"2023-10-14T12:28:46.804560+0000","last_active":"2023-10-14T12:28:51.919108+0000","last_peered":"2023-10-14T12:28:51.919108+0000","last_clean":"2023-10-14T12:28:51.919108+0000","last_became_active":"2023-10-14T12:28:46.804313+0000","last_became_peered":"2023-10-14T12:28:46.804313+0000","last_unstale":"2023-10-14T12:28:51.919108+0000","last_undegraded":"2023-10-14T12:28:51.919108+0000","last_fullsized":"2023-10-14T12:28:51.919108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763776+0000","last_change":"2023-10-14T12:28:46.787411+0000","last_active":"2023-10-14T12:28:51.763776+0000","last_peered":"2023-10-14T12:28:51.763776+0000","last_clean":"2023-10-14T12:28:51.763776+0000","last_became_active":"2023-10-14T12:28:46.787097+0000","last_became_peered":"2023-10-14T12:28:46.787097+0000","last_unstale":"2023-10-14T12:28:51.763776+0000","last_undegraded":"2023-10-14T12:28:51.763776+0000","last_fullsized":"2023-10-14T12:28:51.763776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919180+0000","last_change":"2023-10-14T12:28:46.797642+0000","last_active":"2023-10-14T12:28:51.919180+0000","last_peered":"2023-10-14T12:28:51.919180+0000","last_clean":"2023-10-14T12:28:51.919180+0000","last_became_active":"2023-10-14T12:28:46.795817+0000","last_became_peered":"2023-10-14T12:28:46.795817+0000","last_unstale":"2023-10-14T12:28:51.919180+0000","last_undegraded":"2023-10-14T12:28:51.919180+0000","last_fullsized":"2023-10-14T12:28:51.919180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908111+0000","last_change":"2023-10-14T12:28:46.795955+0000","last_active":"2023-10-14T12:28:51.908111+0000","last_peered":"2023-10-14T12:28:51.908111+0000","last_clean":"2023-10-14T12:28:51.908111+0000","last_became_active":"2023-10-14T12:28:46.795662+0000","last_became_peered":"2023-10-14T12:28:46.795662+0000","last_unstale":"2023-10-14T12:28:51.908111+0000","last_undegraded":"2023-10-14T12:28:51.908111+0000","last_fullsized":"2023-10-14T12:28:51.908111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:25.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765436+0000","last_change":"2023-10-14T12:28:46.790373+0000","last_active":"2023-10-14T12:28:51.765436+0000","last_peered":"2023-10-14T12:28:51.765436+0000","last_clean":"2023-10-14T12:28:51.765436+0000","last_became_active":"2023-10-14T12:28:46.787302+0000","last_became_peered":"2023-10-14T12:28:46.787302+0000","last_unstale":"2023-10-14T12:28:51.765436+0000","last_undegraded":"2023-10-14T12:28:51.765436+0000","last_fullsized":"2023-10-14T12:28:51.765436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906592+0000","last_change":"2023-10-14T12:28:46.795080+0000","last_active":"2023-10-14T12:28:51.906592+0000","last_peered":"2023-10-14T12:28:51.906592+0000","last_clean":"2023-10-14T12:28:51.906592+0000","last_became_active":"2023-10-14T12:28:46.793929+0000","last_became_peered":"2023-10-14T12:28:46.793929+0000","last_unstale":"2023-10-14T12:28:51.906592+0000","last_undegraded":"2023-10-14T12:28:51.906592+0000","last_fullsized":"2023-10-14T12:28:51.906592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141500+0000","last_change":"2023-10-14T12:28:46.792079+0000","last_active":"2023-10-14T12:28:52.141500+0000","last_peered":"2023-10-14T12:28:52.141500+0000","last_clean":"2023-10-14T12:28:52.141500+0000","last_became_active":"2023-10-14T12:28:46.791050+0000","last_became_peered":"2023-10-14T12:28:46.791050+0000","last_unstale":"2023-10-14T12:28:52.141500+0000","last_undegraded":"2023-10-14T12:28:52.141500+0000","last_fullsized":"2023-10-14T12:28:52.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:09.407054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.792801+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.792421+0000","last_became_peered":"2023-10-14T12:28:46.792421+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922455+0000","last_change":"2023-10-14T12:28:46.792599+0000","last_active":"2023-10-14T12:28:51.922455+0000","last_peered":"2023-10-14T12:28:51.922455+0000","last_clean":"2023-10-14T12:28:51.922455+0000","last_became_active":"2023-10-14T12:28:46.792327+0000","last_became_peered":"2023-10-14T12:28:46.792327+0000","last_unstale":"2023-10-14T12:28:51.922455+0000","last_undegraded":"2023-10-14T12:28:51.922455+0000","last_fullsized":"2023-10-14T12:28:51.922455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.917660+0000","last_change":"2023-10-14T12:28:46.781418+0000","last_active":"2023-10-14T12:28:51.917660+0000","last_peered":"2023-10-14T12:28:51.917660+0000","last_clean":"2023-10-14T12:28:51.917660+0000","last_became_active":"2023-10-14T12:28:46.781029+0000","last_became_peered":"2023-10-14T12:28:46.781029+0000","last_unstale":"2023-10-14T12:28:51.917660+0000","last_undegraded":"2023-10-14T12:28:51.917660+0000","last_fullsized":"2023-10-14T12:28:51.917660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908191+0000","last_change":"2023-10-14T12:28:46.789406+0000","last_active":"2023-10-14T12:28:51.908191+0000","last_peered":"2023-10-14T12:28:51.908191+0000","last_clean":"2023-10-14T12:28:51.908191+0000","last_became_active":"2023-10-14T12:28:46.788816+0000","last_became_peered":"2023-10-14T12:28:46.788816+0000","last_unstale":"2023-10-14T12:28:51.908191+0000","last_undegraded":"2023-10-14T12:28:51.908191+0000","last_fullsized":"2023-10-14T12:28:51.908191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:51.781330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761766+0000","last_change":"2023-10-14T12:28:46.796885+0000","last_active":"2023-10-14T12:28:51.761766+0000","last_peered":"2023-10-14T12:28:51.761766+0000","last_clean":"2023-10-14T12:28:51.761766+0000","last_became_active":"2023-10-14T12:28:46.796301+0000","last_became_peered":"2023-10-14T12:28:46.796301+0000","last_unstale":"2023-10-14T12:28:51.761766+0000","last_undegraded":"2023-10-14T12:28:51.761766+0000","last_fullsized":"2023-10-14T12:28:51.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767000+0000","last_change":"2023-10-14T12:28:46.777441+0000","last_active":"2023-10-14T12:28:51.767000+0000","last_peered":"2023-10-14T12:28:51.767000+0000","last_clean":"2023-10-14T12:28:51.767000+0000","last_became_active":"2023-10-14T12:28:46.776829+0000","last_became_peered":"2023-10-14T12:28:46.776829+0000","last_unstale":"2023-10-14T12:28:51.767000+0000","last_undegraded":"2023-10-14T12:28:51.767000+0000","last_fullsized":"2023-10-14T12:28:51.767000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:26.687643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765557+0000","last_change":"2023-10-14T12:28:46.797878+0000","last_active":"2023-10-14T12:28:51.765557+0000","last_peered":"2023-10-14T12:28:51.765557+0000","last_clean":"2023-10-14T12:28:51.765557+0000","last_became_active":"2023-10-14T12:28:46.796270+0000","last_became_peered":"2023-10-14T12:28:46.796270+0000","last_unstale":"2023-10-14T12:28:51.765557+0000","last_undegraded":"2023-10-14T12:28:51.765557+0000","last_fullsized":"2023-10-14T12:28:51.765557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765711+0000","last_change":"2023-10-14T12:28:46.789943+0000","last_active":"2023-10-14T12:28:51.765711+0000","last_peered":"2023-10-14T12:28:51.765711+0000","last_clean":"2023-10-14T12:28:51.765711+0000","last_became_active":"2023-10-14T12:28:46.789674+0000","last_became_peered":"2023-10-14T12:28:46.789674+0000","last_unstale":"2023-10-14T12:28:51.765711+0000","last_undegraded":"2023-10-14T12:28:51.765711+0000","last_fullsized":"2023-10-14T12:28:51.765711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905479+0000","last_change":"2023-10-14T12:28:46.803906+0000","last_active":"2023-10-14T12:28:51.905479+0000","last_peered":"2023-10-14T12:28:51.905479+0000","last_clean":"2023-10-14T12:28:51.905479+0000","last_became_active":"2023-10-14T12:28:46.803546+0000","last_became_peered":"2023-10-14T12:28:46.803546+0000","last_unstale":"2023-10-14T12:28:51.905479+0000","last_undegraded":"2023-10-14T12:28:51.905479+0000","last_fullsized":"2023-10-14T12:28:51.905479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:56.121924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761095+0000","last_change":"2023-10-14T12:28:46.797087+0000","last_active":"2023-10-14T12:28:51.761095+0000","last_peered":"2023-10-14T12:28:51.761095+0000","last_clean":"2023-10-14T12:28:51.761095+0000","last_became_active":"2023-10-14T12:28:46.796131+0000","last_became_peered":"2023-10-14T12:28:46.796131+0000","last_unstale":"2023-10-14T12:28:51.761095+0000","last_undegraded":"2023-10-14T12:28:51.761095+0000","last_fullsized":"2023-10-14T12:28:51.761095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901832+0000","last_change":"2023-10-14T12:28:46.796853+0000","last_active":"2023-10-14T12:28:51.901832+0000","last_peered":"2023-10-14T12:28:51.901832+0000","last_clean":"2023-10-14T12:28:51.901832+0000","last_became_active":"2023-10-14T12:28:46.796587+0000","last_became_peered":"2023-10-14T12:28:46.796587+0000","last_unstale":"2023-10-14T12:28:51.901832+0000","last_undegraded":"2023-10-14T12:28:51.901832+0000","last_fullsized":"2023-10-14T12:28:51.901832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919066+0000","last_change":"2023-10-14T12:28:46.791836+0000","last_active":"2023-10-14T12:28:51.919066+0000","last_peered":"2023-10-14T12:28:51.919066+0000","last_clean":"2023-10-14T12:28:51.919066+0000","last_became_active":"2023-10-14T12:28:46.791576+0000","last_became_peered":"2023-10-14T12:28:46.791576+0000","last_unstale":"2023-10-14T12:28:51.919066+0000","last_undegraded":"2023-10-14T12:28:51.919066+0000","last_fullsized":"2023-10-14T12:28:51.919066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901570+0000","last_change":"2023-10-14T12:28:46.794780+0000","last_active":"2023-10-14T12:28:51.901570+0000","last_peered":"2023-10-14T12:28:51.901570+0000","last_clean":"2023-10-14T12:28:51.901570+0000","last_became_active":"2023-10-14T12:28:46.794505+0000","last_became_peered":"2023-10-14T12:28:46.794505+0000","last_unstale":"2023-10-14T12:28:51.901570+0000","last_undegraded":"2023-10-14T12:28:51.901570+0000","last_fullsized":"2023-10-14T12:28:51.901570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922495+0000","last_change":"2023-10-14T12:28:46.803988+0000","last_active":"2023-10-14T12:28:51.922495+0000","last_peered":"2023-10-14T12:28:51.922495+0000","last_clean":"2023-10-14T12:28:51.922495+0000","last_became_active":"2023-10-14T12:28:46.803738+0000","last_became_peered":"2023-10-14T12:28:46.803738+0000","last_unstale":"2023-10-14T12:28:51.922495+0000","last_undegraded":"2023-10-14T12:28:51.922495+0000","last_fullsized":"2023-10-14T12:28:51.922495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.907759+0000","last_change":"2023-10-14T12:28:46.794216+0000","last_active":"2023-10-14T12:28:51.907759+0000","last_peered":"2023-10-14T12:28:51.907759+0000","last_clean":"2023-10-14T12:28:51.907759+0000","last_became_active":"2023-10-14T12:28:46.792243+0000","last_became_peered":"2023-10-14T12:28:46.792243+0000","last_unstale":"2023-10-14T12:28:51.907759+0000","last_undegraded":"2023-10-14T12:28:51.907759+0000","last_fullsized":"2023-10-14T12:28:51.907759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:39:12.370839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920339+0000","last_change":"2023-10-14T12:28:46.792759+0000","last_active":"2023-10-14T12:28:51.920339+0000","last_peered":"2023-10-14T12:28:51.920339+0000","last_clean":"2023-10-14T12:28:51.920339+0000","last_became_active":"2023-10-14T12:28:46.791814+0000","last_became_peered":"2023-10-14T12:28:46.791814+0000","last_unstale":"2023-10-14T12:28:51.920339+0000","last_undegraded":"2023-10-14T12:28:51.920339+0000","last_fullsized":"2023-10-14T12:28:51.920339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.904779+0000","last_change":"2023-10-14T12:28:46.791353+0000","last_active":"2023-10-14T12:28:51.904779+0000","last_peered":"2023-10-14T12:28:51.904779+0000","last_clean":"2023-10-14T12:28:51.904779+0000","last_became_active":"2023-10-14T12:28:46.791059+0000","last_became_peered":"2023-10-14T12:28:46.791059+0000","last_unstale":"2023-10-14T12:28:51.904779+0000","last_undegraded":"2023-10-14T12:28:51.904779+0000","last_fullsized":"2023-10-14T12:28:51.904779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4498,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":8996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5269999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81999999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0569999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.321}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.448}]}]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2350000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.615}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8700000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542150,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.28}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.319}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.577}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.609}]}]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":114863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3089999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4590000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0649999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542150,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542151,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":114737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.375}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79000000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1279999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.405}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":0,"up_from":14,"seq":60129542150,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2110000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:29:09.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:29:09.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.571+0000 7f0d030ea640 1 Processor -- start 2023-10-14T12:29:09.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.571+0000 7f0d030ea640 1 -- start start 2023-10-14T12:29:09.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.573+0000 7f0d030ea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0ca660 0x7f0cfc0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.573+0000 7f0d030ea640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc15acb0 con 0x7f0cfc15a8d0 2023-10-14T12:29:09.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.573+0000 7f0d030ea640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cfc0c1c60 con 0x7f0cfc0cb250 2023-10-14T12:29:09.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.573+0000 7f0d030ea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cfc15e350 con 0x7f0cfc0ca660 2023-10-14T12:29:09.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.573+0000 7f0d020e8640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f0cfc15a8d0 0x7f0cfc0cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42518/0 (socket says 172.21.15.64:42518) 2023-10-14T12:29:09.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.573+0000 7f0d020e8640 1 -- 172.21.15.64:0/3010788042 learned_addr learned my addr 172.21.15.64:0/3010788042 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:09.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3291635266 0 0) 0x7f0cf8001290 con 0x7f0cfc15a8d0 2023-10-14T12:29:09.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d028e9640 1 --2- 172.21.15.64:0/3010788042 >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0ca660 0x7f0cfc0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ce8003520 con 0x7f0cfc15a8d0 2023-10-14T12:29:09.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3199853489 0 0) 0x7f0ce8003520 con 0x7f0cfc15a8d0 2023-10-14T12:29:09.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0ca660 msgr2=0x7f0cfc0c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:09.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 --2- 172.21.15.64:0/3010788042 >> v2:172.21.15.177:3300/0 conn(0x7f0cfc0ca660 0x7f0cfc0c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 >> v1:172.21.15.177:6789/0 conn(0x7f0cfc0cb250 legacy=0x7f0cfc0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc15e630 con 0x7f0cfc15a8d0 2023-10-14T12:29:09.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f0cf8001980 con 0x7f0cfc15a8d0 2023-10-14T12:29:09.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 >> v1:172.21.15.64:6789/0 conn(0x7f0cfc15a8d0 legacy=0x7f0cfc0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce8003970 0x7f0ce8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce80047c0 0x7f0ce8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ce8005180 0x7f0ce800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc15e350 con 0x7f0ce80047c0 2023-10-14T12:29:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce800c050 con 0x7f0ce8005180 2023-10-14T12:29:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.574+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce800c210 con 0x7f0ce8003970 2023-10-14T12:29:09.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d018e7640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce80047c0 0x7f0ce8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d020e8640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce8003970 0x7f0ce8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d018e7640 1 -- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce8003970 msgr2=0x7f0ce8003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d018e7640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce8003970 0x7f0ce8003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d018e7640 1 -- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ce8005180 msgr2=0x7f0ce800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:09.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d018e7640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0ce8005180 0x7f0ce800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d018e7640 1 -- 172.21.15.64:0/3010788042 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce8003520 con 0x7f0ce80047c0 2023-10-14T12:29:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d028e9640 1 -- 172.21.15.64:0/3010788042 reap_dead start 2023-10-14T12:29:09.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.575+0000 7f0d020e8640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce8003970 0x7f0ce8003db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:09.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.576+0000 7f0d018e7640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce80047c0 0x7f0ce8004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0cec001750 tx=0x7f0ce80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b40c4a4fd5973100 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:09.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.576+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0052d0 con 0x7f0ce80047c0 2023-10-14T12:29:09.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.576+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec02e050 con 0x7f0ce80047c0 2023-10-14T12:29:09.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d010e6640 1 -- 172.21.15.64:0/3010788042 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0035f0 con 0x7f0ce80047c0 2023-10-14T12:29:09.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d030ea640 1 -- 172.21.15.64:0/3010788042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce80047c0 msgr2=0x7f0ce8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d030ea640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce80047c0 0x7f0ce8004c40 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0cec001750 tx=0x7f0ce80057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d030ea640 1 -- 172.21.15.64:0/3010788042 shutdown_connections 2023-10-14T12:29:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d030ea640 1 --2- 172.21.15.64:0/3010788042 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0ce80047c0 0x7f0ce8004c40 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d030ea640 1 -- 172.21.15.64:0/3010788042 >> 172.21.15.64:0/3010788042 conn(0x7f0cfc06a470 msgr2=0x7f0cfc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:09.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d030ea640 1 -- 172.21.15.64:0/3010788042 shutdown_connections 2023-10-14T12:29:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.577+0000 7f0d030ea640 1 -- 172.21.15.64:0/3010788042 wait complete. 2023-10-14T12:29:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.579+0000 7f0d030ea640 1 Processor -- start 2023-10-14T12:29:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.579+0000 7f0d030ea640 1 -- start start 2023-10-14T12:29:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d030ea640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce80047c0 0x7f0cfc0c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d030ea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cfc1f6660 0x7f0cfc159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d030ea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0cc810 0x7f0cfc0ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d030ea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc1efeb0 con 0x7f0cfc1f6660 2023-10-14T12:29:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d030ea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc0cd1d0 con 0x7f0cfc0cc810 2023-10-14T12:29:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d030ea640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cfc1f2460 con 0x7f0ce80047c0 2023-10-14T12:29:09.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d018e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cfc1f6660 0x7f0cfc159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d018e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cfc1f6660 0x7f0cfc159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37562/0 (socket says 172.21.15.64:37562) 2023-10-14T12:29:09.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.580+0000 7f0d018e7640 1 -- 172.21.15.64:0/2678182644 learned_addr learned my addr 172.21.15.64:0/2678182644 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:09.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0d018e7640 1 -- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce80047c0 msgr2=0x7f0cfc0c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0d028e9640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0cc810 0x7f0cfc0ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0d018e7640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce80047c0 0x7f0cfc0c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0d018e7640 1 -- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0cc810 msgr2=0x7f0cfc0ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0d018e7640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0cc810 0x7f0cfc0ccc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0d018e7640 1 -- 172.21.15.64:0/2678182644 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cfc0c6d70 con 0x7f0cfc1f6660 2023-10-14T12:29:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0d018e7640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cfc1f6660 0x7f0cfc159470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000c00 tx=0x7f0cec001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:09.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0cf2ffd640 1 -- 172.21.15.64:0/2678182644 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec0076c0 con 0x7f0cfc1f6660 2023-10-14T12:29:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.581+0000 7f0cf2ffd640 1 -- 172.21.15.64:0/2678182644 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cec007a30 con 0x7f0cfc1f6660 2023-10-14T12:29:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.582+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cfc1f26b0 con 0x7f0cfc1f6660 2023-10-14T12:29:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.582+0000 7f0cf2ffd640 1 -- 172.21.15.64:0/2678182644 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cec006be0 con 0x7f0cfc1f6660 2023-10-14T12:29:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.582+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cfc1f2c70 con 0x7f0cfc1f6660 2023-10-14T12:29:09.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.583+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cfc04e9b0 con 0x7f0cfc1f6660 2023-10-14T12:29:09.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.584+0000 7f0cf2ffd640 1 -- 172.21.15.64:0/2678182644 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0cec006d40 con 0x7f0cfc1f6660 2023-10-14T12:29:09.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.585+0000 7f0cf2ffd640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0ce006ae70 0x7f0ce006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:09.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.585+0000 7f0cf2ffd640 1 -- 172.21.15.64:0/2678182644 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0cec0ab4b0 con 0x7f0cfc1f6660 2023-10-14T12:29:09.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.586+0000 7f0d020e8640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0ce006ae70 0x7f0ce006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:09.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.587+0000 7f0d020e8640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0ce006ae70 0x7f0ce006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000ef0 tx=0x7f0cf8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:09.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.589+0000 7f0cf2ffd640 1 -- 172.21.15.64:0/2678182644 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0cec0761d0 con 0x7f0cfc1f6660 2023-10-14T12:29:09.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.780+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0cfc15ebf0 con 0x7f0ce006ae70 2023-10-14T12:29:09.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.806+0000 7f0cf2ffd640 1 -- 172.21.15.64:0/2678182644 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345031 (secure 0 0 0) 0x7f0cf80018e0 con 0x7f0ce006ae70 2023-10-14T12:29:09.809 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:09.814 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:29:09.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0ce006ae70 msgr2=0x7f0ce006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0ce006ae70 0x7f0ce006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8000ef0 tx=0x7f0cf8009040 comp rx=0 tx=0).stop 2023-10-14T12:29:09.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cfc1f6660 msgr2=0x7f0cfc159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:09.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cfc1f6660 0x7f0cfc159470 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0cec000c00 tx=0x7f0cec001120 comp rx=0 tx=0).stop 2023-10-14T12:29:09.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 shutdown_connections 2023-10-14T12:29:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0ce006ae70 0x7f0ce006d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0cfc0cc810 0x7f0cfc0ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0cfc1f6660 0x7f0cfc159470 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 --2- 172.21.15.64:0/2678182644 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0ce80047c0 0x7f0cfc0c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:09.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.813+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 >> 172.21.15.64:0/2678182644 conn(0x7f0cfc06a470 msgr2=0x7f0cfc0af410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:09.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.814+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 shutdown_connections 2023-10-14T12:29:09.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:09.814+0000 7f0d030ea640 1 -- 172.21.15.64:0/2678182644 wait complete. 2023-10-14T12:29:09.835 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-10-14T12:29:09.732572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":211,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219632,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755088,"statfs":{"total":773094113280,"available":772869210112,"internally_reserved":0,"allocated":3547136,"data_stored":2107910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2229,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005259"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.913373+0000","last_change":"2023-10-14T12:28:46.080407+0000","last_active":"2023-10-14T12:28:51.913373+0000","last_peered":"2023-10-14T12:28:51.913373+0000","last_clean":"2023-10-14T12:28:51.913373+0000","last_became_active":"2023-10-14T12:28:46.080075+0000","last_became_peered":"2023-10-14T12:28:46.080075+0000","last_unstale":"2023-10-14T12:28:51.913373+0000","last_undegraded":"2023-10-14T12:28:51.913373+0000","last_fullsized":"2023-10-14T12:28:51.913373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:34:41.571338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762559+0000","last_change":"2023-10-14T12:28:46.798279+0000","last_active":"2023-10-14T12:28:51.762559+0000","last_peered":"2023-10-14T12:28:51.762559+0000","last_clean":"2023-10-14T12:28:51.762559+0000","last_became_active":"2023-10-14T12:28:46.797918+0000","last_became_peered":"2023-10-14T12:28:46.797918+0000","last_unstale":"2023-10-14T12:28:51.762559+0000","last_undegraded":"2023-10-14T12:28:51.762559+0000","last_fullsized":"2023-10-14T12:28:51.762559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765687+0000","last_change":"2023-10-14T12:28:51.919038+0000","last_active":"2023-10-14T12:28:52.765687+0000","last_peered":"2023-10-14T12:28:52.765687+0000","last_clean":"2023-10-14T12:28:52.765687+0000","last_became_active":"2023-10-14T12:28:51.917610+0000","last_became_peered":"2023-10-14T12:28:51.917610+0000","last_unstale":"2023-10-14T12:28:52.765687+0000","last_undegraded":"2023-10-14T12:28:52.765687+0000","last_fullsized":"2023-10-14T12:28:52.765687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:07.544233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762860+0000","last_change":"2023-10-14T12:28:46.085671+0000","last_active":"2023-10-14T12:28:51.762860+0000","last_peered":"2023-10-14T12:28:51.762860+0000","last_clean":"2023-10-14T12:28:51.762860+0000","last_became_active":"2023-10-14T12:28:46.085352+0000","last_became_peered":"2023-10-14T12:28:46.085352+0000","last_unstale":"2023-10-14T12:28:51.762860+0000","last_undegraded":"2023-10-14T12:28:51.762860+0000","last_fullsized":"2023-10-14T12:28:51.762860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908566+0000","last_change":"2023-10-14T12:28:46.797554+0000","last_active":"2023-10-14T12:28:51.908566+0000","last_peered":"2023-10-14T12:28:51.908566+0000","last_clean":"2023-10-14T12:28:51.908566+0000","last_became_active":"2023-10-14T12:28:46.794880+0000","last_became_peered":"2023-10-14T12:28:46.794880+0000","last_unstale":"2023-10-14T12:28:51.908566+0000","last_undegraded":"2023-10-14T12:28:51.908566+0000","last_fullsized":"2023-10-14T12:28:51.908566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:52.797863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748815+0000","last_change":"2023-10-14T12:28:51.142417+0000","last_active":"2023-10-14T12:28:53.748815+0000","last_peered":"2023-10-14T12:28:53.748815+0000","last_clean":"2023-10-14T12:28:53.748815+0000","last_became_active":"2023-10-14T12:28:51.141839+0000","last_became_peered":"2023-10-14T12:28:51.141839+0000","last_unstale":"2023-10-14T12:28:53.748815+0000","last_undegraded":"2023-10-14T12:28:53.748815+0000","last_fullsized":"2023-10-14T12:28:53.748815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:41.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903557+0000","last_change":"2023-10-14T12:28:46.086064+0000","last_active":"2023-10-14T12:28:51.903557+0000","last_peered":"2023-10-14T12:28:51.903557+0000","last_clean":"2023-10-14T12:28:51.903557+0000","last_became_active":"2023-10-14T12:28:46.083071+0000","last_became_peered":"2023-10-14T12:28:46.083071+0000","last_unstale":"2023-10-14T12:28:51.903557+0000","last_undegraded":"2023-10-14T12:28:51.903557+0000","last_fullsized":"2023-10-14T12:28:51.903557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922469+0000","last_change":"2023-10-14T12:28:46.784072+0000","last_active":"2023-10-14T12:28:51.922469+0000","last_peered":"2023-10-14T12:28:51.922469+0000","last_clean":"2023-10-14T12:28:51.922469+0000","last_became_active":"2023-10-14T12:28:46.783653+0000","last_became_peered":"2023-10-14T12:28:46.783653+0000","last_unstale":"2023-10-14T12:28:51.922469+0000","last_undegraded":"2023-10-14T12:28:51.922469+0000","last_fullsized":"2023-10-14T12:28:51.922469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749295+0000","last_change":"2023-10-14T12:28:51.141444+0000","last_active":"2023-10-14T12:28:53.749295+0000","last_peered":"2023-10-14T12:28:53.749295+0000","last_clean":"2023-10-14T12:28:53.749295+0000","last_became_active":"2023-10-14T12:28:51.140883+0000","last_became_peered":"2023-10-14T12:28:51.140883+0000","last_unstale":"2023-10-14T12:28:53.749295+0000","last_undegraded":"2023-10-14T12:28:53.749295+0000","last_fullsized":"2023-10-14T12:28:53.749295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902128+0000","last_change":"2023-10-14T12:28:46.090824+0000","last_active":"2023-10-14T12:28:51.902128+0000","last_peered":"2023-10-14T12:28:51.902128+0000","last_clean":"2023-10-14T12:28:51.902128+0000","last_became_active":"2023-10-14T12:28:46.090494+0000","last_became_peered":"2023-10-14T12:28:46.090494+0000","last_unstale":"2023-10-14T12:28:51.902128+0000","last_undegraded":"2023-10-14T12:28:51.902128+0000","last_fullsized":"2023-10-14T12:28:51.902128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922922+0000","last_change":"2023-10-14T12:28:46.795518+0000","last_active":"2023-10-14T12:28:51.922922+0000","last_peered":"2023-10-14T12:28:51.922922+0000","last_clean":"2023-10-14T12:28:51.922922+0000","last_became_active":"2023-10-14T12:28:46.794866+0000","last_became_peered":"2023-10-14T12:28:46.794866+0000","last_unstale":"2023-10-14T12:28:51.922922+0000","last_undegraded":"2023-10-14T12:28:51.922922+0000","last_fullsized":"2023-10-14T12:28:51.922922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748983+0000","last_change":"2023-10-14T12:28:51.145294+0000","last_active":"2023-10-14T12:28:53.748983+0000","last_peered":"2023-10-14T12:28:53.748983+0000","last_clean":"2023-10-14T12:28:53.748983+0000","last_became_active":"2023-10-14T12:28:51.144881+0000","last_became_peered":"2023-10-14T12:28:51.144881+0000","last_unstale":"2023-10-14T12:28:53.748983+0000","last_undegraded":"2023-10-14T12:28:53.748983+0000","last_fullsized":"2023-10-14T12:28:53.748983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.171951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763978+0000","last_change":"2023-10-14T12:28:46.787464+0000","last_active":"2023-10-14T12:28:51.763978+0000","last_peered":"2023-10-14T12:28:51.763978+0000","last_clean":"2023-10-14T12:28:51.763978+0000","last_became_active":"2023-10-14T12:28:46.787118+0000","last_became_peered":"2023-10-14T12:28:46.787118+0000","last_unstale":"2023-10-14T12:28:51.763978+0000","last_undegraded":"2023-10-14T12:28:51.763978+0000","last_fullsized":"2023-10-14T12:28:51.763978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901958+0000","last_change":"2023-10-14T12:28:46.080330+0000","last_active":"2023-10-14T12:28:51.901958+0000","last_peered":"2023-10-14T12:28:51.901958+0000","last_clean":"2023-10-14T12:28:51.901958+0000","last_became_active":"2023-10-14T12:28:46.079439+0000","last_became_peered":"2023-10-14T12:28:46.079439+0000","last_unstale":"2023-10-14T12:28:51.901958+0000","last_undegraded":"2023-10-14T12:28:51.901958+0000","last_fullsized":"2023-10-14T12:28:51.901958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:34.159395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.750153+0000","last_change":"2023-10-14T12:28:51.140074+0000","last_active":"2023-10-14T12:28:53.750153+0000","last_peered":"2023-10-14T12:28:53.750153+0000","last_clean":"2023-10-14T12:28:53.750153+0000","last_became_active":"2023-10-14T12:28:51.139545+0000","last_became_peered":"2023-10-14T12:28:51.139545+0000","last_unstale":"2023-10-14T12:28:53.750153+0000","last_undegraded":"2023-10-14T12:28:53.750153+0000","last_fullsized":"2023-10-14T12:28:53.750153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762014+0000","last_change":"2023-10-14T12:28:46.798887+0000","last_active":"2023-10-14T12:28:51.762014+0000","last_peered":"2023-10-14T12:28:51.762014+0000","last_clean":"2023-10-14T12:28:51.762014+0000","last_became_active":"2023-10-14T12:28:46.797610+0000","last_became_peered":"2023-10-14T12:28:46.797610+0000","last_unstale":"2023-10-14T12:28:51.762014+0000","last_undegraded":"2023-10-14T12:28:51.762014+0000","last_fullsized":"2023-10-14T12:28:51.762014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920774+0000","last_change":"2023-10-14T12:28:46.082663+0000","last_active":"2023-10-14T12:28:51.920774+0000","last_peered":"2023-10-14T12:28:51.920774+0000","last_clean":"2023-10-14T12:28:51.920774+0000","last_became_active":"2023-10-14T12:28:46.081809+0000","last_became_peered":"2023-10-14T12:28:46.081809+0000","last_unstale":"2023-10-14T12:28:51.920774+0000","last_undegraded":"2023-10-14T12:28:51.920774+0000","last_fullsized":"2023-10-14T12:28:51.920774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749519+0000","last_change":"2023-10-14T12:28:51.146584+0000","last_active":"2023-10-14T12:28:53.749519+0000","last_peered":"2023-10-14T12:28:53.749519+0000","last_clean":"2023-10-14T12:28:53.749519+0000","last_became_active":"2023-10-14T12:28:51.146146+0000","last_became_peered":"2023-10-14T12:28:51.146146+0000","last_unstale":"2023-10-14T12:28:53.749519+0000","last_undegraded":"2023-10-14T12:28:53.749519+0000","last_fullsized":"2023-10-14T12:28:53.749519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761572+0000","last_change":"2023-10-14T12:28:46.789261+0000","last_active":"2023-10-14T12:28:51.761572+0000","last_peered":"2023-10-14T12:28:51.761572+0000","last_clean":"2023-10-14T12:28:51.761572+0000","last_became_active":"2023-10-14T12:28:46.788031+0000","last_became_peered":"2023-10-14T12:28:46.788031+0000","last_unstale":"2023-10-14T12:28:51.761572+0000","last_undegraded":"2023-10-14T12:28:51.761572+0000","last_fullsized":"2023-10-14T12:28:51.761572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.918090+0000","last_change":"2023-10-14T12:28:46.079896+0000","last_active":"2023-10-14T12:28:51.918090+0000","last_peered":"2023-10-14T12:28:51.918090+0000","last_clean":"2023-10-14T12:28:51.918090+0000","last_became_active":"2023-10-14T12:28:46.079498+0000","last_became_peered":"2023-10-14T12:28:46.079498+0000","last_unstale":"2023-10-14T12:28:51.918090+0000","last_undegraded":"2023-10-14T12:28:51.918090+0000","last_fullsized":"2023-10-14T12:28:51.918090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549998+0000","last_change":"2023-10-14T12:28:51.923834+0000","last_active":"2023-10-14T12:28:54.549998+0000","last_peered":"2023-10-14T12:28:54.549998+0000","last_clean":"2023-10-14T12:28:54.549998+0000","last_became_active":"2023-10-14T12:28:51.916869+0000","last_became_peered":"2023-10-14T12:28:51.916869+0000","last_unstale":"2023-10-14T12:28:54.549998+0000","last_undegraded":"2023-10-14T12:28:54.549998+0000","last_fullsized":"2023-10-14T12:28:54.549998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765552+0000","last_change":"2023-10-14T12:28:46.786929+0000","last_active":"2023-10-14T12:28:51.765552+0000","last_peered":"2023-10-14T12:28:51.765552+0000","last_clean":"2023-10-14T12:28:51.765552+0000","last_became_active":"2023-10-14T12:28:46.785285+0000","last_became_peered":"2023-10-14T12:28:46.785285+0000","last_unstale":"2023-10-14T12:28:51.765552+0000","last_undegraded":"2023-10-14T12:28:51.765552+0000","last_fullsized":"2023-10-14T12:28:51.765552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:14.608032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901022+0000","last_change":"2023-10-14T12:28:46.085793+0000","last_active":"2023-10-14T12:28:51.901022+0000","last_peered":"2023-10-14T12:28:51.901022+0000","last_clean":"2023-10-14T12:28:51.901022+0000","last_became_active":"2023-10-14T12:28:46.085539+0000","last_became_peered":"2023-10-14T12:28:46.085539+0000","last_unstale":"2023-10-14T12:28:51.901022+0000","last_undegraded":"2023-10-14T12:28:51.901022+0000","last_fullsized":"2023-10-14T12:28:51.901022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749922+0000","last_change":"2023-10-14T12:28:51.142284+0000","last_active":"2023-10-14T12:28:53.749922+0000","last_peered":"2023-10-14T12:28:53.749922+0000","last_clean":"2023-10-14T12:28:53.749922+0000","last_became_active":"2023-10-14T12:28:51.141786+0000","last_became_peered":"2023-10-14T12:28:51.141786+0000","last_unstale":"2023-10-14T12:28:53.749922+0000","last_undegraded":"2023-10-14T12:28:53.749922+0000","last_fullsized":"2023-10-14T12:28:53.749922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908548+0000","last_change":"2023-10-14T12:28:46.784288+0000","last_active":"2023-10-14T12:28:51.908548+0000","last_peered":"2023-10-14T12:28:51.908548+0000","last_clean":"2023-10-14T12:28:51.908548+0000","last_became_active":"2023-10-14T12:28:46.783048+0000","last_became_peered":"2023-10-14T12:28:46.783048+0000","last_unstale":"2023-10-14T12:28:51.908548+0000","last_undegraded":"2023-10-14T12:28:51.908548+0000","last_fullsized":"2023-10-14T12:28:51.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:10.556463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766748+0000","last_change":"2023-10-14T12:28:46.077038+0000","last_active":"2023-10-14T12:28:51.766748+0000","last_peered":"2023-10-14T12:28:51.766748+0000","last_clean":"2023-10-14T12:28:51.766748+0000","last_became_active":"2023-10-14T12:28:46.075513+0000","last_became_peered":"2023-10-14T12:28:46.075513+0000","last_unstale":"2023-10-14T12:28:51.766748+0000","last_undegraded":"2023-10-14T12:28:51.766748+0000","last_fullsized":"2023-10-14T12:28:51.766748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748977+0000","last_change":"2023-10-14T12:28:51.911158+0000","last_active":"2023-10-14T12:28:53.748977+0000","last_peered":"2023-10-14T12:28:53.748977+0000","last_clean":"2023-10-14T12:28:53.748977+0000","last_became_active":"2023-10-14T12:28:51.910002+0000","last_became_peered":"2023-10-14T12:28:51.910002+0000","last_unstale":"2023-10-14T12:28:53.748977+0000","last_undegraded":"2023-10-14T12:28:53.748977+0000","last_fullsized":"2023-10-14T12:28:53.748977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:00.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763687+0000","last_change":"2023-10-14T12:28:46.796917+0000","last_active":"2023-10-14T12:28:51.763687+0000","last_peered":"2023-10-14T12:28:51.763687+0000","last_clean":"2023-10-14T12:28:51.763687+0000","last_became_active":"2023-10-14T12:28:46.796090+0000","last_became_peered":"2023-10-14T12:28:46.796090+0000","last_unstale":"2023-10-14T12:28:51.763687+0000","last_undegraded":"2023-10-14T12:28:51.763687+0000","last_fullsized":"2023-10-14T12:28:51.763687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.548495+0000","last_change":"2023-10-14T12:28:46.072468+0000","last_active":"2023-10-14T12:28:54.548495+0000","last_peered":"2023-10-14T12:28:54.548495+0000","last_clean":"2023-10-14T12:28:54.548495+0000","last_became_active":"2023-10-14T12:28:46.071827+0000","last_became_peered":"2023-10-14T12:28:46.071827+0000","last_unstale":"2023-10-14T12:28:54.548495+0000","last_undegraded":"2023-10-14T12:28:54.548495+0000","last_fullsized":"2023-10-14T12:28:54.548495+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765187+0000","last_change":"2023-10-14T12:28:51.903366+0000","last_active":"2023-10-14T12:28:52.765187+0000","last_peered":"2023-10-14T12:28:52.765187+0000","last_clean":"2023-10-14T12:28:52.765187+0000","last_became_active":"2023-10-14T12:28:51.902191+0000","last_became_peered":"2023-10-14T12:28:51.902191+0000","last_unstale":"2023-10-14T12:28:52.765187+0000","last_undegraded":"2023-10-14T12:28:52.765187+0000","last_fullsized":"2023-10-14T12:28:52.765187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920090+0000","last_change":"2023-10-14T12:28:46.786490+0000","last_active":"2023-10-14T12:28:51.920090+0000","last_peered":"2023-10-14T12:28:51.920090+0000","last_clean":"2023-10-14T12:28:51.920090+0000","last_became_active":"2023-10-14T12:28:46.785976+0000","last_became_peered":"2023-10-14T12:28:46.785976+0000","last_unstale":"2023-10-14T12:28:51.920090+0000","last_undegraded":"2023-10-14T12:28:51.920090+0000","last_fullsized":"2023-10-14T12:28:51.920090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905284+0000","last_change":"2023-10-14T12:28:46.087365+0000","last_active":"2023-10-14T12:28:51.905284+0000","last_peered":"2023-10-14T12:28:51.905284+0000","last_clean":"2023-10-14T12:28:51.905284+0000","last_became_active":"2023-10-14T12:28:46.087090+0000","last_became_peered":"2023-10-14T12:28:46.087090+0000","last_unstale":"2023-10-14T12:28:51.905284+0000","last_undegraded":"2023-10-14T12:28:51.905284+0000","last_fullsized":"2023-10-14T12:28:51.905284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409835+0000","last_change":"2023-10-14T12:28:51.909277+0000","last_active":"2023-10-14T12:28:54.409835+0000","last_peered":"2023-10-14T12:28:54.409835+0000","last_clean":"2023-10-14T12:28:54.409835+0000","last_became_active":"2023-10-14T12:28:51.907121+0000","last_became_peered":"2023-10-14T12:28:51.907121+0000","last_unstale":"2023-10-14T12:28:54.409835+0000","last_undegraded":"2023-10-14T12:28:54.409835+0000","last_fullsized":"2023-10-14T12:28:54.409835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:31.934707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923040+0000","last_change":"2023-10-14T12:28:46.805297+0000","last_active":"2023-10-14T12:28:51.923040+0000","last_peered":"2023-10-14T12:28:51.923040+0000","last_clean":"2023-10-14T12:28:51.923040+0000","last_became_active":"2023-10-14T12:28:46.805000+0000","last_became_peered":"2023-10-14T12:28:46.805000+0000","last_unstale":"2023-10-14T12:28:51.923040+0000","last_undegraded":"2023-10-14T12:28:51.923040+0000","last_fullsized":"2023-10-14T12:28:51.923040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920314+0000","last_change":"2023-10-14T12:28:46.078052+0000","last_active":"2023-10-14T12:28:51.920314+0000","last_peered":"2023-10-14T12:28:51.920314+0000","last_clean":"2023-10-14T12:28:51.920314+0000","last_became_active":"2023-10-14T12:28:46.077730+0000","last_became_peered":"2023-10-14T12:28:46.077730+0000","last_unstale":"2023-10-14T12:28:51.920314+0000","last_undegraded":"2023-10-14T12:28:51.920314+0000","last_fullsized":"2023-10-14T12:28:51.920314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549170+0000","last_change":"2023-10-14T12:28:51.141425+0000","last_active":"2023-10-14T12:28:54.549170+0000","last_peered":"2023-10-14T12:28:54.549170+0000","last_clean":"2023-10-14T12:28:54.549170+0000","last_became_active":"2023-10-14T12:28:51.140998+0000","last_became_peered":"2023-10-14T12:28:51.140998+0000","last_unstale":"2023-10-14T12:28:54.549170+0000","last_undegraded":"2023-10-14T12:28:54.549170+0000","last_fullsized":"2023-10-14T12:28:54.549170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766791+0000","last_change":"2023-10-14T12:28:46.791914+0000","last_active":"2023-10-14T12:28:51.766791+0000","last_peered":"2023-10-14T12:28:51.766791+0000","last_clean":"2023-10-14T12:28:51.766791+0000","last_became_active":"2023-10-14T12:28:46.790081+0000","last_became_peered":"2023-10-14T12:28:46.790081+0000","last_unstale":"2023-10-14T12:28:51.766791+0000","last_undegraded":"2023-10-14T12:28:51.766791+0000","last_fullsized":"2023-10-14T12:28:51.766791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:51.665543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919424+0000","last_change":"2023-10-14T12:28:46.087850+0000","last_active":"2023-10-14T12:28:51.919424+0000","last_peered":"2023-10-14T12:28:51.919424+0000","last_clean":"2023-10-14T12:28:51.919424+0000","last_became_active":"2023-10-14T12:28:46.087568+0000","last_became_peered":"2023-10-14T12:28:46.087568+0000","last_unstale":"2023-10-14T12:28:51.919424+0000","last_undegraded":"2023-10-14T12:28:51.919424+0000","last_fullsized":"2023-10-14T12:28:51.919424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:00.886203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549701+0000","last_change":"2023-10-14T12:28:51.140452+0000","last_active":"2023-10-14T12:28:54.549701+0000","last_peered":"2023-10-14T12:28:54.549701+0000","last_clean":"2023-10-14T12:28:54.549701+0000","last_became_active":"2023-10-14T12:28:51.140047+0000","last_became_peered":"2023-10-14T12:28:51.140047+0000","last_unstale":"2023-10-14T12:28:54.549701+0000","last_undegraded":"2023-10-14T12:28:54.549701+0000","last_fullsized":"2023-10-14T12:28:54.549701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.915866+0000","last_change":"2023-10-14T12:28:46.785632+0000","last_active":"2023-10-14T12:28:51.915866+0000","last_peered":"2023-10-14T12:28:51.915866+0000","last_clean":"2023-10-14T12:28:51.915866+0000","last_became_active":"2023-10-14T12:28:46.785306+0000","last_became_peered":"2023-10-14T12:28:46.785306+0000","last_unstale":"2023-10-14T12:28:51.915866+0000","last_undegraded":"2023-10-14T12:28:51.915866+0000","last_fullsized":"2023-10-14T12:28:51.915866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140904+0000","last_change":"2023-10-14T12:28:46.079395+0000","last_active":"2023-10-14T12:28:52.140904+0000","last_peered":"2023-10-14T12:28:52.140904+0000","last_clean":"2023-10-14T12:28:52.140904+0000","last_became_active":"2023-10-14T12:28:46.079066+0000","last_became_peered":"2023-10-14T12:28:46.079066+0000","last_unstale":"2023-10-14T12:28:52.140904+0000","last_undegraded":"2023-10-14T12:28:52.140904+0000","last_fullsized":"2023-10-14T12:28:52.140904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:14.299609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.550104+0000","last_change":"2023-10-14T12:28:51.146682+0000","last_active":"2023-10-14T12:28:54.550104+0000","last_peered":"2023-10-14T12:28:54.550104+0000","last_clean":"2023-10-14T12:28:54.550104+0000","last_became_active":"2023-10-14T12:28:51.146103+0000","last_became_peered":"2023-10-14T12:28:51.146103+0000","last_unstale":"2023-10-14T12:28:54.550104+0000","last_undegraded":"2023-10-14T12:28:54.550104+0000","last_fullsized":"2023-10-14T12:28:54.550104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906672+0000","last_change":"2023-10-14T12:28:46.787997+0000","last_active":"2023-10-14T12:28:51.906672+0000","last_peered":"2023-10-14T12:28:51.906672+0000","last_clean":"2023-10-14T12:28:51.906672+0000","last_became_active":"2023-10-14T12:28:46.787646+0000","last_became_peered":"2023-10-14T12:28:46.787646+0000","last_unstale":"2023-10-14T12:28:51.906672+0000","last_undegraded":"2023-10-14T12:28:51.906672+0000","last_fullsized":"2023-10-14T12:28:51.906672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:23.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901433+0000","last_change":"2023-10-14T12:28:46.088704+0000","last_active":"2023-10-14T12:28:51.901433+0000","last_peered":"2023-10-14T12:28:51.901433+0000","last_clean":"2023-10-14T12:28:51.901433+0000","last_became_active":"2023-10-14T12:28:46.088429+0000","last_became_peered":"2023-10-14T12:28:46.088429+0000","last_unstale":"2023-10-14T12:28:51.901433+0000","last_undegraded":"2023-10-14T12:28:51.901433+0000","last_fullsized":"2023-10-14T12:28:51.901433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:08.064671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.411094+0000","last_change":"2023-10-14T12:28:51.920214+0000","last_active":"2023-10-14T12:28:54.411094+0000","last_peered":"2023-10-14T12:28:54.411094+0000","last_clean":"2023-10-14T12:28:54.411094+0000","last_became_active":"2023-10-14T12:28:51.918279+0000","last_became_peered":"2023-10-14T12:28:51.918279+0000","last_unstale":"2023-10-14T12:28:54.411094+0000","last_undegraded":"2023-10-14T12:28:54.411094+0000","last_fullsized":"2023-10-14T12:28:54.411094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:32.336264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762038+0000","last_change":"2023-10-14T12:28:46.793764+0000","last_active":"2023-10-14T12:28:51.762038+0000","last_peered":"2023-10-14T12:28:51.762038+0000","last_clean":"2023-10-14T12:28:51.762038+0000","last_became_active":"2023-10-14T12:28:46.793460+0000","last_became_peered":"2023-10-14T12:28:46.793460+0000","last_unstale":"2023-10-14T12:28:51.762038+0000","last_undegraded":"2023-10-14T12:28:51.762038+0000","last_fullsized":"2023-10-14T12:28:51.762038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922056+0000","last_change":"2023-10-14T12:28:46.082037+0000","last_active":"2023-10-14T12:28:51.922056+0000","last_peered":"2023-10-14T12:28:51.922056+0000","last_clean":"2023-10-14T12:28:51.922056+0000","last_became_active":"2023-10-14T12:28:46.081174+0000","last_became_peered":"2023-10-14T12:28:46.081174+0000","last_unstale":"2023-10-14T12:28:51.922056+0000","last_undegraded":"2023-10-14T12:28:51.922056+0000","last_fullsized":"2023-10-14T12:28:51.922056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901828+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:28:51.901828+0000","last_peered":"2023-10-14T12:28:51.901828+0000","last_clean":"2023-10-14T12:28:51.901828+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:28:51.901828+0000","last_undegraded":"2023-10-14T12:28:51.901828+0000","last_fullsized":"2023-10-14T12:28:51.901828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.768326+0000","last_change":"2023-10-14T12:28:51.910300+0000","last_active":"2023-10-14T12:28:52.768326+0000","last_peered":"2023-10-14T12:28:52.768326+0000","last_clean":"2023-10-14T12:28:52.768326+0000","last_became_active":"2023-10-14T12:28:51.909121+0000","last_became_peered":"2023-10-14T12:28:51.909121+0000","last_unstale":"2023-10-14T12:28:52.768326+0000","last_undegraded":"2023-10-14T12:28:52.768326+0000","last_fullsized":"2023-10-14T12:28:52.768326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:43.101212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902148+0000","last_change":"2023-10-14T12:28:46.801572+0000","last_active":"2023-10-14T12:28:51.902148+0000","last_peered":"2023-10-14T12:28:51.902148+0000","last_clean":"2023-10-14T12:28:51.902148+0000","last_became_active":"2023-10-14T12:28:46.801273+0000","last_became_peered":"2023-10-14T12:28:46.801273+0000","last_unstale":"2023-10-14T12:28:51.902148+0000","last_undegraded":"2023-10-14T12:28:51.902148+0000","last_fullsized":"2023-10-14T12:28:51.902148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.142466+0000","last_change":"2023-10-14T12:28:46.089021+0000","last_active":"2023-10-14T12:28:52.142466+0000","last_peered":"2023-10-14T12:28:52.142466+0000","last_clean":"2023-10-14T12:28:52.142466+0000","last_became_active":"2023-10-14T12:28:46.088640+0000","last_became_peered":"2023-10-14T12:28:46.088640+0000","last_unstale":"2023-10-14T12:28:52.142466+0000","last_undegraded":"2023-10-14T12:28:52.142466+0000","last_fullsized":"2023-10-14T12:28:52.142466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:07:19.614243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766407+0000","last_change":"2023-10-14T12:28:51.909391+0000","last_active":"2023-10-14T12:28:52.766407+0000","last_peered":"2023-10-14T12:28:52.766407+0000","last_clean":"2023-10-14T12:28:52.766407+0000","last_became_active":"2023-10-14T12:28:51.908099+0000","last_became_peered":"2023-10-14T12:28:51.908099+0000","last_unstale":"2023-10-14T12:28:52.766407+0000","last_undegraded":"2023-10-14T12:28:52.766407+0000","last_fullsized":"2023-10-14T12:28:52.766407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:28.364649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922641+0000","last_change":"2023-10-14T12:28:46.800329+0000","last_active":"2023-10-14T12:28:51.922641+0000","last_peered":"2023-10-14T12:28:51.922641+0000","last_clean":"2023-10-14T12:28:51.922641+0000","last_became_active":"2023-10-14T12:28:46.800007+0000","last_became_peered":"2023-10-14T12:28:46.800007+0000","last_unstale":"2023-10-14T12:28:51.922641+0000","last_undegraded":"2023-10-14T12:28:51.922641+0000","last_fullsized":"2023-10-14T12:28:51.922641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921828+0000","last_change":"2023-10-14T12:28:46.078949+0000","last_active":"2023-10-14T12:28:51.921828+0000","last_peered":"2023-10-14T12:28:51.921828+0000","last_clean":"2023-10-14T12:28:51.921828+0000","last_became_active":"2023-10-14T12:28:46.078670+0000","last_became_peered":"2023-10-14T12:28:46.078670+0000","last_unstale":"2023-10-14T12:28:51.921828+0000","last_undegraded":"2023-10-14T12:28:51.921828+0000","last_fullsized":"2023-10-14T12:28:51.921828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409867+0000","last_change":"2023-10-14T12:28:51.150655+0000","last_active":"2023-10-14T12:28:54.409867+0000","last_peered":"2023-10-14T12:28:54.409867+0000","last_clean":"2023-10-14T12:28:54.409867+0000","last_became_active":"2023-10-14T12:28:51.150108+0000","last_became_peered":"2023-10-14T12:28:51.150108+0000","last_unstale":"2023-10-14T12:28:54.409867+0000","last_undegraded":"2023-10-14T12:28:54.409867+0000","last_fullsized":"2023-10-14T12:28:54.409867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:26.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905515+0000","last_change":"2023-10-14T12:28:46.799576+0000","last_active":"2023-10-14T12:28:51.905515+0000","last_peered":"2023-10-14T12:28:51.905515+0000","last_clean":"2023-10-14T12:28:51.905515+0000","last_became_active":"2023-10-14T12:28:46.798883+0000","last_became_peered":"2023-10-14T12:28:46.798883+0000","last_unstale":"2023-10-14T12:28:51.905515+0000","last_undegraded":"2023-10-14T12:28:51.905515+0000","last_fullsized":"2023-10-14T12:28:51.905515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:44.311419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141623+0000","last_change":"2023-10-14T12:28:46.082303+0000","last_active":"2023-10-14T12:28:52.141623+0000","last_peered":"2023-10-14T12:28:52.141623+0000","last_clean":"2023-10-14T12:28:52.141623+0000","last_became_active":"2023-10-14T12:28:46.081916+0000","last_became_peered":"2023-10-14T12:28:46.081916+0000","last_unstale":"2023-10-14T12:28:52.141623+0000","last_undegraded":"2023-10-14T12:28:52.141623+0000","last_fullsized":"2023-10-14T12:28:52.141623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:58.702563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765960+0000","last_change":"2023-10-14T12:28:51.922025+0000","last_active":"2023-10-14T12:28:52.765960+0000","last_peered":"2023-10-14T12:28:52.765960+0000","last_clean":"2023-10-14T12:28:52.765960+0000","last_became_active":"2023-10-14T12:28:51.918049+0000","last_became_peered":"2023-10-14T12:28:51.918049+0000","last_unstale":"2023-10-14T12:28:52.765960+0000","last_undegraded":"2023-10-14T12:28:52.765960+0000","last_fullsized":"2023-10-14T12:28:52.765960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905811+0000","last_change":"2023-10-14T12:28:46.795831+0000","last_active":"2023-10-14T12:28:51.905811+0000","last_peered":"2023-10-14T12:28:51.905811+0000","last_clean":"2023-10-14T12:28:51.905811+0000","last_became_active":"2023-10-14T12:28:46.795571+0000","last_became_peered":"2023-10-14T12:28:46.795571+0000","last_unstale":"2023-10-14T12:28:51.905811+0000","last_undegraded":"2023-10-14T12:28:51.905811+0000","last_fullsized":"2023-10-14T12:28:51.905811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:29.280284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766935+0000","last_change":"2023-10-14T12:28:46.084244+0000","last_active":"2023-10-14T12:28:51.766935+0000","last_peered":"2023-10-14T12:28:51.766935+0000","last_clean":"2023-10-14T12:28:51.766935+0000","last_became_active":"2023-10-14T12:28:46.083772+0000","last_became_peered":"2023-10-14T12:28:46.083772+0000","last_unstale":"2023-10-14T12:28:51.766935+0000","last_undegraded":"2023-10-14T12:28:51.766935+0000","last_fullsized":"2023-10-14T12:28:51.766935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748760+0000","last_change":"2023-10-14T12:28:51.141542+0000","last_active":"2023-10-14T12:28:53.748760+0000","last_peered":"2023-10-14T12:28:53.748760+0000","last_clean":"2023-10-14T12:28:53.748760+0000","last_became_active":"2023-10-14T12:28:51.141066+0000","last_became_peered":"2023-10-14T12:28:51.141066+0000","last_unstale":"2023-10-14T12:28:53.748760+0000","last_undegraded":"2023-10-14T12:28:53.748760+0000","last_fullsized":"2023-10-14T12:28:53.748760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902142+0000","last_change":"2023-10-14T12:28:46.799195+0000","last_active":"2023-10-14T12:28:51.902142+0000","last_peered":"2023-10-14T12:28:51.902142+0000","last_clean":"2023-10-14T12:28:51.902142+0000","last_became_active":"2023-10-14T12:28:46.798850+0000","last_became_peered":"2023-10-14T12:28:46.798850+0000","last_unstale":"2023-10-14T12:28:51.902142+0000","last_undegraded":"2023-10-14T12:28:51.902142+0000","last_fullsized":"2023-10-14T12:28:51.902142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140517+0000","last_change":"2023-10-14T12:28:46.074743+0000","last_active":"2023-10-14T12:28:52.140517+0000","last_peered":"2023-10-14T12:28:52.140517+0000","last_clean":"2023-10-14T12:28:52.140517+0000","last_became_active":"2023-10-14T12:28:46.074430+0000","last_became_peered":"2023-10-14T12:28:46.074430+0000","last_unstale":"2023-10-14T12:28:52.140517+0000","last_undegraded":"2023-10-14T12:28:52.140517+0000","last_fullsized":"2023-10-14T12:28:52.140517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:44.943766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410859+0000","last_change":"2023-10-14T12:28:51.147740+0000","last_active":"2023-10-14T12:28:54.410859+0000","last_peered":"2023-10-14T12:28:54.410859+0000","last_clean":"2023-10-14T12:28:54.410859+0000","last_became_active":"2023-10-14T12:28:51.147168+0000","last_became_peered":"2023-10-14T12:28:51.147168+0000","last_unstale":"2023-10-14T12:28:54.410859+0000","last_undegraded":"2023-10-14T12:28:54.410859+0000","last_fullsized":"2023-10-14T12:28:54.410859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:27.739547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763688+0000","last_change":"2023-10-14T12:28:46.796316+0000","last_active":"2023-10-14T12:28:51.763688+0000","last_peered":"2023-10-14T12:28:51.763688+0000","last_clean":"2023-10-14T12:28:51.763688+0000","last_became_active":"2023-10-14T12:28:46.795991+0000","last_became_peered":"2023-10-14T12:28:46.795991+0000","last_unstale":"2023-10-14T12:28:51.763688+0000","last_undegraded":"2023-10-14T12:28:51.763688+0000","last_fullsized":"2023-10-14T12:28:51.763688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763934+0000","last_change":"2023-10-14T12:28:46.078905+0000","last_active":"2023-10-14T12:28:51.763934+0000","last_peered":"2023-10-14T12:28:51.763934+0000","last_clean":"2023-10-14T12:28:51.763934+0000","last_became_active":"2023-10-14T12:28:46.078601+0000","last_became_peered":"2023-10-14T12:28:46.078601+0000","last_unstale":"2023-10-14T12:28:51.763934+0000","last_undegraded":"2023-10-14T12:28:51.763934+0000","last_fullsized":"2023-10-14T12:28:51.763934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767902+0000","last_change":"2023-10-14T12:28:51.912591+0000","last_active":"2023-10-14T12:28:52.767902+0000","last_peered":"2023-10-14T12:28:52.767902+0000","last_clean":"2023-10-14T12:28:52.767902+0000","last_became_active":"2023-10-14T12:28:51.911444+0000","last_became_peered":"2023-10-14T12:28:51.911444+0000","last_unstale":"2023-10-14T12:28:52.767902+0000","last_undegraded":"2023-10-14T12:28:52.767902+0000","last_fullsized":"2023-10-14T12:28:52.767902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:01.865763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901725+0000","last_change":"2023-10-14T12:28:46.794280+0000","last_active":"2023-10-14T12:28:51.901725+0000","last_peered":"2023-10-14T12:28:51.901725+0000","last_clean":"2023-10-14T12:28:51.901725+0000","last_became_active":"2023-10-14T12:28:46.794011+0000","last_became_peered":"2023-10-14T12:28:46.794011+0000","last_unstale":"2023-10-14T12:28:51.901725+0000","last_undegraded":"2023-10-14T12:28:51.901725+0000","last_fullsized":"2023-10-14T12:28:51.901725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921941+0000","last_change":"2023-10-14T12:28:46.087268+0000","last_active":"2023-10-14T12:28:51.921941+0000","last_peered":"2023-10-14T12:28:51.921941+0000","last_clean":"2023-10-14T12:28:51.921941+0000","last_became_active":"2023-10-14T12:28:46.086933+0000","last_became_peered":"2023-10-14T12:28:46.086933+0000","last_unstale":"2023-10-14T12:28:51.921941+0000","last_undegraded":"2023-10-14T12:28:51.921941+0000","last_fullsized":"2023-10-14T12:28:51.921941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:49.643084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766946+0000","last_change":"2023-10-14T12:28:51.914988+0000","last_active":"2023-10-14T12:28:52.766946+0000","last_peered":"2023-10-14T12:28:52.766946+0000","last_clean":"2023-10-14T12:28:52.766946+0000","last_became_active":"2023-10-14T12:28:51.913882+0000","last_became_peered":"2023-10-14T12:28:51.913882+0000","last_unstale":"2023-10-14T12:28:52.766946+0000","last_undegraded":"2023-10-14T12:28:52.766946+0000","last_fullsized":"2023-10-14T12:28:52.766946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:08:30.117146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908486+0000","last_change":"2023-10-14T12:28:46.788853+0000","last_active":"2023-10-14T12:28:51.908486+0000","last_peered":"2023-10-14T12:28:51.908486+0000","last_clean":"2023-10-14T12:28:51.908486+0000","last_became_active":"2023-10-14T12:28:46.788458+0000","last_became_peered":"2023-10-14T12:28:46.788458+0000","last_unstale":"2023-10-14T12:28:51.908486+0000","last_undegraded":"2023-10-14T12:28:51.908486+0000","last_fullsized":"2023-10-14T12:28:51.908486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:34:10.344432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908891+0000","last_change":"2023-10-14T12:28:46.076853+0000","last_active":"2023-10-14T12:28:51.908891+0000","last_peered":"2023-10-14T12:28:51.908891+0000","last_clean":"2023-10-14T12:28:51.908891+0000","last_became_active":"2023-10-14T12:28:46.076541+0000","last_became_peered":"2023-10-14T12:28:46.076541+0000","last_unstale":"2023-10-14T12:28:51.908891+0000","last_undegraded":"2023-10-14T12:28:51.908891+0000","last_fullsized":"2023-10-14T12:28:51.908891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:17.061278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769108+0000","last_change":"2023-10-14T12:28:51.920296+0000","last_active":"2023-10-14T12:28:52.769108+0000","last_peered":"2023-10-14T12:28:52.769108+0000","last_clean":"2023-10-14T12:28:52.769108+0000","last_became_active":"2023-10-14T12:28:51.917580+0000","last_became_peered":"2023-10-14T12:28:51.917580+0000","last_unstale":"2023-10-14T12:28:52.769108+0000","last_undegraded":"2023-10-14T12:28:52.769108+0000","last_fullsized":"2023-10-14T12:28:52.769108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903467+0000","last_change":"2023-10-14T12:28:46.801997+0000","last_active":"2023-10-14T12:28:51.903467+0000","last_peered":"2023-10-14T12:28:51.903467+0000","last_clean":"2023-10-14T12:28:51.903467+0000","last_became_active":"2023-10-14T12:28:46.801720+0000","last_became_peered":"2023-10-14T12:28:46.801720+0000","last_unstale":"2023-10-14T12:28:51.903467+0000","last_undegraded":"2023-10-14T12:28:51.903467+0000","last_fullsized":"2023-10-14T12:28:51.903467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'11","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:29:05.089296+0000","last_change":"2023-10-14T12:28:46.076997+0000","last_active":"2023-10-14T12:29:05.089296+0000","last_peered":"2023-10-14T12:29:05.089296+0000","last_clean":"2023-10-14T12:29:05.089296+0000","last_became_active":"2023-10-14T12:28:46.076345+0000","last_became_peered":"2023-10-14T12:28:46.076345+0000","last_unstale":"2023-10-14T12:29:05.089296+0000","last_undegraded":"2023-10-14T12:29:05.089296+0000","last_fullsized":"2023-10-14T12:29:05.089296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549272+0000","last_change":"2023-10-14T12:28:51.138516+0000","last_active":"2023-10-14T12:28:54.549272+0000","last_peered":"2023-10-14T12:28:54.549272+0000","last_clean":"2023-10-14T12:28:54.549272+0000","last_became_active":"2023-10-14T12:28:51.137516+0000","last_became_peered":"2023-10-14T12:28:51.137516+0000","last_unstale":"2023-10-14T12:28:54.549272+0000","last_undegraded":"2023-10-14T12:28:54.549272+0000","last_fullsized":"2023-10-14T12:28:54.549272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767066+0000","last_change":"2023-10-14T12:28:46.792271+0000","last_active":"2023-10-14T12:28:51.767066+0000","last_peered":"2023-10-14T12:28:51.767066+0000","last_clean":"2023-10-14T12:28:51.767066+0000","last_became_active":"2023-10-14T12:28:46.789471+0000","last_became_peered":"2023-10-14T12:28:46.789471+0000","last_unstale":"2023-10-14T12:28:51.767066+0000","last_undegraded":"2023-10-14T12:28:51.767066+0000","last_fullsized":"2023-10-14T12:28:51.767066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:36.235202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921217+0000","last_change":"2023-10-14T12:28:46.088735+0000","last_active":"2023-10-14T12:28:51.921217+0000","last_peered":"2023-10-14T12:28:51.921217+0000","last_clean":"2023-10-14T12:28:51.921217+0000","last_became_active":"2023-10-14T12:28:46.088457+0000","last_became_peered":"2023-10-14T12:28:46.088457+0000","last_unstale":"2023-10-14T12:28:51.921217+0000","last_undegraded":"2023-10-14T12:28:51.921217+0000","last_fullsized":"2023-10-14T12:28:51.921217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749567+0000","last_change":"2023-10-14T12:28:51.139023+0000","last_active":"2023-10-14T12:28:53.749567+0000","last_peered":"2023-10-14T12:28:53.749567+0000","last_clean":"2023-10-14T12:28:53.749567+0000","last_became_active":"2023-10-14T12:28:51.138588+0000","last_became_peered":"2023-10-14T12:28:51.138588+0000","last_unstale":"2023-10-14T12:28:53.749567+0000","last_undegraded":"2023-10-14T12:28:53.749567+0000","last_fullsized":"2023-10-14T12:28:53.749567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.909074+0000","last_change":"2023-10-14T12:28:46.795155+0000","last_active":"2023-10-14T12:28:51.909074+0000","last_peered":"2023-10-14T12:28:51.909074+0000","last_clean":"2023-10-14T12:28:51.909074+0000","last_became_active":"2023-10-14T12:28:46.794637+0000","last_became_peered":"2023-10-14T12:28:46.794637+0000","last_unstale":"2023-10-14T12:28:51.909074+0000","last_undegraded":"2023-10-14T12:28:51.909074+0000","last_fullsized":"2023-10-14T12:28:51.909074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:28.917771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.086906+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.078677+0000","last_became_peered":"2023-10-14T12:28:46.078677+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765685+0000","last_change":"2023-10-14T12:28:51.150961+0000","last_active":"2023-10-14T12:28:52.765685+0000","last_peered":"2023-10-14T12:28:52.765685+0000","last_clean":"2023-10-14T12:28:52.765685+0000","last_became_active":"2023-10-14T12:28:51.147298+0000","last_became_peered":"2023-10-14T12:28:51.147298+0000","last_unstale":"2023-10-14T12:28:52.765685+0000","last_undegraded":"2023-10-14T12:28:52.765685+0000","last_fullsized":"2023-10-14T12:28:52.765685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:44.659889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922854+0000","last_change":"2023-10-14T12:28:46.791198+0000","last_active":"2023-10-14T12:28:51.922854+0000","last_peered":"2023-10-14T12:28:51.922854+0000","last_clean":"2023-10-14T12:28:51.922854+0000","last_became_active":"2023-10-14T12:28:46.790867+0000","last_became_peered":"2023-10-14T12:28:46.790867+0000","last_unstale":"2023-10-14T12:28:51.922854+0000","last_undegraded":"2023-10-14T12:28:51.922854+0000","last_fullsized":"2023-10-14T12:28:51.922854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766297+0000","last_change":"2023-10-14T12:28:46.082839+0000","last_active":"2023-10-14T12:28:51.766297+0000","last_peered":"2023-10-14T12:28:51.766297+0000","last_clean":"2023-10-14T12:28:51.766297+0000","last_became_active":"2023-10-14T12:28:46.082602+0000","last_became_peered":"2023-10-14T12:28:46.082602+0000","last_unstale":"2023-10-14T12:28:51.766297+0000","last_undegraded":"2023-10-14T12:28:51.766297+0000","last_fullsized":"2023-10-14T12:28:51.766297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:50.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765534+0000","last_change":"2023-10-14T12:28:51.907147+0000","last_active":"2023-10-14T12:28:52.765534+0000","last_peered":"2023-10-14T12:28:52.765534+0000","last_clean":"2023-10-14T12:28:52.765534+0000","last_became_active":"2023-10-14T12:28:51.905096+0000","last_became_peered":"2023-10-14T12:28:51.905096+0000","last_unstale":"2023-10-14T12:28:52.765534+0000","last_undegraded":"2023-10-14T12:28:52.765534+0000","last_fullsized":"2023-10-14T12:28:52.765534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410456+0000","last_change":"2023-10-14T12:28:51.924721+0000","last_active":"2023-10-14T12:28:54.410456+0000","last_peered":"2023-10-14T12:28:54.410456+0000","last_clean":"2023-10-14T12:28:54.410456+0000","last_became_active":"2023-10-14T12:28:51.922270+0000","last_became_peered":"2023-10-14T12:28:51.922270+0000","last_unstale":"2023-10-14T12:28:54.410456+0000","last_undegraded":"2023-10-14T12:28:54.410456+0000","last_fullsized":"2023-10-14T12:28:54.410456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:45.274534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.916174+0000","last_change":"2023-10-14T12:28:46.787783+0000","last_active":"2023-10-14T12:28:51.916174+0000","last_peered":"2023-10-14T12:28:51.916174+0000","last_clean":"2023-10-14T12:28:51.916174+0000","last_became_active":"2023-10-14T12:28:46.787485+0000","last_became_peered":"2023-10-14T12:28:46.787485+0000","last_unstale":"2023-10-14T12:28:51.916174+0000","last_undegraded":"2023-10-14T12:28:51.916174+0000","last_fullsized":"2023-10-14T12:28:51.916174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919246+0000","last_change":"2023-10-14T12:28:46.081339+0000","last_active":"2023-10-14T12:28:51.919246+0000","last_peered":"2023-10-14T12:28:51.919246+0000","last_clean":"2023-10-14T12:28:51.919246+0000","last_became_active":"2023-10-14T12:28:46.080996+0000","last_became_peered":"2023-10-14T12:28:46.080996+0000","last_unstale":"2023-10-14T12:28:51.919246+0000","last_undegraded":"2023-10-14T12:28:51.919246+0000","last_fullsized":"2023-10-14T12:28:51.919246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:02.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769101+0000","last_change":"2023-10-14T12:28:51.140428+0000","last_active":"2023-10-14T12:28:52.769101+0000","last_peered":"2023-10-14T12:28:52.769101+0000","last_clean":"2023-10-14T12:28:52.769101+0000","last_became_active":"2023-10-14T12:28:51.139878+0000","last_became_peered":"2023-10-14T12:28:51.139878+0000","last_unstale":"2023-10-14T12:28:52.769101+0000","last_undegraded":"2023-10-14T12:28:52.769101+0000","last_fullsized":"2023-10-14T12:28:52.769101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761342+0000","last_change":"2023-10-14T12:28:46.796221+0000","last_active":"2023-10-14T12:28:51.761342+0000","last_peered":"2023-10-14T12:28:51.761342+0000","last_clean":"2023-10-14T12:28:51.761342+0000","last_became_active":"2023-10-14T12:28:46.795708+0000","last_became_peered":"2023-10-14T12:28:46.795708+0000","last_unstale":"2023-10-14T12:28:51.761342+0000","last_undegraded":"2023-10-14T12:28:51.761342+0000","last_fullsized":"2023-10-14T12:28:51.761342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763958+0000","last_change":"2023-10-14T12:28:46.079635+0000","last_active":"2023-10-14T12:28:51.763958+0000","last_peered":"2023-10-14T12:28:51.763958+0000","last_clean":"2023-10-14T12:28:51.763958+0000","last_became_active":"2023-10-14T12:28:46.079237+0000","last_became_peered":"2023-10-14T12:28:46.079237+0000","last_unstale":"2023-10-14T12:28:51.763958+0000","last_undegraded":"2023-10-14T12:28:51.763958+0000","last_fullsized":"2023-10-14T12:28:51.763958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.764406+0000","last_change":"2023-10-14T12:28:46.082807+0000","last_active":"2023-10-14T12:28:51.764406+0000","last_peered":"2023-10-14T12:28:51.764406+0000","last_clean":"2023-10-14T12:28:51.764406+0000","last_became_active":"2023-10-14T12:28:46.082446+0000","last_became_peered":"2023-10-14T12:28:46.082446+0000","last_unstale":"2023-10-14T12:28:51.764406+0000","last_undegraded":"2023-10-14T12:28:51.764406+0000","last_fullsized":"2023-10-14T12:28:51.764406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908770+0000","last_change":"2023-10-14T12:28:46.789200+0000","last_active":"2023-10-14T12:28:51.908770+0000","last_peered":"2023-10-14T12:28:51.908770+0000","last_clean":"2023-10-14T12:28:51.908770+0000","last_became_active":"2023-10-14T12:28:46.788290+0000","last_became_peered":"2023-10-14T12:28:46.788290+0000","last_unstale":"2023-10-14T12:28:51.908770+0000","last_undegraded":"2023-10-14T12:28:51.908770+0000","last_fullsized":"2023-10-14T12:28:51.908770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:53:29.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.405050+0000","last_change":"2023-10-14T12:28:51.139776+0000","last_active":"2023-10-14T12:28:54.405050+0000","last_peered":"2023-10-14T12:28:54.405050+0000","last_clean":"2023-10-14T12:28:54.405050+0000","last_became_active":"2023-10-14T12:28:51.139357+0000","last_became_peered":"2023-10-14T12:28:51.139357+0000","last_unstale":"2023-10-14T12:28:54.405050+0000","last_undegraded":"2023-10-14T12:28:54.405050+0000","last_fullsized":"2023-10-14T12:28:54.405050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:32.967798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762275+0000","last_change":"2023-10-14T12:28:46.080941+0000","last_active":"2023-10-14T12:28:51.762275+0000","last_peered":"2023-10-14T12:28:51.762275+0000","last_clean":"2023-10-14T12:28:51.762275+0000","last_became_active":"2023-10-14T12:28:46.080441+0000","last_became_peered":"2023-10-14T12:28:46.080441+0000","last_unstale":"2023-10-14T12:28:51.762275+0000","last_undegraded":"2023-10-14T12:28:51.762275+0000","last_fullsized":"2023-10-14T12:28:51.762275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765820+0000","last_change":"2023-10-14T12:28:46.783353+0000","last_active":"2023-10-14T12:28:51.765820+0000","last_peered":"2023-10-14T12:28:51.765820+0000","last_clean":"2023-10-14T12:28:51.765820+0000","last_became_active":"2023-10-14T12:28:46.780547+0000","last_became_peered":"2023-10-14T12:28:46.780547+0000","last_unstale":"2023-10-14T12:28:51.765820+0000","last_undegraded":"2023-10-14T12:28:51.765820+0000","last_fullsized":"2023-10-14T12:28:51.765820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.312389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767132+0000","last_change":"2023-10-14T12:28:51.148240+0000","last_active":"2023-10-14T12:28:52.767132+0000","last_peered":"2023-10-14T12:28:52.767132+0000","last_clean":"2023-10-14T12:28:52.767132+0000","last_became_active":"2023-10-14T12:28:51.147866+0000","last_became_peered":"2023-10-14T12:28:51.147866+0000","last_unstale":"2023-10-14T12:28:52.767132+0000","last_undegraded":"2023-10-14T12:28:52.767132+0000","last_fullsized":"2023-10-14T12:28:52.767132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:58.023924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763203+0000","last_change":"2023-10-14T12:28:46.796117+0000","last_active":"2023-10-14T12:28:51.763203+0000","last_peered":"2023-10-14T12:28:51.763203+0000","last_clean":"2023-10-14T12:28:51.763203+0000","last_became_active":"2023-10-14T12:28:46.795584+0000","last_became_peered":"2023-10-14T12:28:46.795584+0000","last_unstale":"2023-10-14T12:28:51.763203+0000","last_undegraded":"2023-10-14T12:28:51.763203+0000","last_fullsized":"2023-10-14T12:28:51.763203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140779+0000","last_change":"2023-10-14T12:28:46.792780+0000","last_active":"2023-10-14T12:28:52.140779+0000","last_peered":"2023-10-14T12:28:52.140779+0000","last_clean":"2023-10-14T12:28:52.140779+0000","last_became_active":"2023-10-14T12:28:46.792468+0000","last_became_peered":"2023-10-14T12:28:46.792468+0000","last_unstale":"2023-10-14T12:28:52.140779+0000","last_undegraded":"2023-10-14T12:28:52.140779+0000","last_fullsized":"2023-10-14T12:28:52.140779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:12:50.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919258+0000","last_change":"2023-10-14T12:28:46.800621+0000","last_active":"2023-10-14T12:28:51.919258+0000","last_peered":"2023-10-14T12:28:51.919258+0000","last_clean":"2023-10-14T12:28:51.919258+0000","last_became_active":"2023-10-14T12:28:46.800259+0000","last_became_peered":"2023-10-14T12:28:46.800259+0000","last_unstale":"2023-10-14T12:28:51.919258+0000","last_undegraded":"2023-10-14T12:28:51.919258+0000","last_fullsized":"2023-10-14T12:28:51.919258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908609+0000","last_change":"2023-10-14T12:28:46.798651+0000","last_active":"2023-10-14T12:28:51.908609+0000","last_peered":"2023-10-14T12:28:51.908609+0000","last_clean":"2023-10-14T12:28:51.908609+0000","last_became_active":"2023-10-14T12:28:46.798154+0000","last_became_peered":"2023-10-14T12:28:46.798154+0000","last_unstale":"2023-10-14T12:28:51.908609+0000","last_undegraded":"2023-10-14T12:28:51.908609+0000","last_fullsized":"2023-10-14T12:28:51.908609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:51.310465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762274+0000","last_change":"2023-10-14T12:28:46.800534+0000","last_active":"2023-10-14T12:28:51.762274+0000","last_peered":"2023-10-14T12:28:51.762274+0000","last_clean":"2023-10-14T12:28:51.762274+0000","last_became_active":"2023-10-14T12:28:46.800209+0000","last_became_peered":"2023-10-14T12:28:46.800209+0000","last_unstale":"2023-10-14T12:28:51.762274+0000","last_undegraded":"2023-10-14T12:28:51.762274+0000","last_fullsized":"2023-10-14T12:28:51.762274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920892+0000","last_change":"2023-10-14T12:28:46.801224+0000","last_active":"2023-10-14T12:28:51.920892+0000","last_peered":"2023-10-14T12:28:51.920892+0000","last_clean":"2023-10-14T12:28:51.920892+0000","last_became_active":"2023-10-14T12:28:46.799754+0000","last_became_peered":"2023-10-14T12:28:46.799754+0000","last_unstale":"2023-10-14T12:28:51.920892+0000","last_undegraded":"2023-10-14T12:28:51.920892+0000","last_fullsized":"2023-10-14T12:28:51.920892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765879+0000","last_change":"2023-10-14T12:28:46.789306+0000","last_active":"2023-10-14T12:28:51.765879+0000","last_peered":"2023-10-14T12:28:51.765879+0000","last_clean":"2023-10-14T12:28:51.765879+0000","last_became_active":"2023-10-14T12:28:46.788994+0000","last_became_peered":"2023-10-14T12:28:46.788994+0000","last_unstale":"2023-10-14T12:28:51.765879+0000","last_undegraded":"2023-10-14T12:28:51.765879+0000","last_fullsized":"2023-10-14T12:28:51.765879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763488+0000","last_change":"2023-10-14T12:28:46.800979+0000","last_active":"2023-10-14T12:28:51.763488+0000","last_peered":"2023-10-14T12:28:51.763488+0000","last_clean":"2023-10-14T12:28:51.763488+0000","last_became_active":"2023-10-14T12:28:46.800583+0000","last_became_peered":"2023-10-14T12:28:46.800583+0000","last_unstale":"2023-10-14T12:28:51.763488+0000","last_undegraded":"2023-10-14T12:28:51.763488+0000","last_fullsized":"2023-10-14T12:28:51.763488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919108+0000","last_change":"2023-10-14T12:28:46.804560+0000","last_active":"2023-10-14T12:28:51.919108+0000","last_peered":"2023-10-14T12:28:51.919108+0000","last_clean":"2023-10-14T12:28:51.919108+0000","last_became_active":"2023-10-14T12:28:46.804313+0000","last_became_peered":"2023-10-14T12:28:46.804313+0000","last_unstale":"2023-10-14T12:28:51.919108+0000","last_undegraded":"2023-10-14T12:28:51.919108+0000","last_fullsized":"2023-10-14T12:28:51.919108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763776+0000","last_change":"2023-10-14T12:28:46.787411+0000","last_active":"2023-10-14T12:28:51.763776+0000","last_peered":"2023-10-14T12:28:51.763776+0000","last_clean":"2023-10-14T12:28:51.763776+0000","last_became_active":"2023-10-14T12:28:46.787097+0000","last_became_peered":"2023-10-14T12:28:46.787097+0000","last_unstale":"2023-10-14T12:28:51.763776+0000","last_undegraded":"2023-10-14T12:28:51.763776+0000","last_fullsized":"2023-10-14T12:28:51.763776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919180+0000","last_change":"2023-10-14T12:28:46.797642+0000","last_active":"2023-10-14T12:28:51.919180+0000","last_peered":"2023-10-14T12:28:51.919180+0000","last_clean":"2023-10-14T12:28:51.919180+0000","last_became_active":"2023-10-14T12:28:46.795817+0000","last_became_peered":"2023-10-14T12:28:46.795817+0000","last_unstale":"2023-10-14T12:28:51.919180+0000","last_undegraded":"2023-10-14T12:28:51.919180+0000","last_fullsized":"2023-10-14T12:28:51.919180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908111+0000","last_change":"2023-10-14T12:28:46.795955+0000","last_active":"2023-10-14T12:28:51.908111+0000","last_peered":"2023-10-14T12:28:51.908111+0000","last_clean":"2023-10-14T12:28:51.908111+0000","last_became_active":"2023-10-14T12:28:46.795662+0000","last_became_peered":"2023-10-14T12:28:46.795662+0000","last_unstale":"2023-10-14T12:28:51.908111+0000","last_undegraded":"2023-10-14T12:28:51.908111+0000","last_fullsized":"2023-10-14T12:28:51.908111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:25.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765436+0000","last_change":"2023-10-14T12:28:46.790373+0000","last_active":"2023-10-14T12:28:51.765436+0000","last_peered":"2023-10-14T12:28:51.765436+0000","last_clean":"2023-10-14T12:28:51.765436+0000","last_became_active":"2023-10-14T12:28:46.787302+0000","last_became_peered":"2023-10-14T12:28:46.787302+0000","last_unstale":"2023-10-14T12:28:51.765436+0000","last_undegraded":"2023-10-14T12:28:51.765436+0000","last_fullsized":"2023-10-14T12:28:51.765436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906592+0000","last_change":"2023-10-14T12:28:46.795080+0000","last_active":"2023-10-14T12:28:51.906592+0000","last_peered":"2023-10-14T12:28:51.906592+0000","last_clean":"2023-10-14T12:28:51.906592+0000","last_became_active":"2023-10-14T12:28:46.793929+0000","last_became_peered":"2023-10-14T12:28:46.793929+0000","last_unstale":"2023-10-14T12:28:51.906592+0000","last_undegraded":"2023-10-14T12:28:51.906592+0000","last_fullsized":"2023-10-14T12:28:51.906592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141500+0000","last_change":"2023-10-14T12:28:46.792079+0000","last_active":"2023-10-14T12:28:52.141500+0000","last_peered":"2023-10-14T12:28:52.141500+0000","last_clean":"2023-10-14T12:28:52.141500+0000","last_became_active":"2023-10-14T12:28:46.791050+0000","last_became_peered":"2023-10-14T12:28:46.791050+0000","last_unstale":"2023-10-14T12:28:52.141500+0000","last_undegraded":"2023-10-14T12:28:52.141500+0000","last_fullsized":"2023-10-14T12:28:52.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:09.407054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.792801+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.792421+0000","last_became_peered":"2023-10-14T12:28:46.792421+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922455+0000","last_change":"2023-10-14T12:28:46.792599+0000","last_active":"2023-10-14T12:28:51.922455+0000","last_peered":"2023-10-14T12:28:51.922455+0000","last_clean":"2023-10-14T12:28:51.922455+0000","last_became_active":"2023-10-14T12:28:46.792327+0000","last_became_peered":"2023-10-14T12:28:46.792327+0000","last_unstale":"2023-10-14T12:28:51.922455+0000","last_undegraded":"2023-10-14T12:28:51.922455+0000","last_fullsized":"2023-10-14T12:28:51.922455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.917660+0000","last_change":"2023-10-14T12:28:46.781418+0000","last_active":"2023-10-14T12:28:51.917660+0000","last_peered":"2023-10-14T12:28:51.917660+0000","last_clean":"2023-10-14T12:28:51.917660+0000","last_became_active":"2023-10-14T12:28:46.781029+0000","last_became_peered":"2023-10-14T12:28:46.781029+0000","last_unstale":"2023-10-14T12:28:51.917660+0000","last_undegraded":"2023-10-14T12:28:51.917660+0000","last_fullsized":"2023-10-14T12:28:51.917660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908191+0000","last_change":"2023-10-14T12:28:46.789406+0000","last_active":"2023-10-14T12:28:51.908191+0000","last_peered":"2023-10-14T12:28:51.908191+0000","last_clean":"2023-10-14T12:28:51.908191+0000","last_became_active":"2023-10-14T12:28:46.788816+0000","last_became_peered":"2023-10-14T12:28:46.788816+0000","last_unstale":"2023-10-14T12:28:51.908191+0000","last_undegraded":"2023-10-14T12:28:51.908191+0000","last_fullsized":"2023-10-14T12:28:51.908191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:51.781330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761766+0000","last_change":"2023-10-14T12:28:46.796885+0000","last_active":"2023-10-14T12:28:51.761766+0000","last_peered":"2023-10-14T12:28:51.761766+0000","last_clean":"2023-10-14T12:28:51.761766+0000","last_became_active":"2023-10-14T12:28:46.796301+0000","last_became_peered":"2023-10-14T12:28:46.796301+0000","last_unstale":"2023-10-14T12:28:51.761766+0000","last_undegraded":"2023-10-14T12:28:51.761766+0000","last_fullsized":"2023-10-14T12:28:51.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767000+0000","last_change":"2023-10-14T12:28:46.777441+0000","last_active":"2023-10-14T12:28:51.767000+0000","last_peered":"2023-10-14T12:28:51.767000+0000","last_clean":"2023-10-14T12:28:51.767000+0000","last_became_active":"2023-10-14T12:28:46.776829+0000","last_became_peered":"2023-10-14T12:28:46.776829+0000","last_unstale":"2023-10-14T12:28:51.767000+0000","last_undegraded":"2023-10-14T12:28:51.767000+0000","last_fullsized":"2023-10-14T12:28:51.767000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:26.687643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765557+0000","last_change":"2023-10-14T12:28:46.797878+0000","last_active":"2023-10-14T12:28:51.765557+0000","last_peered":"2023-10-14T12:28:51.765557+0000","last_clean":"2023-10-14T12:28:51.765557+0000","last_became_active":"2023-10-14T12:28:46.796270+0000","last_became_peered":"2023-10-14T12:28:46.796270+0000","last_unstale":"2023-10-14T12:28:51.765557+0000","last_undegraded":"2023-10-14T12:28:51.765557+0000","last_fullsized":"2023-10-14T12:28:51.765557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765711+0000","last_change":"2023-10-14T12:28:46.789943+0000","last_active":"2023-10-14T12:28:51.765711+0000","last_peered":"2023-10-14T12:28:51.765711+0000","last_clean":"2023-10-14T12:28:51.765711+0000","last_became_active":"2023-10-14T12:28:46.789674+0000","last_became_peered":"2023-10-14T12:28:46.789674+0000","last_unstale":"2023-10-14T12:28:51.765711+0000","last_undegraded":"2023-10-14T12:28:51.765711+0000","last_fullsized":"2023-10-14T12:28:51.765711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905479+0000","last_change":"2023-10-14T12:28:46.803906+0000","last_active":"2023-10-14T12:28:51.905479+0000","last_peered":"2023-10-14T12:28:51.905479+0000","last_clean":"2023-10-14T12:28:51.905479+0000","last_became_active":"2023-10-14T12:28:46.803546+0000","last_became_peered":"2023-10-14T12:28:46.803546+0000","last_unstale":"2023-10-14T12:28:51.905479+0000","last_undegraded":"2023-10-14T12:28:51.905479+0000","last_fullsized":"2023-10-14T12:28:51.905479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:56.121924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761095+0000","last_change":"2023-10-14T12:28:46.797087+0000","last_active":"2023-10-14T12:28:51.761095+0000","last_peered":"2023-10-14T12:28:51.761095+0000","last_clean":"2023-10-14T12:28:51.761095+0000","last_became_active":"2023-10-14T12:28:46.796131+0000","last_became_peered":"2023-10-14T12:28:46.796131+0000","last_unstale":"2023-10-14T12:28:51.761095+0000","last_undegraded":"2023-10-14T12:28:51.761095+0000","last_fullsized":"2023-10-14T12:28:51.761095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901832+0000","last_change":"2023-10-14T12:28:46.796853+0000","last_active":"2023-10-14T12:28:51.901832+0000","last_peered":"2023-10-14T12:28:51.901832+0000","last_clean":"2023-10-14T12:28:51.901832+0000","last_became_active":"2023-10-14T12:28:46.796587+0000","last_became_peered":"2023-10-14T12:28:46.796587+0000","last_unstale":"2023-10-14T12:28:51.901832+0000","last_undegraded":"2023-10-14T12:28:51.901832+0000","last_fullsized":"2023-10-14T12:28:51.901832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919066+0000","last_change":"2023-10-14T12:28:46.791836+0000","last_active":"2023-10-14T12:28:51.919066+0000","last_peered":"2023-10-14T12:28:51.919066+0000","last_clean":"2023-10-14T12:28:51.919066+0000","last_became_active":"2023-10-14T12:28:46.791576+0000","last_became_peered":"2023-10-14T12:28:46.791576+0000","last_unstale":"2023-10-14T12:28:51.919066+0000","last_undegraded":"2023-10-14T12:28:51.919066+0000","last_fullsized":"2023-10-14T12:28:51.919066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901570+0000","last_change":"2023-10-14T12:28:46.794780+0000","last_active":"2023-10-14T12:28:51.901570+0000","last_peered":"2023-10-14T12:28:51.901570+0000","last_clean":"2023-10-14T12:28:51.901570+0000","last_became_active":"2023-10-14T12:28:46.794505+0000","last_became_peered":"2023-10-14T12:28:46.794505+0000","last_unstale":"2023-10-14T12:28:51.901570+0000","last_undegraded":"2023-10-14T12:28:51.901570+0000","last_fullsized":"2023-10-14T12:28:51.901570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922495+0000","last_change":"2023-10-14T12:28:46.803988+0000","last_active":"2023-10-14T12:28:51.922495+0000","last_peered":"2023-10-14T12:28:51.922495+0000","last_clean":"2023-10-14T12:28:51.922495+0000","last_became_active":"2023-10-14T12:28:46.803738+0000","last_became_peered":"2023-10-14T12:28:46.803738+0000","last_unstale":"2023-10-14T12:28:51.922495+0000","last_undegraded":"2023-10-14T12:28:51.922495+0000","last_fullsized":"2023-10-14T12:28:51.922495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.907759+0000","last_change":"2023-10-14T12:28:46.794216+0000","last_active":"2023-10-14T12:28:51.907759+0000","last_peered":"2023-10-14T12:28:51.907759+0000","last_clean":"2023-10-14T12:28:51.907759+0000","last_became_active":"2023-10-14T12:28:46.792243+0000","last_became_peered":"2023-10-14T12:28:46.792243+0000","last_unstale":"2023-10-14T12:28:51.907759+0000","last_undegraded":"2023-10-14T12:28:51.907759+0000","last_fullsized":"2023-10-14T12:28:51.907759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:39:12.370839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920339+0000","last_change":"2023-10-14T12:28:46.792759+0000","last_active":"2023-10-14T12:28:51.920339+0000","last_peered":"2023-10-14T12:28:51.920339+0000","last_clean":"2023-10-14T12:28:51.920339+0000","last_became_active":"2023-10-14T12:28:46.791814+0000","last_became_peered":"2023-10-14T12:28:46.791814+0000","last_unstale":"2023-10-14T12:28:51.920339+0000","last_undegraded":"2023-10-14T12:28:51.920339+0000","last_fullsized":"2023-10-14T12:28:51.920339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.904779+0000","last_change":"2023-10-14T12:28:46.791353+0000","last_active":"2023-10-14T12:28:51.904779+0000","last_peered":"2023-10-14T12:28:51.904779+0000","last_clean":"2023-10-14T12:28:51.904779+0000","last_became_active":"2023-10-14T12:28:46.791059+0000","last_became_peered":"2023-10-14T12:28:46.791059+0000","last_unstale":"2023-10-14T12:28:51.904779+0000","last_undegraded":"2023-10-14T12:28:51.904779+0000","last_fullsized":"2023-10-14T12:28:51.904779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]}]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5309999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2849999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7589999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0579999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1309999999999998}]}]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":114863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.462}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.984}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0449999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.222}]}]},{"osd":3,"up_from":14,"seq":60129542151,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77700000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.155}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0309999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":114737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.069}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8740000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.554}]}]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":114897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.337}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]}]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.681}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:29:09.842 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T12:29:09.843 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-14T12:29:09.843 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-14T12:29:09.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-14T12:29:09.844 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-14T12:29:09.999 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:29:10.005 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:29:10.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.108+0000 7f411bfff640 1 Processor -- start 2023-10-14T12:29:10.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.109+0000 7f411bfff640 1 -- start start 2023-10-14T12:29:10.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.110+0000 7f411bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f411c0ae6d0 0x7f411c0b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.110+0000 7f411bfff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c06ed50 con 0x7f411c0b4d40 2023-10-14T12:29:10.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.110+0000 7f411bfff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411c0aef50 con 0x7f411c15a8f0 2023-10-14T12:29:10.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.110+0000 7f411bfff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411c06f280 con 0x7f411c0ae6d0 2023-10-14T12:29:10.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.110+0000 7f411b7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f411c0b4d40 0x7f411c071750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42532/0 (socket says 172.21.15.64:42532) 2023-10-14T12:29:10.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.110+0000 7f411b7fe640 1 -- 172.21.15.64:0/3212006142 learned_addr learned my addr 172.21.15.64:0/3212006142 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:10.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.111+0000 7f411a7fc640 1 --2- 172.21.15.64:0/3212006142 >> v2:172.21.15.177:3300/0 conn(0x7f411c0ae6d0 0x7f411c0b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.111+0000 7f4119ffb640 1 -- 172.21.15.64:0/3212006142 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076355824 0 0) 0x7f411c06ed50 con 0x7f411c0b4d40 2023-10-14T12:29:10.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.111+0000 7f4119ffb640 1 -- 172.21.15.64:0/3212006142 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4104003520 con 0x7f411c0b4d40 2023-10-14T12:29:10.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.111+0000 7f411a7fc640 1 -- 172.21.15.64:0/3212006142 >> v1:172.21.15.177:6789/0 conn(0x7f411c15a8f0 legacy=0x7f411c0b25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.111+0000 7f411a7fc640 1 -- 172.21.15.64:0/3212006142 >> v1:172.21.15.64:6789/0 conn(0x7f411c0b4d40 legacy=0x7f411c071750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.111+0000 7f411a7fc640 1 -- 172.21.15.64:0/3212006142 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411c0b5430 con 0x7f411c0ae6d0 2023-10-14T12:29:10.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.111+0000 7f4119ffb640 1 -- 172.21.15.64:0/3212006142 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 930610031 0 0) 0x7f4104003520 con 0x7f411c0b4d40 2023-10-14T12:29:10.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.113+0000 7f411a7fc640 1 --2- 172.21.15.64:0/3212006142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0ae6d0 0x7f411c0b1160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41100097a0 tx=0x7f411002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e99581bf06b85c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:10.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.113+0000 7f4119ffb640 1 -- 172.21.15.64:0/3212006142 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411002f050 con 0x7f411c0ae6d0 2023-10-14T12:29:10.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.113+0000 7f4119ffb640 1 -- 172.21.15.64:0/3212006142 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110031500 con 0x7f411c0ae6d0 2023-10-14T12:29:10.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.113+0000 7f4119ffb640 1 -- 172.21.15.64:0/3212006142 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140019f0 con 0x7f411c0ae6d0 2023-10-14T12:29:10.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.114+0000 7f411bfff640 1 -- 172.21.15.64:0/3212006142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0ae6d0 msgr2=0x7f411c0b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.114+0000 7f411bfff640 1 --2- 172.21.15.64:0/3212006142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0ae6d0 0x7f411c0b1160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f41100097a0 tx=0x7f411002b820 comp rx=0 tx=0).stop 2023-10-14T12:29:10.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.114+0000 7f411bfff640 1 -- 172.21.15.64:0/3212006142 shutdown_connections 2023-10-14T12:29:10.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.114+0000 7f411bfff640 1 --2- 172.21.15.64:0/3212006142 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0ae6d0 0x7f411c0b1160 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.114+0000 7f411bfff640 1 -- 172.21.15.64:0/3212006142 >> 172.21.15.64:0/3212006142 conn(0x7f411c0cf660 msgr2=0x7f411c0cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:10.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.114+0000 7f411bfff640 1 -- 172.21.15.64:0/3212006142 shutdown_connections 2023-10-14T12:29:10.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.114+0000 7f411bfff640 1 -- 172.21.15.64:0/3212006142 wait complete. 2023-10-14T12:29:10.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.116+0000 7f411bfff640 1 Processor -- start 2023-10-14T12:29:10.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.116+0000 7f411bfff640 1 -- start start 2023-10-14T12:29:10.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f411c0ae6d0 0x7f411c158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0b4d40 0x7f411c0ac8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f411c15a8f0 0x7f411c0acdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411bfff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c15da00 con 0x7f411c15a8f0 2023-10-14T12:29:10.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411bfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c3d10 con 0x7f411c0b4d40 2023-10-14T12:29:10.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f411c0c3ff0 con 0x7f411c0ae6d0 2023-10-14T12:29:10.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f411c15a8f0 0x7f411c0acdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f411c15a8f0 0x7f411c0acdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37572/0 (socket says 172.21.15.64:37572) 2023-10-14T12:29:10.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.117+0000 7f411b7fe640 1 -- 172.21.15.64:0/3283713795 learned_addr learned my addr 172.21.15.64:0/3283713795 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:10.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411a7fc640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0b4d40 0x7f411c0ac8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411affd640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f411c0ae6d0 0x7f411c158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411b7fe640 1 -- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f411c0ae6d0 msgr2=0x7f411c158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411b7fe640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f411c0ae6d0 0x7f411c158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411b7fe640 1 -- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0b4d40 msgr2=0x7f411c0ac8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411b7fe640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0b4d40 0x7f411c0ac8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411b7fe640 1 -- 172.21.15.64:0/3283713795 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110009400 con 0x7f411c15a8f0 2023-10-14T12:29:10.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411a7fc640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0b4d40 0x7f411c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:10.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f411b7fe640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f411c15a8f0 0x7f411c0acdf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4114001f70 tx=0x7f411400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:10.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f41037fe640 1 -- 172.21.15.64:0/3283713795 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4114012400 con 0x7f411c15a8f0 2023-10-14T12:29:10.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.118+0000 7f41037fe640 1 -- 172.21.15.64:0/3283713795 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4114012560 con 0x7f411c15a8f0 2023-10-14T12:29:10.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.119+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f411c0c42d0 con 0x7f411c15a8f0 2023-10-14T12:29:10.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.119+0000 7f41037fe640 1 -- 172.21.15.64:0/3283713795 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41140128d0 con 0x7f411c15a8f0 2023-10-14T12:29:10.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.119+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f411c0c4890 con 0x7f411c15a8f0 2023-10-14T12:29:10.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.120+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411c0b2c60 con 0x7f411c15a8f0 2023-10-14T12:29:10.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.121+0000 7f41037fe640 1 -- 172.21.15.64:0/3283713795 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4114012a30 con 0x7f411c15a8f0 2023-10-14T12:29:10.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.122+0000 7f41037fe640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f410806aec0 0x7f410806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.122+0000 7f41037fe640 1 -- 172.21.15.64:0/3283713795 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4114089fd0 con 0x7f411c15a8f0 2023-10-14T12:29:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.122+0000 7f411affd640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f410806aec0 0x7f410806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.123+0000 7f411affd640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f410806aec0 0x7f410806d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f410c000f60 tx=0x7f410c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.126+0000 7f41037fe640 1 -- 172.21.15.64:0/3283713795 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4114054e80 con 0x7f411c15a8f0 2023-10-14T12:29:10.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.372+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f411c04e9b0 con 0x7f411c15a8f0 2023-10-14T12:29:10.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.379+0000 7f41037fe640 1 -- 172.21.15.64:0/3283713795 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171030 (secure 0 0 0) 0x7f41140584a0 con 0x7f411c15a8f0 2023-10-14T12:29:10.382 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:10.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f410806aec0 msgr2=0x7f410806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f410806aec0 0x7f410806d380 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f410c000f60 tx=0x7f410c009040 comp rx=0 tx=0).stop 2023-10-14T12:29:10.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f411c15a8f0 msgr2=0x7f411c0acdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f411c15a8f0 0x7f411c0acdf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4114001f70 tx=0x7f411400a430 comp rx=0 tx=0).stop 2023-10-14T12:29:10.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 shutdown_connections 2023-10-14T12:29:10.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f410806aec0 0x7f410806d380 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f411c15a8f0 0x7f411c0acdf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f411c0b4d40 0x7f411c0ac8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 --2- 172.21.15.64:0/3283713795 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f411c0ae6d0 0x7f411c158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 >> 172.21.15.64:0/3283713795 conn(0x7f411c0cf660 msgr2=0x7f411c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:10.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 shutdown_connections 2023-10-14T12:29:10.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.384+0000 7f411bfff640 1 -- 172.21.15.64:0/3283713795 wait complete. 2023-10-14T12:29:10.405 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":5,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6832","nonce":55986901},{"type":"v1","addr":"172.21.15.177:6833","nonce":55986901}]},"active_addr":"172.21.15.177:6833/55986901","active_change":"2023-10-14T12:28:31.703792+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":491905949}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":4239640031}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":4046395010}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2863705416}]}]} 2023-10-14T12:29:10.409 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-14T12:29:10.410 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-14T12:29:10.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:10.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.677+0000 7f486e93c640 1 Processor -- start 2023-10-14T12:29:10.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.677+0000 7f486e93c640 1 -- start start 2023-10-14T12:29:10.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.679+0000 7f486e93c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 0x7f48680cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.679+0000 7f486e93c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486815acb0 con 0x7f486806ff40 2023-10-14T12:29:10.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.679+0000 7f486e93c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48680c1c60 con 0x7f48680ca660 2023-10-14T12:29:10.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.679+0000 7f486e93c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f486806cd50 con 0x7f486815a8d0 2023-10-14T12:29:10.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.679+0000 7f486e13b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f486806ff40 0x7f486806c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42540/0 (socket says 172.21.15.64:42540) 2023-10-14T12:29:10.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.679+0000 7f486e13b640 1 -- 172.21.15.64:0/3136156985 learned_addr learned my addr 172.21.15.64:0/3136156985 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:10.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486d93a640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 0x7f48680cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656202968 0 0) 0x7f4860001490 con 0x7f486806ff40 2023-10-14T12:29:10.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4854003520 con 0x7f486806ff40 2023-10-14T12:29:10.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2460102551 0 0) 0x7f4854003520 con 0x7f486806ff40 2023-10-14T12:29:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 msgr2=0x7f48680cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 0x7f48680cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 >> v1:172.21.15.177:6789/0 conn(0x7f48680ca660 legacy=0x7f486806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486815e350 con 0x7f486806ff40 2023-10-14T12:29:10.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f4860001b80 con 0x7f486806ff40 2023-10-14T12:29:10.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 >> v1:172.21.15.64:6789/0 conn(0x7f486806ff40 legacy=0x7f486806c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48540039a0 0x7f4854003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48540047c0 0x7f4854004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 0x7f4854005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486806cd50 con 0x7f48540047c0 2023-10-14T12:29:10.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485400ba60 con 0x7f48540039a0 2023-10-14T12:29:10.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.680+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485400bc20 con 0x7f486815a8d0 2023-10-14T12:29:10.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486d139640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48540047c0 0x7f4854004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486d93a640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48540039a0 0x7f4854003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486e13b640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 0x7f4854005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486d139640 1 -- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 msgr2=0x7f4854005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:10.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486d139640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f486815a8d0 0x7f4854005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486d139640 1 -- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48540039a0 msgr2=0x7f4854003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:10.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486d139640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f48540039a0 0x7f4854003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.681+0000 7f486d139640 1 -- 172.21.15.64:0/3136156985 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854003520 con 0x7f48540047c0 2023-10-14T12:29:10.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.682+0000 7f486d139640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48540047c0 0x7f4854004c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4858001720 tx=0x7f48540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d3f9cb6c195b406 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:10.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580052d0 con 0x7f48540047c0 2023-10-14T12:29:10.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485802e050 con 0x7f48540047c0 2023-10-14T12:29:10.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486c938640 1 -- 172.21.15.64:0/3136156985 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48580035f0 con 0x7f48540047c0 2023-10-14T12:29:10.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486e93c640 1 -- 172.21.15.64:0/3136156985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48540047c0 msgr2=0x7f4854004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486e93c640 1 --2- 172.21.15.64:0/3136156985 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48540047c0 0x7f4854004c40 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4858001720 tx=0x7f48540057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486e13b640 1 -- 172.21.15.64:0/3136156985 reap_dead start 2023-10-14T12:29:10.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486e93c640 1 -- 172.21.15.64:0/3136156985 shutdown_connections 2023-10-14T12:29:10.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486e93c640 1 -- 172.21.15.64:0/3136156985 >> 172.21.15.64:0/3136156985 conn(0x7f486806a470 msgr2=0x7f48680afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:10.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486e93c640 1 -- 172.21.15.64:0/3136156985 shutdown_connections 2023-10-14T12:29:10.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.683+0000 7f486e93c640 1 -- 172.21.15.64:0/3136156985 wait complete. 2023-10-14T12:29:10.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.685+0000 7f486e93c640 1 Processor -- start 2023-10-14T12:29:10.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.685+0000 7f486e93c640 1 -- start start 2023-10-14T12:29:10.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.686+0000 7f486e93c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48540047c0 0x7f48680c4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.686+0000 7f486e93c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4868157680 0x7f4868156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.686+0000 7f486e93c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48680c7460 0x7f48680c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.686+0000 7f486e93c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48680c4b00 con 0x7f48680c7460 2023-10-14T12:29:10.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.686+0000 7f486e93c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48680c7e20 con 0x7f4868157680 2023-10-14T12:29:10.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.686+0000 7f486e93c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48680c3380 con 0x7f48540047c0 2023-10-14T12:29:10.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48680c7460 0x7f48680c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48680c7460 0x7f48680c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37586/0 (socket says 172.21.15.64:37586) 2023-10-14T12:29:10.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 -- 172.21.15.64:0/177613441 learned_addr learned my addr 172.21.15.64:0/177613441 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:10.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486d93a640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48540047c0 0x7f48680c4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486d139640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4868157680 0x7f4868156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 -- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48540047c0 msgr2=0x7f48680c4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48540047c0 0x7f48680c4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 -- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4868157680 msgr2=0x7f4868156ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4868157680 0x7f4868156ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 -- 172.21.15.64:0/177613441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48680c4860 con 0x7f48680c7460 2023-10-14T12:29:10.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486d139640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4868157680 0x7f4868156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:10.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.687+0000 7f486e13b640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48680c7460 0x7f48680c78e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f486806e190 tx=0x7f486000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:10.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.688+0000 7f485e7fc640 1 -- 172.21.15.64:0/177613441 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f486000ec10 con 0x7f48680c7460 2023-10-14T12:29:10.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.688+0000 7f485e7fc640 1 -- 172.21.15.64:0/177613441 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f486000ed90 con 0x7f48680c7460 2023-10-14T12:29:10.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.688+0000 7f485e7fc640 1 -- 172.21.15.64:0/177613441 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4860013660 con 0x7f48680c7460 2023-10-14T12:29:10.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.688+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48680c2a50 con 0x7f48680c7460 2023-10-14T12:29:10.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.688+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48680c3010 con 0x7f48680c7460 2023-10-14T12:29:10.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.689+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48680c3510 con 0x7f48680c7460 2023-10-14T12:29:10.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.690+0000 7f485e7fc640 1 -- 172.21.15.64:0/177613441 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f48600137c0 con 0x7f48680c7460 2023-10-14T12:29:10.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.691+0000 7f485e7fc640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f484c06ae70 0x7f484c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:10.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.691+0000 7f485e7fc640 1 -- 172.21.15.64:0/177613441 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4860089ce0 con 0x7f48680c7460 2023-10-14T12:29:10.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.692+0000 7f486d93a640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f484c06ae70 0x7f484c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:10.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.693+0000 7f486d93a640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f484c06ae70 0x7f484c06d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4864009a00 tx=0x7f4864008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:10.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.695+0000 7f485e7fc640 1 -- 172.21.15.64:0/177613441 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4860054a10 con 0x7f48680c7460 2023-10-14T12:29:10.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.897+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48680c3510 con 0x7f48680c7460 2023-10-14T12:29:10.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.899+0000 7f485e7fc640 1 -- 172.21.15.64:0/177613441 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f4860058030 con 0x7f48680c7460 2023-10-14T12:29:10.901 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:10.901 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:10.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f484c06ae70 msgr2=0x7f484c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f484c06ae70 0x7f484c06d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4864009a00 tx=0x7f4864008040 comp rx=0 tx=0).stop 2023-10-14T12:29:10.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48680c7460 msgr2=0x7f48680c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:10.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48680c7460 0x7f48680c78e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f486806e190 tx=0x7f486000e530 comp rx=0 tx=0).stop 2023-10-14T12:29:10.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 shutdown_connections 2023-10-14T12:29:10.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f484c06ae70 0x7f484c06d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f48680c7460 0x7f48680c78e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4868157680 0x7f4868156ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 --2- 172.21.15.64:0/177613441 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f48540047c0 0x7f48680c4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:10.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 >> 172.21.15.64:0/177613441 conn(0x7f486806a470 msgr2=0x7f48680afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:10.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 shutdown_connections 2023-10-14T12:29:10.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:10.901+0000 7f486e93c640 1 -- 172.21.15.64:0/177613441 wait complete. 2023-10-14T12:29:10.923 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-14T12:29:10.924 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:11.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.151+0000 7fa6061e9640 1 Processor -- start 2023-10-14T12:29:11.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.152+0000 7fa6061e9640 1 -- start start 2023-10-14T12:29:11.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6061e9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa6000cb250 0x7fa6000c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6061e9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa6000ca660 0x7fa6000c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6061e9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa60015acb0 con 0x7fa60015a8d0 2023-10-14T12:29:11.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6061e9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6000c1c60 con 0x7fa6000cb250 2023-10-14T12:29:11.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6061e9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa60015e350 con 0x7fa6000ca660 2023-10-14T12:29:11.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6051e7640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fa60015a8d0 0x7fa6000cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42548/0 (socket says 172.21.15.64:42548) 2023-10-14T12:29:11.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6051e7640 1 -- 172.21.15.64:0/1665045579 learned_addr learned my addr 172.21.15.64:0/1665045579 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:11.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.153+0000 7fa6049e6640 1 --2- 172.21.15.64:0/1665045579 >> v2:172.21.15.64:3300/0 conn(0x7fa6000cb250 0x7fa6000c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.154+0000 7fa6059e8640 1 --2- 172.21.15.64:0/1665045579 >> v2:172.21.15.177:3300/0 conn(0x7fa6000ca660 0x7fa6000c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.154+0000 7fa6049e6640 1 -- 172.21.15.64:0/1665045579 >> v2:172.21.15.177:3300/0 conn(0x7fa6000ca660 msgr2=0x7fa6000c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.154+0000 7fa6049e6640 1 --2- 172.21.15.64:0/1665045579 >> v2:172.21.15.177:3300/0 conn(0x7fa6000ca660 0x7fa6000c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.154+0000 7fa6049e6640 1 -- 172.21.15.64:0/1665045579 >> v1:172.21.15.64:6789/0 conn(0x7fa60015a8d0 legacy=0x7fa6000cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.154+0000 7fa5f7fff640 1 -- 172.21.15.64:0/1665045579 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477413085 0 0) 0x7fa5fc001290 con 0x7fa60015a8d0 2023-10-14T12:29:11.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.154+0000 7fa6049e6640 1 -- 172.21.15.64:0/1665045579 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa60015e630 con 0x7fa6000cb250 2023-10-14T12:29:11.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.154+0000 7fa6059e8640 1 --2- 172.21.15.64:0/1665045579 >> v2:172.21.15.177:3300/0 conn(0x7fa6000ca660 0x7fa6000c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:11.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.155+0000 7fa6049e6640 1 --2- 172.21.15.64:0/1665045579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000cb250 0x7fa6000c8e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6000addb0 tx=0x7fa5f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415e9798ccec253b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.155+0000 7fa5f7fff640 1 -- 172.21.15.64:0/1665045579 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0031830 con 0x7fa6000cb250 2023-10-14T12:29:11.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.155+0000 7fa5f7fff640 1 -- 172.21.15.64:0/1665045579 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5f0031990 con 0x7fa6000cb250 2023-10-14T12:29:11.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.155+0000 7fa5f7fff640 1 -- 172.21.15.64:0/1665045579 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0031d20 con 0x7fa6000cb250 2023-10-14T12:29:11.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 -- 172.21.15.64:0/1665045579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000cb250 msgr2=0x7fa6000c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 --2- 172.21.15.64:0/1665045579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000cb250 0x7fa6000c8e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa6000addb0 tx=0x7fa5f002b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 -- 172.21.15.64:0/1665045579 shutdown_connections 2023-10-14T12:29:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 --2- 172.21.15.64:0/1665045579 >> v2:172.21.15.177:3300/0 conn(0x7fa6000ca660 0x7fa6000c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 --2- 172.21.15.64:0/1665045579 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000cb250 0x7fa6000c8e10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 -- 172.21.15.64:0/1665045579 >> 172.21.15.64:0/1665045579 conn(0x7fa60006a470 msgr2=0x7fa6000afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 -- 172.21.15.64:0/1665045579 shutdown_connections 2023-10-14T12:29:11.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.156+0000 7fa6061e9640 1 -- 172.21.15.64:0/1665045579 wait complete. 2023-10-14T12:29:11.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.158+0000 7fa6061e9640 1 Processor -- start 2023-10-14T12:29:11.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.158+0000 7fa6061e9640 1 -- start start 2023-10-14T12:29:11.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6061e9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000ca660 0x7fa60014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6061e9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6000cb250 0x7fa6000ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6061e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60015a8d0 0x7fa6000c3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6061e9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000ac5a0 con 0x7fa6000ca660 2023-10-14T12:29:11.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6061e9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000ab990 con 0x7fa60015a8d0 2023-10-14T12:29:11.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6061e9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6000abc70 con 0x7fa6000cb250 2023-10-14T12:29:11.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6051e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000ca660 0x7fa60014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6051e7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000ca660 0x7fa60014e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37612/0 (socket says 172.21.15.64:37612) 2023-10-14T12:29:11.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.159+0000 7fa6051e7640 1 -- 172.21.15.64:0/3302856902 learned_addr learned my addr 172.21.15.64:0/3302856902 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6059e8640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60015a8d0 0x7fa6000c3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6049e6640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6000cb250 0x7fa6000ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6051e7640 1 -- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6000cb250 msgr2=0x7fa6000ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6051e7640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6000cb250 0x7fa6000ad040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6051e7640 1 -- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60015a8d0 msgr2=0x7fa6000c3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6051e7640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60015a8d0 0x7fa6000c3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6051e7640 1 -- 172.21.15.64:0/3302856902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0009400 con 0x7fa6000ca660 2023-10-14T12:29:11.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6059e8640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60015a8d0 0x7fa6000c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:11.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6051e7640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000ca660 0x7fa60014e9a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0014f0 tx=0x7fa5fc00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa5f5ffb640 1 -- 172.21.15.64:0/3302856902 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc007480 con 0x7fa6000ca660 2023-10-14T12:29:11.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa5f5ffb640 1 -- 172.21.15.64:0/3302856902 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5fc007600 con 0x7fa6000ca660 2023-10-14T12:29:11.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa5f5ffb640 1 -- 172.21.15.64:0/3302856902 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5fc0059e0 con 0x7fa6000ca660 2023-10-14T12:29:11.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6000abf50 con 0x7fa6000ca660 2023-10-14T12:29:11.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.160+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6000cddf0 con 0x7fa6000ca660 2023-10-14T12:29:11.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.161+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa60004e9b0 con 0x7fa6000ca660 2023-10-14T12:29:11.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.163+0000 7fa5f5ffb640 1 -- 172.21.15.64:0/3302856902 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa5fc005b40 con 0x7fa6000ca660 2023-10-14T12:29:11.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.163+0000 7fa5f5ffb640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa5e406ae70 0x7fa5e406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.164+0000 7fa5f5ffb640 1 -- 172.21.15.64:0/3302856902 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa5fc088c60 con 0x7fa6000ca660 2023-10-14T12:29:11.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.164+0000 7fa6049e6640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa5e406ae70 0x7fa5e406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.165+0000 7fa6049e6640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa5e406ae70 0x7fa5e406d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0036000 tx=0x7fa5f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.168+0000 7fa5f5ffb640 1 -- 172.21.15.64:0/3302856902 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa5fc053ab0 con 0x7fa6000ca660 2023-10-14T12:29:11.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.366+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa60015acb0 con 0x7fa6000ca660 2023-10-14T12:29:11.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.368+0000 7fa5f5ffb640 1 -- 172.21.15.64:0/3302856902 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7fa60015acb0 con 0x7fa6000ca660 2023-10-14T12:29:11.370 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:11.370 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:11.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa5e406ae70 msgr2=0x7fa5e406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa5e406ae70 0x7fa5e406d330 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0036000 tx=0x7fa5f0008030 comp rx=0 tx=0).stop 2023-10-14T12:29:11.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000ca660 msgr2=0x7fa60014e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000ca660 0x7fa60014e9a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fa5fc0014f0 tx=0x7fa5fc00c960 comp rx=0 tx=0).stop 2023-10-14T12:29:11.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 shutdown_connections 2023-10-14T12:29:11.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa5e406ae70 0x7fa5e406d330 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa60015a8d0 0x7fa6000c3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa6000cb250 0x7fa6000ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 --2- 172.21.15.64:0/3302856902 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa6000ca660 0x7fa60014e9a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.370+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 >> 172.21.15.64:0/3302856902 conn(0x7fa60006a470 msgr2=0x7fa6000af290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.371+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 shutdown_connections 2023-10-14T12:29:11.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.371+0000 7fa6061e9640 1 -- 172.21.15.64:0/3302856902 wait complete. 2023-10-14T12:29:11.394 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-14T12:29:11.394 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-14T12:29:11.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-14T12:29:11.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-14T12:29:11.396 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-14T12:29:11.397 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-14T12:29:11.397 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-14T12:29:11.398 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-14T12:29:11.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.707+0000 7fc861c7c640 1 Processor -- start 2023-10-14T12:29:11.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.708+0000 7fc861c7c640 1 -- start start 2023-10-14T12:29:11.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.711+0000 7fc861c7c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8540e64b0 0x7fc85403e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.711+0000 7fc861c7c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc8540382c0 0x7fc85403c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fc861c7c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc854057200 con 0x7fc854053cf0 2023-10-14T12:29:11.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fb74d0e5640 1 Processor -- start 2023-10-14T12:29:11.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8540e64b0 0x7fc85403e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fc861c7c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8540574a0 con 0x7fc8540382c0 2023-10-14T12:29:11.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fc861c7c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc854057780 con 0x7fc8540e64b0 2023-10-14T12:29:11.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fc85affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc8540382c0 0x7fc85403c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8540e64b0 0x7fc85403e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45128/0 (socket says 172.21.15.64:45128) 2023-10-14T12:29:11.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.712+0000 7fb74d0e5640 1 -- start start 2023-10-14T12:29:11.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.713+0000 7fc85affd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc8540382c0 0x7fc85403c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:37716/0 (socket says 172.21.15.64:37716) 2023-10-14T12:29:11.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.713+0000 7fc85affd640 1 -- 172.21.15.64:0/1738689770 learned_addr learned my addr 172.21.15.64:0/1738689770 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.714+0000 7fb74d0e5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb7480c1380 0x7fb7480b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.714+0000 7fb74d0e5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7480c1760 0x7fb7480cc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.714+0000 7fb74d0e5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7480cd010 con 0x7fb748069de0 2023-10-14T12:29:11.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.714+0000 7fb74d0e5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7480cdc90 con 0x7fb7480c1380 2023-10-14T12:29:11.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.714+0000 7fb74d0e5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480cd2f0 con 0x7fb7480c1760 2023-10-14T12:29:11.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.715+0000 7fb74659c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7480c1760 0x7fb7480cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.715+0000 7fb74659c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7480c1760 0x7fb7480cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45130/0 (socket says 172.21.15.64:45130) 2023-10-14T12:29:11.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.716+0000 7fb74659c640 1 -- 172.21.15.64:0/3584847497 learned_addr learned my addr 172.21.15.64:0/3584847497 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.715+0000 7fb74759e640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fb748069de0 0x7fb74806a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:55156/0 (socket says 172.21.15.64:55156) 2023-10-14T12:29:11.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.714+0000 7fc85a7fc640 1 -- 172.21.15.64:0/1738689770 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3676449142 0 0) 0x7fc854057200 con 0x7fc854053cf0 2023-10-14T12:29:11.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.714+0000 7fc85a7fc640 1 -- 172.21.15.64:0/1738689770 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc84c003520 con 0x7fc854053cf0 2023-10-14T12:29:11.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.715+0000 7fc85affd640 1 -- 172.21.15.64:0/1738689770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8540e64b0 msgr2=0x7fc85403e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.715+0000 7fc85affd640 1 --2- 172.21.15.64:0/1738689770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8540e64b0 0x7fc85403e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.715+0000 7fc85affd640 1 -- 172.21.15.64:0/1738689770 >> v1:172.21.15.177:6789/0 conn(0x7fc854053cf0 legacy=0x7fc854058260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.715+0000 7fc85affd640 1 -- 172.21.15.64:0/1738689770 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc854057a60 con 0x7fc8540382c0 2023-10-14T12:29:11.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.716+0000 7fb746d9d640 1 --2- 172.21.15.64:0/3584847497 >> v2:172.21.15.177:3300/0 conn(0x7fb7480c1380 0x7fb7480b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fc85affd640 1 --2- 172.21.15.64:0/1738689770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540382c0 0x7fc85403c1c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc850009870 tx=0x7fc85002b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4a9afba6dfbf181 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fb74659c640 1 -- 172.21.15.64:0/3584847497 >> v2:172.21.15.177:3300/0 conn(0x7fb7480c1380 msgr2=0x7fb7480b23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fb74659c640 1 --2- 172.21.15.64:0/3584847497 >> v2:172.21.15.177:3300/0 conn(0x7fb7480c1380 0x7fb7480b23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fb74659c640 1 -- 172.21.15.64:0/3584847497 >> v1:172.21.15.177:6789/0 conn(0x7fb748069de0 legacy=0x7fb74806a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fb74659c640 1 -- 172.21.15.64:0/3584847497 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7480cd5d0 con 0x7fb7480c1760 2023-10-14T12:29:11.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fc85a7fc640 1 -- 172.21.15.64:0/1738689770 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850030860 con 0x7fc8540382c0 2023-10-14T12:29:11.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fc85a7fc640 1 -- 172.21.15.64:0/1738689770 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8500309c0 con 0x7fc8540382c0 2023-10-14T12:29:11.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.717+0000 7fc85a7fc640 1 -- 172.21.15.64:0/1738689770 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850030d90 con 0x7fc8540382c0 2023-10-14T12:29:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 -- 172.21.15.64:0/1738689770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540382c0 msgr2=0x7fc85403c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 --2- 172.21.15.64:0/1738689770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540382c0 0x7fc85403c1c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc850009870 tx=0x7fc85002b9a0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 -- 172.21.15.64:0/1738689770 shutdown_connections 2023-10-14T12:29:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 --2- 172.21.15.64:0/1738689770 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540382c0 0x7fc85403c1c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 --2- 172.21.15.64:0/1738689770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8540e64b0 0x7fc85403e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 -- 172.21.15.64:0/1738689770 >> 172.21.15.64:0/1738689770 conn(0x7fc854055a30 msgr2=0x7fc854055e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 -- 172.21.15.64:0/1738689770 shutdown_connections 2023-10-14T12:29:11.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.720+0000 7f8c324ec640 1 Processor -- start 2023-10-14T12:29:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.720+0000 7fb74659c640 1 --2- 172.21.15.64:0/3584847497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7480c1760 0x7fb7480cc680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb740009e50 tx=0x7fb74002bdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e38d2c6904985a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.720+0000 7f8c324ec640 1 -- start start 2023-10-14T12:29:11.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.719+0000 7fc861c7c640 1 -- 172.21.15.64:0/1738689770 wait complete. 2023-10-14T12:29:11.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7fb745d9b640 1 -- 172.21.15.64:0/3584847497 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74002c8d0 con 0x7fb7480c1760 2023-10-14T12:29:11.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7fc861c7c640 1 Processor -- start 2023-10-14T12:29:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7fb745d9b640 1 -- 172.21.15.64:0/3584847497 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb74002ca30 con 0x7fb7480c1760 2023-10-14T12:29:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7fb745d9b640 1 -- 172.21.15.64:0/3584847497 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74002cdc0 con 0x7fb7480c1760 2023-10-14T12:29:11.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7f8c324ec640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c0b0e90 0x7f8c2c0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7f8c324ec640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c06be00 con 0x7f8c2c1600e0 2023-10-14T12:29:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7f8c324ec640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c2c06c470 con 0x7f8c2c1604c0 2023-10-14T12:29:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7f8c324ec640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c06c290 con 0x7f8c2c0b0e90 2023-10-14T12:29:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.723+0000 7f8c2bfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f8c2c1600e0 0x7f8c2c06c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42560/0 (socket says 172.21.15.64:42560) 2023-10-14T12:29:11.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.723+0000 7f8c2bfff640 1 -- 172.21.15.64:0/3421117215 learned_addr learned my addr 172.21.15.64:0/3421117215 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:11.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fb74d0e5640 1 -- 172.21.15.64:0/3584847497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7480c1760 msgr2=0x7fb7480cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fb74d0e5640 1 --2- 172.21.15.64:0/3584847497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7480c1760 0x7fb7480cc680 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb740009e50 tx=0x7fb74002bdb0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563432784 0 0) 0x7f8c2c06be00 con 0x7f8c2c1600e0 2023-10-14T12:29:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c18003520 con 0x7f8c2c1600e0 2023-10-14T12:29:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.722+0000 7fc861c7c640 1 -- start start 2023-10-14T12:29:11.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fc861c7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8540382c0 0x7fc8540d8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fc861c7c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc854053cf0 0x7fc854039060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fc861c7c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540e64b0 0x7fc85400c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fc861c7c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540d9a60 con 0x7fc8540382c0 2023-10-14T12:29:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fc861c7c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8540d9470 con 0x7fc8540e64b0 2023-10-14T12:29:11.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.724+0000 7fc861c7c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc854039b70 con 0x7fc854053cf0 2023-10-14T12:29:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389333119 0 0) 0x7f8c18003520 con 0x7f8c2c1600e0 2023-10-14T12:29:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c0b0e90 msgr2=0x7f8c2c0b1320 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:29:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c0b0e90 0x7f8c2c0b1320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 >> v1:172.21.15.177:6789/0 conn(0x7f8c2c1604c0 legacy=0x7f8c2c0d0da0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T12:29:11.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0d32e0 con 0x7f8c2c1600e0 2023-10-14T12:29:11.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8540382c0 0x7fc8540d8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7fc85b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8540382c0 0x7fc8540d8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37624/0 (socket says 172.21.15.64:37624) 2023-10-14T12:29:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7fc85b7fe640 1 -- 172.21.15.64:0/123717219 learned_addr learned my addr 172.21.15.64:0/123717219 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7fc85affd640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc854053cf0 0x7fc854039060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7fc85bfff640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540e64b0 0x7fc85400c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7fc85b7fe640 1 -- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc854053cf0 msgr2=0x7fc854039060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f8c1c001670 con 0x7f8c2c1600e0 2023-10-14T12:29:11.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fb74d0e5640 1 -- 172.21.15.64:0/3584847497 shutdown_connections 2023-10-14T12:29:11.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fb74d0e5640 1 --2- 172.21.15.64:0/3584847497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb7480c1760 0x7fb7480cc680 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fb74d0e5640 1 --2- 172.21.15.64:0/3584847497 >> v2:172.21.15.177:3300/0 conn(0x7fb7480c1380 0x7fb7480b23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fb74d0e5640 1 -- 172.21.15.64:0/3584847497 >> 172.21.15.64:0/3584847497 conn(0x7fb7480ce7d0 msgr2=0x7fb7480cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 >> v1:172.21.15.64:6789/0 conn(0x7f8c2c1600e0 legacy=0x7f8c2c06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c180039a0 0x7f8c18003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c180047c0 0x7f8c18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180052a0 0x7f8c1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c06c290 con 0x7f8c180052a0 2023-10-14T12:29:11.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1800c140 con 0x7f8c180039a0 2023-10-14T12:29:11.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.725+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1800c300 con 0x7f8c180047c0 2023-10-14T12:29:11.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fc85b7fe640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc854053cf0 0x7fc854039060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fc85b7fe640 1 -- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540e64b0 msgr2=0x7fc85400c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fc85b7fe640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540e64b0 0x7fc85400c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fc85b7fe640 1 -- 172.21.15.64:0/123717219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8500094d0 con 0x7fc8540382c0 2023-10-14T12:29:11.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fc85bfff640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8540e64b0 0x7fc85400c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:11.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fc85affd640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc854053cf0 0x7fc854039060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:11.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fb74d0e5640 1 -- 172.21.15.64:0/3584847497 shutdown_connections 2023-10-14T12:29:11.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7fb74d0e5640 1 -- 172.21.15.64:0/3584847497 wait complete. 2023-10-14T12:29:11.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.726+0000 7f8c2bfff640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c180039a0 0x7f8c18003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.727+0000 7f8c30a89640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180052a0 0x7f8c1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.727+0000 7f8c23fff640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c180047c0 0x7f8c18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.727+0000 7fc85b7fe640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8540382c0 0x7fc8540d8b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0639b0 tx=0x7fc85c072520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7f8c2bfff640 1 -- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c180047c0 msgr2=0x7f8c18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7f8c2bfff640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c180047c0 0x7f8c18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7f8c2bfff640 1 -- 172.21.15.64:0/3421117215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180052a0 msgr2=0x7f8c1800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c08e070 con 0x7fc8540382c0 2023-10-14T12:29:11.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85c072980 con 0x7fc8540382c0 2023-10-14T12:29:11.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85c072cf0 con 0x7fc8540382c0 2023-10-14T12:29:11.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc854039e50 con 0x7fc8540382c0 2023-10-14T12:29:11.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8540d90a0 con 0x7fc8540382c0 2023-10-14T12:29:11.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7f8c2bfff640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180052a0 0x7f8c1800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.728+0000 7f8c2bfff640 1 -- 172.21.15.64:0/3421117215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c18003520 con 0x7f8c180039a0 2023-10-14T12:29:11.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.730+0000 7f8c30a89640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180052a0 0x7f8c1800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:11.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.730+0000 7fb74d0e5640 1 Processor -- start 2023-10-14T12:29:11.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.731+0000 7f8c2bfff640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c180039a0 0x7f8c18003da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c160 tx=0x7f8c180057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af476fd438e2905 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.730+0000 7fb74d0e5640 1 -- start start 2023-10-14T12:29:11.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c005ad0 con 0x7f8c180039a0 2023-10-14T12:29:11.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c005c30 con 0x7f8c180039a0 2023-10-14T12:29:11.747 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7f8c2b7fe640 1 -- 172.21.15.64:0/3421117215 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c02ca30 con 0x7f8c180039a0 2023-10-14T12:29:11.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7fb74d0e5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb748069de0 0x7fb7480c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7fb74d0e5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7480c1380 0x7fb7481f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7fb74d0e5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7480c1760 0x7fb7481f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7fb74d0e5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7481f7340 con 0x7fb7480c1380 2023-10-14T12:29:11.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7fb74d0e5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480c75a0 con 0x7fb7480c1760 2023-10-14T12:29:11.749 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7fb74d0e5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7480c77b0 con 0x7fb748069de0 2023-10-14T12:29:11.749 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.733+0000 7fb74659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7480c1380 0x7fb7481f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.749 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.732+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc85c072e50 con 0x7fc8540382c0 2023-10-14T12:29:11.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.733+0000 7fb74759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7480c1760 0x7fb7481f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.733+0000 7fb74759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7480c1760 0x7fb7481f62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:37748/0 (socket says 172.21.15.64:37748) 2023-10-14T12:29:11.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.733+0000 7fb74759e640 1 -- 172.21.15.64:0/1554622349 learned_addr learned my addr 172.21.15.64:0/1554622349 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.733+0000 7f8c324ec640 1 -- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c180039a0 msgr2=0x7f8c18003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.733+0000 7f8c324ec640 1 --2- 172.21.15.64:0/3421117215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c180039a0 0x7f8c18003da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c160 tx=0x7f8c180057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.733+0000 7f8c30a89640 1 -- 172.21.15.64:0/3421117215 reap_dead start 2023-10-14T12:29:11.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc83c000fc0 con 0x7fc8540382c0 2023-10-14T12:29:11.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fb74759e640 1 -- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb748069de0 msgr2=0x7fb7480c43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fb74759e640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb748069de0 0x7fb7480c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fb74759e640 1 -- 172.21.15.64:0/1554622349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7480c1380 msgr2=0x7fb7481f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fb74759e640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb7480c1380 0x7fb7481f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fb74759e640 1 -- 172.21.15.64:0/1554622349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb740009b30 con 0x7fb7480c1760 2023-10-14T12:29:11.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fc847fff640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc84006aef0 0x7fc84006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7f8c324ec640 1 -- 172.21.15.64:0/3421117215 shutdown_connections 2023-10-14T12:29:11.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7f8c324ec640 1 -- 172.21.15.64:0/3421117215 >> 172.21.15.64:0/3421117215 conn(0x7f8c2c0d27c0 msgr2=0x7f8c2c0d2bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.734+0000 7fb74759e640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7480c1760 0x7fb7481f62f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c780 tx=0x7fb73000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.735+0000 7f8c324ec640 1 -- 172.21.15.64:0/3421117215 shutdown_connections 2023-10-14T12:29:11.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.735+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc85c102920 con 0x7fc8540382c0 2023-10-14T12:29:11.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.735+0000 7fc847fff640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fc8400744b0 0x7fc8400768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.735+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 --> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc840076fc0 con 0x7fc8400744b0 2023-10-14T12:29:11.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.735+0000 7fc85affd640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc84006aef0 0x7fc84006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.756 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.735+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc85c0cd900 con 0x7fc8540382c0 2023-10-14T12:29:11.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.736+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb730007270 con 0x7fb7480c1760 2023-10-14T12:29:11.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.736+0000 7fc85bfff640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fc8400744b0 0x7fc8400768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.735+0000 7f8c324ec640 1 -- 172.21.15.64:0/3421117215 wait complete. 2023-10-14T12:29:11.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.737+0000 7fc85bfff640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fc8400744b0 0x7fc8400768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.736+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7300073d0 con 0x7fb7480c1760 2023-10-14T12:29:11.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.736+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300047e0 con 0x7fb7480c1760 2023-10-14T12:29:11.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.736+0000 7fb74d0e5640 1 -- 172.21.15.64:0/1554622349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7480c7a90 con 0x7fb7480c1760 2023-10-14T12:29:11.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.736+0000 7fb74d0e5640 1 -- 172.21.15.64:0/1554622349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7480c8050 con 0x7fb7480c1760 2023-10-14T12:29:11.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.738+0000 7f8c324ec640 1 Processor -- start 2023-10-14T12:29:11.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.738+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb720000fc0 con 0x7fb7480c1760 2023-10-14T12:29:11.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.738+0000 7fc85affd640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc84006aef0 0x7fc84006d3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc850036000 tx=0x7fc85003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.738+0000 7f8c324ec640 1 -- start start 2023-10-14T12:29:11.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.739+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== osd.0 v2:172.21.15.64:6812/1338117486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc840076fc0 con 0x7fc8400744b0 2023-10-14T12:29:11.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.740+0000 7f8c324ec640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180039a0 0x7f8c2c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.740+0000 7f8c324ec640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c154620 0x7f8c2c15d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.741+0000 7f8c2bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180039a0 0x7f8c2c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.741+0000 7f8c2bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180039a0 0x7f8c2c153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37654/0 (socket says 172.21.15.64:37654) 2023-10-14T12:29:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.741+0000 7f8c324ec640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c154aa0 0x7f8c2c15d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.741+0000 7f8c23fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c154620 0x7f8c2c15d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7f8c23fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c154620 0x7f8c2c15d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45180/0 (socket says 172.21.15.64:45180) 2023-10-14T12:29:11.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7f8c2bfff640 1 -- 172.21.15.64:0/992582378 learned_addr learned my addr 172.21.15.64:0/992582378 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.740+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb730004940 con 0x7fb7480c1760 2023-10-14T12:29:11.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7fb73f7fe640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb72806af40 0x7fb72806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.764 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb730089010 con 0x7fb7480c1760 2023-10-14T12:29:11.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.743+0000 7fb73f7fe640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fb728074500 0x7fb728076940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.743+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 --> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb728077010 con 0x7fb728074500 2023-10-14T12:29:11.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.743+0000 7fb74659c640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fb728074500 0x7fb728076940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7fb746d9d640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb72806af40 0x7fb72806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0ce580 con 0x7f8c180039a0 2023-10-14T12:29:11.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0ce860 con 0x7f8c2c154aa0 2023-10-14T12:29:11.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2c0ceb40 con 0x7f8c2c154620 2023-10-14T12:29:11.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.742+0000 7f8c30a89640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c154aa0 0x7f8c2c15d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.766 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8c2bfff640 1 -- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c154620 msgr2=0x7f8c2c15d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8c2bfff640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c154620 0x7f8c2c15d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8c2bfff640 1 -- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c154aa0 msgr2=0x7f8c2c15d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8c2bfff640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c154aa0 0x7f8c2c15d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8c2bfff640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c2c0cee20 con 0x7f8c180039a0 2023-10-14T12:29:11.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8c30a89640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8c2c154aa0 0x7f8c2c15d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:11.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8c23fff640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8c2c154620 0x7f8c2c15d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:11.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.743+0000 7f8a57010640 1 Processor -- start 2023-10-14T12:29:11.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.744+0000 7f8a57010640 1 -- start start 2023-10-14T12:29:11.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.745+0000 7f8c2bfff640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180039a0 0x7f8c2c153d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c160 tx=0x7f8c1c001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.745+0000 7fb74659c640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fb728074500 0x7fb728076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.745+0000 7fb746d9d640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb72806af40 0x7fb72806d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb738006a90 tx=0x7fb738006a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.745+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7300012b0 con 0x7fb7480c1760 2023-10-14T12:29:11.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.746+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c02cac0 con 0x7f8c180039a0 2023-10-14T12:29:11.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.746+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c02cc20 con 0x7f8c180039a0 2023-10-14T12:29:11.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.746+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c2c0cf100 con 0x7f8c180039a0 2023-10-14T12:29:11.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.746+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1c007070 con 0x7f8c180039a0 2023-10-14T12:29:11.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.747+0000 7f8a57010640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8a501599c0 0x7f8a500ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.747+0000 7f8a57010640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a500b08c0 0x7f8a500cc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.747+0000 7f8a57010640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a500cac40 con 0x7f8a500ca730 2023-10-14T12:29:11.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.747+0000 7f8a57010640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5006d290 con 0x7f8a501599c0 2023-10-14T12:29:11.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.747+0000 7f8a57010640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a5006d570 con 0x7f8a500b08c0 2023-10-14T12:29:11.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.747+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c2c0cf620 con 0x7f8c180039a0 2023-10-14T12:29:11.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.748+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== osd.1 v2:172.21.15.64:6802/1017343200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb728077010 con 0x7fb728074500 2023-10-14T12:29:11.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.748+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c2c0d35c0 con 0x7f8c180039a0 2023-10-14T12:29:11.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7f8a555ad640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8a500b08c0 0x7f8a500cc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7f8a47fff640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f8a500ca730 0x7f8a500b01b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:55178/0 (socket says 172.21.15.64:55178) 2023-10-14T12:29:11.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7f8a47fff640 1 -- 172.21.15.64:0/1746551183 learned_addr learned my addr 172.21.15.64:0/1746551183 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:11.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7f8a54dac640 1 --2- 172.21.15.64:0/1746551183 >> v2:172.21.15.64:3300/0 conn(0x7f8a501599c0 0x7f8a500ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7f8a477fe640 1 -- 172.21.15.64:0/1746551183 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3172522677 0 0) 0x7f8a500cac40 con 0x7f8a500ca730 2023-10-14T12:29:11.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7efd751f5640 1 Processor -- start 2023-10-14T12:29:11.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7efd751f5640 1 -- start start 2023-10-14T12:29:11.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.750+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8c1c032070 con 0x7f8c180039a0 2023-10-14T12:29:11.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.751+0000 7efd751f5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efd7015cf70 0x7efd7006d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.751+0000 7efd751f5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efd700b08c0 0x7efd700c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.751+0000 7efd751f5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd7006cb90 con 0x7efd7015d350 2023-10-14T12:29:11.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.751+0000 7efd751f5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7015a040 con 0x7efd7015cf70 2023-10-14T12:29:11.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.751+0000 7efd751f5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd7006c2a0 con 0x7efd700b08c0 2023-10-14T12:29:11.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.749+0000 7f8a477fe640 1 -- 172.21.15.64:0/1746551183 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a38003520 con 0x7f8a500ca730 2023-10-14T12:29:11.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.750+0000 7f8a54dac640 1 -- 172.21.15.64:0/1746551183 >> v2:172.21.15.177:3300/0 conn(0x7f8a500b08c0 msgr2=0x7f8a500cc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.750+0000 7f8a54dac640 1 --2- 172.21.15.64:0/1746551183 >> v2:172.21.15.177:3300/0 conn(0x7f8a500b08c0 0x7f8a500cc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.750+0000 7f8a54dac640 1 -- 172.21.15.64:0/1746551183 >> v1:172.21.15.177:6789/0 conn(0x7f8a500ca730 legacy=0x7f8a500b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.750+0000 7f8a54dac640 1 -- 172.21.15.64:0/1746551183 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a5006d850 con 0x7f8a501599c0 2023-10-14T12:29:11.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.751+0000 7f8a54dac640 1 --2- 172.21.15.64:0/1746551183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a501599c0 0x7f8a500ca1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a500cc280 tx=0x7f8a4c02b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd7bb9b91600e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7f8c297fa640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8c0c06af40 0x7f8c0c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7f8a477fe640 1 -- 172.21.15.64:0/1746551183 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c031520 con 0x7f8a501599c0 2023-10-14T12:29:11.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7f8a477fe640 1 -- 172.21.15.64:0/1746551183 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a4c031680 con 0x7f8a501599c0 2023-10-14T12:29:11.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7f8a477fe640 1 -- 172.21.15.64:0/1746551183 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c031a10 con 0x7f8a501599c0 2023-10-14T12:29:11.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c1c0aae20 con 0x7f8c180039a0 2023-10-14T12:29:11.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7efd6ed9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efd7015cf70 0x7efd7006d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7f835b705640 1 Processor -- start 2023-10-14T12:29:11.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7efd6f59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efd700b08c0 0x7efd700c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7efd6f59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efd700b08c0 0x7efd700c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:37790/0 (socket says 172.21.15.64:37790) 2023-10-14T12:29:11.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.752+0000 7efd6f59e640 1 -- 172.21.15.64:0/1873510108 learned_addr learned my addr 172.21.15.64:0/1873510108 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.753+0000 7f835b705640 1 -- start start 2023-10-14T12:29:11.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.753+0000 7f8c297fa640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7f8c0c074580 0x7f8c0c0769c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.753+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c0c077090 con 0x7f8c0c074580 2023-10-14T12:29:11.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.753+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c1c0ad440 con 0x7f8c180039a0 2023-10-14T12:29:11.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.753+0000 7f8a57010640 1 -- 172.21.15.64:0/1746551183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a501599c0 msgr2=0x7f8a500ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.753+0000 7efd6f59e640 1 -- 172.21.15.64:0/1873510108 >> v2:172.21.15.64:3300/0 conn(0x7efd7015cf70 msgr2=0x7efd7006d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7efd6f59e640 1 --2- 172.21.15.64:0/1873510108 >> v2:172.21.15.64:3300/0 conn(0x7efd7015cf70 0x7efd7006d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7efd6f59e640 1 -- 172.21.15.64:0/1873510108 >> v1:172.21.15.177:6789/0 conn(0x7efd7015d350 legacy=0x7efd700b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7efd6f59e640 1 -- 172.21.15.64:0/1873510108 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd70159d60 con 0x7efd700b08c0 2023-10-14T12:29:11.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.753+0000 7f8a57010640 1 --2- 172.21.15.64:0/1746551183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a501599c0 0x7f8a500ca1f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8a500cc280 tx=0x7f8a4c02b7c0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7f8a57010640 1 -- 172.21.15.64:0/1746551183 shutdown_connections 2023-10-14T12:29:11.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7f8a57010640 1 --2- 172.21.15.64:0/1746551183 >> v2:172.21.15.177:3300/0 conn(0x7f8a500b08c0 0x7f8a500cc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7f8a57010640 1 --2- 172.21.15.64:0/1746551183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a501599c0 0x7f8a500ca1f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7f8a57010640 1 -- 172.21.15.64:0/1746551183 >> 172.21.15.64:0/1746551183 conn(0x7f8a5006a440 msgr2=0x7f8a500cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7f8a57010640 1 -- 172.21.15.64:0/1746551183 shutdown_connections 2023-10-14T12:29:11.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.754+0000 7f8a57010640 1 -- 172.21.15.64:0/1746551183 wait complete. 2023-10-14T12:29:11.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f8c30a89640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7f8c0c074580 0x7f8c0c0769c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f835b705640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83540cdda0 0x7f835406ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f835b705640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540caff0 0x7f83540ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f835b705640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83540ce6c0 con 0x7f83540c5870 2023-10-14T12:29:11.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f835b705640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83540661f0 con 0x7f83540cdda0 2023-10-14T12:29:11.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f835b705640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8354065c30 con 0x7f83540caff0 2023-10-14T12:29:11.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f8c23fff640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8c0c06af40 0x7f8c0c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f8359ca2640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f83540c5870 0x7f83540c9ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42568/0 (socket says 172.21.15.64:42568) 2023-10-14T12:29:11.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.755+0000 7f8359ca2640 1 -- 172.21.15.64:0/3919857064 learned_addr learned my addr 172.21.15.64:0/3919857064 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:11.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.756+0000 7f8358ca0640 1 --2- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540caff0 0x7f83540ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.756+0000 7f83594a1640 1 --2- 172.21.15.64:0/3919857064 >> v2:172.21.15.177:3300/0 conn(0x7f83540cdda0 0x7f835406ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.756+0000 7efd6f59e640 1 --2- 172.21.15.64:0/1873510108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 0x7efd700c8d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd700c57b0 tx=0x7efd6802e2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dc288f5665300b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.756+0000 7f8c30a89640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7f8c0c074580 0x7f8c0c0769c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.756+0000 7f8c23fff640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8c0c06af40 0x7f8c0c06d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0c6d90 tx=0x7f8c14008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.757+0000 7f83594a1640 1 -- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540caff0 msgr2=0x7f83540ce180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.757+0000 7f83594a1640 1 --2- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540caff0 0x7f83540ce180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.757+0000 7f83594a1640 1 -- 172.21.15.64:0/3919857064 >> v1:172.21.15.64:6789/0 conn(0x7f83540c5870 legacy=0x7f83540c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.757+0000 7f83594a1640 1 -- 172.21.15.64:0/3919857064 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8354065f10 con 0x7f83540cdda0 2023-10-14T12:29:11.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.758+0000 7efd6e59c640 1 -- 172.21.15.64:0/1873510108 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd6802ede0 con 0x7efd700b08c0 2023-10-14T12:29:11.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.758+0000 7f8a57010640 1 Processor -- start 2023-10-14T12:29:11.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.758+0000 7efd6e59c640 1 -- 172.21.15.64:0/1873510108 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd680363f0 con 0x7efd700b08c0 2023-10-14T12:29:11.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.758+0000 7efd6e59c640 1 -- 172.21.15.64:0/1873510108 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68036780 con 0x7efd700b08c0 2023-10-14T12:29:11.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7f83594a1640 1 --2- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540cdda0 0x7f835406ca20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83500097a0 tx=0x7f835002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90f8708789683dea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.758+0000 7f8a57010640 1 -- start start 2023-10-14T12:29:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7efd751f5640 1 -- 172.21.15.64:0/1873510108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 msgr2=0x7efd700c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7efd751f5640 1 --2- 172.21.15.64:0/1873510108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 0x7efd700c8d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7efd700c57b0 tx=0x7efd6802e2c0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== osd.2 v2:172.21.15.64:6820/496287232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8c0c077090 con 0x7f8c0c074580 2023-10-14T12:29:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7f834bfff640 1 -- 172.21.15.64:0/3919857064 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350031830 con 0x7f83540cdda0 2023-10-14T12:29:11.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7efd751f5640 1 -- 172.21.15.64:0/1873510108 shutdown_connections 2023-10-14T12:29:11.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7efd751f5640 1 --2- 172.21.15.64:0/1873510108 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 0x7efd700c8d80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7efd751f5640 1 --2- 172.21.15.64:0/1873510108 >> v2:172.21.15.64:3300/0 conn(0x7efd7015cf70 0x7efd7006d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7efd751f5640 1 -- 172.21.15.64:0/1873510108 >> 172.21.15.64:0/1873510108 conn(0x7efd700cb1b0 msgr2=0x7efd700cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.760+0000 7efd751f5640 1 -- 172.21.15.64:0/1873510108 shutdown_connections 2023-10-14T12:29:11.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7f834bfff640 1 -- 172.21.15.64:0/3919857064 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8350031990 con 0x7f83540cdda0 2023-10-14T12:29:11.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.759+0000 7f834bfff640 1 -- 172.21.15.64:0/3919857064 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8350031d20 con 0x7f83540cdda0 2023-10-14T12:29:11.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.760+0000 7f8a57010640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500b08c0 0x7f8a5014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.760+0000 7f835b705640 1 -- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540cdda0 msgr2=0x7f835406ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.760+0000 7f835b705640 1 --2- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540cdda0 0x7f835406ca20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f83500097a0 tx=0x7f835002b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.760+0000 7efd751f5640 1 -- 172.21.15.64:0/1873510108 wait complete. 2023-10-14T12:29:11.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.761+0000 7f8a57010640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a500ca730 0x7f8a500c3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.761+0000 7f2340a0f640 1 Processor -- start 2023-10-14T12:29:11.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.761+0000 7f2340a0f640 1 -- start start 2023-10-14T12:29:11.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.761+0000 7f8a57010640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a5015a040 0x7f8a5015c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.761+0000 7f8a57010640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500c5130 con 0x7f8a500b08c0 2023-10-14T12:29:11.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a500ca730 0x7f8a500c3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7f8a47fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a500ca730 0x7f8a500c3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:37806/0 (socket says 172.21.15.64:37806) 2023-10-14T12:29:11.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7f8a47fff640 1 -- 172.21.15.64:0/1728248069 learned_addr learned my addr 172.21.15.64:0/1728248069 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7efd751f5640 1 Processor -- start 2023-10-14T12:29:11.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7f8a555ad640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a5015a040 0x7f8a5015c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500c4090 con 0x7f8a500ca730 2023-10-14T12:29:11.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a500c4370 con 0x7f8a5015a040 2023-10-14T12:29:11.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.762+0000 7efd751f5640 1 -- start start 2023-10-14T12:29:11.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.763+0000 7ff683210640 1 Processor -- start 2023-10-14T12:29:11.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.763+0000 7f835b705640 1 -- 172.21.15.64:0/3919857064 shutdown_connections 2023-10-14T12:29:11.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.763+0000 7f835b705640 1 --2- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540caff0 0x7f83540ce180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.763+0000 7f835b705640 1 --2- 172.21.15.64:0/3919857064 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540cdda0 0x7f835406ca20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.763+0000 7f835b705640 1 -- 172.21.15.64:0/3919857064 >> 172.21.15.64:0/3919857064 conn(0x7f83540cb830 msgr2=0x7f83540cbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7efd751f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 0x7efd700acbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7efd751f5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd7015cf70 0x7efd700c7780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7efd751f5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd7015d350 0x7efd700c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7efd751f5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd701ef240 con 0x7efd7015d350 2023-10-14T12:29:11.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7efd751f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c8320 con 0x7efd700b08c0 2023-10-14T12:29:11.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7efd751f5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd700c8600 con 0x7efd7015cf70 2023-10-14T12:29:11.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.763+0000 7f8a54dac640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500b08c0 0x7f8a5014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f8a47fff640 1 -- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a5015a040 msgr2=0x7f8a5015c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f8a47fff640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a5015a040 0x7f8a5015c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f8a47fff640 1 -- 172.21.15.64:0/1728248069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500b08c0 msgr2=0x7f8a5014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f8a47fff640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a500b08c0 0x7f8a5014fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f2340a0f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2334038180 0x7f2334053d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f2340a0f640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f23340542d0 0x7f23340573e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f2340a0f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2334054740 con 0x7f23340e3190 2023-10-14T12:29:11.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f2340a0f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233403f100 con 0x7f2334038180 2023-10-14T12:29:11.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f2340a0f640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2334007c40 con 0x7f23340542d0 2023-10-14T12:29:11.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f233ad9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f23340e3190 0x7f233403e920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42578/0 (socket says 172.21.15.64:42578) 2023-10-14T12:29:11.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f233ad9d640 1 -- 172.21.15.64:0/4032579607 learned_addr learned my addr 172.21.15.64:0/4032579607 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:11.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.763+0000 7ff683210640 1 -- start start 2023-10-14T12:29:11.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7f233a59c640 1 --2- 172.21.15.64:0/4032579607 >> v2:172.21.15.64:3300/0 conn(0x7f2334038180 0x7f2334053d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7f233b59e640 1 --2- 172.21.15.64:0/4032579607 >> v2:172.21.15.177:3300/0 conn(0x7f23340542d0 0x7f23340573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd67fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd7015cf70 0x7efd700c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd67fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd7015cf70 0x7efd700c7780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45204/0 (socket says 172.21.15.64:45204) 2023-10-14T12:29:11.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd67fff640 1 -- 172.21.15.64:0/2603860405 learned_addr learned my addr 172.21.15.64:0/2603860405 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd6f59e640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd7015d350 0x7efd700c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7f835b705640 1 -- 172.21.15.64:0/3919857064 shutdown_connections 2023-10-14T12:29:11.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7f835b705640 1 -- 172.21.15.64:0/3919857064 wait complete. 2023-10-14T12:29:11.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7f233a59c640 1 -- 172.21.15.64:0/4032579607 >> v2:172.21.15.177:3300/0 conn(0x7f23340542d0 msgr2=0x7f23340573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7f233a59c640 1 --2- 172.21.15.64:0/4032579607 >> v2:172.21.15.177:3300/0 conn(0x7f23340542d0 0x7f23340573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7f233a59c640 1 -- 172.21.15.64:0/4032579607 >> v1:172.21.15.64:6789/0 conn(0x7f23340e3190 legacy=0x7f233403e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7f233a59c640 1 -- 172.21.15.64:0/4032579607 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334006e80 con 0x7f2334038180 2023-10-14T12:29:11.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd6ed9d640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 0x7efd700acbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd6f59e640 1 -- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd7015cf70 msgr2=0x7efd700c7780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd6f59e640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efd7015cf70 0x7efd700c7780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd6f59e640 1 -- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 msgr2=0x7efd700acbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd6f59e640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 0x7efd700acbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7efd6f59e640 1 -- 172.21.15.64:0/2603860405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd680096b0 con 0x7efd7015d350 2023-10-14T12:29:11.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7ff683210640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff67c0b2990 0x7ff67c0cdda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7ff683210640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff67c0b3650 0x7ff67c06aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7ff683210640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c098eb0 con 0x7ff67c15cf10 2023-10-14T12:29:11.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7ff683210640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0b5700 con 0x7ff67c0b3650 2023-10-14T12:29:11.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7ff683210640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0b3240 con 0x7ff67c0b2990 2023-10-14T12:29:11.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7efd6f59e640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd7015d350 0x7efd700c7cc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd68034000 tx=0x7efd68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.767+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68040420 con 0x7efd7015d350 2023-10-14T12:29:11.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.767+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd68040580 con 0x7efd7015d350 2023-10-14T12:29:11.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.767+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd68040420 con 0x7efd7015d350 2023-10-14T12:29:11.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.767+0000 7efd751f5640 1 -- 172.21.15.64:0/2603860405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd700c88e0 con 0x7efd7015d350 2023-10-14T12:29:11.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.764+0000 7f8a47fff640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a4c009400 con 0x7f8a500ca730 2023-10-14T12:29:11.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.765+0000 7f8a555ad640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a5015a040 0x7f8a5015c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:11.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7f8a47fff640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a500ca730 0x7f8a500c3720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c490 tx=0x7f8a4000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.767+0000 7efd751f5640 1 -- 172.21.15.64:0/2603860405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd70158250 con 0x7efd7015d350 2023-10-14T12:29:11.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.768+0000 7ff6817ad640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff67c0b3650 0x7ff67c06aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.768+0000 7f835b705640 1 Processor -- start 2023-10-14T12:29:11.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.768+0000 7ff6817ad640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff67c0b3650 0x7ff67c06aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37710/0 (socket says 172.21.15.64:37710) 2023-10-14T12:29:11.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.768+0000 7ff6817ad640 1 -- 172.21.15.64:0/59618995 learned_addr learned my addr 172.21.15.64:0/59618995 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.766+0000 7efd6ed9d640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efd700b08c0 0x7efd700acbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:11.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.769+0000 7ff6817ad640 1 -- 172.21.15.64:0/59618995 >> v2:172.21.15.177:3300/0 conn(0x7ff67c0b2990 msgr2=0x7ff67c0cdda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:11.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.769+0000 7ff6817ad640 1 --2- 172.21.15.64:0/59618995 >> v2:172.21.15.177:3300/0 conn(0x7ff67c0b2990 0x7ff67c0cdda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.769+0000 7ff6817ad640 1 -- 172.21.15.64:0/59618995 >> v1:172.21.15.177:6789/0 conn(0x7ff67c15cf10 legacy=0x7ff67c0b2280 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:29:11.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.769+0000 7ff6817ad640 1 -- 172.21.15.64:0/59618995 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c15d2f0 con 0x7ff67c0b3650 2023-10-14T12:29:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.769+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd7006c820 con 0x7efd7015d350 2023-10-14T12:29:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a400074e0 con 0x7f8a500ca730 2023-10-14T12:29:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a40007640 con 0x7f8a500ca730 2023-10-14T12:29:11.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a40004a00 con 0x7f8a500ca730 2023-10-14T12:29:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.768+0000 7f835b705640 1 -- start start 2023-10-14T12:29:11.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f835b705640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540c5870 0x7f835415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f835b705640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83540caff0 0x7f83541f6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f835b705640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540cdda0 0x7f835415a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f835b705640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835414c6e0 con 0x7f83540caff0 2023-10-14T12:29:11.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f835b705640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f835414c960 con 0x7f83540c5870 2023-10-14T12:29:11.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f835b705640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83541f6f60 con 0x7f83540cdda0 2023-10-14T12:29:11.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.771+0000 7f8358ca0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83540caff0 0x7f83541f6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.770+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a500c4650 con 0x7f8a500ca730 2023-10-14T12:29:11.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.771+0000 7f8358ca0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83540caff0 0x7f83541f6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37720/0 (socket says 172.21.15.64:37720) 2023-10-14T12:29:11.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.771+0000 7f8358ca0640 1 -- 172.21.15.64:0/1053423285 learned_addr learned my addr 172.21.15.64:0/1053423285 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.771+0000 7f233a59c640 1 --2- 172.21.15.64:0/4032579607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 0x7f2334053d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2334059d70 tx=0x7f232802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb293da0b47800b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.771+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a500c4c10 con 0x7f8a500ca730 2023-10-14T12:29:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.771+0000 7f83594a1640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540c5870 0x7f835415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.771+0000 7f8359ca2640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540cdda0 0x7f835415a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f2339d9b640 1 -- 172.21.15.64:0/4032579607 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328030710 con 0x7f2334038180 2023-10-14T12:29:11.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f2339d9b640 1 -- 172.21.15.64:0/4032579607 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f232802e050 con 0x7f2334038180 2023-10-14T12:29:11.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f2339d9b640 1 -- 172.21.15.64:0/4032579607 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328030a90 con 0x7f2334038180 2023-10-14T12:29:11.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 --> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc83c002cb0 con 0x7fc8400744b0 2023-10-14T12:29:11.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7ff6817ad640 1 --2- 172.21.15.64:0/59618995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 0x7ff67c06aef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0b00f0 tx=0x7ff67402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a73de8b305fb957b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8a500b4260 con 0x7f8a500ca730 2023-10-14T12:29:11.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f8358ca0640 1 -- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540cdda0 msgr2=0x7f835415a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f8358ca0640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f83540cdda0 0x7f835415a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f8358ca0640 1 -- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540c5870 msgr2=0x7f835415c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f8358ca0640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83540c5870 0x7f835415c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f8358ca0640 1 -- 172.21.15.64:0/1053423285 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8350009400 con 0x7f83540caff0 2023-10-14T12:29:11.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.772+0000 7f8358ca0640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83540caff0 0x7f83541f6a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f834400eb40 tx=0x7f834400d350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344010440 con 0x7f83540caff0 2023-10-14T12:29:11.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83440105a0 con 0x7f83540caff0 2023-10-14T12:29:11.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efd68040710 con 0x7efd7015d350 2023-10-14T12:29:11.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83541f71c0 con 0x7f83540caff0 2023-10-14T12:29:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7fc847fff640 1 -- 172.21.15.64:0/123717219 <== osd.0 v2:172.21.15.64:6812/1338117486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc83c002cb0 con 0x7fc8400744b0 2023-10-14T12:29:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8344010950 con 0x7f83540caff0 2023-10-14T12:29:11.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f2340a0f640 1 -- 172.21.15.64:0/4032579607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 msgr2=0x7f2334053d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f2340a0f640 1 --2- 172.21.15.64:0/4032579607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 0x7f2334053d90 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2334059d70 tx=0x7f232802b710 comp rx=0 tx=0).stop 2023-10-14T12:29:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fc8400744b0 msgr2=0x7fc8400768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7fc861c7c640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fc8400744b0 0x7fc8400768f0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f2340a0f640 1 -- 172.21.15.64:0/4032579607 shutdown_connections 2023-10-14T12:29:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f2340a0f640 1 --2- 172.21.15.64:0/4032579607 >> v2:172.21.15.177:3300/0 conn(0x7f23340542d0 0x7f23340573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f2340a0f640 1 --2- 172.21.15.64:0/4032579607 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 0x7f2334053d90 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.773+0000 7f2340a0f640 1 -- 172.21.15.64:0/4032579607 >> 172.21.15.64:0/4032579607 conn(0x7f23340590c0 msgr2=0x7f23340594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc84006aef0 msgr2=0x7fc84006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc84006aef0 0x7fc84006d3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc850036000 tx=0x7fc85003b040 comp rx=0 tx=0).stop 2023-10-14T12:29:11.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8540382c0 msgr2=0x7fc8540d8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 --2- 172.21.15.64:0/123717219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8540382c0 0x7fc8540d8b60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0639b0 tx=0x7fc85c072520 comp rx=0 tx=0).stop 2023-10-14T12:29:11.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc85bfff640 1 -- 172.21.15.64:0/123717219 reap_dead start 2023-10-14T12:29:11.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 shutdown_connections 2023-10-14T12:29:11.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 >> 172.21.15.64:0/123717219 conn(0x7fc854055a30 msgr2=0x7fc854037b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 shutdown_connections 2023-10-14T12:29:11.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83541f7780 con 0x7f83540caff0 2023-10-14T12:29:11.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7fc861c7c640 1 -- 172.21.15.64:0/123717219 wait complete. 2023-10-14T12:29:11.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7efd677fe640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efd5006aed0 0x7efd5006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.775+0000 7f2340a0f640 1 -- 172.21.15.64:0/4032579607 shutdown_connections 2023-10-14T12:29:11.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.775+0000 7efd6ed9d640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efd5006aed0 0x7efd5006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.775+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd680acfb0 con 0x7efd7015d350 2023-10-14T12:29:11.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.775+0000 7efd677fe640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7efd50074490 0x7efd500768d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.776+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 --> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd50076fa0 con 0x7efd50074490 2023-10-14T12:29:11.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.776+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd680ad400 con 0x7efd7015d350 2023-10-14T12:29:11.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.776+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f83541599d0 con 0x7f83540caff0 2023-10-14T12:29:11.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.775+0000 7f2340a0f640 1 -- 172.21.15.64:0/4032579607 wait complete. 2023-10-14T12:29:11.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.776+0000 7efd67fff640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7efd50074490 0x7efd500768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.777+0000 7efd67fff640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7efd50074490 0x7efd500768d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.774+0000 7ff67b7fe640 1 -- 172.21.15.64:0/59618995 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67402ca80 con 0x7ff67c0b3650 2023-10-14T12:29:11.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.777+0000 7f2340a0f640 1 Processor -- start 2023-10-14T12:29:11.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.777+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8344010ab0 con 0x7f83540caff0 2023-10-14T12:29:11.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.778+0000 7ff67b7fe640 1 -- 172.21.15.64:0/59618995 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff67402cbe0 con 0x7ff67c0b3650 2023-10-14T12:29:11.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.778+0000 7ff67b7fe640 1 -- 172.21.15.64:0/59618995 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff67402ca80 con 0x7ff67c0b3650 2023-10-14T12:29:11.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.778+0000 7f2340a0f640 1 -- start start 2023-10-14T12:29:11.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.778+0000 7f8349ffb640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f833806ae70 0x7f833806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.779+0000 7ff683210640 1 -- 172.21.15.64:0/59618995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 msgr2=0x7ff67c06aef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.779+0000 7ff683210640 1 --2- 172.21.15.64:0/59618995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 0x7ff67c06aef0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0b00f0 tx=0x7ff67402bee0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.779+0000 7ff683210640 1 -- 172.21.15.64:0/59618995 shutdown_connections 2023-10-14T12:29:11.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.779+0000 7ff683210640 1 --2- 172.21.15.64:0/59618995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 0x7ff67c06aef0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.779+0000 7ff683210640 1 --2- 172.21.15.64:0/59618995 >> v2:172.21.15.177:3300/0 conn(0x7ff67c0b2990 0x7ff67c0cdda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.779+0000 7ff683210640 1 -- 172.21.15.64:0/59618995 >> 172.21.15.64:0/59618995 conn(0x7ff67c0cd280 msgr2=0x7ff67c0cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7ff683210640 1 -- 172.21.15.64:0/59618995 shutdown_connections 2023-10-14T12:29:11.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7ff683210640 1 -- 172.21.15.64:0/59618995 wait complete. 2023-10-14T12:29:11.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== osd.3 v2:172.21.15.64:6800/635710568 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7efd50076fa0 con 0x7efd50074490 2023-10-14T12:29:11.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f2340a0f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 0x7f233416ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f2340a0f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23340542d0 0x7f23340522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f2340a0f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23340e3190 0x7f233403a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f2340a0f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233417d250 con 0x7f2334038180 2023-10-14T12:29:11.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f2340a0f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334052810 con 0x7f23340542d0 2023-10-14T12:29:11.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f2340a0f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f233417c640 con 0x7f23340e3190 2023-10-14T12:29:11.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f233b59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23340e3190 0x7f233403a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f233b59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23340e3190 0x7f233403a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45226/0 (socket says 172.21.15.64:45226) 2023-10-14T12:29:11.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.780+0000 7f233b59e640 1 -- 172.21.15.64:0/3534502449 learned_addr learned my addr 172.21.15.64:0/3534502449 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.779+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a40004b60 con 0x7f8a500ca730 2023-10-14T12:29:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f233ad9d640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 0x7f233416ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f233a59c640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23340542d0 0x7f23340522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f233b59e640 1 -- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23340542d0 msgr2=0x7f23340522d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f233b59e640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f23340542d0 0x7f23340522d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f233b59e640 1 -- 172.21.15.64:0/3534502449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 msgr2=0x7f233416ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f233b59e640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2334038180 0x7f233416ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f233b59e640 1 -- 172.21.15.64:0/3534502449 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328009400 con 0x7f23340e3190 2023-10-14T12:29:11.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.781+0000 7f8a457fa640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a3c06af70 0x7f8a3c06d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.782+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8a400895e0 con 0x7f8a500ca730 2023-10-14T12:29:11.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.782+0000 7efd6ed9d640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efd5006aed0 0x7efd5006d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efd5800abc0 tx=0x7efd58008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.782+0000 7f8a54dac640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a3c06af70 0x7f8a3c06d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.782+0000 7f8a457fa640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7f8a3c0745b0 0x7f8a3c0769f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.782+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8a3c0770c0 con 0x7f8a3c0745b0 2023-10-14T12:29:11.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.782+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a40089990 con 0x7f8a500ca730 2023-10-14T12:29:11.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.782+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 --> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c2c0cf620 con 0x7f8c0c074580 2023-10-14T12:29:11.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8344057fc0 con 0x7f83540caff0 2023-10-14T12:29:11.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f8a555ad640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7f8a3c0745b0 0x7f8a3c0769f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f8349ffb640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7f8338074430 0x7f8338076870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 --> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8338076f40 con 0x7f8338074430 2023-10-14T12:29:11.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8344054300 con 0x7f83540caff0 2023-10-14T12:29:11.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f233b59e640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23340e3190 0x7f233403a140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f233c0639b0 tx=0x7f233c072520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f8c297fa640 1 -- 172.21.15.64:0/992582378 <== osd.2 v2:172.21.15.64:6820/496287232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c2c0cf620 con 0x7f8c0c074580 2023-10-14T12:29:11.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.783+0000 7f83594a1640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f833806ae70 0x7f833806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7f8c0c074580 msgr2=0x7f8c0c0769c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8c324ec640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7f8c0c074580 0x7f8c0c0769c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8359ca2640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7f8338074430 0x7f8338076870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c08e070 con 0x7f23340e3190 2023-10-14T12:29:11.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7ff683210640 1 Processor -- start 2023-10-14T12:29:11.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8c0c06af40 msgr2=0x7f8c0c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8c324ec640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8c0c06af40 0x7f8c0c06d400 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c2c0c6d90 tx=0x7f8c14008040 comp rx=0 tx=0).stop 2023-10-14T12:29:11.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180039a0 msgr2=0x7f8c2c153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8c324ec640 1 --2- 172.21.15.64:0/992582378 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8c180039a0 0x7f8c2c153d00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00c160 tx=0x7f8c1c001930 comp rx=0 tx=0).stop 2023-10-14T12:29:11.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8c30a89640 1 -- 172.21.15.64:0/992582378 reap_dead start 2023-10-14T12:29:11.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8a555ad640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7f8a3c0745b0 0x7f8a3c0769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f8a54dac640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a3c06af70 0x7f8a3c06d430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c035000 tx=0x7f8a4c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.785+0000 7f8359ca2640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7f8338074430 0x7f8338076870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7ff683210640 1 -- start start 2023-10-14T12:29:11.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f233417c920 con 0x7f23340e3190 2023-10-14T12:29:11.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f233417cee0 con 0x7f23340e3190 2023-10-14T12:29:11.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.784+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c072770 con 0x7f23340e3190 2023-10-14T12:29:11.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.785+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f233c072ae0 con 0x7f23340e3190 2023-10-14T12:29:11.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.786+0000 7f83594a1640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f833806ae70 0x7f833806d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8350036000 tx=0x7f835003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.786+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 shutdown_connections 2023-10-14T12:29:11.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.786+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 >> 172.21.15.64:0/992582378 conn(0x7f8c2c0d27c0 msgr2=0x7f8c2c15cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.786+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 shutdown_connections 2023-10-14T12:29:11.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.786+0000 7f8c324ec640 1 -- 172.21.15.64:0/992582378 wait complete. 2023-10-14T12:29:11.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.786+0000 7ff683210640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c0b2990 0x7ff67c15fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2318000fc0 con 0x7f23340e3190 2023-10-14T12:29:11.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff683210640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 0x7ff67c0b04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff683210640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15cf10 0x7ff67c149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff680fac640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c0b2990 0x7ff67c15fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff67bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 0x7ff67c0b04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff680fac640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c0b2990 0x7ff67c15fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45230/0 (socket says 172.21.15.64:45230) 2023-10-14T12:29:11.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== osd.5 v2:172.21.15.177:6808/2099766660 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8338076f40 con 0x7f8338074430 2023-10-14T12:29:11.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff680fac640 1 -- 172.21.15.64:0/890579583 learned_addr learned my addr 172.21.15.64:0/890579583 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:11.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c1603a0 con 0x7ff67c0b3650 2023-10-14T12:29:11.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.787+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0ce530 con 0x7ff67c15cf10 2023-10-14T12:29:11.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.788+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c160100 con 0x7ff67c0b2990 2023-10-14T12:29:11.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.789+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== osd.4 v2:172.21.15.177:6800/2887223078 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f8a3c0770c0 con 0x7f8a3c0745b0 2023-10-14T12:29:11.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.788+0000 7ff67bfff640 1 -- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c0b2990 msgr2=0x7ff67c15fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.788+0000 7ff67bfff640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c0b2990 0x7ff67c15fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.789+0000 7ff67bfff640 1 -- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15cf10 msgr2=0x7ff67c149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.789+0000 7ff67bfff640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff67c15cf10 0x7ff67c149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.789+0000 7ff67bfff640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff674009b30 con 0x7ff67c0b3650 2023-10-14T12:29:11.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.789+0000 7ff680fac640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff67c0b2990 0x7ff67c15fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:11.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.789+0000 7ff67bfff640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 0x7ff67c0b04d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00b3e0 tx=0x7ff66c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.790+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c011830 con 0x7ff67c0b3650 2023-10-14T12:29:11.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.790+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c151200 con 0x7ff67c0b3650 2023-10-14T12:29:11.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.789+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f233c072c40 con 0x7f23340e3190 2023-10-14T12:29:11.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.790+0000 7f23337fe640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f232406aea0 0x7f232406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.791+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f233c102b00 con 0x7f23340e3190 2023-10-14T12:29:11.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.791+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c0ceab0 con 0x7ff67c0b3650 2023-10-14T12:29:11.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.791+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff66c011990 con 0x7ff67c0b3650 2023-10-14T12:29:11.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.791+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff66c011830 con 0x7ff67c0b3650 2023-10-14T12:29:11.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.792+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff65c000fc0 con 0x7ff67c0b3650 2023-10-14T12:29:11.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.792+0000 7f23337fe640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7f2324074460 0x7f23240768a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.793+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 --> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2324076f70 con 0x7f2324074460 2023-10-14T12:29:11.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.793+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f233c0b5ea0 con 0x7f23340e3190 2023-10-14T12:29:11.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.793+0000 7f233ad9d640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f232406aea0 0x7f232406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.794+0000 7f233a59c640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7f2324074460 0x7f23240768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.795+0000 7f233a59c640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7f2324074460 0x7f23240768a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.795+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 --> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb720002cb0 con 0x7fb728074500 2023-10-14T12:29:11.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.795+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff66c011b00 con 0x7ff67c0b3650 2023-10-14T12:29:11.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.796+0000 7fb73f7fe640 1 -- 172.21.15.64:0/1554622349 <== osd.1 v2:172.21.15.64:6802/1017343200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb720002cb0 con 0x7fb728074500 2023-10-14T12:29:11.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.797+0000 7f233ad9d640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f232406aea0 0x7f232406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f232c000f60 tx=0x7f232c007e20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.797+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== osd.6 v2:172.21.15.177:6816/3504567380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f2324076f70 con 0x7f2324074460 2023-10-14T12:29:11.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.797+0000 7ff6797fa640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff66806aed0 0x7ff66806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.880 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:11.881 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T12:29:11.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.797+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff66c089b70 con 0x7ff67c0b3650 2023-10-14T12:29:11.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.797+0000 7ff6797fa640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7ff668074490 0x7ff6680768d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:11.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff668076fa0 con 0x7ff668074490 2023-10-14T12:29:11.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff66c089f90 con 0x7ff67c0b3650 2023-10-14T12:29:11.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7ff680fac640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff66806aed0 0x7ff66806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fb728074500 msgr2=0x7fb728076940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fb728074500 0x7fb728076940 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb72806af40 msgr2=0x7fb72806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb72806af40 0x7fb72806d400 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb738006a90 tx=0x7fb738006a20 comp rx=0 tx=0).stop 2023-10-14T12:29:11.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7480c1760 msgr2=0x7fb7481f62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 --2- 172.21.15.64:0/1554622349 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb7480c1760 0x7fb7481f62f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb73000c780 tx=0x7fb73000cc40 comp rx=0 tx=0).stop 2023-10-14T12:29:11.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb74759e640 1 -- 172.21.15.64:0/1554622349 reap_dead start 2023-10-14T12:29:11.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 shutdown_connections 2023-10-14T12:29:11.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 >> 172.21.15.64:0/1554622349 conn(0x7fb7480ce7d0 msgr2=0x7fb74806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.798+0000 7ff6817ad640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7ff668074490 0x7ff6680768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:11.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.799+0000 7ff680fac640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff66806aed0 0x7ff66806d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff670006fd0 tx=0x7ff670009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.799+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 shutdown_connections 2023-10-14T12:29:11.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.799+0000 7fb73d7fa640 1 -- 172.21.15.64:0/1554622349 wait complete. 2023-10-14T12:29:11.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.799+0000 7ff6817ad640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7ff668074490 0x7ff6680768d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:11.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.802+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== osd.7 v2:172.21.15.177:6824/1113952152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7ff668076fa0 con 0x7ff668074490 2023-10-14T12:29:11.887 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:11.888 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T12:29:11.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.817+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 --> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f83540c95a0 con 0x7f8338074430 2023-10-14T12:29:11.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.818+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 --> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff65c002cb0 con 0x7ff668074490 2023-10-14T12:29:11.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f8349ffb640 1 -- 172.21.15.64:0/1053423285 <== osd.5 v2:172.21.15.177:6808/2099766660 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f834c001f00 con 0x7f8338074430 2023-10-14T12:29:11.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 --> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7efd7006c540 con 0x7efd50074490 2023-10-14T12:29:11.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7f8338074430 msgr2=0x7f8338076870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f835b705640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7f8338074430 0x7f8338076870 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f833806ae70 msgr2=0x7f833806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f835b705640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f833806ae70 0x7f833806d330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8350036000 tx=0x7f835003c040 comp rx=0 tx=0).stop 2023-10-14T12:29:11.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83540caff0 msgr2=0x7f83541f6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f835b705640 1 --2- 172.21.15.64:0/1053423285 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f83540caff0 0x7f83541f6a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f834400eb40 tx=0x7f834400d350 comp rx=0 tx=0).stop 2023-10-14T12:29:11.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7ff6797fa640 1 -- 172.21.15.64:0/890579583 <== osd.7 v2:172.21.15.177:6824/1113952152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff65c002cb0 con 0x7ff668074490 2023-10-14T12:29:11.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 --> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8a5006cf40 con 0x7f8a3c0745b0 2023-10-14T12:29:11.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.819+0000 7f8359ca2640 1 -- 172.21.15.64:0/1053423285 reap_dead start 2023-10-14T12:29:11.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 shutdown_connections 2023-10-14T12:29:11.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 >> 172.21.15.64:0/1053423285 conn(0x7f83540cb830 msgr2=0x7f8354069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 shutdown_connections 2023-10-14T12:29:11.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7f835b705640 1 -- 172.21.15.64:0/1053423285 wait complete. 2023-10-14T12:29:11.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7ff668074490 msgr2=0x7ff6680768d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7ff668074490 0x7ff6680768d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7efd677fe640 1 -- 172.21.15.64:0/2603860405 <== osd.3 v2:172.21.15.64:6800/635710568 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efd600015d0 con 0x7efd50074490 2023-10-14T12:29:11.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff66806aed0 msgr2=0x7ff66806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff66806aed0 0x7ff66806d390 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff670006fd0 tx=0x7ff670009190 comp rx=0 tx=0).stop 2023-10-14T12:29:11.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 msgr2=0x7ff67c0b04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 --2- 172.21.15.64:0/890579583 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff67c0b3650 0x7ff67c0b04d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff66c00b3e0 tx=0x7ff66c00b8a0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff6817ad640 1 -- 172.21.15.64:0/890579583 reap_dead start 2023-10-14T12:29:11.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 shutdown_connections 2023-10-14T12:29:11.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.820+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 >> 172.21.15.64:0/890579583 conn(0x7ff67c0cd280 msgr2=0x7ff67c0b17b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.897 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:11.898 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T12:29:11.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7efd50074490 msgr2=0x7efd500768d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7efd50074490 0x7efd500768d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efd5006aed0 msgr2=0x7efd5006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efd5006aed0 0x7efd5006d390 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7efd5800abc0 tx=0x7efd58008040 comp rx=0 tx=0).stop 2023-10-14T12:29:11.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd7015d350 msgr2=0x7efd700c7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 shutdown_connections 2023-10-14T12:29:11.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 --2- 172.21.15.64:0/2603860405 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efd7015d350 0x7efd700c7cc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efd68034000 tx=0x7efd68004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:11.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7f8a457fa640 1 -- 172.21.15.64:0/1728248069 <== osd.4 v2:172.21.15.177:6800/2887223078 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8a48007de0 con 0x7f8a3c0745b0 2023-10-14T12:29:11.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 --> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2318002cb0 con 0x7f2324074460 2023-10-14T12:29:11.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7ff683210640 1 -- 172.21.15.64:0/890579583 wait complete. 2023-10-14T12:29:11.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd6f59e640 1 -- 172.21.15.64:0/2603860405 reap_dead start 2023-10-14T12:29:11.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 shutdown_connections 2023-10-14T12:29:11.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 >> 172.21.15.64:0/2603860405 conn(0x7efd700cb1b0 msgr2=0x7efd7015b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.821+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7f8a3c0745b0 msgr2=0x7f8a3c0769f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7f8a3c0745b0 0x7f8a3c0769f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 shutdown_connections 2023-10-14T12:29:11.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7efd657fa640 1 -- 172.21.15.64:0/2603860405 wait complete. 2023-10-14T12:29:11.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a3c06af70 msgr2=0x7f8a3c06d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a3c06af70 0x7f8a3c06d430 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c035000 tx=0x7f8a4c030000 comp rx=0 tx=0).stop 2023-10-14T12:29:11.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a500ca730 msgr2=0x7f8a500c3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 --2- 172.21.15.64:0/1728248069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a500ca730 0x7f8a500c3720 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8a4000c490 tx=0x7f8a4000c950 comp rx=0 tx=0).stop 2023-10-14T12:29:11.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a555ad640 1 -- 172.21.15.64:0/1728248069 reap_dead start 2023-10-14T12:29:11.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 shutdown_connections 2023-10-14T12:29:11.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 >> 172.21.15.64:0/1728248069 conn(0x7f8a5006a440 msgr2=0x7f8a50070310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 shutdown_connections 2023-10-14T12:29:11.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f23337fe640 1 -- 172.21.15.64:0/3534502449 <== osd.6 v2:172.21.15.177:6816/3504567380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2318002cb0 con 0x7f2324074460 2023-10-14T12:29:11.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.822+0000 7f8a57010640 1 -- 172.21.15.64:0/1728248069 wait complete. 2023-10-14T12:29:11.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7f2324074460 msgr2=0x7f23240768a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7f2324074460 0x7f23240768a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:11.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f232406aea0 msgr2=0x7f232406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f232406aea0 0x7f232406d360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f232c000f60 tx=0x7f232c007e20 comp rx=0 tx=0).stop 2023-10-14T12:29:11.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23340e3190 msgr2=0x7f233403a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:11.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 --2- 172.21.15.64:0/3534502449 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f23340e3190 0x7f233403a140 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f233c0639b0 tx=0x7f233c072520 comp rx=0 tx=0).stop 2023-10-14T12:29:11.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f233b59e640 1 -- 172.21.15.64:0/3534502449 reap_dead start 2023-10-14T12:29:11.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 shutdown_connections 2023-10-14T12:29:11.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 >> 172.21.15.64:0/3534502449 conn(0x7f23340590c0 msgr2=0x7f233403c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:11.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 shutdown_connections 2023-10-14T12:29:11.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:11.823+0000 7f2340a0f640 1 -- 172.21.15.64:0/3534502449 wait complete. 2023-10-14T12:29:11.910 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:11.910 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T12:29:11.911 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:11.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T12:29:11.913 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:11.913 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T12:29:11.914 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:11.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T12:29:11.915 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:11.916 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T12:29:12.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.223+0000 7efdea133640 1 Processor -- start 2023-10-14T12:29:12.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.223+0000 7efdea133640 1 -- start start 2023-10-14T12:29:12.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.225+0000 7efdea133640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efde415be60 0x7efde406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.225+0000 7efdea133640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40cb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.226+0000 7efdea133640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde4070fe0 con 0x7efde40cb6c0 2023-10-14T12:29:12.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.226+0000 7efdea133640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde406d440 con 0x7efde415be60 2023-10-14T12:29:12.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.226+0000 7efdea133640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40cd040 con 0x7efde40b1200 2023-10-14T12:29:12.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.226+0000 7efde37fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efde415be60 0x7efde406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.226+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40cb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.226+0000 7efde3fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7efde40cb6c0 0x7efde4071470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42590/0 (socket says 172.21.15.64:42590) 2023-10-14T12:29:12.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.226+0000 7efde3fff640 1 -- 172.21.15.64:0/16382106 learned_addr learned my addr 172.21.15.64:0/16382106 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:12.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.228+0000 7efde27fc640 1 -- 172.21.15.64:0/16382106 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889532321 0 0) 0x7efde4070fe0 con 0x7efde40cb6c0 2023-10-14T12:29:12.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.228+0000 7efde27fc640 1 -- 172.21.15.64:0/16382106 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdcc007930 con 0x7efde40cb6c0 2023-10-14T12:29:12.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.228+0000 7efde2ffd640 1 -- 172.21.15.64:0/16382106 >> v2:172.21.15.177:3300/0 conn(0x7efde415be60 msgr2=0x7efde406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.228+0000 7efde2ffd640 1 --2- 172.21.15.64:0/16382106 >> v2:172.21.15.177:3300/0 conn(0x7efde415be60 0x7efde406cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.228+0000 7efde2ffd640 1 -- 172.21.15.64:0/16382106 >> v1:172.21.15.64:6789/0 conn(0x7efde40cb6c0 legacy=0x7efde4071470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.229+0000 7efde2ffd640 1 -- 172.21.15.64:0/16382106 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde415c240 con 0x7efde40b1200 2023-10-14T12:29:12.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.231+0000 7efde2ffd640 1 --2- 172.21.15.64:0/16382106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40cb180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efdd800d7b0 tx=0x7efdd80343e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12c4fef83b6ec96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.232+0000 7efde27fc640 1 -- 172.21.15.64:0/16382106 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8039710 con 0x7efde40b1200 2023-10-14T12:29:12.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.232+0000 7efde27fc640 1 -- 172.21.15.64:0/16382106 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8037050 con 0x7efde40b1200 2023-10-14T12:29:12.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.232+0000 7efde27fc640 1 -- 172.21.15.64:0/16382106 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8039710 con 0x7efde40b1200 2023-10-14T12:29:12.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.233+0000 7efdea133640 1 -- 172.21.15.64:0/16382106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 msgr2=0x7efde40cb180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.233+0000 7efdea133640 1 --2- 172.21.15.64:0/16382106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40cb180 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7efdd800d7b0 tx=0x7efdd80343e0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.233+0000 7efdea133640 1 -- 172.21.15.64:0/16382106 shutdown_connections 2023-10-14T12:29:12.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.233+0000 7efdea133640 1 --2- 172.21.15.64:0/16382106 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40cb180 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.233+0000 7efdea133640 1 --2- 172.21.15.64:0/16382106 >> v2:172.21.15.177:3300/0 conn(0x7efde415be60 0x7efde406cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.233+0000 7efdea133640 1 -- 172.21.15.64:0/16382106 >> 172.21.15.64:0/16382106 conn(0x7efde40ce7d0 msgr2=0x7efde40cebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.234+0000 7efdea133640 1 -- 172.21.15.64:0/16382106 shutdown_connections 2023-10-14T12:29:12.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.234+0000 7efdea133640 1 -- 172.21.15.64:0/16382106 wait complete. 2023-10-14T12:29:12.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.236+0000 7efdea133640 1 Processor -- start 2023-10-14T12:29:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.237+0000 7efdea133640 1 -- start start 2023-10-14T12:29:12.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.238+0000 7f4b4d675640 1 Processor -- start 2023-10-14T12:29:12.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.238+0000 7f4b4d675640 1 -- start start 2023-10-14T12:29:12.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.239+0000 7efdea133640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.239+0000 7efdea133640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efde40cb6c0 0x7efde40715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7efdea133640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efde415be60 0x7efde4159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7efde37fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7efde37fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40c6810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45244/0 (socket says 172.21.15.64:45244) 2023-10-14T12:29:12.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7f4b4d675640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4815cb60 0x7f4b480cde90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7f4b4d675640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4b4806dd90 0x7f4b480b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7f4b4d675640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4b480b06f0 0x7f4b48070330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7f4b4d675640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b480b0b80 con 0x7f4b480b06f0 2023-10-14T12:29:12.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7f4b4d675640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b4815cf40 con 0x7f4b4806dd90 2023-10-14T12:29:12.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.240+0000 7f4b4d675640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c8d80 con 0x7f4b4815cb60 2023-10-14T12:29:12.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.241+0000 7f4b46ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4815cb60 0x7f4b480cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.241+0000 7f4b46ffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4815cb60 0x7f4b480cde90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45250/0 (socket says 172.21.15.64:45250) 2023-10-14T12:29:12.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.241+0000 7f4b46ffd640 1 -- 172.21.15.64:0/3603968222 learned_addr learned my addr 172.21.15.64:0/3603968222 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.241+0000 7f4b467fc640 1 --2- 172.21.15.64:0/3603968222 >> v2:172.21.15.177:3300/0 conn(0x7f4b4806dd90 0x7f4b480b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.241+0000 7efde2ffd640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efde40cb6c0 0x7efde40715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.241+0000 7efdea133640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde40ca8c0 con 0x7efde415be60 2023-10-14T12:29:12.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.242+0000 7efde37fe640 1 -- 172.21.15.64:0/4233017863 learned_addr learned my addr 172.21.15.64:0/4233017863 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.242+0000 7efde3fff640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efde415be60 0x7efde4159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.242+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde40c9cb0 con 0x7efde40cb6c0 2023-10-14T12:29:12.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.242+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde40c9f90 con 0x7efde40b1200 2023-10-14T12:29:12.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7f4b477fe640 1 --2- 172.21.15.64:0/3603968222 >> v2:172.21.15.64:3300/0 conn(0x7f4b480b06f0 0x7f4b48070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7f4b467fc640 1 -- 172.21.15.64:0/3603968222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4815cb60 msgr2=0x7f4b480cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7f4b467fc640 1 --2- 172.21.15.64:0/3603968222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4815cb60 0x7f4b480cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7efde3fff640 1 -- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 msgr2=0x7efde40c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7efde3fff640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7efde3fff640 1 -- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efde40cb6c0 msgr2=0x7efde40715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7efde3fff640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efde40cb6c0 0x7efde40715e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7efde3fff640 1 -- 172.21.15.64:0/4233017863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd800d410 con 0x7efde415be60 2023-10-14T12:29:12.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7f4b467fc640 1 -- 172.21.15.64:0/3603968222 >> v2:172.21.15.64:3300/0 conn(0x7f4b480b06f0 msgr2=0x7f4b48070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7f4b467fc640 1 --2- 172.21.15.64:0/3603968222 >> v2:172.21.15.64:3300/0 conn(0x7f4b480b06f0 0x7f4b48070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.243+0000 7f4b467fc640 1 -- 172.21.15.64:0/3603968222 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b480c8fd0 con 0x7f4b4806dd90 2023-10-14T12:29:12.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.244+0000 7f4b477fe640 1 --2- 172.21.15.64:0/3603968222 >> v2:172.21.15.64:3300/0 conn(0x7f4b480b06f0 0x7f4b48070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:12.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.244+0000 7f370f810640 1 Processor -- start 2023-10-14T12:29:12.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.244+0000 7efde3fff640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efde415be60 0x7efde4159080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efdd400ca80 tx=0x7efdd400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.244+0000 7efdcbfff640 1 -- 172.21.15.64:0/4233017863 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd400ac30 con 0x7efde415be60 2023-10-14T12:29:12.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.244+0000 7efdcbfff640 1 -- 172.21.15.64:0/4233017863 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd400ad90 con 0x7efde415be60 2023-10-14T12:29:12.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.244+0000 7efdcbfff640 1 -- 172.21.15.64:0/4233017863 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd4012640 con 0x7efde415be60 2023-10-14T12:29:12.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.245+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde40ca270 con 0x7efde415be60 2023-10-14T12:29:12.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.246+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde40c6d50 con 0x7efde415be60 2023-10-14T12:29:12.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.244+0000 7f370f810640 1 -- start start 2023-10-14T12:29:12.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.246+0000 7f370f810640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3700006b70 0x7f3700053c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.246+0000 7f370f810640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f370003c070 con 0x7f3700054190 2023-10-14T12:29:12.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.246+0000 7f370f810640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37000545e0 con 0x7f37000e3070 2023-10-14T12:29:12.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.246+0000 7f370f810640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37000070f0 con 0x7f3700006b70 2023-10-14T12:29:12.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.246+0000 7f4b467fc640 1 --2- 172.21.15.64:0/3603968222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4806dd90 0x7f4b480b01b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b480cc2b0 tx=0x7f4b4002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f91284cc7976c11 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.247+0000 7f370cdab640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3700006b70 0x7f3700053c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.247+0000 7f4b45ffb640 1 -- 172.21.15.64:0/3603968222 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4002cbd0 con 0x7f4b4806dd90 2023-10-14T12:29:12.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.247+0000 7f4b45ffb640 1 -- 172.21.15.64:0/3603968222 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4002cd30 con 0x7f4b4806dd90 2023-10-14T12:29:12.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.247+0000 7f370d5ac640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f37000e3070 0x7f370003ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:55202/0 (socket says 172.21.15.64:55202) 2023-10-14T12:29:12.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.247+0000 7f370d5ac640 1 -- 172.21.15.64:0/2487616073 learned_addr learned my addr 172.21.15.64:0/2487616073 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:12.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.247+0000 7f370ddad640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f3700054190 0x7f3700057720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42606/0 (socket says 172.21.15.64:42606) 2023-10-14T12:29:12.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.249+0000 7f4b45ffb640 1 -- 172.21.15.64:0/3603968222 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4002cbd0 con 0x7f4b4806dd90 2023-10-14T12:29:12.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.249+0000 7f36fffff640 1 -- 172.21.15.64:0/2487616073 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296915142 0 0) 0x7f3704001040 con 0x7f37000e3070 2023-10-14T12:29:12.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.249+0000 7f36fffff640 1 -- 172.21.15.64:0/2487616073 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36f4003520 con 0x7f37000e3070 2023-10-14T12:29:12.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.249+0000 7f4b4d675640 1 -- 172.21.15.64:0/3603968222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4806dd90 msgr2=0x7f4b480b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.249+0000 7f4b4d675640 1 --2- 172.21.15.64:0/3603968222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4806dd90 0x7f4b480b01b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4b480cc2b0 tx=0x7f4b4002be20 comp rx=0 tx=0).stop 2023-10-14T12:29:12.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.247+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde40caa30 con 0x7efde415be60 2023-10-14T12:29:12.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f4b4d675640 1 -- 172.21.15.64:0/3603968222 shutdown_connections 2023-10-14T12:29:12.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f4b4d675640 1 --2- 172.21.15.64:0/3603968222 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4806dd90 0x7f4b480b01b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f4b4d675640 1 --2- 172.21.15.64:0/3603968222 >> v2:172.21.15.64:3300/0 conn(0x7f4b480b06f0 0x7f4b48070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f370cdab640 1 -- 172.21.15.64:0/2487616073 >> v1:172.21.15.177:6789/0 conn(0x7f37000e3070 legacy=0x7f370003ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f370cdab640 1 -- 172.21.15.64:0/2487616073 >> v1:172.21.15.64:6789/0 conn(0x7f3700054190 legacy=0x7f3700057720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f4b4d675640 1 --2- 172.21.15.64:0/3603968222 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4815cb60 0x7f4b480cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f4b4d675640 1 -- 172.21.15.64:0/3603968222 >> 172.21.15.64:0/3603968222 conn(0x7f4b4806a440 msgr2=0x7f4b480cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.250+0000 7f370cdab640 1 -- 172.21.15.64:0/2487616073 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37000073b0 con 0x7f3700006b70 2023-10-14T12:29:12.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.251+0000 7f4b4d675640 1 -- 172.21.15.64:0/3603968222 shutdown_connections 2023-10-14T12:29:12.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.251+0000 7f4b4d675640 1 -- 172.21.15.64:0/3603968222 wait complete. 2023-10-14T12:29:12.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.252+0000 7f370cdab640 1 --2- 172.21.15.64:0/2487616073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700006b70 0x7f3700053c50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36f80097a0 tx=0x7f36f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0ecf4f0e5f0396 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.254+0000 7f4b4d675640 1 Processor -- start 2023-10-14T12:29:12.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.254+0000 7efdcbfff640 1 -- 172.21.15.64:0/4233017863 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efdd4007070 con 0x7efde415be60 2023-10-14T12:29:12.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.255+0000 7f4b4d675640 1 -- start start 2023-10-14T12:29:12.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.256+0000 7efdcbfff640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efdd006af40 0x7efdd006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.256+0000 7efdcbfff640 1 -- 172.21.15.64:0/4233017863 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efdd4089ce0 con 0x7efde415be60 2023-10-14T12:29:12.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7f4b4d675640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4806dd90 0x7f4b48150bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7fddbcf43640 1 Processor -- start 2023-10-14T12:29:12.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7f4b4d675640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b480b06f0 0x7f4b480c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7f4b4d675640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4815cb60 0x7f4b480c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7f4b4d675640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480b1760 con 0x7f4b480b06f0 2023-10-14T12:29:12.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7f4b4d675640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c79e0 con 0x7f4b4815cb60 2023-10-14T12:29:12.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7f4b4d675640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b480c7cc0 con 0x7f4b4806dd90 2023-10-14T12:29:12.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7efde37fe640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efdd006af40 0x7efdd006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f4b477fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4815cb60 0x7f4b480c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f4b467fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b480b06f0 0x7f4b480c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f4b467fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b480b06f0 0x7f4b480c5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37782/0 (socket says 172.21.15.64:37782) 2023-10-14T12:29:12.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f4b467fc640 1 -- 172.21.15.64:0/67300223 learned_addr learned my addr 172.21.15.64:0/67300223 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f4b46ffd640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4806dd90 0x7f4b48150bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f36fffff640 1 -- 172.21.15.64:0/2487616073 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8030610 con 0x7f3700006b70 2023-10-14T12:29:12.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f36fffff640 1 -- 172.21.15.64:0/2487616073 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36f8030770 con 0x7f3700006b70 2023-10-14T12:29:12.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.258+0000 7f36fffff640 1 -- 172.21.15.64:0/2487616073 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36f8030b00 con 0x7f3700006b70 2023-10-14T12:29:12.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7efde37fe640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efdd006af40 0x7efdd006d400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efde4159ca0 tx=0x7efddc009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f4b467fc640 1 -- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4806dd90 msgr2=0x7f4b48150bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f4b467fc640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4806dd90 0x7f4b48150bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f4b467fc640 1 -- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4815cb60 msgr2=0x7f4b480c5d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f4b467fc640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4815cb60 0x7f4b480c5d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f4b467fc640 1 -- 172.21.15.64:0/67300223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b40009a70 con 0x7f4b480b06f0 2023-10-14T12:29:12.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f370f810640 1 -- 172.21.15.64:0/2487616073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700006b70 msgr2=0x7f3700053c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f370f810640 1 --2- 172.21.15.64:0/2487616073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700006b70 0x7f3700053c50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f36f80097a0 tx=0x7f36f802b960 comp rx=0 tx=0).stop 2023-10-14T12:29:12.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.259+0000 7f4b467fc640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b480b06f0 0x7f4b480c5800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b40000f80 tx=0x7f4b40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.257+0000 7fddbcf43640 1 -- start start 2023-10-14T12:29:12.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f370f810640 1 -- 172.21.15.64:0/2487616073 shutdown_connections 2023-10-14T12:29:12.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f370f810640 1 --2- 172.21.15.64:0/2487616073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700006b70 0x7f3700053c50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f370f810640 1 -- 172.21.15.64:0/2487616073 >> 172.21.15.64:0/2487616073 conn(0x7f3700055a90 msgr2=0x7f3700055e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7fddbcf43640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fddb00e78b0 0x7fddb004f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f4b2f7fe640 1 -- 172.21.15.64:0/67300223 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4002cea0 con 0x7f4b480b06f0 2023-10-14T12:29:12.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f4b2f7fe640 1 -- 172.21.15.64:0/67300223 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b40004880 con 0x7f4b480b06f0 2023-10-14T12:29:12.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f4b2f7fe640 1 -- 172.21.15.64:0/67300223 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b40034640 con 0x7f4b480b06f0 2023-10-14T12:29:12.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b480b13f0 con 0x7f4b480b06f0 2023-10-14T12:29:12.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f370f810640 1 -- 172.21.15.64:0/2487616073 shutdown_connections 2023-10-14T12:29:12.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b480c7fa0 con 0x7f4b480b06f0 2023-10-14T12:29:12.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.260+0000 7f370f810640 1 -- 172.21.15.64:0/2487616073 wait complete. 2023-10-14T12:29:12.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.262+0000 7fddbcf43640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb700 0x7fddb00536f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.262+0000 7fddbcf43640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb0050340 con 0x7fddb00eb2c0 2023-10-14T12:29:12.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.262+0000 7fddbcf43640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddb0006480 con 0x7fddb00e78b0 2023-10-14T12:29:12.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.262+0000 7fddbcf43640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb0007920 con 0x7fddb00eb700 2023-10-14T12:29:12.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.262+0000 7fddb77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fddb00e78b0 0x7fddb004f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.263+0000 7efdcbfff640 1 -- 172.21.15.64:0/4233017863 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efdd4054b30 con 0x7efde415be60 2023-10-14T12:29:12.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.262+0000 7fddb6ffd640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fddb00eb2c0 0x7fddb0052fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:55214/0 (socket says 172.21.15.64:55214) 2023-10-14T12:29:12.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.262+0000 7fddb6ffd640 1 -- 172.21.15.64:0/272257586 learned_addr learned my addr 172.21.15.64:0/272257586 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.263+0000 7fddb7fff640 1 --2- 172.21.15.64:0/272257586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb700 0x7fddb00536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.263+0000 7fddb77fe640 1 -- 172.21.15.64:0/272257586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb700 msgr2=0x7fddb00536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.263+0000 7fddb77fe640 1 --2- 172.21.15.64:0/272257586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb700 0x7fddb00536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.263+0000 7fddb77fe640 1 -- 172.21.15.64:0/272257586 >> v1:172.21.15.177:6789/0 conn(0x7fddb00eb2c0 legacy=0x7fddb0052fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.263+0000 7fddb77fe640 1 -- 172.21.15.64:0/272257586 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb004fd80 con 0x7fddb00e78b0 2023-10-14T12:29:12.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.263+0000 7fddb7fff640 1 --2- 172.21.15.64:0/272257586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb700 0x7fddb00536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:12.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.264+0000 7f370f810640 1 Processor -- start 2023-10-14T12:29:12.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.264+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b28005250 con 0x7f4b480b06f0 2023-10-14T12:29:12.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.264+0000 7f4b2f7fe640 1 -- 172.21.15.64:0/67300223 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4b4003b030 con 0x7f4b480b06f0 2023-10-14T12:29:12.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.264+0000 7f370f810640 1 -- start start 2023-10-14T12:29:12.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f4b2f7fe640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4b3406ae70 0x7f4b3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f370f810640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3700006b70 0x7f370004c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f370f810640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700054190 0x7f37000d22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f370f810640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37000e3070 0x7f37000de2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f370f810640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000dbf50 con 0x7f3700054190 2023-10-14T12:29:12.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f370f810640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37000390a0 con 0x7f3700006b70 2023-10-14T12:29:12.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f370f810640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37000dba20 con 0x7f37000e3070 2023-10-14T12:29:12.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f4b2f7fe640 1 -- 172.21.15.64:0/67300223 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4b400ac300 con 0x7f4b480b06f0 2023-10-14T12:29:12.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f70a1b2c640 1 Processor -- start 2023-10-14T12:29:12.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f370ddad640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37000e3070 0x7f37000de2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7f70a1b2c640 1 -- start start 2023-10-14T12:29:12.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.266+0000 7fddb77fe640 1 --2- 172.21.15.64:0/272257586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00e78b0 0x7fddb004f260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddac0097a0 tx=0x7fddac02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e1e550c3a51069 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370ddad640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37000e3070 0x7f37000de2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45290/0 (socket says 172.21.15.64:45290) 2023-10-14T12:29:12.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370ddad640 1 -- 172.21.15.64:0/2349088282 learned_addr learned my addr 172.21.15.64:0/2349088282 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f4b46ffd640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4b3406ae70 0x7f4b3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370ddad640 1 -- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3700006b70 msgr2=0x7f370004c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370ddad640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3700006b70 0x7f370004c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370cdab640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700054190 0x7f37000d22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370ddad640 1 -- 172.21.15.64:0/2349088282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700054190 msgr2=0x7f37000d22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370ddad640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700054190 0x7f37000d22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370ddad640 1 -- 172.21.15.64:0/2349088282 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f8009400 con 0x7f37000e3070 2023-10-14T12:29:12.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.267+0000 7f370cdab640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700054190 0x7f37000d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:12.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f0e43a39640 1 Processor -- start 2023-10-14T12:29:12.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f4b46ffd640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4b3406ae70 0x7f4b3406d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b480acd60 tx=0x7f4b38016040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f70a1b2c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f709c15d700 0x7f709c159c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f70a1b2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c0b01b0 0x7f709c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f70a1b2c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f709c15a2c0 con 0x7f709c15dae0 2023-10-14T12:29:12.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.269+0000 7f370ddad640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37000e3070 0x7f37000de2b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3708073520 tx=0x7f3708072520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f70a1b2c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c0b0b60 con 0x7f709c15d700 2023-10-14T12:29:12.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f70a1b2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c15a5a0 con 0x7f709c0b01b0 2023-10-14T12:29:12.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.269+0000 7f709b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f709c15d700 0x7f709c159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.269+0000 7f709b7fe640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f709c15d700 0x7f709c159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:37924/0 (socket says 172.21.15.64:37924) 2023-10-14T12:29:12.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.269+0000 7f36fdffb640 1 -- 172.21.15.64:0/2349088282 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708072970 con 0x7f37000e3070 2023-10-14T12:29:12.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.269+0000 7f36fdffb640 1 -- 172.21.15.64:0/2349088282 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370808d070 con 0x7f37000e3070 2023-10-14T12:29:12.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.269+0000 7f36fdffb640 1 -- 172.21.15.64:0/2349088282 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708072db0 con 0x7f37000e3070 2023-10-14T12:29:12.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.269+0000 7f709b7fe640 1 -- 172.21.15.64:0/1403432259 learned_addr learned my addr 172.21.15.64:0/1403432259 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f370f810640 1 -- 172.21.15.64:0/2349088282 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37000d4770 con 0x7f37000e3070 2023-10-14T12:29:12.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f709b7fe640 1 -- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c0b01b0 msgr2=0x7f709c0b0620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-14T12:29:12.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f370f810640 1 -- 172.21.15.64:0/2349088282 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37000d4400 con 0x7f37000e3070 2023-10-14T12:29:12.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f709bfff640 1 --2- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c0b01b0 0x7f709c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.271+0000 7f709b7fe640 1 --2- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c0b01b0 0x7f709c0b0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.271+0000 7f709b7fe640 1 -- 172.21.15.64:0/1403432259 >> v1:172.21.15.64:6789/0 conn(0x7f709c15dae0 legacy=0x7f709c06cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.268+0000 7f0e43a39640 1 -- start start 2023-10-14T12:29:12.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f0e43a39640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0e3c0b83b0 0x7f0e3c0cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f0e43a39640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c0ce010 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f0e43a39640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e3c161520 con 0x7f0e3c0cdbc0 2023-10-14T12:29:12.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.270+0000 7f0e43a39640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e3c160f60 con 0x7f0e3c0b83b0 2023-10-14T12:29:12.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.271+0000 7f709b7fe640 1 -- 172.21.15.64:0/1403432259 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c15a880 con 0x7f709c15d700 2023-10-14T12:29:12.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.271+0000 7f0e417d5640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f0e3c15c9f0 0x7f0e3c160680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42632/0 (socket says 172.21.15.64:42632) 2023-10-14T12:29:12.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.272+0000 7f0e417d5640 1 -- 172.21.15.64:0/263523518 learned_addr learned my addr 172.21.15.64:0/263523518 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:12.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.272+0000 7f0e40fd4640 1 --2- 172.21.15.64:0/263523518 >> v2:172.21.15.64:3300/0 conn(0x7f0e3c0b83b0 0x7f0e3c0cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.272+0000 7f88fffff640 1 Processor -- start 2023-10-14T12:29:12.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.272+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36e4005250 con 0x7f37000e3070 2023-10-14T12:29:12.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.272+0000 7f88fffff640 1 -- start start 2023-10-14T12:29:12.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.273+0000 7f709b7fe640 1 --2- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d700 0x7f709c159c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f708c00bb10 tx=0x7f708c02e150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bc816c7ab7fae6f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.273+0000 7f0e40fd4640 1 -- 172.21.15.64:0/263523518 >> v1:172.21.15.177:6789/0 conn(0x7f0e3c0cdbc0 legacy=0x7f0e3c0d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.273+0000 7f0e40fd4640 1 -- 172.21.15.64:0/263523518 >> v1:172.21.15.64:6789/0 conn(0x7f0e3c15c9f0 legacy=0x7f0e3c160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7fddb67fc640 1 -- 172.21.15.64:0/272257586 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac0316f0 con 0x7fddb00e78b0 2023-10-14T12:29:12.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7fddb67fc640 1 -- 172.21.15.64:0/272257586 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac031850 con 0x7fddb00e78b0 2023-10-14T12:29:12.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7fddb67fc640 1 -- 172.21.15.64:0/272257586 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac031be0 con 0x7fddb00e78b0 2023-10-14T12:29:12.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f709affd640 1 -- 172.21.15.64:0/1403432259 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c036440 con 0x7f709c15d700 2023-10-14T12:29:12.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f709affd640 1 -- 172.21.15.64:0/1403432259 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c0365a0 con 0x7f709c15d700 2023-10-14T12:29:12.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f709affd640 1 -- 172.21.15.64:0/1403432259 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c036930 con 0x7f709c15d700 2023-10-14T12:29:12.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f88fffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f89000d14d0 0x7f89000cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f88fffff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89000d3760 con 0x7f890015cc90 2023-10-14T12:29:12.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f88fffff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89000cf9e0 con 0x7f89000cfe70 2023-10-14T12:29:12.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f88fffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890015d070 con 0x7f89000d14d0 2023-10-14T12:29:12.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7fddbcf43640 1 -- 172.21.15.64:0/272257586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00e78b0 msgr2=0x7fddb004f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f70a1b2c640 1 -- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d700 msgr2=0x7f709c159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d700 0x7f709c159c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f708c00bb10 tx=0x7f708c02e150 comp rx=0 tx=0).stop 2023-10-14T12:29:12.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7fddbcf43640 1 --2- 172.21.15.64:0/272257586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00e78b0 0x7fddb004f260 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fddac0097a0 tx=0x7fddac02b790 comp rx=0 tx=0).stop 2023-10-14T12:29:12.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f36fdffb640 1 -- 172.21.15.64:0/2349088282 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3708093430 con 0x7f37000e3070 2023-10-14T12:29:12.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f4b2f7fe640 1 -- 172.21.15.64:0/67300223 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4b40077280 con 0x7f4b480b06f0 2023-10-14T12:29:12.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f88feffd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f890015cc90 0x7f89000d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42644/0 (socket says 172.21.15.64:42644) 2023-10-14T12:29:12.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f88feffd640 1 -- 172.21.15.64:0/3128214076 learned_addr learned my addr 172.21.15.64:0/3128214076 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:12.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f70a1b2c640 1 -- 172.21.15.64:0/1403432259 shutdown_connections 2023-10-14T12:29:12.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c0b01b0 0x7f709c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/1403432259 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c15d700 0x7f709c159c80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f70a1b2c640 1 -- 172.21.15.64:0/1403432259 >> 172.21.15.64:0/1403432259 conn(0x7f709c0cb1b0 msgr2=0x7f709c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f36fdffb640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36ec06ae70 0x7f36ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f70a1b2c640 1 -- 172.21.15.64:0/1403432259 shutdown_connections 2023-10-14T12:29:12.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f36fdffb640 1 -- 172.21.15.64:0/2349088282 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3708103300 con 0x7f37000e3070 2023-10-14T12:29:12.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.274+0000 7f0e40fd4640 1 -- 172.21.15.64:0/263523518 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c161240 con 0x7f0e3c0b83b0 2023-10-14T12:29:12.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.277+0000 7f370d5ac640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36ec06ae70 0x7f36ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f70a1b2c640 1 -- 172.21.15.64:0/1403432259 wait complete. 2023-10-14T12:29:12.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7fddbcf43640 1 -- 172.21.15.64:0/272257586 shutdown_connections 2023-10-14T12:29:12.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7fddbcf43640 1 --2- 172.21.15.64:0/272257586 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb700 0x7fddb00536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7fddbcf43640 1 --2- 172.21.15.64:0/272257586 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00e78b0 0x7fddb004f260 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7fddbcf43640 1 -- 172.21.15.64:0/272257586 >> 172.21.15.64:0/272257586 conn(0x7fddb0054c10 msgr2=0x7fddb0054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.275+0000 7f88f67fc640 1 --2- 172.21.15.64:0/3128214076 >> v2:172.21.15.177:3300/0 conn(0x7f89000d14d0 0x7f89000cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2493120637 0 0) 0x7f89000d3760 con 0x7f890015cc90 2023-10-14T12:29:12.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88ec003520 con 0x7f890015cc90 2023-10-14T12:29:12.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2071666720 0 0) 0x7f88ec003520 con 0x7f890015cc90 2023-10-14T12:29:12.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 >> v2:172.21.15.177:3300/0 conn(0x7f89000d14d0 msgr2=0x7f89000cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 --2- 172.21.15.64:0/3128214076 >> v2:172.21.15.177:3300/0 conn(0x7f89000d14d0 0x7f89000cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 >> v1:172.21.15.177:6789/0 conn(0x7f89000cfe70 legacy=0x7f89000cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89000b1870 con 0x7f890015cc90 2023-10-14T12:29:12.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f88e8001670 con 0x7f890015cc90 2023-10-14T12:29:12.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 >> v1:172.21.15.64:6789/0 conn(0x7f890015cc90 legacy=0x7f89000d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ec0039c0 0x7f88ec003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ec0047c0 0x7f88ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.277+0000 7fddbcf43640 1 -- 172.21.15.64:0/272257586 shutdown_connections 2023-10-14T12:29:12.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec005330 0x7f88ec00b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890015d070 con 0x7f88ec005330 2023-10-14T12:29:12.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec00c280 con 0x7f88ec0039c0 2023-10-14T12:29:12.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.276+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec00c440 con 0x7f88ec0047c0 2023-10-14T12:29:12.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.277+0000 7f88ff7fe640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec005330 0x7f88ec00b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.277+0000 7f88feffd640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ec0039c0 0x7f88ec003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7fddbcf43640 1 -- 172.21.15.64:0/272257586 wait complete. 2023-10-14T12:29:12.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f88f67fc640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ec0047c0 0x7f88ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f0e40fd4640 1 --2- 172.21.15.64:0/263523518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c0b83b0 0x7f0e3c0cd680 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0097a0 tx=0x7f0e2c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b3772541d895c08 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f88feffd640 1 -- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ec0047c0 msgr2=0x7f88ec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f88feffd640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ec0047c0 0x7f88ec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f88feffd640 1 -- 172.21.15.64:0/3128214076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec005330 msgr2=0x7f88ec00b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f88feffd640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec005330 0x7f88ec00b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f88feffd640 1 -- 172.21.15.64:0/3128214076 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec003520 con 0x7f88ec0039c0 2023-10-14T12:29:12.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f88f67fc640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f88ec0047c0 0x7f88ec004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:12.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.278+0000 7f0e33fff640 1 -- 172.21.15.64:0/263523518 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c030610 con 0x7f0e3c0b83b0 2023-10-14T12:29:12.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.279+0000 7f0e33fff640 1 -- 172.21.15.64:0/263523518 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c030770 con 0x7f0e3c0b83b0 2023-10-14T12:29:12.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.279+0000 7f0e33fff640 1 -- 172.21.15.64:0/263523518 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c030610 con 0x7f0e3c0b83b0 2023-10-14T12:29:12.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.279+0000 7f70a1b2c640 1 Processor -- start 2023-10-14T12:29:12.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f0e43a39640 1 -- 172.21.15.64:0/263523518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c0b83b0 msgr2=0x7f0e3c0cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.279+0000 7f370d5ac640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36ec06ae70 0x7f36ec06d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3704001680 tx=0x7f37040078d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f70a1b2c640 1 -- start start 2023-10-14T12:29:12.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f0e43a39640 1 --2- 172.21.15.64:0/263523518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c0b83b0 0x7f0e3c0cd680 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c0097a0 tx=0x7f0e2c02b960 comp rx=0 tx=0).stop 2023-10-14T12:29:12.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f88ff7fe640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec005330 0x7f88ec00b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:12.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f88ff7fe640 1 -- 172.21.15.64:0/3128214076 reap_dead start 2023-10-14T12:29:12.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f0e43a39640 1 -- 172.21.15.64:0/263523518 shutdown_connections 2023-10-14T12:29:12.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f0e43a39640 1 --2- 172.21.15.64:0/263523518 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c0b83b0 0x7f0e3c0cd680 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f0e43a39640 1 -- 172.21.15.64:0/263523518 >> 172.21.15.64:0/263523518 conn(0x7f0e3c071510 msgr2=0x7f0e3c071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7fddbcf43640 1 Processor -- start 2023-10-14T12:29:12.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f0e43a39640 1 -- 172.21.15.64:0/263523518 shutdown_connections 2023-10-14T12:29:12.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.281+0000 7f88feffd640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ec0039c0 0x7f88ec003dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c190 tx=0x7f88ec0057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15cac6ca10572c65 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.281+0000 7fddbcf43640 1 -- start start 2023-10-14T12:29:12.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.280+0000 7f0e43a39640 1 -- 172.21.15.64:0/263523518 wait complete. 2023-10-14T12:29:12.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.281+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8005ad0 con 0x7f88ec0039c0 2023-10-14T12:29:12.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e8005c30 con 0x7f88ec0039c0 2023-10-14T12:29:12.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f88fe7fc640 1 -- 172.21.15.64:0/3128214076 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e802ca50 con 0x7f88ec0039c0 2023-10-14T12:29:12.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f2756864640 1 Processor -- start 2023-10-14T12:29:12.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f0e43a39640 1 Processor -- start 2023-10-14T12:29:12.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f2756864640 1 -- start start 2023-10-14T12:29:12.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7fddbcf43640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb2c0 0x7fddb0053e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7f0e43a39640 1 -- start start 2023-10-14T12:29:12.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7fddbcf43640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00eb700 0x7fddb0185c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f70a1b2c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0b01b0 0x7f709c152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7f88fffff640 1 -- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ec0039c0 msgr2=0x7f88ec003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f70a1b2c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f709c15d700 0x7f709c0c3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f70a1b2c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c15dae0 0x7f709c0c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f70a1b2c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1535f0 con 0x7f709c15d700 2023-10-14T12:29:12.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f70a1b2c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c1531c0 con 0x7f709c0b01b0 2023-10-14T12:29:12.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7f88fffff640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ec0039c0 0x7f88ec003dc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c190 tx=0x7f88ec0057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.282+0000 7f70a1b2c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0affd0 con 0x7f709c15dae0 2023-10-14T12:29:12.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7fddbcf43640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb00e7e40 0x7fddb004a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7f7093fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f709c15d700 0x7f709c0c3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.283+0000 7fddbcf43640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb01861d0 con 0x7fddb00eb700 2023-10-14T12:29:12.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f709b7fe640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0b01b0 0x7f709c152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7fddb77fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb2c0 0x7fddb0053e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7fddb77fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb2c0 0x7fddb0053e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45312/0 (socket says 172.21.15.64:45312) 2023-10-14T12:29:12.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7fddb77fe640 1 -- 172.21.15.64:0/406140852 learned_addr learned my addr 172.21.15.64:0/406140852 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb00dcc90 con 0x7fddb00e7e40 2023-10-14T12:29:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f0e43a39640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e3c0cdbc0 0x7f0e3c0c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f0e43a39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e3c15c9f0 0x7f0e3c0b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb0054410 con 0x7fddb00eb2c0 2023-10-14T12:29:12.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7fddb7fff640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb00e7e40 0x7fddb004a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f7093fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f709c15d700 0x7f709c0c3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37836/0 (socket says 172.21.15.64:37836) 2023-10-14T12:29:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f7093fff640 1 -- 172.21.15.64:0/945215833 learned_addr learned my addr 172.21.15.64:0/945215833 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f88fffff640 1 -- 172.21.15.64:0/3128214076 shutdown_connections 2023-10-14T12:29:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f88fffff640 1 --2- 172.21.15.64:0/3128214076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f88ec0039c0 0x7f88ec003dc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f88fffff640 1 -- 172.21.15.64:0/3128214076 >> 172.21.15.64:0/3128214076 conn(0x7f89000d27e0 msgr2=0x7f89000d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f0e43a39640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c1f32e0 0x7f0e3c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f0e43a39640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c9290 con 0x7f0e3c1f32e0 2023-10-14T12:29:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f0e43a39640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c8fb0 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f709bfff640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c15dae0 0x7f709c0c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f0e43a39640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c0c6610 con 0x7f0e3c0cdbc0 2023-10-14T12:29:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f0e40fd4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e3c15c9f0 0x7f0e3c0b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f2756864640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f275015c9f0 0x7f2750160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f2756864640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2750161520 con 0x7f27500b83b0 2023-10-14T12:29:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f2756864640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2750160f60 con 0x7f27500cdd90 2023-10-14T12:29:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f0e40fd4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e3c15c9f0 0x7f0e3c0b3690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:37966/0 (socket says 172.21.15.64:37966) 2023-10-14T12:29:12.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f0e40fd4640 1 -- 172.21.15.64:0/313283780 learned_addr learned my addr 172.21.15.64:0/313283780 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.284+0000 7f2756864640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2750161240 con 0x7f275015c9f0 2023-10-14T12:29:12.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f88fffff640 1 -- 172.21.15.64:0/3128214076 shutdown_connections 2023-10-14T12:29:12.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7fddb6ffd640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00eb700 0x7fddb0185c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f88fffff640 1 -- 172.21.15.64:0/3128214076 wait complete. 2023-10-14T12:29:12.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f274f7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f27500b83b0 0x7f27500cd680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42660/0 (socket says 172.21.15.64:42660) 2023-10-14T12:29:12.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f274f7fe640 1 -- 172.21.15.64:0/3694372554 learned_addr learned my addr 172.21.15.64:0/3694372554 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:12.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f709bfff640 1 -- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0b01b0 msgr2=0x7f709c152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f709bfff640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0b01b0 0x7f709c152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f709bfff640 1 -- 172.21.15.64:0/945215833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f709c15d700 msgr2=0x7f709c0c3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f709bfff640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f709c15d700 0x7f709c0c3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f709bfff640 1 -- 172.21.15.64:0/945215833 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c00b770 con 0x7f709c15dae0 2023-10-14T12:29:12.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f7093fff640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f709c15d700 0x7f709c0c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:12.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f0e41fd6640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c1f32e0 0x7f0e3c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.285+0000 7f0e417d5640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e3c0cdbc0 0x7f0e3c0c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7fddb77fe640 1 -- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb00e7e40 msgr2=0x7fddb004a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7f274ffff640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f275015c9f0 0x7f2750160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7fddb77fe640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb00e7e40 0x7fddb004a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7f0e40fd4640 1 -- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e3c0cdbc0 msgr2=0x7f0e3c0c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7f0e40fd4640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e3c0cdbc0 0x7f0e3c0c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7f0e40fd4640 1 -- 172.21.15.64:0/313283780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c1f32e0 msgr2=0x7f0e3c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 515572761 0 0) 0x7f2750161520 con 0x7f27500b83b0 2023-10-14T12:29:12.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f273c003520 con 0x7f27500b83b0 2023-10-14T12:29:12.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7f0e40fd4640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c1f32e0 0x7f0e3c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f0e40fd4640 1 -- 172.21.15.64:0/313283780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2c009400 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f0e41fd6640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c1f32e0 0x7f0e3c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:12.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3045478353 0 0) 0x7f273c003520 con 0x7f27500b83b0 2023-10-14T12:29:12.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f275015c9f0 msgr2=0x7f2750160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f275015c9f0 0x7f2750160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 >> v1:172.21.15.177:6789/0 conn(0x7f27500cdd90 legacy=0x7f27500d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500d0b70 con 0x7f27500b83b0 2023-10-14T12:29:12.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f2740001670 con 0x7f27500b83b0 2023-10-14T12:29:12.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 >> v1:172.21.15.64:6789/0 conn(0x7f27500b83b0 legacy=0x7f27500cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c0039a0 0x7f273c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f273c004350 0x7f273c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273c005020 0x7f273c014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2750161240 con 0x7f273c004350 2023-10-14T12:29:12.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273c014750 con 0x7f273c005020 2023-10-14T12:29:12.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273c014910 con 0x7f273c0039a0 2023-10-14T12:29:12.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f274f7fe640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f273c004350 0x7f273c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f0e40fd4640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e3c15c9f0 0x7f0e3c0b3690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c02bf70 tx=0x7f0e2c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7f709bfff640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c15dae0 0x7f709c0c3f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f709400ccb0 tx=0x7f709400a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.286+0000 7fddb77fe640 1 -- 172.21.15.64:0/406140852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00eb700 msgr2=0x7fddb0185c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7fddb77fe640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00eb700 0x7fddb0185c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7fddb77fe640 1 -- 172.21.15.64:0/406140852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddac009400 con 0x7fddb00eb2c0 2023-10-14T12:29:12.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7fddb7fff640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb00e7e40 0x7fddb004a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:12.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.287+0000 7fddb6ffd640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00eb700 0x7fddb0185c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:12.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f0e31ffb640 1 -- 172.21.15.64:0/313283780 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c03f070 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f0e31ffb640 1 -- 172.21.15.64:0/313283780 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e2c030e20 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f0e31ffb640 1 -- 172.21.15.64:0/313283780 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e2c003830 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e3c0c68f0 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f2754e01640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273c005020 0x7f273c014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f274ffff640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c0039a0 0x7f273c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7fddb77fe640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb2c0 0x7fddb0053e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddac02bd20 tx=0x7fddac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f274f7fe640 1 -- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c0039a0 msgr2=0x7f273c003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f274f7fe640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c0039a0 0x7f273c003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f274f7fe640 1 -- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273c005020 msgr2=0x7f273c014190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:12.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f88fffff640 1 Processor -- start 2023-10-14T12:29:12.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f274f7fe640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f273c005020 0x7f273c014190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f274f7fe640 1 -- 172.21.15.64:0/3694372554 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273c003520 con 0x7f273c004350 2023-10-14T12:29:12.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f88fffff640 1 -- start start 2023-10-14T12:29:12.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.288+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e3c0c8b80 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.289+0000 7f274ffff640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c0039a0 0x7f273c003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:12.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.290+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e3c0c6e10 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.290+0000 7f88fffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec0039c0 0x7f89000cec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.290+0000 7f88fffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8900152830 0x7f8900152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88fffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8900153200 0x7f8900153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f274f7fe640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f273c004350 0x7f273c004820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f274000c160 tx=0x7f273c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887f6c9fa96d5c29 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88feffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec0039c0 0x7f89000cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88fffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8900157dc0 con 0x7f88ec0039c0 2023-10-14T12:29:12.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88feffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec0039c0 0x7f89000cec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37876/0 (socket says 172.21.15.64:37876) 2023-10-14T12:29:12.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88f67fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8900152830 0x7f8900152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88feffd640 1 -- 172.21.15.64:0/1650549215 learned_addr learned my addr 172.21.15.64:0/1650549215 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89000c9a70 con 0x7f8900153200 2023-10-14T12:29:12.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8900154590 con 0x7f8900152830 2023-10-14T12:29:12.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740005ad0 con 0x7f273c004350 2023-10-14T12:29:12.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f88ff7fe640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8900153200 0x7f8900153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.291+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740005c30 con 0x7f273c004350 2023-10-14T12:29:12.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f88f67fc640 1 -- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8900153200 msgr2=0x7f8900153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f88f67fc640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8900153200 0x7f8900153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f88f67fc640 1 -- 172.21.15.64:0/1650549215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec0039c0 msgr2=0x7f89000cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f88f67fc640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec0039c0 0x7f89000cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f88f67fc640 1 -- 172.21.15.64:0/1650549215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8900153cf0 con 0x7f8900152830 2023-10-14T12:29:12.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f274effd640 1 -- 172.21.15.64:0/3694372554 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740007070 con 0x7f273c004350 2023-10-14T12:29:12.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f88f67fc640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8900152830 0x7f8900152cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f88f000d630 tx=0x7f88f000da30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f2756864640 1 -- 172.21.15.64:0/3694372554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f273c004350 msgr2=0x7f273c004820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f2756864640 1 --2- 172.21.15.64:0/3694372554 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f273c004350 0x7f273c004820 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f274000c160 tx=0x7f273c0057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f2754e01640 1 -- 172.21.15.64:0/3694372554 reap_dead start 2023-10-14T12:29:12.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f2756864640 1 -- 172.21.15.64:0/3694372554 shutdown_connections 2023-10-14T12:29:12.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f2756864640 1 -- 172.21.15.64:0/3694372554 >> 172.21.15.64:0/3694372554 conn(0x7f2750071510 msgr2=0x7f2750071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f2756864640 1 -- 172.21.15.64:0/3694372554 shutdown_connections 2023-10-14T12:29:12.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f2756864640 1 -- 172.21.15.64:0/3694372554 wait complete. 2023-10-14T12:29:12.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.292+0000 7f0e31ffb640 1 -- 172.21.15.64:0/313283780 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0e2c003990 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f0e31ffb640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e2006ae70 0x7f0e2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f0e31ffb640 1 -- 172.21.15.64:0/313283780 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e2c0ab710 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.293+0000 7f0e417d5640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e2006ae70 0x7f0e2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7fdda3fff640 1 -- 172.21.15.64:0/406140852 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac034890 con 0x7fddb00eb2c0 2023-10-14T12:29:12.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f7098ff9640 1 -- 172.21.15.64:0/945215833 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094003b90 con 0x7f709c15dae0 2023-10-14T12:29:12.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f7098ff9640 1 -- 172.21.15.64:0/945215833 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7094003cf0 con 0x7f709c15dae0 2023-10-14T12:29:12.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb00546f0 con 0x7fddb00eb2c0 2023-10-14T12:29:12.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c0c44c0 con 0x7f709c15dae0 2023-10-14T12:29:12.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f88f7fff640 1 -- 172.21.15.64:0/1650549215 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0004440 con 0x7f8900152830 2023-10-14T12:29:12.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f88f7fff640 1 -- 172.21.15.64:0/1650549215 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f000c040 con 0x7f8900152830 2023-10-14T12:29:12.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f88f7fff640 1 -- 172.21.15.64:0/1650549215 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f0003850 con 0x7f8900152830 2023-10-14T12:29:12.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c0afa10 con 0x7f709c15dae0 2023-10-14T12:29:12.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f36fdffb640 1 -- 172.21.15.64:0/2349088282 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37080ce200 con 0x7f37000e3070 2023-10-14T12:29:12.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f7098ff9640 1 -- 172.21.15.64:0/945215833 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7094004240 con 0x7f709c15dae0 2023-10-14T12:29:12.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.295+0000 7fdda3fff640 1 -- 172.21.15.64:0/406140852 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac0349f0 con 0x7fddb00eb2c0 2023-10-14T12:29:12.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.295+0000 7fdda3fff640 1 -- 172.21.15.64:0/406140852 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac034890 con 0x7fddb00eb2c0 2023-10-14T12:29:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8900153fd0 con 0x7f8900152830 2023-10-14T12:29:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.294+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89000cf1a0 con 0x7f8900152830 2023-10-14T12:29:12.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.295+0000 7f0e417d5640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e2006ae70 0x7f0e2006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e38005880 tx=0x7f0e38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.296+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c153730 con 0x7f709c15dae0 2023-10-14T12:29:12.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.296+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890004e9b0 con 0x7f8900152830 2023-10-14T12:29:12.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.297+0000 7f2756864640 1 Processor -- start 2023-10-14T12:29:12.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.295+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb00dd1c0 con 0x7fddb00eb2c0 2023-10-14T12:29:12.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.296+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb00548d0 con 0x7fddb00eb2c0 2023-10-14T12:29:12.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.297+0000 7f2756864640 1 -- start start 2023-10-14T12:29:12.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.298+0000 7f7098ff9640 1 -- 172.21.15.64:0/945215833 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7094036d50 con 0x7f709c15dae0 2023-10-14T12:29:12.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.300+0000 7f2756864640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c004350 0x7f275006ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.300+0000 7f2756864640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2750152360 0x7f275006fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.300+0000 7f7098ff9640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f707c06ae70 0x7f707c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.300+0000 7f7098ff9640 1 -- 172.21.15.64:0/945215833 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7094012070 con 0x7f709c15dae0 2023-10-14T12:29:12.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.300+0000 7f88f7fff640 1 -- 172.21.15.64:0/1650549215 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f88f00039b0 con 0x7f8900152830 2023-10-14T12:29:12.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.301+0000 7f709b7fe640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f707c06ae70 0x7f707c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.300+0000 7f274ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c004350 0x7f275006ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.301+0000 7f274f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2750152360 0x7f275006fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f274f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2750152360 0x7f275006fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37884/0 (socket says 172.21.15.64:37884) 2023-10-14T12:29:12.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f274f7fe640 1 -- 172.21.15.64:0/933835428 learned_addr learned my addr 172.21.15.64:0/933835428 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:12.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f709b7fe640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f707c06ae70 0x7f707c06d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f708c038000 tx=0x7f708c032000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.300+0000 7fdda3fff640 1 -- 172.21.15.64:0/406140852 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fddac03b040 con 0x7fddb00eb2c0 2023-10-14T12:29:12.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7fdda3fff640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9c06aed0 0x7fdd9c06d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f274ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c004350 0x7f275006ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45366/0 (socket says 172.21.15.64:45366) 2023-10-14T12:29:12.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f2756864640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27500cb770 0x7f2750153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cc310 con 0x7f2750152360 2023-10-14T12:29:12.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.303+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27500cc030 con 0x7f27500cb770 2023-10-14T12:29:12.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f88f7fff640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f88e006af70 0x7f88e006d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.302+0000 7f88f7fff640 1 -- 172.21.15.64:0/1650549215 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88f008a120 con 0x7f8900152830 2023-10-14T12:29:12.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.303+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27500c9c20 con 0x7f273c004350 2023-10-14T12:29:12.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.303+0000 7f2754e01640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27500cb770 0x7f2750153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7f88feffd640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f88e006af70 0x7f88e006d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7f274f7fe640 1 -- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c004350 msgr2=0x7f275006ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7f274f7fe640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c004350 0x7f275006ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7f274f7fe640 1 -- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27500cb770 msgr2=0x7f2750153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7f274f7fe640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27500cb770 0x7f2750153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7f274f7fe640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27500c9f00 con 0x7f2750152360 2023-10-14T12:29:12.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7fddb6ffd640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9c06aed0 0x7fdd9c06d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.304+0000 7f274f7fe640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2750152360 0x7f275006fc50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f274002c2a0 tx=0x7f2740001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.305+0000 7fddb6ffd640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9c06aed0 0x7fdd9c06d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fddb0053dc0 tx=0x7fdda40098a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.305+0000 7f88feffd640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f88e006af70 0x7f88e006d430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c190 tx=0x7f88e8009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.305+0000 7f274cff9640 1 -- 172.21.15.64:0/933835428 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740039070 con 0x7f2750152360 2023-10-14T12:29:12.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.305+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27500ca1e0 con 0x7f2750152360 2023-10-14T12:29:12.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.305+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27500cbbf0 con 0x7f2750152360 2023-10-14T12:29:12.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.306+0000 7f274cff9640 1 -- 172.21.15.64:0/933835428 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2740007580 con 0x7f2750152360 2023-10-14T12:29:12.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.306+0000 7f274cff9640 1 -- 172.21.15.64:0/933835428 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2740039070 con 0x7f2750152360 2023-10-14T12:29:12.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.307+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2734005250 con 0x7f2750152360 2023-10-14T12:29:12.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.309+0000 7f274cff9640 1 -- 172.21.15.64:0/933835428 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2740032070 con 0x7f2750152360 2023-10-14T12:29:12.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.310+0000 7f274cff9640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f273006af00 0x7f273006d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:12.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.310+0000 7f274cff9640 1 -- 172.21.15.64:0/933835428 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27400aa7d0 con 0x7f2750152360 2023-10-14T12:29:12.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.311+0000 7f274ffff640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f273006af00 0x7f273006d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:12.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.312+0000 7f274ffff640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f273006af00 0x7f273006d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27500b6d30 tx=0x7f2738008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:12.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.312+0000 7fdda3fff640 1 -- 172.21.15.64:0/406140852 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fddac07a3c0 con 0x7fddb00eb2c0 2023-10-14T12:29:12.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.313+0000 7f7098ff9640 1 -- 172.21.15.64:0/945215833 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7094054fb0 con 0x7f709c15dae0 2023-10-14T12:29:12.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.314+0000 7f0e31ffb640 1 -- 172.21.15.64:0/313283780 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0e3c0c6e10 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.320+0000 7f274cff9640 1 -- 172.21.15.64:0/933835428 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2740075780 con 0x7f2750152360 2023-10-14T12:29:12.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.326+0000 7f88f7fff640 1 -- 172.21.15.64:0/1650549215 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f88f0054f50 con 0x7f8900152830 2023-10-14T12:29:12.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.336+0000 7fdda3fff640 1 -- 172.21.15.64:0/406140852 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fddac076000 con 0x7fddb00eb2c0 2023-10-14T12:29:12.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.684+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7efde404e9b0 con 0x7efde415be60 2023-10-14T12:29:12.689 INFO:teuthology.orchestra.run.smithi064.stdout:60129542151 2023-10-14T12:29:12.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.685+0000 7efdcbfff640 1 -- 172.21.15.64:0/4233017863 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdd4017020 con 0x7efde415be60 2023-10-14T12:29:12.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.689+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efdd006af40 msgr2=0x7efdd006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.689+0000 7efdea133640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efdd006af40 0x7efdd006d400 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efde4159ca0 tx=0x7efddc009190 comp rx=0 tx=0).stop 2023-10-14T12:29:12.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.689+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efde415be60 msgr2=0x7efde4159080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.689+0000 7efdea133640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efde415be60 0x7efde4159080 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7efdd400ca80 tx=0x7efdd400cf40 comp rx=0 tx=0).stop 2023-10-14T12:29:12.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 shutdown_connections 2023-10-14T12:29:12.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7efdea133640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efdd006af40 0x7efdd006d400 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efde4159ca0 tx=0x7efddc009190 comp rx=0 tx=0).stop 2023-10-14T12:29:12.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7efdea133640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efde415be60 0x7efde4159080 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7efdea133640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efde40cb6c0 0x7efde40715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7efdea133640 1 --2- 172.21.15.64:0/4233017863 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efde40b1200 0x7efde40c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 >> 172.21.15.64:0/4233017863 conn(0x7efde40ce7d0 msgr2=0x7efde40b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 shutdown_connections 2023-10-14T12:29:12.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.690+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f4b280050c0 con 0x7f4b480b06f0 2023-10-14T12:29:12.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.691+0000 7efdea133640 1 -- 172.21.15.64:0/4233017863 wait complete. 2023-10-14T12:29:12.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.691+0000 7f4b2f7fe640 1 -- 172.21.15.64:0/67300223 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4b40009450 con 0x7f4b480b06f0 2023-10-14T12:29:12.696 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:12.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.695+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4b3406ae70 msgr2=0x7f4b3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.695+0000 7f4b4d675640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4b3406ae70 0x7f4b3406d330 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4b480acd60 tx=0x7f4b38016040 comp rx=0 tx=0).stop 2023-10-14T12:29:12.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.695+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b480b06f0 msgr2=0x7f4b480c5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.695+0000 7f4b4d675640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b480b06f0 0x7f4b480c5800 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4b40000f80 tx=0x7f4b40004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:12.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.695+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f36e40057d0 con 0x7f37000e3070 2023-10-14T12:29:12.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.696+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 shutdown_connections 2023-10-14T12:29:12.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.696+0000 7f4b4d675640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4b3406ae70 0x7f4b3406d330 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.696+0000 7f4b4d675640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4b4815cb60 0x7f4b480c5d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.696+0000 7f4b4d675640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4b480b06f0 0x7f4b480c5800 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.696+0000 7f4b4d675640 1 --2- 172.21.15.64:0/67300223 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4b4806dd90 0x7f4b48150bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.696+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 >> 172.21.15.64:0/67300223 conn(0x7f4b4806a440 msgr2=0x7f4b480cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.697+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 shutdown_connections 2023-10-14T12:29:12.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.697+0000 7f4b4d675640 1 -- 172.21.15.64:0/67300223 wait complete. 2023-10-14T12:29:12.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.698+0000 7f36fdffb640 1 -- 172.21.15.64:0/2349088282 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3708098090 con 0x7f37000e3070 2023-10-14T12:29:12.704 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:12.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36ec06ae70 msgr2=0x7f36ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36ec06ae70 0x7f36ec06d330 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3704001680 tx=0x7f37040078d0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37000e3070 msgr2=0x7f37000de2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37000e3070 0x7f37000de2b0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3708073520 tx=0x7f3708072520 comp rx=0 tx=0).stop 2023-10-14T12:29:12.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 shutdown_connections 2023-10-14T12:29:12.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36ec06ae70 0x7f36ec06d330 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37000e3070 0x7f37000de2b0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3700054190 0x7f37000d22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 --2- 172.21.15.64:0/2349088282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3700006b70 0x7f370004c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.705+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 >> 172.21.15.64:0/2349088282 conn(0x7f3700055a90 msgr2=0x7f37000da870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.707+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 shutdown_connections 2023-10-14T12:29:12.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.707+0000 7f36eb7fe640 1 -- 172.21.15.64:0/2349088282 wait complete. 2023-10-14T12:29:12.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.709+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f709c153730 con 0x7f709c15dae0 2023-10-14T12:29:12.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.712+0000 7f7098ff9640 1 -- 172.21.15.64:0/945215833 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f709c153730 con 0x7f709c15dae0 2023-10-14T12:29:12.717 INFO:teuthology.orchestra.run.smithi064.stdout:60129542151 2023-10-14T12:29:12.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f707c06ae70 msgr2=0x7f707c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f707c06ae70 0x7f707c06d330 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f708c038000 tx=0x7f708c032000 comp rx=0 tx=0).stop 2023-10-14T12:29:12.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c15dae0 msgr2=0x7f709c0c3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c15dae0 0x7f709c0c3f80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f709400ccb0 tx=0x7f709400a660 comp rx=0 tx=0).stop 2023-10-14T12:29:12.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 shutdown_connections 2023-10-14T12:29:12.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f707c06ae70 0x7f707c06d330 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f709c15dae0 0x7f709c0c3f80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f709c15d700 0x7f709c0c3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 --2- 172.21.15.64:0/945215833 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f709c0b01b0 0x7f709c152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.718+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 >> 172.21.15.64:0/945215833 conn(0x7f709c0cb1b0 msgr2=0x7f709c0cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.719+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 shutdown_connections 2023-10-14T12:29:12.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.719+0000 7f70a1b2c640 1 -- 172.21.15.64:0/945215833 wait complete. 2023-10-14T12:29:12.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.0 2023-10-14T12:29:12.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.2 2023-10-14T12:29:12.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.728+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0e3c0c6e10 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.729+0000 7f0e31ffb640 1 -- 172.21.15.64:0/313283780 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0e3c0c6e10 con 0x7f0e3c15c9f0 2023-10-14T12:29:12.731 INFO:teuthology.orchestra.run.smithi064.stdout:60129542151 2023-10-14T12:29:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e2006ae70 msgr2=0x7f0e2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e2006ae70 0x7f0e2006d330 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e38005880 tx=0x7f0e38009040 comp rx=0 tx=0).stop 2023-10-14T12:29:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e3c15c9f0 msgr2=0x7f0e3c0b3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e3c15c9f0 0x7f0e3c0b3690 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c02bf70 tx=0x7f0e2c0046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 shutdown_connections 2023-10-14T12:29:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0e2006ae70 0x7f0e2006d330 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0e38005880 tx=0x7f0e38009040 comp rx=0 tx=0).stop 2023-10-14T12:29:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0e3c1f32e0 0x7f0e3c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0e3c15c9f0 0x7f0e3c0b3690 secure :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0e2c02bf70 tx=0x7f0e2c0046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 --2- 172.21.15.64:0/313283780 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0e3c0cdbc0 0x7f0e3c0c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 >> 172.21.15.64:0/313283780 conn(0x7f0e3c071510 msgr2=0x7f0e3c15b580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 shutdown_connections 2023-10-14T12:29:12.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.731+0000 7f0e43a39640 1 -- 172.21.15.64:0/313283780 wait complete. 2023-10-14T12:29:12.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.1 2023-10-14T12:29:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.738+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f89000c9bb0 con 0x7f8900152830 2023-10-14T12:29:12.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.739+0000 7f88f7fff640 1 -- 172.21.15.64:0/1650549215 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f88f0058570 con 0x7f8900152830 2023-10-14T12:29:12.741 INFO:teuthology.orchestra.run.smithi064.stdout:60129542151 2023-10-14T12:29:12.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.6 2023-10-14T12:29:12.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f88e006af70 msgr2=0x7f88e006d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f88e006af70 0x7f88e006d430 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f88e800c190 tx=0x7f88e8009030 comp rx=0 tx=0).stop 2023-10-14T12:29:12.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8900152830 msgr2=0x7f8900152cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8900152830 0x7f8900152cc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f88f000d630 tx=0x7f88f000da30 comp rx=0 tx=0).stop 2023-10-14T12:29:12.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 shutdown_connections 2023-10-14T12:29:12.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f88e006af70 0x7f88e006d430 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8900153200 0x7f8900153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8900152830 0x7f8900152cc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 --2- 172.21.15.64:0/1650549215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f88ec0039c0 0x7f89000cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 >> 172.21.15.64:0/1650549215 conn(0x7f89000d27e0 msgr2=0x7f890015bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 shutdown_connections 2023-10-14T12:29:12.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.742+0000 7f88fffff640 1 -- 172.21.15.64:0/1650549215 wait complete. 2023-10-14T12:29:12.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.752+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2734005500 con 0x7f2750152360 2023-10-14T12:29:12.759 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.3 2023-10-14T12:29:12.760 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.753+0000 7f274cff9640 1 -- 172.21.15.64:0/933835428 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2740078da0 con 0x7f2750152360 2023-10-14T12:29:12.760 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:12.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f273006af00 msgr2=0x7f273006d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f273006af00 0x7f273006d3c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f27500b6d30 tx=0x7f2738008040 comp rx=0 tx=0).stop 2023-10-14T12:29:12.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2750152360 msgr2=0x7f275006fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2750152360 0x7f275006fc50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f274002c2a0 tx=0x7f2740001930 comp rx=0 tx=0).stop 2023-10-14T12:29:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 shutdown_connections 2023-10-14T12:29:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f273006af00 0x7f273006d3c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27500cb770 0x7f2750153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2750152360 0x7f275006fc50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 --2- 172.21.15.64:0/933835428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f273c004350 0x7f275006ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 >> 172.21.15.64:0/933835428 conn(0x7f2750071510 msgr2=0x7f275015d160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 shutdown_connections 2023-10-14T12:29:12.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.755+0000 7f2756864640 1 -- 172.21.15.64:0/933835428 wait complete. 2023-10-14T12:29:12.764 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.5 2023-10-14T12:29:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.763+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fddb0005490 con 0x7fddb00eb2c0 2023-10-14T12:29:12.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.764+0000 7fdda3fff640 1 -- 172.21.15.64:0/406140852 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fddac079620 con 0x7fddb00eb2c0 2023-10-14T12:29:12.766 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:12.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9c06aed0 msgr2=0x7fdd9c06d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9c06aed0 0x7fdd9c06d390 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fddb0053dc0 tx=0x7fdda40098a0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb2c0 msgr2=0x7fddb0053e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:12.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb2c0 0x7fddb0053e30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fddac02bd20 tx=0x7fddac0046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 shutdown_connections 2023-10-14T12:29:12.770 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdd9c06aed0 0x7fdd9c06d390 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fddb00e7e40 0x7fddb004a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fddb00eb700 0x7fddb0185c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 --2- 172.21.15.64:0/406140852 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fddb00eb2c0 0x7fddb0053e30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 >> 172.21.15.64:0/406140852 conn(0x7fddb0054c10 msgr2=0x7fddb0037d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:12.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 shutdown_connections 2023-10-14T12:29:12.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:12.767+0000 7fddbcf43640 1 -- 172.21.15.64:0/406140852 wait complete. 2023-10-14T12:29:12.777 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.4 2023-10-14T12:29:12.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2023-10-14T12:29:13.725 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-14T12:29:13.725 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-14T12:29:13.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-14T12:29:13.743 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-14T12:29:13.760 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-14T12:29:13.765 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-14T12:29:13.778 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-14T12:29:13.788 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-14T12:29:14.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.015+0000 7f1dd7200640 1 Processor -- start 2023-10-14T12:29:14.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.016+0000 7f1dd7200640 1 -- start start 2023-10-14T12:29:14.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.017+0000 7f1dd7200640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1dd0160f40 0x7f1dd00c9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.018+0000 7f1dd7200640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f1dd00c1a90 0x7f1dd00b1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.018+0000 7f1dd7200640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dd00c9980 con 0x7f1dd00ce2e0 2023-10-14T12:29:14.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.018+0000 7f1dd7200640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00ca350 con 0x7f1dd00c1a90 2023-10-14T12:29:14.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.018+0000 7f1dd7200640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dd00c8d70 con 0x7f1dd0160f40 2023-10-14T12:29:14.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.018+0000 7f1dd4f9c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1dd0160f40 0x7f1dd00c9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.018+0000 7f1dd4f9c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1dd0160f40 0x7f1dd00c9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:38006/0 (socket says 172.21.15.64:38006) 2023-10-14T12:29:14.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.018+0000 7f1dd4f9c640 1 -- 172.21.15.64:0/2367227127 learned_addr learned my addr 172.21.15.64:0/2367227127 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.019+0000 7fd7142f7640 1 Processor -- start 2023-10-14T12:29:14.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.019+0000 7f1dd579d640 1 --2- 172.21.15.64:0/2367227127 >> v2:172.21.15.64:3300/0 conn(0x7f1dd00c1a90 0x7f1dd00b1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.019+0000 7f1dd4f9c640 1 -- 172.21.15.64:0/2367227127 >> v2:172.21.15.64:3300/0 conn(0x7f1dd00c1a90 msgr2=0x7f1dd00b1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.019+0000 7f1dd4f9c640 1 --2- 172.21.15.64:0/2367227127 >> v2:172.21.15.64:3300/0 conn(0x7f1dd00c1a90 0x7f1dd00b1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.021+0000 7fd7142f7640 1 -- start start 2023-10-14T12:29:14.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.020+0000 7f1dd4f9c640 1 -- 172.21.15.64:0/2367227127 >> v1:172.21.15.64:6789/0 conn(0x7f1dd00ce2e0 legacy=0x7f1dd00c1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.020+0000 7f1dd4f9c640 1 -- 172.21.15.64:0/2367227127 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd00c9050 con 0x7f1dd0160f40 2023-10-14T12:29:14.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.020+0000 7f1dd579d640 1 --2- 172.21.15.64:0/2367227127 >> v2:172.21.15.64:3300/0 conn(0x7f1dd00c1a90 0x7f1dd00b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:14.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.022+0000 7f1dd4f9c640 1 --2- 172.21.15.64:0/2367227127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd0160f40 0x7f1dd00c9e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00afe70 tx=0x7f1dc402b9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67d1787733336a22 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.023+0000 7f1dcf7fe640 1 -- 172.21.15.64:0/2367227127 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4030870 con 0x7f1dd0160f40 2023-10-14T12:29:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.023+0000 7f1dcf7fe640 1 -- 172.21.15.64:0/2367227127 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc40309d0 con 0x7f1dd0160f40 2023-10-14T12:29:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.023+0000 7f1dcf7fe640 1 -- 172.21.15.64:0/2367227127 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4030d60 con 0x7f1dd0160f40 2023-10-14T12:29:14.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.023+0000 7fd7142f7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7040e4770 0x7fd7040543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.024+0000 7fd712093640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7040e4770 0x7fd7040543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.024+0000 7fd712093640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7040e4770 0x7fd7040543f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:38014/0 (socket says 172.21.15.64:38014) 2023-10-14T12:29:14.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.024+0000 7fd712093640 1 -- 172.21.15.64:0/2492639707 learned_addr learned my addr 172.21.15.64:0/2492639707 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.024+0000 7f1dd7200640 1 -- 172.21.15.64:0/2367227127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd0160f40 msgr2=0x7f1dd00c9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.024+0000 7f1dd7200640 1 --2- 172.21.15.64:0/2367227127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd0160f40 0x7f1dd00c9e10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1dd00afe70 tx=0x7f1dc402b9b0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.024+0000 7fd7142f7640 1 --2- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd704054eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.025+0000 7f1dd7200640 1 -- 172.21.15.64:0/2367227127 shutdown_connections 2023-10-14T12:29:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.025+0000 7f1dd7200640 1 --2- 172.21.15.64:0/2367227127 >> v2:172.21.15.64:3300/0 conn(0x7f1dd00c1a90 0x7f1dd00b1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.025+0000 7f1dd7200640 1 --2- 172.21.15.64:0/2367227127 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd0160f40 0x7f1dd00c9e10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.025+0000 7f1dd7200640 1 -- 172.21.15.64:0/2367227127 >> 172.21.15.64:0/2367227127 conn(0x7f1dd0071400 msgr2=0x7f1dd0071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.025+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd704056bc0 con 0x7fd704035cf0 2023-10-14T12:29:14.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.025+0000 7f1dd7200640 1 -- 172.21.15.64:0/2367227127 shutdown_connections 2023-10-14T12:29:14.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.026+0000 7f1dd7200640 1 -- 172.21.15.64:0/2367227127 wait complete. 2023-10-14T12:29:14.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.026+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd704054a20 con 0x7fd7040e4770 2023-10-14T12:29:14.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.026+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd704036370 con 0x7fd704038fe0 2023-10-14T12:29:14.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.027+0000 7fd712093640 1 -- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 msgr2=0x7fd704054eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.027+0000 7fd712093640 1 --2- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd704054eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.027+0000 7fd712093640 1 -- 172.21.15.64:0/2492639707 >> v1:172.21.15.64:6789/0 conn(0x7fd704035cf0 legacy=0x7fd7040388d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.027+0000 7fd712093640 1 -- 172.21.15.64:0/2492639707 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704051750 con 0x7fd7040e4770 2023-10-14T12:29:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.029+0000 7fd712093640 1 --2- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7040e4770 0x7fd7040543f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=276a3fdf43663f30 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.029+0000 7f1dd7200640 1 Processor -- start 2023-10-14T12:29:14.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.029+0000 7fd711091640 1 -- 172.21.15.64:0/2492639707 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7000317e0 con 0x7fd7040e4770 2023-10-14T12:29:14.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.030+0000 7fd711091640 1 -- 172.21.15.64:0/2492639707 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd700031940 con 0x7fd7040e4770 2023-10-14T12:29:14.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.030+0000 7fd711091640 1 -- 172.21.15.64:0/2492639707 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700031cd0 con 0x7fd7040e4770 2023-10-14T12:29:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7040e4770 msgr2=0x7fd7040543f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7fd7142f7640 1 --2- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7040e4770 0x7fd7040543f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd700009870 tx=0x7fd70002b880 comp rx=0 tx=0).stop 2023-10-14T12:29:14.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.030+0000 7f1dd7200640 1 -- start start 2023-10-14T12:29:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7f1dd7200640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd00c1a90 0x7f1dd01f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7f1dd7200640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1dd00ce2e0 0x7f1dd00b7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.032+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 shutdown_connections 2023-10-14T12:29:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7f1dd7200640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dd0160f40 0x7f1dd00c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7f1dd7200640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd01f61d0 con 0x7f1dd00ce2e0 2023-10-14T12:29:14.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7f1dd7200640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd01f7280 con 0x7f1dd00c1a90 2023-10-14T12:29:14.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.031+0000 7f1dd7200640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd00c6800 con 0x7f1dd0160f40 2023-10-14T12:29:14.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.032+0000 7f1dd579d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dd0160f40 0x7f1dd00c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.032+0000 7fd7142f7640 1 --2- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd704054eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.032+0000 7f1dd579d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dd0160f40 0x7f1dd00c3e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45388/0 (socket says 172.21.15.64:45388) 2023-10-14T12:29:14.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.032+0000 7f1dd579d640 1 -- 172.21.15.64:0/1586650847 learned_addr learned my addr 172.21.15.64:0/1586650847 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.032+0000 7fd7142f7640 1 --2- 172.21.15.64:0/2492639707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7040e4770 0x7fd7040543f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.032+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 >> 172.21.15.64:0/2492639707 conn(0x7fd7040538d0 msgr2=0x7fd704053ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.033+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 shutdown_connections 2023-10-14T12:29:14.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.033+0000 7fd7142f7640 1 -- 172.21.15.64:0/2492639707 wait complete. 2023-10-14T12:29:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.033+0000 7f1dcffff640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1dd00ce2e0 0x7f1dd00b7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.034+0000 7f1dd4f9c640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd00c1a90 0x7f1dd01f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.034+0000 7f1dd579d640 1 -- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd00c1a90 msgr2=0x7f1dd01f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.034+0000 7f1dd579d640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd00c1a90 0x7f1dd01f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.034+0000 7f1dd579d640 1 -- 172.21.15.64:0/1586650847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1dd00ce2e0 msgr2=0x7f1dd00b7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.034+0000 7f1dd579d640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1dd00ce2e0 0x7f1dd00b7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.034+0000 7f1dd579d640 1 -- 172.21.15.64:0/1586650847 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dc40094d0 con 0x7f1dd0160f40 2023-10-14T12:29:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.035+0000 7f1dcffff640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1dd00ce2e0 0x7f1dd00b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:14.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.035+0000 7f1dd579d640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dd0160f40 0x7f1dd00c3e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800cf20 tx=0x7f1dc800a7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.036+0000 7f1dcd7fa640 1 -- 172.21.15.64:0/1586650847 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800d840 con 0x7f1dd0160f40 2023-10-14T12:29:14.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.036+0000 7f1dcd7fa640 1 -- 172.21.15.64:0/1586650847 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dc800d9c0 con 0x7f1dd0160f40 2023-10-14T12:29:14.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.036+0000 7f1dcd7fa640 1 -- 172.21.15.64:0/1586650847 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc800dd70 con 0x7f1dd0160f40 2023-10-14T12:29:14.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.037+0000 7f1dd7200640 1 -- 172.21.15.64:0/1586650847 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd00c6ae0 con 0x7f1dd0160f40 2023-10-14T12:29:14.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.037+0000 7fd7142f7640 1 Processor -- start 2023-10-14T12:29:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.038+0000 7f1dd7200640 1 -- 172.21.15.64:0/1586650847 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd00c70a0 con 0x7f1dd0160f40 2023-10-14T12:29:14.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.038+0000 7fd7142f7640 1 -- start start 2023-10-14T12:29:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.040+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dd004e9b0 con 0x7f1dd0160f40 2023-10-14T12:29:14.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.043+0000 7f1dcd7fa640 1 -- 172.21.15.64:0/1586650847 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1dc801e3b0 con 0x7f1dd0160f40 2023-10-14T12:29:14.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.043+0000 7fd7142f7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd704035cf0 0x7fd70404b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.043+0000 7fd7142f7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd70404bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.043+0000 7fd7142f7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7040e4770 0x7fd70404c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.043+0000 7fd7142f7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7040e3980 con 0x7fd7040e4770 2023-10-14T12:29:14.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.043+0000 7fd7142f7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70404fb50 con 0x7fd704035cf0 2023-10-14T12:29:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.043+0000 7fd7142f7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70404fe30 con 0x7fd704038fe0 2023-10-14T12:29:14.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.044+0000 7f1dcd7fa640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1db406aec0 0x7f1db406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7fd711892640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd70404bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7fd712093640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd704035cf0 0x7fd70404b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7fd712894640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7040e4770 0x7fd70404c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7f1dcd7fa640 1 -- 172.21.15.64:0/1586650847 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1dc808a380 con 0x7f1dd0160f40 2023-10-14T12:29:14.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7f1dd4f9c640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1db406aec0 0x7f1db406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7fd711892640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd70404bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45400/0 (socket says 172.21.15.64:45400) 2023-10-14T12:29:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7fd712093640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd704035cf0 0x7fd70404b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:38018/0 (socket says 172.21.15.64:38018) 2023-10-14T12:29:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.045+0000 7fd712093640 1 -- 172.21.15.64:0/3462193926 learned_addr learned my addr 172.21.15.64:0/3462193926 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.046+0000 7fd712894640 1 -- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 msgr2=0x7fd70404bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.046+0000 7fd712894640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd70404bf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.046+0000 7fd712894640 1 -- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd704035cf0 msgr2=0x7fd70404b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.046+0000 7fd712894640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd704035cf0 0x7fd70404b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.046+0000 7fd712894640 1 -- 172.21.15.64:0/3462193926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000094d0 con 0x7fd7040e4770 2023-10-14T12:29:14.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.046+0000 7fd711892640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd70404bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:14.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.047+0000 7fd712894640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7040e4770 0x7fd70404c450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd70c074bb0 tx=0x7fd70c072520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.047+0000 7fd6feffd640 1 -- 172.21.15.64:0/3462193926 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c072970 con 0x7fd7040e4770 2023-10-14T12:29:14.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.047+0000 7f1dd4f9c640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1db406aec0 0x7f1db406d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4036000 tx=0x7f1dc403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.047+0000 7fd6feffd640 1 -- 172.21.15.64:0/3462193926 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd70c0682b0 con 0x7fd7040e4770 2023-10-14T12:29:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.047+0000 7fd6feffd640 1 -- 172.21.15.64:0/3462193926 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70c072e50 con 0x7fd7040e4770 2023-10-14T12:29:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.048+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd704050110 con 0x7fd7040e4770 2023-10-14T12:29:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.048+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70404f770 con 0x7fd7040e4770 2023-10-14T12:29:14.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.050+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd704005910 con 0x7fd7040e4770 2023-10-14T12:29:14.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.052+0000 7fd6feffd640 1 -- 172.21.15.64:0/3462193926 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd70c08f070 con 0x7fd7040e4770 2023-10-14T12:29:14.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.054+0000 7fd6feffd640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6f006aec0 0x7fd6f006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.054+0000 7fd6feffd640 1 -- 172.21.15.64:0/3462193926 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd70c072fb0 con 0x7fd7040e4770 2023-10-14T12:29:14.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.055+0000 7fd712093640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6f006aec0 0x7fd6f006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.057+0000 7fd712093640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6f006aec0 0x7fd6f006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd700000c00 tx=0x7fd70003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.060+0000 7fd6feffd640 1 -- 172.21.15.64:0/3462193926 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd70c0ce4b0 con 0x7fd7040e4770 2023-10-14T12:29:14.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.062+0000 7f1dcd7fa640 1 -- 172.21.15.64:0/1586650847 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1dc8055160 con 0x7f1dd0160f40 2023-10-14T12:29:14.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.078+0000 7f64e76e5640 1 Processor -- start 2023-10-14T12:29:14.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.078+0000 7f64e76e5640 1 -- start start 2023-10-14T12:29:14.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.081+0000 7f64e76e5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f64e006c9b0 0x7f64e00ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.081+0000 7f64e76e5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f64e00b01b0 0x7f64e00b0600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.082+0000 7f64e5481640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f64e0158b40 0x7f64e006c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:55258/0 (socket says 172.21.15.64:55258) 2023-10-14T12:29:14.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.082+0000 7f64e4c80640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f64e006c9b0 0x7f64e00ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.082+0000 7f64e76e5640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64e00b0b40 con 0x7f64e0158b40 2023-10-14T12:29:14.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.082+0000 7f64e76e5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e006d6e0 con 0x7f64e006c9b0 2023-10-14T12:29:14.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.082+0000 7f64e76e5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64e00c8fb0 con 0x7f64e00b01b0 2023-10-14T12:29:14.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.082+0000 7f64e5481640 1 -- 172.21.15.64:0/4149487052 learned_addr learned my addr 172.21.15.64:0/4149487052 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:14.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.083+0000 7f64e5c82640 1 --2- 172.21.15.64:0/4149487052 >> v2:172.21.15.177:3300/0 conn(0x7f64e00b01b0 0x7f64e00b0600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.083+0000 7f64dffff640 1 -- 172.21.15.64:0/4149487052 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 713751834 0 0) 0x7f64d4001490 con 0x7f64e0158b40 2023-10-14T12:29:14.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.083+0000 7f64e4c80640 1 -- 172.21.15.64:0/4149487052 >> v2:172.21.15.177:3300/0 conn(0x7f64e00b01b0 msgr2=0x7f64e00b0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.083+0000 7f64e4c80640 1 --2- 172.21.15.64:0/4149487052 >> v2:172.21.15.177:3300/0 conn(0x7f64e00b01b0 0x7f64e00b0600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.083+0000 7f64e4c80640 1 -- 172.21.15.64:0/4149487052 >> v1:172.21.15.177:6789/0 conn(0x7f64e0158b40 legacy=0x7f64e006c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.083+0000 7f64e4c80640 1 -- 172.21.15.64:0/4149487052 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64e006ce40 con 0x7f64e006c9b0 2023-10-14T12:29:14.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.083+0000 7f64e5c82640 1 --2- 172.21.15.64:0/4149487052 >> v2:172.21.15.177:3300/0 conn(0x7f64e00b01b0 0x7f64e00b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:14.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.085+0000 7f64e4c80640 1 --2- 172.21.15.64:0/4149487052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e006c9b0 0x7f64e00ccbe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64e00cae10 tx=0x7f64cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=227b86b72da53c91 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.084+0000 7fe5fb590640 1 Processor -- start 2023-10-14T12:29:14.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.084+0000 7fe5fb590640 1 -- start start 2023-10-14T12:29:14.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7f64dffff640 1 -- 172.21.15.64:0/4149487052 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc031830 con 0x7f64e006c9b0 2023-10-14T12:29:14.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7fe5fb590640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe5f40b1e30 0x7fe5f41652f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7fe5fb590640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40cd000 0x7fe5f40cd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7fe5fb590640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f40cd990 con 0x7fe5f40cfba0 2023-10-14T12:29:14.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7fe5fb590640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f4164ed0 con 0x7fe5f40b1e30 2023-10-14T12:29:14.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7fe5fb590640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f4164b60 con 0x7fe5f40cd000 2023-10-14T12:29:14.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7f64dffff640 1 -- 172.21.15.64:0/4149487052 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64cc031990 con 0x7f64e006c9b0 2023-10-14T12:29:14.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.086+0000 7f64dffff640 1 -- 172.21.15.64:0/4149487052 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc031830 con 0x7f64e006c9b0 2023-10-14T12:29:14.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.087+0000 7fe5f932c640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fe5f40cfba0 0x7fe5f41614d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:55272/0 (socket says 172.21.15.64:55272) 2023-10-14T12:29:14.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.087+0000 7fe5f932c640 1 -- 172.21.15.64:0/1104961819 learned_addr learned my addr 172.21.15.64:0/1104961819 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:14.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.087+0000 7fe5f8b2b640 1 --2- 172.21.15.64:0/1104961819 >> v2:172.21.15.177:3300/0 conn(0x7fe5f40b1e30 0x7fe5f41652f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.087+0000 7f64e76e5640 1 -- 172.21.15.64:0/4149487052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e006c9b0 msgr2=0x7f64e00ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.087+0000 7f64e76e5640 1 --2- 172.21.15.64:0/4149487052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e006c9b0 0x7f64e00ccbe0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f64e00cae10 tx=0x7f64cc02b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7fe5ebfff640 1 -- 172.21.15.64:0/1104961819 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4231964084 0 0) 0x7fe5ec001490 con 0x7fe5f40cfba0 2023-10-14T12:29:14.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7fe5ebfff640 1 -- 172.21.15.64:0/1104961819 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e0003520 con 0x7fe5f40cfba0 2023-10-14T12:29:14.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7f64e76e5640 1 -- 172.21.15.64:0/4149487052 shutdown_connections 2023-10-14T12:29:14.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7f64e76e5640 1 --2- 172.21.15.64:0/4149487052 >> v2:172.21.15.177:3300/0 conn(0x7f64e00b01b0 0x7f64e00b0600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7f64e76e5640 1 --2- 172.21.15.64:0/4149487052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e006c9b0 0x7f64e00ccbe0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7f64e76e5640 1 -- 172.21.15.64:0/4149487052 >> 172.21.15.64:0/4149487052 conn(0x7f64e006a440 msgr2=0x7f64e00cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7f64e76e5640 1 -- 172.21.15.64:0/4149487052 shutdown_connections 2023-10-14T12:29:14.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7f64e76e5640 1 -- 172.21.15.64:0/4149487052 wait complete. 2023-10-14T12:29:14.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7fe5f8b2b640 1 -- 172.21.15.64:0/1104961819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40cd000 msgr2=0x7fe5f40cd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7fe5f8b2b640 1 --2- 172.21.15.64:0/1104961819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40cd000 0x7fe5f40cd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7fe5f8b2b640 1 -- 172.21.15.64:0/1104961819 >> v1:172.21.15.177:6789/0 conn(0x7fe5f40cfba0 legacy=0x7fe5f41614d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.088+0000 7fe5f8b2b640 1 -- 172.21.15.64:0/1104961819 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f415b9b0 con 0x7fe5f40b1e30 2023-10-14T12:29:14.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.090+0000 7fe5f8b2b640 1 --2- 172.21.15.64:0/1104961819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40b1e30 0x7fe5f41652f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40097a0 tx=0x7fe5e402b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=982c830fc3f17a43 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.091+0000 7f64e76e5640 1 Processor -- start 2023-10-14T12:29:14.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.092+0000 7fe5ebfff640 1 -- 172.21.15.64:0/1104961819 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e40317c0 con 0x7fe5f40b1e30 2023-10-14T12:29:14.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.092+0000 7fe5ebfff640 1 -- 172.21.15.64:0/1104961819 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4031920 con 0x7fe5f40b1e30 2023-10-14T12:29:14.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.092+0000 7fe5ebfff640 1 -- 172.21.15.64:0/1104961819 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4031c90 con 0x7fe5f40b1e30 2023-10-14T12:29:14.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.091+0000 7f64e76e5640 1 -- start start 2023-10-14T12:29:14.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 -- 172.21.15.64:0/1104961819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40b1e30 msgr2=0x7fe5f41652f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 --2- 172.21.15.64:0/1104961819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40b1e30 0x7fe5f41652f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe5e40097a0 tx=0x7fe5e402b860 comp rx=0 tx=0).stop 2023-10-14T12:29:14.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 -- 172.21.15.64:0/1104961819 shutdown_connections 2023-10-14T12:29:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 --2- 172.21.15.64:0/1104961819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40cd000 0x7fe5f40cd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 --2- 172.21.15.64:0/1104961819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40b1e30 0x7fe5f41652f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 -- 172.21.15.64:0/1104961819 >> 172.21.15.64:0/1104961819 conn(0x7fe5f4071510 msgr2=0x7fe5f4071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7fb5cb59e640 1 Processor -- start 2023-10-14T12:29:14.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7f64e76e5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64e00b01b0 0x7f64e014e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7f64e76e5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e0158b40 0x7f64e014db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7f64e76e5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64e0159930 0x7f64e015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7f64e76e5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e014ea30 con 0x7f64e0158b40 2023-10-14T12:29:14.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7f64e76e5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c5980 con 0x7f64e00b01b0 2023-10-14T12:29:14.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7f64e76e5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64e00c5c40 con 0x7f64e0159930 2023-10-14T12:29:14.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.094+0000 7fb5cb59e640 1 -- start start 2023-10-14T12:29:14.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 -- 172.21.15.64:0/1104961819 shutdown_connections 2023-10-14T12:29:14.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.093+0000 7fe5fb590640 1 -- 172.21.15.64:0/1104961819 wait complete. 2023-10-14T12:29:14.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.095+0000 7f64e5481640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64e00b01b0 0x7f64e014e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.095+0000 7f64e5481640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64e00b01b0 0x7f64e014e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:38050/0 (socket says 172.21.15.64:38050) 2023-10-14T12:29:14.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.095+0000 7f64e5481640 1 -- 172.21.15.64:0/3872588893 learned_addr learned my addr 172.21.15.64:0/3872588893 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7fe5fb590640 1 Processor -- start 2023-10-14T12:29:14.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7f64e5481640 1 -- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64e0159930 msgr2=0x7f64e015aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7f64e5481640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64e0159930 0x7f64e015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7fb5cb59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c40e3190 0x7fb5c403e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7fb5cb59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb5c4038180 0x7fb5c4053d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7fb5cb59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb5c40542d0 0x7fb5c40e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7fe5fb590640 1 -- start start 2023-10-14T12:29:14.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7f64e5481640 1 -- 172.21.15.64:0/3872588893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e0158b40 msgr2=0x7f64e014db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7f64e5481640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e0158b40 0x7f64e014db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.096+0000 7f64e5481640 1 -- 172.21.15.64:0/3872588893 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc009400 con 0x7f64e00b01b0 2023-10-14T12:29:14.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.097+0000 7f64e5481640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64e00b01b0 0x7f64e014e4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64d400c7c0 tx=0x7f64d400cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.097+0000 7fb5cb59e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c403f100 con 0x7fb5c4038180 2023-10-14T12:29:14.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.097+0000 7fb5cb59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5c4007c40 con 0x7fb5c40542d0 2023-10-14T12:29:14.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.097+0000 7fb5cb59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c403ee60 con 0x7fb5c40e3190 2023-10-14T12:29:14.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.097+0000 7fb5c9d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb5c4038180 0x7fb5c4053d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.097+0000 7fb5c9d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb5c4038180 0x7fb5c4053d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37938/0 (socket says 172.21.15.64:37938) 2023-10-14T12:29:14.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.097+0000 7fb5c9d9b640 1 -- 172.21.15.64:0/4158428025 learned_addr learned my addr 172.21.15.64:0/4158428025 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.099+0000 7f64ddffb640 1 -- 172.21.15.64:0/3872588893 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400a640 con 0x7f64e00b01b0 2023-10-14T12:29:14.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5ca59c640 1 --2- 172.21.15.64:0/4158428025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c40e3190 0x7fb5c403e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5cad9d640 1 --2- 172.21.15.64:0/4158428025 >> v2:172.21.15.177:3300/0 conn(0x7fb5c40542d0 0x7fb5c40e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5c9d9b640 1 -- 172.21.15.64:0/4158428025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c40e3190 msgr2=0x7fb5c403e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.099+0000 7fe5fb590640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40b1e30 0x7fe5f415e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5c9d9b640 1 --2- 172.21.15.64:0/4158428025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c40e3190 0x7fb5c403e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5c9d9b640 1 -- 172.21.15.64:0/4158428025 >> v2:172.21.15.177:3300/0 conn(0x7fb5c40542d0 msgr2=0x7fb5c40e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.099+0000 7fe5fb590640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5f40cd000 0x7fe5f40c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5c9d9b640 1 --2- 172.21.15.64:0/4158428025 >> v2:172.21.15.177:3300/0 conn(0x7fb5c40542d0 0x7fb5c40e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5c9d9b640 1 -- 172.21.15.64:0/4158428025 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5c4006e80 con 0x7fb5c4038180 2023-10-14T12:29:14.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.098+0000 7fb5cad9d640 1 --2- 172.21.15.64:0/4158428025 >> v2:172.21.15.177:3300/0 conn(0x7fb5c40542d0 0x7fb5c40e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:14.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7f64ddffb640 1 -- 172.21.15.64:0/3872588893 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64d400a7a0 con 0x7f64e00b01b0 2023-10-14T12:29:14.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.099+0000 7fe5fb590640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40cfba0 0x7fe5f40c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5fb590640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40b2890 con 0x7fe5f40cd000 2023-10-14T12:29:14.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5fb590640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40b22a0 con 0x7fe5f40cfba0 2023-10-14T12:29:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5fb590640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40c8a00 con 0x7fe5f40b1e30 2023-10-14T12:29:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7f64ddffb640 1 -- 172.21.15.64:0/3872588893 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400ab30 con 0x7f64e00b01b0 2023-10-14T12:29:14.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64e00c5f20 con 0x7f64e00b01b0 2023-10-14T12:29:14.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fb5c9d9b640 1 --2- 172.21.15.64:0/4158428025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c4038180 0x7fb5c4053d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4057300 tx=0x7fb5cc0adf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5d6d30c1e5782a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5f932c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40b1e30 0x7fe5f415e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5f932c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40b1e30 0x7fe5f415e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45426/0 (socket says 172.21.15.64:45426) 2023-10-14T12:29:14.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5f932c640 1 -- 172.21.15.64:0/3083433913 learned_addr learned my addr 172.21.15.64:0/3083433913 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5f8b2b640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5f40cd000 0x7fe5f40c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.100+0000 7fe5f9b2d640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40cfba0 0x7fe5f40c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.101+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64e014e090 con 0x7f64e00b01b0 2023-10-14T12:29:14.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.101+0000 7fe5f8b2b640 1 -- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40b1e30 msgr2=0x7fe5f415e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.101+0000 7fe5f8b2b640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40b1e30 0x7fe5f415e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.101+0000 7fe5f8b2b640 1 -- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40cfba0 msgr2=0x7fe5f40c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.101+0000 7fe5f8b2b640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40cfba0 0x7fe5f40c9a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.101+0000 7fe5f8b2b640 1 -- 172.21.15.64:0/3083433913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4009400 con 0x7fe5f40cd000 2023-10-14T12:29:14.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.101+0000 7fe5f9b2d640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40cfba0 0x7fe5f40c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:14.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7fb5c959a640 1 -- 172.21.15.64:0/4158428025 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc0aeb70 con 0x7fb5c4038180 2023-10-14T12:29:14.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7fb5c959a640 1 -- 172.21.15.64:0/4158428025 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5cc0aecd0 con 0x7fb5c4038180 2023-10-14T12:29:14.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7fb5c959a640 1 -- 172.21.15.64:0/4158428025 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5cc0b6640 con 0x7fb5c4038180 2023-10-14T12:29:14.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7fe5f8b2b640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5f40cd000 0x7fe5f40c7f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4033000 tx=0x7fe5e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7fe5e9ffb640 1 -- 172.21.15.64:0/3083433913 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003810 con 0x7fe5f40cd000 2023-10-14T12:29:14.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7f28bde4f640 1 Processor -- start 2023-10-14T12:29:14.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64c0005250 con 0x7f64e00b01b0 2023-10-14T12:29:14.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7fe5e9ffb640 1 -- 172.21.15.64:0/3083433913 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e4040070 con 0x7fe5f40cd000 2023-10-14T12:29:14.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.102+0000 7fe5e9ffb640 1 -- 172.21.15.64:0/3083433913 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e4003bb0 con 0x7fe5f40cd000 2023-10-14T12:29:14.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.103+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5f40c8ce0 con 0x7fe5f40cd000 2023-10-14T12:29:14.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.103+0000 7f28bde4f640 1 -- start start 2023-10-14T12:29:14.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.103+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f4154390 con 0x7fe5f40cd000 2023-10-14T12:29:14.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.103+0000 7fb5cb59e640 1 -- 172.21.15.64:0/4158428025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c4038180 msgr2=0x7fb5c4053d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.103+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/4158428025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c4038180 0x7fb5c4053d90 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb5c4057300 tx=0x7fb5cc0adf70 comp rx=0 tx=0).stop 2023-10-14T12:29:14.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.104+0000 7fb5cb59e640 1 -- 172.21.15.64:0/4158428025 shutdown_connections 2023-10-14T12:29:14.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.104+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/4158428025 >> v2:172.21.15.177:3300/0 conn(0x7fb5c40542d0 0x7fb5c40e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.104+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/4158428025 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c4038180 0x7fb5c4053d90 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.104+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/4158428025 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c40e3190 0x7fb5c403e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.104+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f40b29d0 con 0x7fe5f40cd000 2023-10-14T12:29:14.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.104+0000 7fb5cb59e640 1 -- 172.21.15.64:0/4158428025 >> 172.21.15.64:0/4158428025 conn(0x7fb5c40590c0 msgr2=0x7fb5c40594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.105+0000 7fb5cb59e640 1 -- 172.21.15.64:0/4158428025 shutdown_connections 2023-10-14T12:29:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.105+0000 7f28bde4f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f28b80b08c0 0x7f28b80ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.105+0000 7f28bde4f640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b80c8fb0 con 0x7f28b8158b40 2023-10-14T12:29:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.105+0000 7f28bde4f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28b806ce40 con 0x7f28b806c9b0 2023-10-14T12:29:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.105+0000 7f28bde4f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28b806d6e0 con 0x7f28b80b08c0 2023-10-14T12:29:14.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.106+0000 7f28b7fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f28b80b08c0 0x7f28b80ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.106+0000 7f28b7fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f28b80b08c0 0x7f28b80ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37958/0 (socket says 172.21.15.64:37958) 2023-10-14T12:29:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.106+0000 7f28b7fff640 1 -- 172.21.15.64:0/2110174871 learned_addr learned my addr 172.21.15.64:0/2110174871 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.107+0000 7f28b7fff640 1 -- 172.21.15.64:0/2110174871 >> v1:172.21.15.177:6789/0 conn(0x7f28b806c9b0 legacy=0x7f28b80b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.107+0000 7f28b7fff640 1 -- 172.21.15.64:0/2110174871 >> v1:172.21.15.64:6789/0 conn(0x7f28b8158b40 legacy=0x7f28b806c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.107+0000 7f28b7fff640 1 -- 172.21.15.64:0/2110174871 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b806d120 con 0x7f28b80b08c0 2023-10-14T12:29:14.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.107+0000 7fb5cb59e640 1 -- 172.21.15.64:0/4158428025 wait complete. 2023-10-14T12:29:14.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.107+0000 7faf5a755640 1 Processor -- start 2023-10-14T12:29:14.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.108+0000 7faf5a755640 1 -- start start 2023-10-14T12:29:14.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.109+0000 7f28b7fff640 1 --2- 172.21.15.64:0/2110174871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80ccbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009bd0 tx=0x7f28b002d3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9110b82c7d1662b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.109+0000 7fb5cb59e640 1 Processor -- start 2023-10-14T12:29:14.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7faf5a755640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faf5415cc90 0x7faf540d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7faf5a755640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf540d05c0 0x7faf540ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7faf5a755640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf540d3760 con 0x7faf540cfe70 2023-10-14T12:29:14.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7faf5a755640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf540cf9e0 con 0x7faf5415cc90 2023-10-14T12:29:14.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7faf5a755640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf5415d070 con 0x7faf540d05c0 2023-10-14T12:29:14.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7fb5cb59e640 1 -- start start 2023-10-14T12:29:14.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7fe5e9ffb640 1 -- 172.21.15.64:0/3083433913 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe5e4003d10 con 0x7fe5f40cd000 2023-10-14T12:29:14.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7faf59f54640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf540d05c0 0x7faf540ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7faf59f54640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf540d05c0 0x7faf540ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:45428/0 (socket says 172.21.15.64:45428) 2023-10-14T12:29:14.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7faf59f54640 1 -- 172.21.15.64:0/3916670425 learned_addr learned my addr 172.21.15.64:0/3916670425 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7faf59753640 1 --2- 172.21.15.64:0/3916670425 >> v2:172.21.15.177:3300/0 conn(0x7faf5415cc90 0x7faf540d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7fb5cb59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c4038180 0x7fb5c40d34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7fb5cb59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c40542d0 0x7fb5c4052e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7fb5cb59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c40e3190 0x7fb5c4057650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7faf59f54640 1 -- 172.21.15.64:0/3916670425 >> v2:172.21.15.177:3300/0 conn(0x7faf5415cc90 msgr2=0x7faf540d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7faf59f54640 1 --2- 172.21.15.64:0/3916670425 >> v2:172.21.15.177:3300/0 conn(0x7faf5415cc90 0x7faf540d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7faf59f54640 1 -- 172.21.15.64:0/3916670425 >> v1:172.21.15.177:6789/0 conn(0x7faf540cfe70 legacy=0x7faf5406af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7faf59f54640 1 -- 172.21.15.64:0/3916670425 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf540b1870 con 0x7faf540d05c0 2023-10-14T12:29:14.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fe5e9ffb640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe5d806ae70 0x7fe5d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fb5cb59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40533c0 con 0x7fb5c40e3190 2023-10-14T12:29:14.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fb5cb59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40535d0 con 0x7fb5c40542d0 2023-10-14T12:29:14.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fb5cb59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c40512f0 con 0x7fb5c4038180 2023-10-14T12:29:14.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fe5e9ffb640 1 -- 172.21.15.64:0/3083433913 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe5e4042070 con 0x7fe5f40cd000 2023-10-14T12:29:14.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fb5cad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c40e3190 0x7fb5c4057650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fb5c9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c40542d0 0x7fb5c4052e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fb5c9d9b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c40542d0 0x7fb5c4052e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:38078/0 (socket says 172.21.15.64:38078) 2023-10-14T12:29:14.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.112+0000 7fb5c9d9b640 1 -- 172.21.15.64:0/2884762343 learned_addr learned my addr 172.21.15.64:0/2884762343 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.113+0000 7fe5f932c640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe5d806ae70 0x7fe5d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.113+0000 7fb5cad9d640 1 -- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c4038180 msgr2=0x7fb5c40d34d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:29:14.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.113+0000 7fb5cad9d640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c4038180 0x7fb5c40d34d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.113+0000 7fb5cad9d640 1 -- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c40542d0 msgr2=0x7fb5c4052e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.113+0000 7fb5cad9d640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c40542d0 0x7fb5c4052e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.113+0000 7fb5cad9d640 1 -- 172.21.15.64:0/2884762343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5cc073860 con 0x7fb5c40e3190 2023-10-14T12:29:14.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.108+0000 7f64ddffb640 1 -- 172.21.15.64:0/3872588893 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f64d400ac90 con 0x7f64e00b01b0 2023-10-14T12:29:14.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7f64ddffb640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f64c406af70 0x7f64c406d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.110+0000 7f64ddffb640 1 -- 172.21.15.64:0/3872588893 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f64d4089530 con 0x7f64e00b01b0 2023-10-14T12:29:14.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.111+0000 7f64e4c80640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f64c406af70 0x7f64c406d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.113+0000 7f64e4c80640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f64c406af70 0x7f64c406d430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64cc036000 tx=0x7f64cc030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.114+0000 7faf59f54640 1 --2- 172.21.15.64:0/3916670425 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf540d05c0 0x7faf540ce300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009e50 tx=0x7faf4c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a902d6004e56968d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.114+0000 7fb5cad9d640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c40e3190 0x7fb5c4057650 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c5f0 tx=0x7fb5c000cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.114+0000 7faf4bfff640 1 -- 172.21.15.64:0/3916670425 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c02ca80 con 0x7faf540d05c0 2023-10-14T12:29:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.114+0000 7faf4bfff640 1 -- 172.21.15.64:0/3916670425 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf4c02cbe0 con 0x7faf540d05c0 2023-10-14T12:29:14.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.114+0000 7fe5f932c640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe5d806ae70 0x7fe5d806d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0016f0 tx=0x7fe5ec001b60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.114+0000 7faf4bfff640 1 -- 172.21.15.64:0/3916670425 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf4c0343f0 con 0x7faf540d05c0 2023-10-14T12:29:14.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7fb5baffd640 1 -- 172.21.15.64:0/2884762343 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0011800 con 0x7fb5c40e3190 2023-10-14T12:29:14.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7fb5baffd640 1 -- 172.21.15.64:0/2884762343 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5c0011980 con 0x7fb5c40e3190 2023-10-14T12:29:14.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7fb5baffd640 1 -- 172.21.15.64:0/2884762343 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5c0011d30 con 0x7fb5c40e3190 2023-10-14T12:29:14.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7f28b67fc640 1 -- 172.21.15.64:0/2110174871 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0034600 con 0x7f28b80b08c0 2023-10-14T12:29:14.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7f28b67fc640 1 -- 172.21.15.64:0/2110174871 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b0030050 con 0x7f28b80b08c0 2023-10-14T12:29:14.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7f28b67fc640 1 -- 172.21.15.64:0/2110174871 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b0034980 con 0x7f28b80b08c0 2023-10-14T12:29:14.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c40515d0 con 0x7fb5c40e3190 2023-10-14T12:29:14.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c4051b90 con 0x7fb5c40e3190 2023-10-14T12:29:14.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7faf5a755640 1 -- 172.21.15.64:0/3916670425 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf540d05c0 msgr2=0x7faf540ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7faf5a755640 1 --2- 172.21.15.64:0/3916670425 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf540d05c0 0x7faf540ce300 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7faf4c009e50 tx=0x7faf4c02bee0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7fe5e9ffb640 1 -- 172.21.15.64:0/3083433913 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe5e40772f0 con 0x7fe5f40cd000 2023-10-14T12:29:14.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7faf5a755640 1 -- 172.21.15.64:0/3916670425 shutdown_connections 2023-10-14T12:29:14.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7faf5a755640 1 --2- 172.21.15.64:0/3916670425 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf540d05c0 0x7faf540ce300 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7faf5a755640 1 --2- 172.21.15.64:0/3916670425 >> v2:172.21.15.177:3300/0 conn(0x7faf5415cc90 0x7faf540d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.115+0000 7faf5a755640 1 -- 172.21.15.64:0/3916670425 >> 172.21.15.64:0/3916670425 conn(0x7faf540d27e0 msgr2=0x7faf540d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.116+0000 7f28bde4f640 1 -- 172.21.15.64:0/2110174871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 msgr2=0x7f28b80ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.116+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2110174871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80ccbe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f28b0009bd0 tx=0x7f28b002d3f0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.116+0000 7faf5a755640 1 -- 172.21.15.64:0/3916670425 shutdown_connections 2023-10-14T12:29:14.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.116+0000 7f28bde4f640 1 -- 172.21.15.64:0/2110174871 shutdown_connections 2023-10-14T12:29:14.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.116+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2110174871 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80ccbe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.116+0000 7f28bde4f640 1 -- 172.21.15.64:0/2110174871 >> 172.21.15.64:0/2110174871 conn(0x7f28b806a440 msgr2=0x7f28b80cb1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.116+0000 7faf5a755640 1 -- 172.21.15.64:0/3916670425 wait complete. 2023-10-14T12:29:14.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.117+0000 7f28bde4f640 1 -- 172.21.15.64:0/2110174871 shutdown_connections 2023-10-14T12:29:14.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.117+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c4051d80 con 0x7fb5c40e3190 2023-10-14T12:29:14.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.118+0000 7fb5baffd640 1 -- 172.21.15.64:0/2884762343 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb5c0022350 con 0x7fb5c40e3190 2023-10-14T12:29:14.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.119+0000 7fb5baffd640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb5ac06aec0 0x7fb5ac06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.120+0000 7fb5baffd640 1 -- 172.21.15.64:0/2884762343 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb5c0089840 con 0x7fb5c40e3190 2023-10-14T12:29:14.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.117+0000 7f28bde4f640 1 -- 172.21.15.64:0/2110174871 wait complete. 2023-10-14T12:29:14.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.120+0000 7f28bde4f640 1 Processor -- start 2023-10-14T12:29:14.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.120+0000 7f28bde4f640 1 -- start start 2023-10-14T12:29:14.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.120+0000 7f64ddffb640 1 -- 172.21.15.64:0/3872588893 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f64d40542d0 con 0x7f64e00b01b0 2023-10-14T12:29:14.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.121+0000 7fb5ca59c640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb5ac06aec0 0x7fb5ac06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.122+0000 7faf5a755640 1 Processor -- start 2023-10-14T12:29:14.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.122+0000 7faf5a755640 1 -- start start 2023-10-14T12:29:14.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.122+0000 7fb5ca59c640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb5ac06aec0 0x7fb5ac06d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b770 tx=0x7fb5bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.122+0000 7f28bde4f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.123+0000 7f28b77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.123+0000 7f28b77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37972/0 (socket says 172.21.15.64:37972) 2023-10-14T12:29:14.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.123+0000 7f28b77fe640 1 -- 172.21.15.64:0/2754463761 learned_addr learned my addr 172.21.15.64:0/2754463761 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.123+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28b8158b40 0x7f28b8159540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.124+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28b80b1d20 0x7f28b8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.124+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80b31f0 con 0x7f28b80b08c0 2023-10-14T12:29:14.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.124+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80b2290 con 0x7f28b80b1d20 2023-10-14T12:29:14.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.124+0000 7f28b7fff640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28b80b1d20 0x7f28b8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.124+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28b80b2570 con 0x7f28b8158b40 2023-10-14T12:29:14.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.124+0000 7f28b6ffd640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28b8158b40 0x7f28b8159540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.125+0000 7fb5baffd640 1 -- 172.21.15.64:0/2884762343 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb5c0054790 con 0x7fb5c40e3190 2023-10-14T12:29:14.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.125+0000 7faf5a755640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf540cfe70 0x7faf540b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7faf5a755640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf540d05c0 0x7faf540c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7faf59753640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf540cfe70 0x7faf540b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7faf59753640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf540cfe70 0x7faf540b5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:37982/0 (socket says 172.21.15.64:37982) 2023-10-14T12:29:14.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7faf59753640 1 -- 172.21.15.64:0/1842174827 learned_addr learned my addr 172.21.15.64:0/1842174827 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7f28b7fff640 1 -- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28b8158b40 msgr2=0x7f28b8159540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7f28b7fff640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28b8158b40 0x7f28b8159540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7f28b7fff640 1 -- 172.21.15.64:0/2754463761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 msgr2=0x7f28b80c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7f28b7fff640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.126+0000 7f28b7fff640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28b0009830 con 0x7f28b80b1d20 2023-10-14T12:29:14.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.127+0000 7faf5a755640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf5415cc90 0x7faf540ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.127+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540caec0 con 0x7faf540cfe70 2023-10-14T12:29:14.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.127+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf540b5ad0 con 0x7faf540d05c0 2023-10-14T12:29:14.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.127+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf540b5510 con 0x7faf5415cc90 2023-10-14T12:29:14.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.127+0000 7f28b7fff640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28b80b1d20 0x7f28b8159a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f28b0033000 tx=0x7f28b0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.127+0000 7faf58f52640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf540d05c0 0x7faf540c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7faf59f54640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf5415cc90 0x7faf540ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7f289ffff640 1 -- 172.21.15.64:0/2754463761 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b003e620 con 0x7f28b80b1d20 2023-10-14T12:29:14.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28b80b2850 con 0x7f28b80b1d20 2023-10-14T12:29:14.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7faf58f52640 1 -- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf5415cc90 msgr2=0x7faf540ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7faf58f52640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf5415cc90 0x7faf540ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7faf58f52640 1 -- 172.21.15.64:0/1842174827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf540cfe70 msgr2=0x7faf540b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7faf58f52640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf540cfe70 0x7faf540b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7faf58f52640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4c009b30 con 0x7faf540d05c0 2023-10-14T12:29:14.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.129+0000 7faf58f52640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf540d05c0 0x7faf540c98b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faf5408cb90 tx=0x7faf5000c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.129+0000 7faf49ffb640 1 -- 172.21.15.64:0/1842174827 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf500052d0 con 0x7faf540d05c0 2023-10-14T12:29:14.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.130+0000 7faf49ffb640 1 -- 172.21.15.64:0/1842174827 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf50005430 con 0x7faf540d05c0 2023-10-14T12:29:14.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.130+0000 7faf49ffb640 1 -- 172.21.15.64:0/1842174827 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf50003810 con 0x7faf540d05c0 2023-10-14T12:29:14.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28b80b2e10 con 0x7f28b80b1d20 2023-10-14T12:29:14.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7f289ffff640 1 -- 172.21.15.64:0/2754463761 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28b003e780 con 0x7f28b80b1d20 2023-10-14T12:29:14.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.128+0000 7f289ffff640 1 -- 172.21.15.64:0/2754463761 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28b003eb10 con 0x7f28b80b1d20 2023-10-14T12:29:14.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.130+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf540b57f0 con 0x7faf540d05c0 2023-10-14T12:29:14.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.130+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf540cc5e0 con 0x7faf540d05c0 2023-10-14T12:29:14.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.130+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2898005250 con 0x7f28b80b1d20 2023-10-14T12:29:14.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.132+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf34005250 con 0x7faf540d05c0 2023-10-14T12:29:14.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.134+0000 7f289ffff640 1 -- 172.21.15.64:0/2754463761 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f28b003b070 con 0x7f28b80b1d20 2023-10-14T12:29:14.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.136+0000 7f289ffff640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28a406ae70 0x7f28a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.136+0000 7f289ffff640 1 -- 172.21.15.64:0/2754463761 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f28b00ac020 con 0x7f28b80b1d20 2023-10-14T12:29:14.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.134+0000 7faf49ffb640 1 -- 172.21.15.64:0/1842174827 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faf50003970 con 0x7faf540d05c0 2023-10-14T12:29:14.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.135+0000 7faf49ffb640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faf3806ae70 0x7faf3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.137+0000 7faf49ffb640 1 -- 172.21.15.64:0/1842174827 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faf500578a0 con 0x7faf540d05c0 2023-10-14T12:29:14.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.137+0000 7faf59753640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faf3806ae70 0x7faf3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.137+0000 7f28b77fe640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28a406ae70 0x7f28a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.139+0000 7f28b77fe640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28a406ae70 0x7f28a406d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009990 tx=0x7f28a8009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.139+0000 7faf59753640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faf3806ae70 0x7faf3806d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf44009b60 tx=0x7faf44009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.149+0000 7f289ffff640 1 -- 172.21.15.64:0/2754463761 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f28b00deca0 con 0x7f28b80b1d20 2023-10-14T12:29:14.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.157+0000 7fbc7d96c640 1 Processor -- start 2023-10-14T12:29:14.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.158+0000 7fbc7d96c640 1 -- start start 2023-10-14T12:29:14.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.160+0000 7fbc7d96c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc780d14d0 0x7fbc780cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.160+0000 7fbc7d96c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbc780cfe70 0x7fbc780cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.160+0000 7fbc7d96c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc780d3760 con 0x7fbc7815cc90 2023-10-14T12:29:14.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.160+0000 7fbc7d96c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc780cf9e0 con 0x7fbc780cfe70 2023-10-14T12:29:14.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.160+0000 7fbc7d96c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7815d070 con 0x7fbc780d14d0 2023-10-14T12:29:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.160+0000 7fbc7c96a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7fbc7815cc90 0x7fbc780d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:55306/0 (socket says 172.21.15.64:55306) 2023-10-14T12:29:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.160+0000 7fbc7c96a640 1 -- 172.21.15.64:0/2659756146 learned_addr learned my addr 172.21.15.64:0/2659756146 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.161+0000 7fbc77fff640 1 --2- 172.21.15.64:0/2659756146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc780d14d0 0x7fbc780cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.161+0000 7fbc7d16b640 1 --2- 172.21.15.64:0/2659756146 >> v2:172.21.15.64:3300/0 conn(0x7fbc780cfe70 0x7fbc780cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.162+0000 7fbc7d16b640 1 -- 172.21.15.64:0/2659756146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc780d14d0 msgr2=0x7fbc780cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.162+0000 7fbc7d16b640 1 --2- 172.21.15.64:0/2659756146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc780d14d0 0x7fbc780cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.162+0000 7fbc7d16b640 1 -- 172.21.15.64:0/2659756146 >> v1:172.21.15.177:6789/0 conn(0x7fbc7815cc90 legacy=0x7fbc780d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.162+0000 7fbc7d16b640 1 -- 172.21.15.64:0/2659756146 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780b1870 con 0x7fbc780cfe70 2023-10-14T12:29:14.183 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.162+0000 7faf49ffb640 1 -- 172.21.15.64:0/1842174827 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faf50017080 con 0x7faf540d05c0 2023-10-14T12:29:14.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.164+0000 7fbc7d16b640 1 --2- 172.21.15.64:0/2659756146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780cd830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000b050 tx=0x7fbc7002c0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5cd6dc28c8fffa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.164+0000 7fbc777fe640 1 -- 172.21.15.64:0/2659756146 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7002cc50 con 0x7fbc780cfe70 2023-10-14T12:29:14.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.165+0000 7fbc777fe640 1 -- 172.21.15.64:0/2659756146 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc7002cdb0 con 0x7fbc780cfe70 2023-10-14T12:29:14.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.165+0000 7fbc777fe640 1 -- 172.21.15.64:0/2659756146 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc70034660 con 0x7fbc780cfe70 2023-10-14T12:29:14.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.166+0000 7fbc7d96c640 1 -- 172.21.15.64:0/2659756146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 msgr2=0x7fbc780cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.166+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/2659756146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780cd830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fbc7000b050 tx=0x7fbc7002c0b0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.168+0000 7fbc7d96c640 1 -- 172.21.15.64:0/2659756146 shutdown_connections 2023-10-14T12:29:14.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.168+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/2659756146 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780cd830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.168+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/2659756146 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc780d14d0 0x7fbc780cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.168+0000 7fbc7d96c640 1 -- 172.21.15.64:0/2659756146 >> 172.21.15.64:0/2659756146 conn(0x7fbc780d27e0 msgr2=0x7fbc780d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.168+0000 7fbc7d96c640 1 -- 172.21.15.64:0/2659756146 shutdown_connections 2023-10-14T12:29:14.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.168+0000 7fbc7d96c640 1 -- 172.21.15.64:0/2659756146 wait complete. 2023-10-14T12:29:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.171+0000 7fbc7d96c640 1 Processor -- start 2023-10-14T12:29:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.172+0000 7fbc7d96c640 1 -- start start 2023-10-14T12:29:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.174+0000 7fbc7d96c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780b7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.175+0000 7fbc7c96a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780b7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.175+0000 7fbc7c96a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780b7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38002/0 (socket says 172.21.15.64:38002) 2023-10-14T12:29:14.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.175+0000 7fbc7c96a640 1 -- 172.21.15.64:0/793092731 learned_addr learned my addr 172.21.15.64:0/793092731 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.175+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc780d14d0 0x7fbc780b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.176+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc7815cc90 0x7fbc781fe970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.176+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780b37e0 con 0x7fbc780cfe70 2023-10-14T12:29:14.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.176+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780b39d0 con 0x7fbc780d14d0 2023-10-14T12:29:14.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.176+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc780b51c0 con 0x7fbc7815cc90 2023-10-14T12:29:14.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.177+0000 7fbc7d16b640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc7815cc90 0x7fbc781fe970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.177+0000 7fbc7c96a640 1 -- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc7815cc90 msgr2=0x7fbc781fe970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.177+0000 7fbc7c96a640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc7815cc90 0x7fbc781fe970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.177+0000 7fbc7c96a640 1 -- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc780d14d0 msgr2=0x7fbc780b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.176+0000 7fbc77fff640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc780d14d0 0x7fbc780b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.177+0000 7fbc7c96a640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc780d14d0 0x7fbc780b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.177+0000 7fbc7c96a640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc70009a70 con 0x7fbc780cfe70 2023-10-14T12:29:14.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.177+0000 7fbc77fff640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc780d14d0 0x7fbc780b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:14.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.178+0000 7fbc7c96a640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780b7fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00c650 tx=0x7fbc6c00cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.178+0000 7fbc757fa640 1 -- 172.21.15.64:0/793092731 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c0058b0 con 0x7fbc780cfe70 2023-10-14T12:29:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.178+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc780b6fb0 con 0x7fbc780cfe70 2023-10-14T12:29:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.178+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc780b74e0 con 0x7fbc780cfe70 2023-10-14T12:29:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.179+0000 7fbc757fa640 1 -- 172.21.15.64:0/793092731 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6c005a10 con 0x7fbc780cfe70 2023-10-14T12:29:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.179+0000 7fbc757fa640 1 -- 172.21.15.64:0/793092731 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6c005da0 con 0x7fbc780cfe70 2023-10-14T12:29:14.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.180+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7804e9b0 con 0x7fbc780cfe70 2023-10-14T12:29:14.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.182+0000 7fbc757fa640 1 -- 172.21.15.64:0/793092731 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc6c007070 con 0x7fbc780cfe70 2023-10-14T12:29:14.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.184+0000 7fbc757fa640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc5c06af40 0x7fbc5c06d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.185+0000 7fbc757fa640 1 -- 172.21.15.64:0/793092731 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbc6c088e60 con 0x7fbc780cfe70 2023-10-14T12:29:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.185+0000 7fbc77fff640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc5c06af40 0x7fbc5c06d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.186+0000 7fbc77fff640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc5c06af40 0x7fbc5c06d400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc780c92b0 tx=0x7fbc64008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.192+0000 7fbc757fa640 1 -- 172.21.15.64:0/793092731 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc6c053c00 con 0x7fbc780cfe70 2023-10-14T12:29:14.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.470+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f1dd00cea20 con 0x7f1dd0160f40 2023-10-14T12:29:14.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.471+0000 7f1dcd7fa640 1 -- 172.21.15.64:0/1586650847 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1dc8058780 con 0x7f1dd0160f40 2023-10-14T12:29:14.475 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.474+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1db406aec0 msgr2=0x7f1db406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.474+0000 7f1dbaffd640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1db406aec0 0x7f1db406d380 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4036000 tx=0x7f1dc403b040 comp rx=0 tx=0).stop 2023-10-14T12:29:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.474+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dd0160f40 msgr2=0x7f1dd00c3e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.474+0000 7f1dbaffd640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dd0160f40 0x7f1dd00c3e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1dc800cf20 tx=0x7f1dc800a7d0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.475+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 shutdown_connections 2023-10-14T12:29:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.475+0000 7f1dbaffd640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1db406aec0 0x7f1db406d380 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.475+0000 7f1dbaffd640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1dd0160f40 0x7f1dd00c3e80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.475+0000 7f1dbaffd640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1dd00ce2e0 0x7f1dd00b7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.475+0000 7f1dbaffd640 1 --2- 172.21.15.64:0/1586650847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1dd00c1a90 0x7f1dd01f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.475+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 >> 172.21.15.64:0/1586650847 conn(0x7f1dd0071400 msgr2=0x7f1dd0072980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.476+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 shutdown_connections 2023-10-14T12:29:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.476+0000 7f1dbaffd640 1 -- 172.21.15.64:0/1586650847 wait complete. 2023-10-14T12:29:14.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.492+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd70404ff70 con 0x7fd7040e4770 2023-10-14T12:29:14.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.493+0000 7fd6feffd640 1 -- 172.21.15.64:0/3462193926 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd70c097070 con 0x7fd7040e4770 2023-10-14T12:29:14.497 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:14.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.498+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6f006aec0 msgr2=0x7fd6f006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.498+0000 7fd7142f7640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6f006aec0 0x7fd6f006d380 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd700000c00 tx=0x7fd70003d040 comp rx=0 tx=0).stop 2023-10-14T12:29:14.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.498+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7040e4770 msgr2=0x7fd70404c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.498+0000 7fd7142f7640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7040e4770 0x7fd70404c450 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd70c074bb0 tx=0x7fd70c072520 comp rx=0 tx=0).stop 2023-10-14T12:29:14.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.499+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 shutdown_connections 2023-10-14T12:29:14.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.499+0000 7fd7142f7640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd6f006aec0 0x7fd6f006d380 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd700000c00 tx=0x7fd70003d040 comp rx=0 tx=0).stop 2023-10-14T12:29:14.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.499+0000 7fd7142f7640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7040e4770 0x7fd70404c450 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.499+0000 7fd7142f7640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd704038fe0 0x7fd70404bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.499+0000 7fd7142f7640 1 --2- 172.21.15.64:0/3462193926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd704035cf0 0x7fd70404b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.499+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 >> 172.21.15.64:0/3462193926 conn(0x7fd7040538d0 msgr2=0x7fd704036790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.500+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 shutdown_connections 2023-10-14T12:29:14.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.500+0000 7fd7142f7640 1 -- 172.21.15.64:0/3462193926 wait complete. 2023-10-14T12:29:14.505 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.2 2023-10-14T12:29:14.505 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.521+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe5f40b29d0 con 0x7fe5f40cd000 2023-10-14T12:29:14.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.522+0000 7fe5e9ffb640 1 -- 172.21.15.64:0/3083433913 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe5f40b29d0 con 0x7fe5f40cd000 2023-10-14T12:29:14.524 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:14.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.526+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe5d806ae70 msgr2=0x7fe5d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.526+0000 7fe5fb590640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe5d806ae70 0x7fe5d806d330 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec0016f0 tx=0x7fe5ec001b60 comp rx=0 tx=0).stop 2023-10-14T12:29:14.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.526+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5f40cd000 msgr2=0x7fe5f40c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.526+0000 7fe5fb590640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5f40cd000 0x7fe5f40c7f40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4033000 tx=0x7fe5e40046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 shutdown_connections 2023-10-14T12:29:14.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe5d806ae70 0x7fe5d806d330 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe5f40cfba0 0x7fe5f40c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe5f40cd000 0x7fe5f40c7f40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 --2- 172.21.15.64:0/3083433913 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe5f40b1e30 0x7fe5f415e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 >> 172.21.15.64:0/3083433913 conn(0x7fe5f4071510 msgr2=0x7fe5f4162290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 shutdown_connections 2023-10-14T12:29:14.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.527+0000 7fe5fb590640 1 -- 172.21.15.64:0/3083433913 wait complete. 2023-10-14T12:29:14.532 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.0 2023-10-14T12:29:14.532 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.534+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f64c00057d0 con 0x7f64e00b01b0 2023-10-14T12:29:14.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.535+0000 7f64ddffb640 1 -- 172.21.15.64:0/3872588893 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f64d4018090 con 0x7f64e00b01b0 2023-10-14T12:29:14.538 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:14.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2898005500 con 0x7f28b80b1d20 2023-10-14T12:29:14.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f64c406af70 msgr2=0x7f64c406d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f64c406af70 0x7f64c406d430 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f64cc036000 tx=0x7f64cc030000 comp rx=0 tx=0).stop 2023-10-14T12:29:14.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64e00b01b0 msgr2=0x7f64e014e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64e00b01b0 0x7f64e014e4f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f64d400c7c0 tx=0x7f64d400cc80 comp rx=0 tx=0).stop 2023-10-14T12:29:14.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 shutdown_connections 2023-10-14T12:29:14.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f64c406af70 0x7f64c406d430 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f64e0159930 0x7f64e015aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f64e0158b40 0x7f64e014db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 --2- 172.21.15.64:0/3872588893 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f64e00b01b0 0x7f64e014e4f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.537+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 >> 172.21.15.64:0/3872588893 conn(0x7f64e006a440 msgr2=0x7f64e00ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.538+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 shutdown_connections 2023-10-14T12:29:14.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.538+0000 7f64e76e5640 1 -- 172.21.15.64:0/3872588893 wait complete. 2023-10-14T12:29:14.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.538+0000 7f289ffff640 1 -- 172.21.15.64:0/2754463761 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f28b0042020 con 0x7f28b80b1d20 2023-10-14T12:29:14.543 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:14.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28a406ae70 msgr2=0x7f28a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28a406ae70 0x7f28a406d330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f28a8009990 tx=0x7f28a8009110 comp rx=0 tx=0).stop 2023-10-14T12:29:14.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28b80b1d20 msgr2=0x7f28b8159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28b80b1d20 0x7f28b8159a80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f28b0033000 tx=0x7f28b0004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:14.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 shutdown_connections 2023-10-14T12:29:14.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28a406ae70 0x7f28a406d330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f28b80b1d20 0x7f28b8159a80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f28b8158b40 0x7f28b8159540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 --2- 172.21.15.64:0/2754463761 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f28b80b08c0 0x7f28b80c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 >> 172.21.15.64:0/2754463761 conn(0x7f28b806a440 msgr2=0x7f28b815cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 shutdown_connections 2023-10-14T12:29:14.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.541+0000 7f28bde4f640 1 -- 172.21.15.64:0/2754463761 wait complete. 2023-10-14T12:29:14.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.548+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb5c4005490 con 0x7fb5c40e3190 2023-10-14T12:29:14.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.549+0000 7fb5baffd640 1 -- 172.21.15.64:0/2884762343 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb5c0057db0 con 0x7fb5c40e3190 2023-10-14T12:29:14.551 INFO:teuthology.orchestra.run.smithi064.stdout:60129542152 2023-10-14T12:29:14.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.552+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb5ac06aec0 msgr2=0x7fb5ac06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.552+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb5ac06aec0 0x7fb5ac06d380 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb5bc00b770 tx=0x7fb5bc008040 comp rx=0 tx=0).stop 2023-10-14T12:29:14.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.552+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c40e3190 msgr2=0x7fb5c4057650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.552+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c40e3190 0x7fb5c4057650 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb5c000c5f0 tx=0x7fb5c000cab0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.553+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 shutdown_connections 2023-10-14T12:29:14.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.553+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb5ac06aec0 0x7fb5ac06d380 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.553+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5c40e3190 0x7fb5c4057650 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.553+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb5c40542d0 0x7fb5c4052e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.553+0000 7fb5cb59e640 1 --2- 172.21.15.64:0/2884762343 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5c4038180 0x7fb5c40d34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.553+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 >> 172.21.15.64:0/2884762343 conn(0x7fb5c40590c0 msgr2=0x7fb5c4038860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.557 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.6 2023-10-14T12:29:14.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.554+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 shutdown_connections 2023-10-14T12:29:14.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.555+0000 7fb5cb59e640 1 -- 172.21.15.64:0/2884762343 wait complete. 2023-10-14T12:29:14.558 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.1 2023-10-14T12:29:14.559 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.561 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.5 2023-10-14T12:29:14.561 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.576 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.3 2023-10-14T12:29:14.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.574+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faf340057d0 con 0x7faf540d05c0 2023-10-14T12:29:14.576 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.575+0000 7faf49ffb640 1 -- 172.21.15.64:0/1842174827 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf50057670 con 0x7faf540d05c0 2023-10-14T12:29:14.577 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:14.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faf3806ae70 msgr2=0x7faf3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faf3806ae70 0x7faf3806d330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7faf44009b60 tx=0x7faf44009190 comp rx=0 tx=0).stop 2023-10-14T12:29:14.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf540d05c0 msgr2=0x7faf540c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf540d05c0 0x7faf540c98b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7faf5408cb90 tx=0x7faf5000c820 comp rx=0 tx=0).stop 2023-10-14T12:29:14.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 shutdown_connections 2023-10-14T12:29:14.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faf3806ae70 0x7faf3806d330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faf5415cc90 0x7faf540ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faf540d05c0 0x7faf540c98b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 --2- 172.21.15.64:0/1842174827 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faf540cfe70 0x7faf540b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 >> 172.21.15.64:0/1842174827 conn(0x7faf540d27e0 msgr2=0x7faf540cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 shutdown_connections 2023-10-14T12:29:14.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.578+0000 7faf5a755640 1 -- 172.21.15.64:0/1842174827 wait complete. 2023-10-14T12:29:14.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.585+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fbc780712f0 con 0x7fbc780cfe70 2023-10-14T12:29:14.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.585+0000 7fbc757fa640 1 -- 172.21.15.64:0/793092731 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbc6c017090 con 0x7fbc780cfe70 2023-10-14T12:29:14.587 INFO:teuthology.orchestra.run.smithi064.stdout:60129542153 2023-10-14T12:29:14.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc5c06af40 msgr2=0x7fbc5c06d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc5c06af40 0x7fbc5c06d400 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbc780c92b0 tx=0x7fbc64008040 comp rx=0 tx=0).stop 2023-10-14T12:29:14.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 msgr2=0x7fbc780b7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780b7fc0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c00c650 tx=0x7fbc6c00cb10 comp rx=0 tx=0).stop 2023-10-14T12:29:14.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 shutdown_connections 2023-10-14T12:29:14.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc5c06af40 0x7fbc5c06d400 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc7815cc90 0x7fbc781fe970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc780d14d0 0x7fbc780b32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 --2- 172.21.15.64:0/793092731 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc780cfe70 0x7fbc780b7fc0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 >> 172.21.15.64:0/793092731 conn(0x7fbc780d27e0 msgr2=0x7fbc78072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 shutdown_connections 2023-10-14T12:29:14.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.589+0000 7fbc7d96c640 1 -- 172.21.15.64:0/793092731 wait complete. 2023-10-14T12:29:14.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2023-10-14T12:29:14.602 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.7 2023-10-14T12:29:14.608 DEBUG:teuthology.parallel:result is None 2023-10-14T12:29:14.608 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T12:29:14.609 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:29:14.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.868+0000 7f726759e640 1 Processor -- start 2023-10-14T12:29:14.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.868+0000 7f726759e640 1 -- start start 2023-10-14T12:29:14.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.870+0000 7f726759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680cd980 0x7f72680cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.870+0000 7f726759e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f726806bf30 0x7f726806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.870+0000 7f726759e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7268154110 con 0x7f7268159c00 2023-10-14T12:29:14.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.870+0000 7f726759e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f726806c900 con 0x7f726806bf30 2023-10-14T12:29:14.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.870+0000 7f726759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726815d1f0 con 0x7f72680cd980 2023-10-14T12:29:14.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.870+0000 7f725dd9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f7268159c00 0x7f726815d9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:42712/0 (socket says 172.21.15.64:42712) 2023-10-14T12:29:14.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.870+0000 7f725dd9b640 1 -- 172.21.15.64:0/2613684277 learned_addr learned my addr 172.21.15.64:0/2613684277 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:14.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f726659c640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680cd980 0x7f72680cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7266d9d640 1 --2- 172.21.15.64:0/2613684277 >> v2:172.21.15.177:3300/0 conn(0x7f726806bf30 0x7f726806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260732050 0 0) 0x7f7268154110 con 0x7f7268159c00 2023-10-14T12:29:14.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7254003520 con 0x7f7268159c00 2023-10-14T12:29:14.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 617566914 0 0) 0x7f7254003520 con 0x7f7268159c00 2023-10-14T12:29:14.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680cd980 msgr2=0x7f72680cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680cd980 0x7f72680cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 >> v2:172.21.15.177:3300/0 conn(0x7f726806bf30 msgr2=0x7f726806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 --2- 172.21.15.64:0/2613684277 >> v2:172.21.15.177:3300/0 conn(0x7f726806bf30 0x7f726806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726815e0c0 con 0x7f7268159c00 2023-10-14T12:29:14.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f7250001670 con 0x7f7268159c00 2023-10-14T12:29:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 >> v1:172.21.15.64:6789/0 conn(0x7f7268159c00 legacy=0x7f726815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7254003970 0x7f7254003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f7254004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7254005180 0x7f725400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726806c900 con 0x7f72540047c0 2023-10-14T12:29:14.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726815d1f0 con 0x7f7254005180 2023-10-14T12:29:14.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.871+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725400bec0 con 0x7f7254003970 2023-10-14T12:29:14.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f725dd9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f7254004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f726659c640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7254003970 0x7f7254003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f7266d9d640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7254005180 0x7f725400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f725dd9b640 1 -- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7254003970 msgr2=0x7f7254003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f725dd9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7254003970 0x7f7254003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f725dd9b640 1 -- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7254005180 msgr2=0x7f725400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f725dd9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7254005180 0x7f725400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.872+0000 7f725dd9b640 1 -- 172.21.15.64:0/2613684277 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7254003520 con 0x7f72540047c0 2023-10-14T12:29:14.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.873+0000 7f725dd9b640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f7254004c40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f725000c190 tx=0x7f72540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b28ab75897ee0d69 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.873+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7250005ad0 con 0x7f72540047c0 2023-10-14T12:29:14.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.873+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7250005c50 con 0x7f72540047c0 2023-10-14T12:29:14.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.873+0000 7f7265d9b640 1 -- 172.21.15.64:0/2613684277 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f725002c810 con 0x7f72540047c0 2023-10-14T12:29:14.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.874+0000 7f726759e640 1 -- 172.21.15.64:0/2613684277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 msgr2=0x7f7254004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.874+0000 7f726759e640 1 --2- 172.21.15.64:0/2613684277 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f7254004c40 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f725000c190 tx=0x7f72540057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.874+0000 7f7266d9d640 1 -- 172.21.15.64:0/2613684277 reap_dead start 2023-10-14T12:29:14.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.874+0000 7f726759e640 1 -- 172.21.15.64:0/2613684277 shutdown_connections 2023-10-14T12:29:14.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.874+0000 7f726759e640 1 -- 172.21.15.64:0/2613684277 >> 172.21.15.64:0/2613684277 conn(0x7f726806a470 msgr2=0x7f72680afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:14.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.874+0000 7f726759e640 1 -- 172.21.15.64:0/2613684277 shutdown_connections 2023-10-14T12:29:14.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.874+0000 7f726759e640 1 -- 172.21.15.64:0/2613684277 wait complete. 2023-10-14T12:29:14.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.876+0000 7f726759e640 1 Processor -- start 2023-10-14T12:29:14.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.876+0000 7f726759e640 1 -- start start 2023-10-14T12:29:14.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f72680b26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680b3500 0x7f726814dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f726814bff0 0x7f7268156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726814bb60 con 0x7f72540047c0 2023-10-14T12:29:14.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f726814cc50 con 0x7f726814bff0 2023-10-14T12:29:14.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726814af60 con 0x7f72680b3500 2023-10-14T12:29:14.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f72680b26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f72680b26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38028/0 (socket says 172.21.15.64:38028) 2023-10-14T12:29:14.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.877+0000 7f726659c640 1 -- 172.21.15.64:0/2515591580 learned_addr learned my addr 172.21.15.64:0/2515591580 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:14.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f725dd9b640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680b3500 0x7f726814dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f7266d9d640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f726814bff0 0x7f7268156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f726659c640 1 -- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680b3500 msgr2=0x7f726814dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f726659c640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680b3500 0x7f726814dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f726659c640 1 -- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f726814bff0 msgr2=0x7f7268156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:14.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f726659c640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f726814bff0 0x7f7268156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:14.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f726659c640 1 -- 172.21.15.64:0/2515591580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726814b230 con 0x7f72540047c0 2023-10-14T12:29:14.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f726659c640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f72680b26e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72580114c0 tx=0x7f7258011980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f725f7fe640 1 -- 172.21.15.64:0/2515591580 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7258005b90 con 0x7f72540047c0 2023-10-14T12:29:14.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f725f7fe640 1 -- 172.21.15.64:0/2515591580 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7258005d10 con 0x7f72540047c0 2023-10-14T12:29:14.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.878+0000 7f725f7fe640 1 -- 172.21.15.64:0/2515591580 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72580158b0 con 0x7f72540047c0 2023-10-14T12:29:14.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.879+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f726814b510 con 0x7f72540047c0 2023-10-14T12:29:14.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.879+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f726814e000 con 0x7f72540047c0 2023-10-14T12:29:14.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.880+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f726814e1c0 con 0x7f72540047c0 2023-10-14T12:29:14.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.883+0000 7f725f7fe640 1 -- 172.21.15.64:0/2515591580 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7258015a10 con 0x7f72540047c0 2023-10-14T12:29:14.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.884+0000 7f725f7fe640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f724806ae70 0x7f724806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:14.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.884+0000 7f725f7fe640 1 -- 172.21.15.64:0/2515591580 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f725808a150 con 0x7f72540047c0 2023-10-14T12:29:14.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.885+0000 7f725dd9b640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f724806ae70 0x7f724806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:14.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.886+0000 7f725dd9b640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f724806ae70 0x7f724806d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:14.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:14.887+0000 7f725f7fe640 1 -- 172.21.15.64:0/2515591580 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7258054f80 con 0x7f72540047c0 2023-10-14T12:29:15.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.069+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f726815a7a0 con 0x7f724806ae70 2023-10-14T12:29:15.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.097+0000 7f725f7fe640 1 -- 172.21.15.64:0/2515591580 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345128 (secure 0 0 0) 0x7f7250005970 con 0x7f724806ae70 2023-10-14T12:29:15.104 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:15.106 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:29:15.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f724806ae70 msgr2=0x7f724806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f724806ae70 0x7f724806d330 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7250034000 tx=0x7f7250007000 comp rx=0 tx=0).stop 2023-10-14T12:29:15.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 msgr2=0x7f72680b26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f72680b26e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f72580114c0 tx=0x7f7258011980 comp rx=0 tx=0).stop 2023-10-14T12:29:15.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 shutdown_connections 2023-10-14T12:29:15.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f724806ae70 0x7f724806d330 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f726814bff0 0x7f7268156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72680b3500 0x7f726814dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 --2- 172.21.15.64:0/2515591580 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72540047c0 0x7f72680b26e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 >> 172.21.15.64:0/2515591580 conn(0x7f726806a470 msgr2=0x7f72680ae250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:15.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 shutdown_connections 2023-10-14T12:29:15.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.103+0000 7f726759e640 1 -- 172.21.15.64:0/2515591580 wait complete. 2023-10-14T12:29:15.123 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-14T12:29:13.734374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219624,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755096,"statfs":{"total":773094113280,"available":772869218304,"internally_reserved":0,"allocated":3547136,"data_stored":2107910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005244"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.913373+0000","last_change":"2023-10-14T12:28:46.080407+0000","last_active":"2023-10-14T12:28:51.913373+0000","last_peered":"2023-10-14T12:28:51.913373+0000","last_clean":"2023-10-14T12:28:51.913373+0000","last_became_active":"2023-10-14T12:28:46.080075+0000","last_became_peered":"2023-10-14T12:28:46.080075+0000","last_unstale":"2023-10-14T12:28:51.913373+0000","last_undegraded":"2023-10-14T12:28:51.913373+0000","last_fullsized":"2023-10-14T12:28:51.913373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:34:41.571338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762559+0000","last_change":"2023-10-14T12:28:46.798279+0000","last_active":"2023-10-14T12:28:51.762559+0000","last_peered":"2023-10-14T12:28:51.762559+0000","last_clean":"2023-10-14T12:28:51.762559+0000","last_became_active":"2023-10-14T12:28:46.797918+0000","last_became_peered":"2023-10-14T12:28:46.797918+0000","last_unstale":"2023-10-14T12:28:51.762559+0000","last_undegraded":"2023-10-14T12:28:51.762559+0000","last_fullsized":"2023-10-14T12:28:51.762559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765687+0000","last_change":"2023-10-14T12:28:51.919038+0000","last_active":"2023-10-14T12:28:52.765687+0000","last_peered":"2023-10-14T12:28:52.765687+0000","last_clean":"2023-10-14T12:28:52.765687+0000","last_became_active":"2023-10-14T12:28:51.917610+0000","last_became_peered":"2023-10-14T12:28:51.917610+0000","last_unstale":"2023-10-14T12:28:52.765687+0000","last_undegraded":"2023-10-14T12:28:52.765687+0000","last_fullsized":"2023-10-14T12:28:52.765687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:07.544233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762860+0000","last_change":"2023-10-14T12:28:46.085671+0000","last_active":"2023-10-14T12:28:51.762860+0000","last_peered":"2023-10-14T12:28:51.762860+0000","last_clean":"2023-10-14T12:28:51.762860+0000","last_became_active":"2023-10-14T12:28:46.085352+0000","last_became_peered":"2023-10-14T12:28:46.085352+0000","last_unstale":"2023-10-14T12:28:51.762860+0000","last_undegraded":"2023-10-14T12:28:51.762860+0000","last_fullsized":"2023-10-14T12:28:51.762860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908566+0000","last_change":"2023-10-14T12:28:46.797554+0000","last_active":"2023-10-14T12:28:51.908566+0000","last_peered":"2023-10-14T12:28:51.908566+0000","last_clean":"2023-10-14T12:28:51.908566+0000","last_became_active":"2023-10-14T12:28:46.794880+0000","last_became_peered":"2023-10-14T12:28:46.794880+0000","last_unstale":"2023-10-14T12:28:51.908566+0000","last_undegraded":"2023-10-14T12:28:51.908566+0000","last_fullsized":"2023-10-14T12:28:51.908566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:52.797863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748815+0000","last_change":"2023-10-14T12:28:51.142417+0000","last_active":"2023-10-14T12:28:53.748815+0000","last_peered":"2023-10-14T12:28:53.748815+0000","last_clean":"2023-10-14T12:28:53.748815+0000","last_became_active":"2023-10-14T12:28:51.141839+0000","last_became_peered":"2023-10-14T12:28:51.141839+0000","last_unstale":"2023-10-14T12:28:53.748815+0000","last_undegraded":"2023-10-14T12:28:53.748815+0000","last_fullsized":"2023-10-14T12:28:53.748815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:41.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903557+0000","last_change":"2023-10-14T12:28:46.086064+0000","last_active":"2023-10-14T12:28:51.903557+0000","last_peered":"2023-10-14T12:28:51.903557+0000","last_clean":"2023-10-14T12:28:51.903557+0000","last_became_active":"2023-10-14T12:28:46.083071+0000","last_became_peered":"2023-10-14T12:28:46.083071+0000","last_unstale":"2023-10-14T12:28:51.903557+0000","last_undegraded":"2023-10-14T12:28:51.903557+0000","last_fullsized":"2023-10-14T12:28:51.903557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922469+0000","last_change":"2023-10-14T12:28:46.784072+0000","last_active":"2023-10-14T12:28:51.922469+0000","last_peered":"2023-10-14T12:28:51.922469+0000","last_clean":"2023-10-14T12:28:51.922469+0000","last_became_active":"2023-10-14T12:28:46.783653+0000","last_became_peered":"2023-10-14T12:28:46.783653+0000","last_unstale":"2023-10-14T12:28:51.922469+0000","last_undegraded":"2023-10-14T12:28:51.922469+0000","last_fullsized":"2023-10-14T12:28:51.922469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749295+0000","last_change":"2023-10-14T12:28:51.141444+0000","last_active":"2023-10-14T12:28:53.749295+0000","last_peered":"2023-10-14T12:28:53.749295+0000","last_clean":"2023-10-14T12:28:53.749295+0000","last_became_active":"2023-10-14T12:28:51.140883+0000","last_became_peered":"2023-10-14T12:28:51.140883+0000","last_unstale":"2023-10-14T12:28:53.749295+0000","last_undegraded":"2023-10-14T12:28:53.749295+0000","last_fullsized":"2023-10-14T12:28:53.749295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902128+0000","last_change":"2023-10-14T12:28:46.090824+0000","last_active":"2023-10-14T12:28:51.902128+0000","last_peered":"2023-10-14T12:28:51.902128+0000","last_clean":"2023-10-14T12:28:51.902128+0000","last_became_active":"2023-10-14T12:28:46.090494+0000","last_became_peered":"2023-10-14T12:28:46.090494+0000","last_unstale":"2023-10-14T12:28:51.902128+0000","last_undegraded":"2023-10-14T12:28:51.902128+0000","last_fullsized":"2023-10-14T12:28:51.902128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922922+0000","last_change":"2023-10-14T12:28:46.795518+0000","last_active":"2023-10-14T12:28:51.922922+0000","last_peered":"2023-10-14T12:28:51.922922+0000","last_clean":"2023-10-14T12:28:51.922922+0000","last_became_active":"2023-10-14T12:28:46.794866+0000","last_became_peered":"2023-10-14T12:28:46.794866+0000","last_unstale":"2023-10-14T12:28:51.922922+0000","last_undegraded":"2023-10-14T12:28:51.922922+0000","last_fullsized":"2023-10-14T12:28:51.922922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748983+0000","last_change":"2023-10-14T12:28:51.145294+0000","last_active":"2023-10-14T12:28:53.748983+0000","last_peered":"2023-10-14T12:28:53.748983+0000","last_clean":"2023-10-14T12:28:53.748983+0000","last_became_active":"2023-10-14T12:28:51.144881+0000","last_became_peered":"2023-10-14T12:28:51.144881+0000","last_unstale":"2023-10-14T12:28:53.748983+0000","last_undegraded":"2023-10-14T12:28:53.748983+0000","last_fullsized":"2023-10-14T12:28:53.748983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.171951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763978+0000","last_change":"2023-10-14T12:28:46.787464+0000","last_active":"2023-10-14T12:28:51.763978+0000","last_peered":"2023-10-14T12:28:51.763978+0000","last_clean":"2023-10-14T12:28:51.763978+0000","last_became_active":"2023-10-14T12:28:46.787118+0000","last_became_peered":"2023-10-14T12:28:46.787118+0000","last_unstale":"2023-10-14T12:28:51.763978+0000","last_undegraded":"2023-10-14T12:28:51.763978+0000","last_fullsized":"2023-10-14T12:28:51.763978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901958+0000","last_change":"2023-10-14T12:28:46.080330+0000","last_active":"2023-10-14T12:28:51.901958+0000","last_peered":"2023-10-14T12:28:51.901958+0000","last_clean":"2023-10-14T12:28:51.901958+0000","last_became_active":"2023-10-14T12:28:46.079439+0000","last_became_peered":"2023-10-14T12:28:46.079439+0000","last_unstale":"2023-10-14T12:28:51.901958+0000","last_undegraded":"2023-10-14T12:28:51.901958+0000","last_fullsized":"2023-10-14T12:28:51.901958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:34.159395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.750153+0000","last_change":"2023-10-14T12:28:51.140074+0000","last_active":"2023-10-14T12:28:53.750153+0000","last_peered":"2023-10-14T12:28:53.750153+0000","last_clean":"2023-10-14T12:28:53.750153+0000","last_became_active":"2023-10-14T12:28:51.139545+0000","last_became_peered":"2023-10-14T12:28:51.139545+0000","last_unstale":"2023-10-14T12:28:53.750153+0000","last_undegraded":"2023-10-14T12:28:53.750153+0000","last_fullsized":"2023-10-14T12:28:53.750153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762014+0000","last_change":"2023-10-14T12:28:46.798887+0000","last_active":"2023-10-14T12:28:51.762014+0000","last_peered":"2023-10-14T12:28:51.762014+0000","last_clean":"2023-10-14T12:28:51.762014+0000","last_became_active":"2023-10-14T12:28:46.797610+0000","last_became_peered":"2023-10-14T12:28:46.797610+0000","last_unstale":"2023-10-14T12:28:51.762014+0000","last_undegraded":"2023-10-14T12:28:51.762014+0000","last_fullsized":"2023-10-14T12:28:51.762014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920774+0000","last_change":"2023-10-14T12:28:46.082663+0000","last_active":"2023-10-14T12:28:51.920774+0000","last_peered":"2023-10-14T12:28:51.920774+0000","last_clean":"2023-10-14T12:28:51.920774+0000","last_became_active":"2023-10-14T12:28:46.081809+0000","last_became_peered":"2023-10-14T12:28:46.081809+0000","last_unstale":"2023-10-14T12:28:51.920774+0000","last_undegraded":"2023-10-14T12:28:51.920774+0000","last_fullsized":"2023-10-14T12:28:51.920774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749519+0000","last_change":"2023-10-14T12:28:51.146584+0000","last_active":"2023-10-14T12:28:53.749519+0000","last_peered":"2023-10-14T12:28:53.749519+0000","last_clean":"2023-10-14T12:28:53.749519+0000","last_became_active":"2023-10-14T12:28:51.146146+0000","last_became_peered":"2023-10-14T12:28:51.146146+0000","last_unstale":"2023-10-14T12:28:53.749519+0000","last_undegraded":"2023-10-14T12:28:53.749519+0000","last_fullsized":"2023-10-14T12:28:53.749519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761572+0000","last_change":"2023-10-14T12:28:46.789261+0000","last_active":"2023-10-14T12:28:51.761572+0000","last_peered":"2023-10-14T12:28:51.761572+0000","last_clean":"2023-10-14T12:28:51.761572+0000","last_became_active":"2023-10-14T12:28:46.788031+0000","last_became_peered":"2023-10-14T12:28:46.788031+0000","last_unstale":"2023-10-14T12:28:51.761572+0000","last_undegraded":"2023-10-14T12:28:51.761572+0000","last_fullsized":"2023-10-14T12:28:51.761572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.918090+0000","last_change":"2023-10-14T12:28:46.079896+0000","last_active":"2023-10-14T12:28:51.918090+0000","last_peered":"2023-10-14T12:28:51.918090+0000","last_clean":"2023-10-14T12:28:51.918090+0000","last_became_active":"2023-10-14T12:28:46.079498+0000","last_became_peered":"2023-10-14T12:28:46.079498+0000","last_unstale":"2023-10-14T12:28:51.918090+0000","last_undegraded":"2023-10-14T12:28:51.918090+0000","last_fullsized":"2023-10-14T12:28:51.918090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549998+0000","last_change":"2023-10-14T12:28:51.923834+0000","last_active":"2023-10-14T12:28:54.549998+0000","last_peered":"2023-10-14T12:28:54.549998+0000","last_clean":"2023-10-14T12:28:54.549998+0000","last_became_active":"2023-10-14T12:28:51.916869+0000","last_became_peered":"2023-10-14T12:28:51.916869+0000","last_unstale":"2023-10-14T12:28:54.549998+0000","last_undegraded":"2023-10-14T12:28:54.549998+0000","last_fullsized":"2023-10-14T12:28:54.549998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765552+0000","last_change":"2023-10-14T12:28:46.786929+0000","last_active":"2023-10-14T12:28:51.765552+0000","last_peered":"2023-10-14T12:28:51.765552+0000","last_clean":"2023-10-14T12:28:51.765552+0000","last_became_active":"2023-10-14T12:28:46.785285+0000","last_became_peered":"2023-10-14T12:28:46.785285+0000","last_unstale":"2023-10-14T12:28:51.765552+0000","last_undegraded":"2023-10-14T12:28:51.765552+0000","last_fullsized":"2023-10-14T12:28:51.765552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:14.608032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901022+0000","last_change":"2023-10-14T12:28:46.085793+0000","last_active":"2023-10-14T12:28:51.901022+0000","last_peered":"2023-10-14T12:28:51.901022+0000","last_clean":"2023-10-14T12:28:51.901022+0000","last_became_active":"2023-10-14T12:28:46.085539+0000","last_became_peered":"2023-10-14T12:28:46.085539+0000","last_unstale":"2023-10-14T12:28:51.901022+0000","last_undegraded":"2023-10-14T12:28:51.901022+0000","last_fullsized":"2023-10-14T12:28:51.901022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749922+0000","last_change":"2023-10-14T12:28:51.142284+0000","last_active":"2023-10-14T12:28:53.749922+0000","last_peered":"2023-10-14T12:28:53.749922+0000","last_clean":"2023-10-14T12:28:53.749922+0000","last_became_active":"2023-10-14T12:28:51.141786+0000","last_became_peered":"2023-10-14T12:28:51.141786+0000","last_unstale":"2023-10-14T12:28:53.749922+0000","last_undegraded":"2023-10-14T12:28:53.749922+0000","last_fullsized":"2023-10-14T12:28:53.749922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908548+0000","last_change":"2023-10-14T12:28:46.784288+0000","last_active":"2023-10-14T12:28:51.908548+0000","last_peered":"2023-10-14T12:28:51.908548+0000","last_clean":"2023-10-14T12:28:51.908548+0000","last_became_active":"2023-10-14T12:28:46.783048+0000","last_became_peered":"2023-10-14T12:28:46.783048+0000","last_unstale":"2023-10-14T12:28:51.908548+0000","last_undegraded":"2023-10-14T12:28:51.908548+0000","last_fullsized":"2023-10-14T12:28:51.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:10.556463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766748+0000","last_change":"2023-10-14T12:28:46.077038+0000","last_active":"2023-10-14T12:28:51.766748+0000","last_peered":"2023-10-14T12:28:51.766748+0000","last_clean":"2023-10-14T12:28:51.766748+0000","last_became_active":"2023-10-14T12:28:46.075513+0000","last_became_peered":"2023-10-14T12:28:46.075513+0000","last_unstale":"2023-10-14T12:28:51.766748+0000","last_undegraded":"2023-10-14T12:28:51.766748+0000","last_fullsized":"2023-10-14T12:28:51.766748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748977+0000","last_change":"2023-10-14T12:28:51.911158+0000","last_active":"2023-10-14T12:28:53.748977+0000","last_peered":"2023-10-14T12:28:53.748977+0000","last_clean":"2023-10-14T12:28:53.748977+0000","last_became_active":"2023-10-14T12:28:51.910002+0000","last_became_peered":"2023-10-14T12:28:51.910002+0000","last_unstale":"2023-10-14T12:28:53.748977+0000","last_undegraded":"2023-10-14T12:28:53.748977+0000","last_fullsized":"2023-10-14T12:28:53.748977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:00.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763687+0000","last_change":"2023-10-14T12:28:46.796917+0000","last_active":"2023-10-14T12:28:51.763687+0000","last_peered":"2023-10-14T12:28:51.763687+0000","last_clean":"2023-10-14T12:28:51.763687+0000","last_became_active":"2023-10-14T12:28:46.796090+0000","last_became_peered":"2023-10-14T12:28:46.796090+0000","last_unstale":"2023-10-14T12:28:51.763687+0000","last_undegraded":"2023-10-14T12:28:51.763687+0000","last_fullsized":"2023-10-14T12:28:51.763687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:29:04.249281+0000","last_change":"2023-10-14T12:28:46.072468+0000","last_active":"2023-10-14T12:29:04.249281+0000","last_peered":"2023-10-14T12:29:04.249281+0000","last_clean":"2023-10-14T12:29:04.249281+0000","last_became_active":"2023-10-14T12:28:46.071827+0000","last_became_peered":"2023-10-14T12:28:46.071827+0000","last_unstale":"2023-10-14T12:29:04.249281+0000","last_undegraded":"2023-10-14T12:29:04.249281+0000","last_fullsized":"2023-10-14T12:29:04.249281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765187+0000","last_change":"2023-10-14T12:28:51.903366+0000","last_active":"2023-10-14T12:28:52.765187+0000","last_peered":"2023-10-14T12:28:52.765187+0000","last_clean":"2023-10-14T12:28:52.765187+0000","last_became_active":"2023-10-14T12:28:51.902191+0000","last_became_peered":"2023-10-14T12:28:51.902191+0000","last_unstale":"2023-10-14T12:28:52.765187+0000","last_undegraded":"2023-10-14T12:28:52.765187+0000","last_fullsized":"2023-10-14T12:28:52.765187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920090+0000","last_change":"2023-10-14T12:28:46.786490+0000","last_active":"2023-10-14T12:28:51.920090+0000","last_peered":"2023-10-14T12:28:51.920090+0000","last_clean":"2023-10-14T12:28:51.920090+0000","last_became_active":"2023-10-14T12:28:46.785976+0000","last_became_peered":"2023-10-14T12:28:46.785976+0000","last_unstale":"2023-10-14T12:28:51.920090+0000","last_undegraded":"2023-10-14T12:28:51.920090+0000","last_fullsized":"2023-10-14T12:28:51.920090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905284+0000","last_change":"2023-10-14T12:28:46.087365+0000","last_active":"2023-10-14T12:28:51.905284+0000","last_peered":"2023-10-14T12:28:51.905284+0000","last_clean":"2023-10-14T12:28:51.905284+0000","last_became_active":"2023-10-14T12:28:46.087090+0000","last_became_peered":"2023-10-14T12:28:46.087090+0000","last_unstale":"2023-10-14T12:28:51.905284+0000","last_undegraded":"2023-10-14T12:28:51.905284+0000","last_fullsized":"2023-10-14T12:28:51.905284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409835+0000","last_change":"2023-10-14T12:28:51.909277+0000","last_active":"2023-10-14T12:28:54.409835+0000","last_peered":"2023-10-14T12:28:54.409835+0000","last_clean":"2023-10-14T12:28:54.409835+0000","last_became_active":"2023-10-14T12:28:51.907121+0000","last_became_peered":"2023-10-14T12:28:51.907121+0000","last_unstale":"2023-10-14T12:28:54.409835+0000","last_undegraded":"2023-10-14T12:28:54.409835+0000","last_fullsized":"2023-10-14T12:28:54.409835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:31.934707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923040+0000","last_change":"2023-10-14T12:28:46.805297+0000","last_active":"2023-10-14T12:28:51.923040+0000","last_peered":"2023-10-14T12:28:51.923040+0000","last_clean":"2023-10-14T12:28:51.923040+0000","last_became_active":"2023-10-14T12:28:46.805000+0000","last_became_peered":"2023-10-14T12:28:46.805000+0000","last_unstale":"2023-10-14T12:28:51.923040+0000","last_undegraded":"2023-10-14T12:28:51.923040+0000","last_fullsized":"2023-10-14T12:28:51.923040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920314+0000","last_change":"2023-10-14T12:28:46.078052+0000","last_active":"2023-10-14T12:28:51.920314+0000","last_peered":"2023-10-14T12:28:51.920314+0000","last_clean":"2023-10-14T12:28:51.920314+0000","last_became_active":"2023-10-14T12:28:46.077730+0000","last_became_peered":"2023-10-14T12:28:46.077730+0000","last_unstale":"2023-10-14T12:28:51.920314+0000","last_undegraded":"2023-10-14T12:28:51.920314+0000","last_fullsized":"2023-10-14T12:28:51.920314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549170+0000","last_change":"2023-10-14T12:28:51.141425+0000","last_active":"2023-10-14T12:28:54.549170+0000","last_peered":"2023-10-14T12:28:54.549170+0000","last_clean":"2023-10-14T12:28:54.549170+0000","last_became_active":"2023-10-14T12:28:51.140998+0000","last_became_peered":"2023-10-14T12:28:51.140998+0000","last_unstale":"2023-10-14T12:28:54.549170+0000","last_undegraded":"2023-10-14T12:28:54.549170+0000","last_fullsized":"2023-10-14T12:28:54.549170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766791+0000","last_change":"2023-10-14T12:28:46.791914+0000","last_active":"2023-10-14T12:28:51.766791+0000","last_peered":"2023-10-14T12:28:51.766791+0000","last_clean":"2023-10-14T12:28:51.766791+0000","last_became_active":"2023-10-14T12:28:46.790081+0000","last_became_peered":"2023-10-14T12:28:46.790081+0000","last_unstale":"2023-10-14T12:28:51.766791+0000","last_undegraded":"2023-10-14T12:28:51.766791+0000","last_fullsized":"2023-10-14T12:28:51.766791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:51.665543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919424+0000","last_change":"2023-10-14T12:28:46.087850+0000","last_active":"2023-10-14T12:28:51.919424+0000","last_peered":"2023-10-14T12:28:51.919424+0000","last_clean":"2023-10-14T12:28:51.919424+0000","last_became_active":"2023-10-14T12:28:46.087568+0000","last_became_peered":"2023-10-14T12:28:46.087568+0000","last_unstale":"2023-10-14T12:28:51.919424+0000","last_undegraded":"2023-10-14T12:28:51.919424+0000","last_fullsized":"2023-10-14T12:28:51.919424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:00.886203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549701+0000","last_change":"2023-10-14T12:28:51.140452+0000","last_active":"2023-10-14T12:28:54.549701+0000","last_peered":"2023-10-14T12:28:54.549701+0000","last_clean":"2023-10-14T12:28:54.549701+0000","last_became_active":"2023-10-14T12:28:51.140047+0000","last_became_peered":"2023-10-14T12:28:51.140047+0000","last_unstale":"2023-10-14T12:28:54.549701+0000","last_undegraded":"2023-10-14T12:28:54.549701+0000","last_fullsized":"2023-10-14T12:28:54.549701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.915866+0000","last_change":"2023-10-14T12:28:46.785632+0000","last_active":"2023-10-14T12:28:51.915866+0000","last_peered":"2023-10-14T12:28:51.915866+0000","last_clean":"2023-10-14T12:28:51.915866+0000","last_became_active":"2023-10-14T12:28:46.785306+0000","last_became_peered":"2023-10-14T12:28:46.785306+0000","last_unstale":"2023-10-14T12:28:51.915866+0000","last_undegraded":"2023-10-14T12:28:51.915866+0000","last_fullsized":"2023-10-14T12:28:51.915866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140904+0000","last_change":"2023-10-14T12:28:46.079395+0000","last_active":"2023-10-14T12:28:52.140904+0000","last_peered":"2023-10-14T12:28:52.140904+0000","last_clean":"2023-10-14T12:28:52.140904+0000","last_became_active":"2023-10-14T12:28:46.079066+0000","last_became_peered":"2023-10-14T12:28:46.079066+0000","last_unstale":"2023-10-14T12:28:52.140904+0000","last_undegraded":"2023-10-14T12:28:52.140904+0000","last_fullsized":"2023-10-14T12:28:52.140904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:14.299609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.550104+0000","last_change":"2023-10-14T12:28:51.146682+0000","last_active":"2023-10-14T12:28:54.550104+0000","last_peered":"2023-10-14T12:28:54.550104+0000","last_clean":"2023-10-14T12:28:54.550104+0000","last_became_active":"2023-10-14T12:28:51.146103+0000","last_became_peered":"2023-10-14T12:28:51.146103+0000","last_unstale":"2023-10-14T12:28:54.550104+0000","last_undegraded":"2023-10-14T12:28:54.550104+0000","last_fullsized":"2023-10-14T12:28:54.550104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906672+0000","last_change":"2023-10-14T12:28:46.787997+0000","last_active":"2023-10-14T12:28:51.906672+0000","last_peered":"2023-10-14T12:28:51.906672+0000","last_clean":"2023-10-14T12:28:51.906672+0000","last_became_active":"2023-10-14T12:28:46.787646+0000","last_became_peered":"2023-10-14T12:28:46.787646+0000","last_unstale":"2023-10-14T12:28:51.906672+0000","last_undegraded":"2023-10-14T12:28:51.906672+0000","last_fullsized":"2023-10-14T12:28:51.906672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:23.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901433+0000","last_change":"2023-10-14T12:28:46.088704+0000","last_active":"2023-10-14T12:28:51.901433+0000","last_peered":"2023-10-14T12:28:51.901433+0000","last_clean":"2023-10-14T12:28:51.901433+0000","last_became_active":"2023-10-14T12:28:46.088429+0000","last_became_peered":"2023-10-14T12:28:46.088429+0000","last_unstale":"2023-10-14T12:28:51.901433+0000","last_undegraded":"2023-10-14T12:28:51.901433+0000","last_fullsized":"2023-10-14T12:28:51.901433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:08.064671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.411094+0000","last_change":"2023-10-14T12:28:51.920214+0000","last_active":"2023-10-14T12:28:54.411094+0000","last_peered":"2023-10-14T12:28:54.411094+0000","last_clean":"2023-10-14T12:28:54.411094+0000","last_became_active":"2023-10-14T12:28:51.918279+0000","last_became_peered":"2023-10-14T12:28:51.918279+0000","last_unstale":"2023-10-14T12:28:54.411094+0000","last_undegraded":"2023-10-14T12:28:54.411094+0000","last_fullsized":"2023-10-14T12:28:54.411094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:32.336264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762038+0000","last_change":"2023-10-14T12:28:46.793764+0000","last_active":"2023-10-14T12:28:51.762038+0000","last_peered":"2023-10-14T12:28:51.762038+0000","last_clean":"2023-10-14T12:28:51.762038+0000","last_became_active":"2023-10-14T12:28:46.793460+0000","last_became_peered":"2023-10-14T12:28:46.793460+0000","last_unstale":"2023-10-14T12:28:51.762038+0000","last_undegraded":"2023-10-14T12:28:51.762038+0000","last_fullsized":"2023-10-14T12:28:51.762038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922056+0000","last_change":"2023-10-14T12:28:46.082037+0000","last_active":"2023-10-14T12:28:51.922056+0000","last_peered":"2023-10-14T12:28:51.922056+0000","last_clean":"2023-10-14T12:28:51.922056+0000","last_became_active":"2023-10-14T12:28:46.081174+0000","last_became_peered":"2023-10-14T12:28:46.081174+0000","last_unstale":"2023-10-14T12:28:51.922056+0000","last_undegraded":"2023-10-14T12:28:51.922056+0000","last_fullsized":"2023-10-14T12:28:51.922056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901828+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:28:51.901828+0000","last_peered":"2023-10-14T12:28:51.901828+0000","last_clean":"2023-10-14T12:28:51.901828+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:28:51.901828+0000","last_undegraded":"2023-10-14T12:28:51.901828+0000","last_fullsized":"2023-10-14T12:28:51.901828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.768326+0000","last_change":"2023-10-14T12:28:51.910300+0000","last_active":"2023-10-14T12:28:52.768326+0000","last_peered":"2023-10-14T12:28:52.768326+0000","last_clean":"2023-10-14T12:28:52.768326+0000","last_became_active":"2023-10-14T12:28:51.909121+0000","last_became_peered":"2023-10-14T12:28:51.909121+0000","last_unstale":"2023-10-14T12:28:52.768326+0000","last_undegraded":"2023-10-14T12:28:52.768326+0000","last_fullsized":"2023-10-14T12:28:52.768326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:43.101212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902148+0000","last_change":"2023-10-14T12:28:46.801572+0000","last_active":"2023-10-14T12:28:51.902148+0000","last_peered":"2023-10-14T12:28:51.902148+0000","last_clean":"2023-10-14T12:28:51.902148+0000","last_became_active":"2023-10-14T12:28:46.801273+0000","last_became_peered":"2023-10-14T12:28:46.801273+0000","last_unstale":"2023-10-14T12:28:51.902148+0000","last_undegraded":"2023-10-14T12:28:51.902148+0000","last_fullsized":"2023-10-14T12:28:51.902148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.142466+0000","last_change":"2023-10-14T12:28:46.089021+0000","last_active":"2023-10-14T12:28:52.142466+0000","last_peered":"2023-10-14T12:28:52.142466+0000","last_clean":"2023-10-14T12:28:52.142466+0000","last_became_active":"2023-10-14T12:28:46.088640+0000","last_became_peered":"2023-10-14T12:28:46.088640+0000","last_unstale":"2023-10-14T12:28:52.142466+0000","last_undegraded":"2023-10-14T12:28:52.142466+0000","last_fullsized":"2023-10-14T12:28:52.142466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:07:19.614243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766407+0000","last_change":"2023-10-14T12:28:51.909391+0000","last_active":"2023-10-14T12:28:52.766407+0000","last_peered":"2023-10-14T12:28:52.766407+0000","last_clean":"2023-10-14T12:28:52.766407+0000","last_became_active":"2023-10-14T12:28:51.908099+0000","last_became_peered":"2023-10-14T12:28:51.908099+0000","last_unstale":"2023-10-14T12:28:52.766407+0000","last_undegraded":"2023-10-14T12:28:52.766407+0000","last_fullsized":"2023-10-14T12:28:52.766407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:28.364649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922641+0000","last_change":"2023-10-14T12:28:46.800329+0000","last_active":"2023-10-14T12:28:51.922641+0000","last_peered":"2023-10-14T12:28:51.922641+0000","last_clean":"2023-10-14T12:28:51.922641+0000","last_became_active":"2023-10-14T12:28:46.800007+0000","last_became_peered":"2023-10-14T12:28:46.800007+0000","last_unstale":"2023-10-14T12:28:51.922641+0000","last_undegraded":"2023-10-14T12:28:51.922641+0000","last_fullsized":"2023-10-14T12:28:51.922641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921828+0000","last_change":"2023-10-14T12:28:46.078949+0000","last_active":"2023-10-14T12:28:51.921828+0000","last_peered":"2023-10-14T12:28:51.921828+0000","last_clean":"2023-10-14T12:28:51.921828+0000","last_became_active":"2023-10-14T12:28:46.078670+0000","last_became_peered":"2023-10-14T12:28:46.078670+0000","last_unstale":"2023-10-14T12:28:51.921828+0000","last_undegraded":"2023-10-14T12:28:51.921828+0000","last_fullsized":"2023-10-14T12:28:51.921828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409867+0000","last_change":"2023-10-14T12:28:51.150655+0000","last_active":"2023-10-14T12:28:54.409867+0000","last_peered":"2023-10-14T12:28:54.409867+0000","last_clean":"2023-10-14T12:28:54.409867+0000","last_became_active":"2023-10-14T12:28:51.150108+0000","last_became_peered":"2023-10-14T12:28:51.150108+0000","last_unstale":"2023-10-14T12:28:54.409867+0000","last_undegraded":"2023-10-14T12:28:54.409867+0000","last_fullsized":"2023-10-14T12:28:54.409867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:26.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905515+0000","last_change":"2023-10-14T12:28:46.799576+0000","last_active":"2023-10-14T12:28:51.905515+0000","last_peered":"2023-10-14T12:28:51.905515+0000","last_clean":"2023-10-14T12:28:51.905515+0000","last_became_active":"2023-10-14T12:28:46.798883+0000","last_became_peered":"2023-10-14T12:28:46.798883+0000","last_unstale":"2023-10-14T12:28:51.905515+0000","last_undegraded":"2023-10-14T12:28:51.905515+0000","last_fullsized":"2023-10-14T12:28:51.905515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:44.311419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141623+0000","last_change":"2023-10-14T12:28:46.082303+0000","last_active":"2023-10-14T12:28:52.141623+0000","last_peered":"2023-10-14T12:28:52.141623+0000","last_clean":"2023-10-14T12:28:52.141623+0000","last_became_active":"2023-10-14T12:28:46.081916+0000","last_became_peered":"2023-10-14T12:28:46.081916+0000","last_unstale":"2023-10-14T12:28:52.141623+0000","last_undegraded":"2023-10-14T12:28:52.141623+0000","last_fullsized":"2023-10-14T12:28:52.141623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:58.702563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765960+0000","last_change":"2023-10-14T12:28:51.922025+0000","last_active":"2023-10-14T12:28:52.765960+0000","last_peered":"2023-10-14T12:28:52.765960+0000","last_clean":"2023-10-14T12:28:52.765960+0000","last_became_active":"2023-10-14T12:28:51.918049+0000","last_became_peered":"2023-10-14T12:28:51.918049+0000","last_unstale":"2023-10-14T12:28:52.765960+0000","last_undegraded":"2023-10-14T12:28:52.765960+0000","last_fullsized":"2023-10-14T12:28:52.765960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905811+0000","last_change":"2023-10-14T12:28:46.795831+0000","last_active":"2023-10-14T12:28:51.905811+0000","last_peered":"2023-10-14T12:28:51.905811+0000","last_clean":"2023-10-14T12:28:51.905811+0000","last_became_active":"2023-10-14T12:28:46.795571+0000","last_became_peered":"2023-10-14T12:28:46.795571+0000","last_unstale":"2023-10-14T12:28:51.905811+0000","last_undegraded":"2023-10-14T12:28:51.905811+0000","last_fullsized":"2023-10-14T12:28:51.905811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:29.280284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766935+0000","last_change":"2023-10-14T12:28:46.084244+0000","last_active":"2023-10-14T12:28:51.766935+0000","last_peered":"2023-10-14T12:28:51.766935+0000","last_clean":"2023-10-14T12:28:51.766935+0000","last_became_active":"2023-10-14T12:28:46.083772+0000","last_became_peered":"2023-10-14T12:28:46.083772+0000","last_unstale":"2023-10-14T12:28:51.766935+0000","last_undegraded":"2023-10-14T12:28:51.766935+0000","last_fullsized":"2023-10-14T12:28:51.766935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748760+0000","last_change":"2023-10-14T12:28:51.141542+0000","last_active":"2023-10-14T12:28:53.748760+0000","last_peered":"2023-10-14T12:28:53.748760+0000","last_clean":"2023-10-14T12:28:53.748760+0000","last_became_active":"2023-10-14T12:28:51.141066+0000","last_became_peered":"2023-10-14T12:28:51.141066+0000","last_unstale":"2023-10-14T12:28:53.748760+0000","last_undegraded":"2023-10-14T12:28:53.748760+0000","last_fullsized":"2023-10-14T12:28:53.748760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902142+0000","last_change":"2023-10-14T12:28:46.799195+0000","last_active":"2023-10-14T12:28:51.902142+0000","last_peered":"2023-10-14T12:28:51.902142+0000","last_clean":"2023-10-14T12:28:51.902142+0000","last_became_active":"2023-10-14T12:28:46.798850+0000","last_became_peered":"2023-10-14T12:28:46.798850+0000","last_unstale":"2023-10-14T12:28:51.902142+0000","last_undegraded":"2023-10-14T12:28:51.902142+0000","last_fullsized":"2023-10-14T12:28:51.902142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140517+0000","last_change":"2023-10-14T12:28:46.074743+0000","last_active":"2023-10-14T12:28:52.140517+0000","last_peered":"2023-10-14T12:28:52.140517+0000","last_clean":"2023-10-14T12:28:52.140517+0000","last_became_active":"2023-10-14T12:28:46.074430+0000","last_became_peered":"2023-10-14T12:28:46.074430+0000","last_unstale":"2023-10-14T12:28:52.140517+0000","last_undegraded":"2023-10-14T12:28:52.140517+0000","last_fullsized":"2023-10-14T12:28:52.140517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:44.943766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410859+0000","last_change":"2023-10-14T12:28:51.147740+0000","last_active":"2023-10-14T12:28:54.410859+0000","last_peered":"2023-10-14T12:28:54.410859+0000","last_clean":"2023-10-14T12:28:54.410859+0000","last_became_active":"2023-10-14T12:28:51.147168+0000","last_became_peered":"2023-10-14T12:28:51.147168+0000","last_unstale":"2023-10-14T12:28:54.410859+0000","last_undegraded":"2023-10-14T12:28:54.410859+0000","last_fullsized":"2023-10-14T12:28:54.410859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:27.739547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763688+0000","last_change":"2023-10-14T12:28:46.796316+0000","last_active":"2023-10-14T12:28:51.763688+0000","last_peered":"2023-10-14T12:28:51.763688+0000","last_clean":"2023-10-14T12:28:51.763688+0000","last_became_active":"2023-10-14T12:28:46.795991+0000","last_became_peered":"2023-10-14T12:28:46.795991+0000","last_unstale":"2023-10-14T12:28:51.763688+0000","last_undegraded":"2023-10-14T12:28:51.763688+0000","last_fullsized":"2023-10-14T12:28:51.763688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763934+0000","last_change":"2023-10-14T12:28:46.078905+0000","last_active":"2023-10-14T12:28:51.763934+0000","last_peered":"2023-10-14T12:28:51.763934+0000","last_clean":"2023-10-14T12:28:51.763934+0000","last_became_active":"2023-10-14T12:28:46.078601+0000","last_became_peered":"2023-10-14T12:28:46.078601+0000","last_unstale":"2023-10-14T12:28:51.763934+0000","last_undegraded":"2023-10-14T12:28:51.763934+0000","last_fullsized":"2023-10-14T12:28:51.763934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767902+0000","last_change":"2023-10-14T12:28:51.912591+0000","last_active":"2023-10-14T12:28:52.767902+0000","last_peered":"2023-10-14T12:28:52.767902+0000","last_clean":"2023-10-14T12:28:52.767902+0000","last_became_active":"2023-10-14T12:28:51.911444+0000","last_became_peered":"2023-10-14T12:28:51.911444+0000","last_unstale":"2023-10-14T12:28:52.767902+0000","last_undegraded":"2023-10-14T12:28:52.767902+0000","last_fullsized":"2023-10-14T12:28:52.767902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:01.865763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901725+0000","last_change":"2023-10-14T12:28:46.794280+0000","last_active":"2023-10-14T12:28:51.901725+0000","last_peered":"2023-10-14T12:28:51.901725+0000","last_clean":"2023-10-14T12:28:51.901725+0000","last_became_active":"2023-10-14T12:28:46.794011+0000","last_became_peered":"2023-10-14T12:28:46.794011+0000","last_unstale":"2023-10-14T12:28:51.901725+0000","last_undegraded":"2023-10-14T12:28:51.901725+0000","last_fullsized":"2023-10-14T12:28:51.901725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921941+0000","last_change":"2023-10-14T12:28:46.087268+0000","last_active":"2023-10-14T12:28:51.921941+0000","last_peered":"2023-10-14T12:28:51.921941+0000","last_clean":"2023-10-14T12:28:51.921941+0000","last_became_active":"2023-10-14T12:28:46.086933+0000","last_became_peered":"2023-10-14T12:28:46.086933+0000","last_unstale":"2023-10-14T12:28:51.921941+0000","last_undegraded":"2023-10-14T12:28:51.921941+0000","last_fullsized":"2023-10-14T12:28:51.921941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:49.643084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766946+0000","last_change":"2023-10-14T12:28:51.914988+0000","last_active":"2023-10-14T12:28:52.766946+0000","last_peered":"2023-10-14T12:28:52.766946+0000","last_clean":"2023-10-14T12:28:52.766946+0000","last_became_active":"2023-10-14T12:28:51.913882+0000","last_became_peered":"2023-10-14T12:28:51.913882+0000","last_unstale":"2023-10-14T12:28:52.766946+0000","last_undegraded":"2023-10-14T12:28:52.766946+0000","last_fullsized":"2023-10-14T12:28:52.766946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:08:30.117146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908486+0000","last_change":"2023-10-14T12:28:46.788853+0000","last_active":"2023-10-14T12:28:51.908486+0000","last_peered":"2023-10-14T12:28:51.908486+0000","last_clean":"2023-10-14T12:28:51.908486+0000","last_became_active":"2023-10-14T12:28:46.788458+0000","last_became_peered":"2023-10-14T12:28:46.788458+0000","last_unstale":"2023-10-14T12:28:51.908486+0000","last_undegraded":"2023-10-14T12:28:51.908486+0000","last_fullsized":"2023-10-14T12:28:51.908486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:34:10.344432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908891+0000","last_change":"2023-10-14T12:28:46.076853+0000","last_active":"2023-10-14T12:28:51.908891+0000","last_peered":"2023-10-14T12:28:51.908891+0000","last_clean":"2023-10-14T12:28:51.908891+0000","last_became_active":"2023-10-14T12:28:46.076541+0000","last_became_peered":"2023-10-14T12:28:46.076541+0000","last_unstale":"2023-10-14T12:28:51.908891+0000","last_undegraded":"2023-10-14T12:28:51.908891+0000","last_fullsized":"2023-10-14T12:28:51.908891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:17.061278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769108+0000","last_change":"2023-10-14T12:28:51.920296+0000","last_active":"2023-10-14T12:28:52.769108+0000","last_peered":"2023-10-14T12:28:52.769108+0000","last_clean":"2023-10-14T12:28:52.769108+0000","last_became_active":"2023-10-14T12:28:51.917580+0000","last_became_peered":"2023-10-14T12:28:51.917580+0000","last_unstale":"2023-10-14T12:28:52.769108+0000","last_undegraded":"2023-10-14T12:28:52.769108+0000","last_fullsized":"2023-10-14T12:28:52.769108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903467+0000","last_change":"2023-10-14T12:28:46.801997+0000","last_active":"2023-10-14T12:28:51.903467+0000","last_peered":"2023-10-14T12:28:51.903467+0000","last_clean":"2023-10-14T12:28:51.903467+0000","last_became_active":"2023-10-14T12:28:46.801720+0000","last_became_peered":"2023-10-14T12:28:46.801720+0000","last_unstale":"2023-10-14T12:28:51.903467+0000","last_undegraded":"2023-10-14T12:28:51.903467+0000","last_fullsized":"2023-10-14T12:28:51.903467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'11","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:29:05.089296+0000","last_change":"2023-10-14T12:28:46.076997+0000","last_active":"2023-10-14T12:29:05.089296+0000","last_peered":"2023-10-14T12:29:05.089296+0000","last_clean":"2023-10-14T12:29:05.089296+0000","last_became_active":"2023-10-14T12:28:46.076345+0000","last_became_peered":"2023-10-14T12:28:46.076345+0000","last_unstale":"2023-10-14T12:29:05.089296+0000","last_undegraded":"2023-10-14T12:29:05.089296+0000","last_fullsized":"2023-10-14T12:29:05.089296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549272+0000","last_change":"2023-10-14T12:28:51.138516+0000","last_active":"2023-10-14T12:28:54.549272+0000","last_peered":"2023-10-14T12:28:54.549272+0000","last_clean":"2023-10-14T12:28:54.549272+0000","last_became_active":"2023-10-14T12:28:51.137516+0000","last_became_peered":"2023-10-14T12:28:51.137516+0000","last_unstale":"2023-10-14T12:28:54.549272+0000","last_undegraded":"2023-10-14T12:28:54.549272+0000","last_fullsized":"2023-10-14T12:28:54.549272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767066+0000","last_change":"2023-10-14T12:28:46.792271+0000","last_active":"2023-10-14T12:28:51.767066+0000","last_peered":"2023-10-14T12:28:51.767066+0000","last_clean":"2023-10-14T12:28:51.767066+0000","last_became_active":"2023-10-14T12:28:46.789471+0000","last_became_peered":"2023-10-14T12:28:46.789471+0000","last_unstale":"2023-10-14T12:28:51.767066+0000","last_undegraded":"2023-10-14T12:28:51.767066+0000","last_fullsized":"2023-10-14T12:28:51.767066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:36.235202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921217+0000","last_change":"2023-10-14T12:28:46.088735+0000","last_active":"2023-10-14T12:28:51.921217+0000","last_peered":"2023-10-14T12:28:51.921217+0000","last_clean":"2023-10-14T12:28:51.921217+0000","last_became_active":"2023-10-14T12:28:46.088457+0000","last_became_peered":"2023-10-14T12:28:46.088457+0000","last_unstale":"2023-10-14T12:28:51.921217+0000","last_undegraded":"2023-10-14T12:28:51.921217+0000","last_fullsized":"2023-10-14T12:28:51.921217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749567+0000","last_change":"2023-10-14T12:28:51.139023+0000","last_active":"2023-10-14T12:28:53.749567+0000","last_peered":"2023-10-14T12:28:53.749567+0000","last_clean":"2023-10-14T12:28:53.749567+0000","last_became_active":"2023-10-14T12:28:51.138588+0000","last_became_peered":"2023-10-14T12:28:51.138588+0000","last_unstale":"2023-10-14T12:28:53.749567+0000","last_undegraded":"2023-10-14T12:28:53.749567+0000","last_fullsized":"2023-10-14T12:28:53.749567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.909074+0000","last_change":"2023-10-14T12:28:46.795155+0000","last_active":"2023-10-14T12:28:51.909074+0000","last_peered":"2023-10-14T12:28:51.909074+0000","last_clean":"2023-10-14T12:28:51.909074+0000","last_became_active":"2023-10-14T12:28:46.794637+0000","last_became_peered":"2023-10-14T12:28:46.794637+0000","last_unstale":"2023-10-14T12:28:51.909074+0000","last_undegraded":"2023-10-14T12:28:51.909074+0000","last_fullsized":"2023-10-14T12:28:51.909074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:28.917771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.086906+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.078677+0000","last_became_peered":"2023-10-14T12:28:46.078677+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765685+0000","last_change":"2023-10-14T12:28:51.150961+0000","last_active":"2023-10-14T12:28:52.765685+0000","last_peered":"2023-10-14T12:28:52.765685+0000","last_clean":"2023-10-14T12:28:52.765685+0000","last_became_active":"2023-10-14T12:28:51.147298+0000","last_became_peered":"2023-10-14T12:28:51.147298+0000","last_unstale":"2023-10-14T12:28:52.765685+0000","last_undegraded":"2023-10-14T12:28:52.765685+0000","last_fullsized":"2023-10-14T12:28:52.765685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:44.659889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922854+0000","last_change":"2023-10-14T12:28:46.791198+0000","last_active":"2023-10-14T12:28:51.922854+0000","last_peered":"2023-10-14T12:28:51.922854+0000","last_clean":"2023-10-14T12:28:51.922854+0000","last_became_active":"2023-10-14T12:28:46.790867+0000","last_became_peered":"2023-10-14T12:28:46.790867+0000","last_unstale":"2023-10-14T12:28:51.922854+0000","last_undegraded":"2023-10-14T12:28:51.922854+0000","last_fullsized":"2023-10-14T12:28:51.922854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766297+0000","last_change":"2023-10-14T12:28:46.082839+0000","last_active":"2023-10-14T12:28:51.766297+0000","last_peered":"2023-10-14T12:28:51.766297+0000","last_clean":"2023-10-14T12:28:51.766297+0000","last_became_active":"2023-10-14T12:28:46.082602+0000","last_became_peered":"2023-10-14T12:28:46.082602+0000","last_unstale":"2023-10-14T12:28:51.766297+0000","last_undegraded":"2023-10-14T12:28:51.766297+0000","last_fullsized":"2023-10-14T12:28:51.766297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:50.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765534+0000","last_change":"2023-10-14T12:28:51.907147+0000","last_active":"2023-10-14T12:28:52.765534+0000","last_peered":"2023-10-14T12:28:52.765534+0000","last_clean":"2023-10-14T12:28:52.765534+0000","last_became_active":"2023-10-14T12:28:51.905096+0000","last_became_peered":"2023-10-14T12:28:51.905096+0000","last_unstale":"2023-10-14T12:28:52.765534+0000","last_undegraded":"2023-10-14T12:28:52.765534+0000","last_fullsized":"2023-10-14T12:28:52.765534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410456+0000","last_change":"2023-10-14T12:28:51.924721+0000","last_active":"2023-10-14T12:28:54.410456+0000","last_peered":"2023-10-14T12:28:54.410456+0000","last_clean":"2023-10-14T12:28:54.410456+0000","last_became_active":"2023-10-14T12:28:51.922270+0000","last_became_peered":"2023-10-14T12:28:51.922270+0000","last_unstale":"2023-10-14T12:28:54.410456+0000","last_undegraded":"2023-10-14T12:28:54.410456+0000","last_fullsized":"2023-10-14T12:28:54.410456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:45.274534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.916174+0000","last_change":"2023-10-14T12:28:46.787783+0000","last_active":"2023-10-14T12:28:51.916174+0000","last_peered":"2023-10-14T12:28:51.916174+0000","last_clean":"2023-10-14T12:28:51.916174+0000","last_became_active":"2023-10-14T12:28:46.787485+0000","last_became_peered":"2023-10-14T12:28:46.787485+0000","last_unstale":"2023-10-14T12:28:51.916174+0000","last_undegraded":"2023-10-14T12:28:51.916174+0000","last_fullsized":"2023-10-14T12:28:51.916174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919246+0000","last_change":"2023-10-14T12:28:46.081339+0000","last_active":"2023-10-14T12:28:51.919246+0000","last_peered":"2023-10-14T12:28:51.919246+0000","last_clean":"2023-10-14T12:28:51.919246+0000","last_became_active":"2023-10-14T12:28:46.080996+0000","last_became_peered":"2023-10-14T12:28:46.080996+0000","last_unstale":"2023-10-14T12:28:51.919246+0000","last_undegraded":"2023-10-14T12:28:51.919246+0000","last_fullsized":"2023-10-14T12:28:51.919246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:02.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769101+0000","last_change":"2023-10-14T12:28:51.140428+0000","last_active":"2023-10-14T12:28:52.769101+0000","last_peered":"2023-10-14T12:28:52.769101+0000","last_clean":"2023-10-14T12:28:52.769101+0000","last_became_active":"2023-10-14T12:28:51.139878+0000","last_became_peered":"2023-10-14T12:28:51.139878+0000","last_unstale":"2023-10-14T12:28:52.769101+0000","last_undegraded":"2023-10-14T12:28:52.769101+0000","last_fullsized":"2023-10-14T12:28:52.769101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761342+0000","last_change":"2023-10-14T12:28:46.796221+0000","last_active":"2023-10-14T12:28:51.761342+0000","last_peered":"2023-10-14T12:28:51.761342+0000","last_clean":"2023-10-14T12:28:51.761342+0000","last_became_active":"2023-10-14T12:28:46.795708+0000","last_became_peered":"2023-10-14T12:28:46.795708+0000","last_unstale":"2023-10-14T12:28:51.761342+0000","last_undegraded":"2023-10-14T12:28:51.761342+0000","last_fullsized":"2023-10-14T12:28:51.761342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763958+0000","last_change":"2023-10-14T12:28:46.079635+0000","last_active":"2023-10-14T12:28:51.763958+0000","last_peered":"2023-10-14T12:28:51.763958+0000","last_clean":"2023-10-14T12:28:51.763958+0000","last_became_active":"2023-10-14T12:28:46.079237+0000","last_became_peered":"2023-10-14T12:28:46.079237+0000","last_unstale":"2023-10-14T12:28:51.763958+0000","last_undegraded":"2023-10-14T12:28:51.763958+0000","last_fullsized":"2023-10-14T12:28:51.763958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.764406+0000","last_change":"2023-10-14T12:28:46.082807+0000","last_active":"2023-10-14T12:28:51.764406+0000","last_peered":"2023-10-14T12:28:51.764406+0000","last_clean":"2023-10-14T12:28:51.764406+0000","last_became_active":"2023-10-14T12:28:46.082446+0000","last_became_peered":"2023-10-14T12:28:46.082446+0000","last_unstale":"2023-10-14T12:28:51.764406+0000","last_undegraded":"2023-10-14T12:28:51.764406+0000","last_fullsized":"2023-10-14T12:28:51.764406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908770+0000","last_change":"2023-10-14T12:28:46.789200+0000","last_active":"2023-10-14T12:28:51.908770+0000","last_peered":"2023-10-14T12:28:51.908770+0000","last_clean":"2023-10-14T12:28:51.908770+0000","last_became_active":"2023-10-14T12:28:46.788290+0000","last_became_peered":"2023-10-14T12:28:46.788290+0000","last_unstale":"2023-10-14T12:28:51.908770+0000","last_undegraded":"2023-10-14T12:28:51.908770+0000","last_fullsized":"2023-10-14T12:28:51.908770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:53:29.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.405050+0000","last_change":"2023-10-14T12:28:51.139776+0000","last_active":"2023-10-14T12:28:54.405050+0000","last_peered":"2023-10-14T12:28:54.405050+0000","last_clean":"2023-10-14T12:28:54.405050+0000","last_became_active":"2023-10-14T12:28:51.139357+0000","last_became_peered":"2023-10-14T12:28:51.139357+0000","last_unstale":"2023-10-14T12:28:54.405050+0000","last_undegraded":"2023-10-14T12:28:54.405050+0000","last_fullsized":"2023-10-14T12:28:54.405050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:32.967798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762275+0000","last_change":"2023-10-14T12:28:46.080941+0000","last_active":"2023-10-14T12:28:51.762275+0000","last_peered":"2023-10-14T12:28:51.762275+0000","last_clean":"2023-10-14T12:28:51.762275+0000","last_became_active":"2023-10-14T12:28:46.080441+0000","last_became_peered":"2023-10-14T12:28:46.080441+0000","last_unstale":"2023-10-14T12:28:51.762275+0000","last_undegraded":"2023-10-14T12:28:51.762275+0000","last_fullsized":"2023-10-14T12:28:51.762275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765820+0000","last_change":"2023-10-14T12:28:46.783353+0000","last_active":"2023-10-14T12:28:51.765820+0000","last_peered":"2023-10-14T12:28:51.765820+0000","last_clean":"2023-10-14T12:28:51.765820+0000","last_became_active":"2023-10-14T12:28:46.780547+0000","last_became_peered":"2023-10-14T12:28:46.780547+0000","last_unstale":"2023-10-14T12:28:51.765820+0000","last_undegraded":"2023-10-14T12:28:51.765820+0000","last_fullsized":"2023-10-14T12:28:51.765820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.312389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767132+0000","last_change":"2023-10-14T12:28:51.148240+0000","last_active":"2023-10-14T12:28:52.767132+0000","last_peered":"2023-10-14T12:28:52.767132+0000","last_clean":"2023-10-14T12:28:52.767132+0000","last_became_active":"2023-10-14T12:28:51.147866+0000","last_became_peered":"2023-10-14T12:28:51.147866+0000","last_unstale":"2023-10-14T12:28:52.767132+0000","last_undegraded":"2023-10-14T12:28:52.767132+0000","last_fullsized":"2023-10-14T12:28:52.767132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:58.023924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763203+0000","last_change":"2023-10-14T12:28:46.796117+0000","last_active":"2023-10-14T12:28:51.763203+0000","last_peered":"2023-10-14T12:28:51.763203+0000","last_clean":"2023-10-14T12:28:51.763203+0000","last_became_active":"2023-10-14T12:28:46.795584+0000","last_became_peered":"2023-10-14T12:28:46.795584+0000","last_unstale":"2023-10-14T12:28:51.763203+0000","last_undegraded":"2023-10-14T12:28:51.763203+0000","last_fullsized":"2023-10-14T12:28:51.763203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140779+0000","last_change":"2023-10-14T12:28:46.792780+0000","last_active":"2023-10-14T12:28:52.140779+0000","last_peered":"2023-10-14T12:28:52.140779+0000","last_clean":"2023-10-14T12:28:52.140779+0000","last_became_active":"2023-10-14T12:28:46.792468+0000","last_became_peered":"2023-10-14T12:28:46.792468+0000","last_unstale":"2023-10-14T12:28:52.140779+0000","last_undegraded":"2023-10-14T12:28:52.140779+0000","last_fullsized":"2023-10-14T12:28:52.140779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:12:50.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919258+0000","last_change":"2023-10-14T12:28:46.800621+0000","last_active":"2023-10-14T12:28:51.919258+0000","last_peered":"2023-10-14T12:28:51.919258+0000","last_clean":"2023-10-14T12:28:51.919258+0000","last_became_active":"2023-10-14T12:28:46.800259+0000","last_became_peered":"2023-10-14T12:28:46.800259+0000","last_unstale":"2023-10-14T12:28:51.919258+0000","last_undegraded":"2023-10-14T12:28:51.919258+0000","last_fullsized":"2023-10-14T12:28:51.919258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908609+0000","last_change":"2023-10-14T12:28:46.798651+0000","last_active":"2023-10-14T12:28:51.908609+0000","last_peered":"2023-10-14T12:28:51.908609+0000","last_clean":"2023-10-14T12:28:51.908609+0000","last_became_active":"2023-10-14T12:28:46.798154+0000","last_became_peered":"2023-10-14T12:28:46.798154+0000","last_unstale":"2023-10-14T12:28:51.908609+0000","last_undegraded":"2023-10-14T12:28:51.908609+0000","last_fullsized":"2023-10-14T12:28:51.908609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:51.310465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762274+0000","last_change":"2023-10-14T12:28:46.800534+0000","last_active":"2023-10-14T12:28:51.762274+0000","last_peered":"2023-10-14T12:28:51.762274+0000","last_clean":"2023-10-14T12:28:51.762274+0000","last_became_active":"2023-10-14T12:28:46.800209+0000","last_became_peered":"2023-10-14T12:28:46.800209+0000","last_unstale":"2023-10-14T12:28:51.762274+0000","last_undegraded":"2023-10-14T12:28:51.762274+0000","last_fullsized":"2023-10-14T12:28:51.762274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920892+0000","last_change":"2023-10-14T12:28:46.801224+0000","last_active":"2023-10-14T12:28:51.920892+0000","last_peered":"2023-10-14T12:28:51.920892+0000","last_clean":"2023-10-14T12:28:51.920892+0000","last_became_active":"2023-10-14T12:28:46.799754+0000","last_became_peered":"2023-10-14T12:28:46.799754+0000","last_unstale":"2023-10-14T12:28:51.920892+0000","last_undegraded":"2023-10-14T12:28:51.920892+0000","last_fullsized":"2023-10-14T12:28:51.920892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765879+0000","last_change":"2023-10-14T12:28:46.789306+0000","last_active":"2023-10-14T12:28:51.765879+0000","last_peered":"2023-10-14T12:28:51.765879+0000","last_clean":"2023-10-14T12:28:51.765879+0000","last_became_active":"2023-10-14T12:28:46.788994+0000","last_became_peered":"2023-10-14T12:28:46.788994+0000","last_unstale":"2023-10-14T12:28:51.765879+0000","last_undegraded":"2023-10-14T12:28:51.765879+0000","last_fullsized":"2023-10-14T12:28:51.765879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763488+0000","last_change":"2023-10-14T12:28:46.800979+0000","last_active":"2023-10-14T12:28:51.763488+0000","last_peered":"2023-10-14T12:28:51.763488+0000","last_clean":"2023-10-14T12:28:51.763488+0000","last_became_active":"2023-10-14T12:28:46.800583+0000","last_became_peered":"2023-10-14T12:28:46.800583+0000","last_unstale":"2023-10-14T12:28:51.763488+0000","last_undegraded":"2023-10-14T12:28:51.763488+0000","last_fullsized":"2023-10-14T12:28:51.763488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919108+0000","last_change":"2023-10-14T12:28:46.804560+0000","last_active":"2023-10-14T12:28:51.919108+0000","last_peered":"2023-10-14T12:28:51.919108+0000","last_clean":"2023-10-14T12:28:51.919108+0000","last_became_active":"2023-10-14T12:28:46.804313+0000","last_became_peered":"2023-10-14T12:28:46.804313+0000","last_unstale":"2023-10-14T12:28:51.919108+0000","last_undegraded":"2023-10-14T12:28:51.919108+0000","last_fullsized":"2023-10-14T12:28:51.919108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763776+0000","last_change":"2023-10-14T12:28:46.787411+0000","last_active":"2023-10-14T12:28:51.763776+0000","last_peered":"2023-10-14T12:28:51.763776+0000","last_clean":"2023-10-14T12:28:51.763776+0000","last_became_active":"2023-10-14T12:28:46.787097+0000","last_became_peered":"2023-10-14T12:28:46.787097+0000","last_unstale":"2023-10-14T12:28:51.763776+0000","last_undegraded":"2023-10-14T12:28:51.763776+0000","last_fullsized":"2023-10-14T12:28:51.763776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919180+0000","last_change":"2023-10-14T12:28:46.797642+0000","last_active":"2023-10-14T12:28:51.919180+0000","last_peered":"2023-10-14T12:28:51.919180+0000","last_clean":"2023-10-14T12:28:51.919180+0000","last_became_active":"2023-10-14T12:28:46.795817+0000","last_became_peered":"2023-10-14T12:28:46.795817+0000","last_unstale":"2023-10-14T12:28:51.919180+0000","last_undegraded":"2023-10-14T12:28:51.919180+0000","last_fullsized":"2023-10-14T12:28:51.919180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908111+0000","last_change":"2023-10-14T12:28:46.795955+0000","last_active":"2023-10-14T12:28:51.908111+0000","last_peered":"2023-10-14T12:28:51.908111+0000","last_clean":"2023-10-14T12:28:51.908111+0000","last_became_active":"2023-10-14T12:28:46.795662+0000","last_became_peered":"2023-10-14T12:28:46.795662+0000","last_unstale":"2023-10-14T12:28:51.908111+0000","last_undegraded":"2023-10-14T12:28:51.908111+0000","last_fullsized":"2023-10-14T12:28:51.908111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:25.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765436+0000","last_change":"2023-10-14T12:28:46.790373+0000","last_active":"2023-10-14T12:28:51.765436+0000","last_peered":"2023-10-14T12:28:51.765436+0000","last_clean":"2023-10-14T12:28:51.765436+0000","last_became_active":"2023-10-14T12:28:46.787302+0000","last_became_peered":"2023-10-14T12:28:46.787302+0000","last_unstale":"2023-10-14T12:28:51.765436+0000","last_undegraded":"2023-10-14T12:28:51.765436+0000","last_fullsized":"2023-10-14T12:28:51.765436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906592+0000","last_change":"2023-10-14T12:28:46.795080+0000","last_active":"2023-10-14T12:28:51.906592+0000","last_peered":"2023-10-14T12:28:51.906592+0000","last_clean":"2023-10-14T12:28:51.906592+0000","last_became_active":"2023-10-14T12:28:46.793929+0000","last_became_peered":"2023-10-14T12:28:46.793929+0000","last_unstale":"2023-10-14T12:28:51.906592+0000","last_undegraded":"2023-10-14T12:28:51.906592+0000","last_fullsized":"2023-10-14T12:28:51.906592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141500+0000","last_change":"2023-10-14T12:28:46.792079+0000","last_active":"2023-10-14T12:28:52.141500+0000","last_peered":"2023-10-14T12:28:52.141500+0000","last_clean":"2023-10-14T12:28:52.141500+0000","last_became_active":"2023-10-14T12:28:46.791050+0000","last_became_peered":"2023-10-14T12:28:46.791050+0000","last_unstale":"2023-10-14T12:28:52.141500+0000","last_undegraded":"2023-10-14T12:28:52.141500+0000","last_fullsized":"2023-10-14T12:28:52.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:09.407054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.792801+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.792421+0000","last_became_peered":"2023-10-14T12:28:46.792421+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922455+0000","last_change":"2023-10-14T12:28:46.792599+0000","last_active":"2023-10-14T12:28:51.922455+0000","last_peered":"2023-10-14T12:28:51.922455+0000","last_clean":"2023-10-14T12:28:51.922455+0000","last_became_active":"2023-10-14T12:28:46.792327+0000","last_became_peered":"2023-10-14T12:28:46.792327+0000","last_unstale":"2023-10-14T12:28:51.922455+0000","last_undegraded":"2023-10-14T12:28:51.922455+0000","last_fullsized":"2023-10-14T12:28:51.922455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.917660+0000","last_change":"2023-10-14T12:28:46.781418+0000","last_active":"2023-10-14T12:28:51.917660+0000","last_peered":"2023-10-14T12:28:51.917660+0000","last_clean":"2023-10-14T12:28:51.917660+0000","last_became_active":"2023-10-14T12:28:46.781029+0000","last_became_peered":"2023-10-14T12:28:46.781029+0000","last_unstale":"2023-10-14T12:28:51.917660+0000","last_undegraded":"2023-10-14T12:28:51.917660+0000","last_fullsized":"2023-10-14T12:28:51.917660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908191+0000","last_change":"2023-10-14T12:28:46.789406+0000","last_active":"2023-10-14T12:28:51.908191+0000","last_peered":"2023-10-14T12:28:51.908191+0000","last_clean":"2023-10-14T12:28:51.908191+0000","last_became_active":"2023-10-14T12:28:46.788816+0000","last_became_peered":"2023-10-14T12:28:46.788816+0000","last_unstale":"2023-10-14T12:28:51.908191+0000","last_undegraded":"2023-10-14T12:28:51.908191+0000","last_fullsized":"2023-10-14T12:28:51.908191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:51.781330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761766+0000","last_change":"2023-10-14T12:28:46.796885+0000","last_active":"2023-10-14T12:28:51.761766+0000","last_peered":"2023-10-14T12:28:51.761766+0000","last_clean":"2023-10-14T12:28:51.761766+0000","last_became_active":"2023-10-14T12:28:46.796301+0000","last_became_peered":"2023-10-14T12:28:46.796301+0000","last_unstale":"2023-10-14T12:28:51.761766+0000","last_undegraded":"2023-10-14T12:28:51.761766+0000","last_fullsized":"2023-10-14T12:28:51.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767000+0000","last_change":"2023-10-14T12:28:46.777441+0000","last_active":"2023-10-14T12:28:51.767000+0000","last_peered":"2023-10-14T12:28:51.767000+0000","last_clean":"2023-10-14T12:28:51.767000+0000","last_became_active":"2023-10-14T12:28:46.776829+0000","last_became_peered":"2023-10-14T12:28:46.776829+0000","last_unstale":"2023-10-14T12:28:51.767000+0000","last_undegraded":"2023-10-14T12:28:51.767000+0000","last_fullsized":"2023-10-14T12:28:51.767000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:26.687643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765557+0000","last_change":"2023-10-14T12:28:46.797878+0000","last_active":"2023-10-14T12:28:51.765557+0000","last_peered":"2023-10-14T12:28:51.765557+0000","last_clean":"2023-10-14T12:28:51.765557+0000","last_became_active":"2023-10-14T12:28:46.796270+0000","last_became_peered":"2023-10-14T12:28:46.796270+0000","last_unstale":"2023-10-14T12:28:51.765557+0000","last_undegraded":"2023-10-14T12:28:51.765557+0000","last_fullsized":"2023-10-14T12:28:51.765557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765711+0000","last_change":"2023-10-14T12:28:46.789943+0000","last_active":"2023-10-14T12:28:51.765711+0000","last_peered":"2023-10-14T12:28:51.765711+0000","last_clean":"2023-10-14T12:28:51.765711+0000","last_became_active":"2023-10-14T12:28:46.789674+0000","last_became_peered":"2023-10-14T12:28:46.789674+0000","last_unstale":"2023-10-14T12:28:51.765711+0000","last_undegraded":"2023-10-14T12:28:51.765711+0000","last_fullsized":"2023-10-14T12:28:51.765711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905479+0000","last_change":"2023-10-14T12:28:46.803906+0000","last_active":"2023-10-14T12:28:51.905479+0000","last_peered":"2023-10-14T12:28:51.905479+0000","last_clean":"2023-10-14T12:28:51.905479+0000","last_became_active":"2023-10-14T12:28:46.803546+0000","last_became_peered":"2023-10-14T12:28:46.803546+0000","last_unstale":"2023-10-14T12:28:51.905479+0000","last_undegraded":"2023-10-14T12:28:51.905479+0000","last_fullsized":"2023-10-14T12:28:51.905479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:56.121924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761095+0000","last_change":"2023-10-14T12:28:46.797087+0000","last_active":"2023-10-14T12:28:51.761095+0000","last_peered":"2023-10-14T12:28:51.761095+0000","last_clean":"2023-10-14T12:28:51.761095+0000","last_became_active":"2023-10-14T12:28:46.796131+0000","last_became_peered":"2023-10-14T12:28:46.796131+0000","last_unstale":"2023-10-14T12:28:51.761095+0000","last_undegraded":"2023-10-14T12:28:51.761095+0000","last_fullsized":"2023-10-14T12:28:51.761095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901832+0000","last_change":"2023-10-14T12:28:46.796853+0000","last_active":"2023-10-14T12:28:51.901832+0000","last_peered":"2023-10-14T12:28:51.901832+0000","last_clean":"2023-10-14T12:28:51.901832+0000","last_became_active":"2023-10-14T12:28:46.796587+0000","last_became_peered":"2023-10-14T12:28:46.796587+0000","last_unstale":"2023-10-14T12:28:51.901832+0000","last_undegraded":"2023-10-14T12:28:51.901832+0000","last_fullsized":"2023-10-14T12:28:51.901832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919066+0000","last_change":"2023-10-14T12:28:46.791836+0000","last_active":"2023-10-14T12:28:51.919066+0000","last_peered":"2023-10-14T12:28:51.919066+0000","last_clean":"2023-10-14T12:28:51.919066+0000","last_became_active":"2023-10-14T12:28:46.791576+0000","last_became_peered":"2023-10-14T12:28:46.791576+0000","last_unstale":"2023-10-14T12:28:51.919066+0000","last_undegraded":"2023-10-14T12:28:51.919066+0000","last_fullsized":"2023-10-14T12:28:51.919066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901570+0000","last_change":"2023-10-14T12:28:46.794780+0000","last_active":"2023-10-14T12:28:51.901570+0000","last_peered":"2023-10-14T12:28:51.901570+0000","last_clean":"2023-10-14T12:28:51.901570+0000","last_became_active":"2023-10-14T12:28:46.794505+0000","last_became_peered":"2023-10-14T12:28:46.794505+0000","last_unstale":"2023-10-14T12:28:51.901570+0000","last_undegraded":"2023-10-14T12:28:51.901570+0000","last_fullsized":"2023-10-14T12:28:51.901570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922495+0000","last_change":"2023-10-14T12:28:46.803988+0000","last_active":"2023-10-14T12:28:51.922495+0000","last_peered":"2023-10-14T12:28:51.922495+0000","last_clean":"2023-10-14T12:28:51.922495+0000","last_became_active":"2023-10-14T12:28:46.803738+0000","last_became_peered":"2023-10-14T12:28:46.803738+0000","last_unstale":"2023-10-14T12:28:51.922495+0000","last_undegraded":"2023-10-14T12:28:51.922495+0000","last_fullsized":"2023-10-14T12:28:51.922495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.907759+0000","last_change":"2023-10-14T12:28:46.794216+0000","last_active":"2023-10-14T12:28:51.907759+0000","last_peered":"2023-10-14T12:28:51.907759+0000","last_clean":"2023-10-14T12:28:51.907759+0000","last_became_active":"2023-10-14T12:28:46.792243+0000","last_became_peered":"2023-10-14T12:28:46.792243+0000","last_unstale":"2023-10-14T12:28:51.907759+0000","last_undegraded":"2023-10-14T12:28:51.907759+0000","last_fullsized":"2023-10-14T12:28:51.907759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:39:12.370839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920339+0000","last_change":"2023-10-14T12:28:46.792759+0000","last_active":"2023-10-14T12:28:51.920339+0000","last_peered":"2023-10-14T12:28:51.920339+0000","last_clean":"2023-10-14T12:28:51.920339+0000","last_became_active":"2023-10-14T12:28:46.791814+0000","last_became_peered":"2023-10-14T12:28:46.791814+0000","last_unstale":"2023-10-14T12:28:51.920339+0000","last_undegraded":"2023-10-14T12:28:51.920339+0000","last_fullsized":"2023-10-14T12:28:51.920339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.904779+0000","last_change":"2023-10-14T12:28:46.791353+0000","last_active":"2023-10-14T12:28:51.904779+0000","last_peered":"2023-10-14T12:28:51.904779+0000","last_clean":"2023-10-14T12:28:51.904779+0000","last_became_active":"2023-10-14T12:28:46.791059+0000","last_became_peered":"2023-10-14T12:28:46.791059+0000","last_unstale":"2023-10-14T12:28:51.904779+0000","last_undegraded":"2023-10-14T12:28:51.904779+0000","last_fullsized":"2023-10-14T12:28:51.904779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":114863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":114737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.681}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:29:15.130 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:29:15.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.388+0000 7f6001ac9640 1 Processor -- start 2023-10-14T12:29:15.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.388+0000 7f6001ac9640 1 -- start start 2023-10-14T12:29:15.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.390+0000 7f6001ac9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15ad00 0x7f5ffc0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.390+0000 7f6001ac9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ffc15f040 0x7f5ffc15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.390+0000 7f6001ac9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ffc0707f0 con 0x7f5ffc0b0010 2023-10-14T12:29:15.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.390+0000 7f6001ac9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ffc070ad0 con 0x7f5ffc15f040 2023-10-14T12:29:15.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.390+0000 7f6001ac9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc15b1d0 con 0x7f5ffc15ad00 2023-10-14T12:29:15.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.390+0000 7f5ffbfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ffc15f040 0x7f5ffc15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.391+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15ad00 0x7f5ffc0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.391+0000 7f5ffbfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5ffc15f040 0x7f5ffc15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:38140/0 (socket says 172.21.15.64:38140) 2023-10-14T12:29:15.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.391+0000 7f5ffbfff640 1 -- 172.21.15.64:0/2049490770 learned_addr learned my addr 172.21.15.64:0/2049490770 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:15.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.391+0000 7f5ffaffd640 1 -- 172.21.15.64:0/2049490770 >> v2:172.21.15.177:3300/0 conn(0x7f5ffc15f040 msgr2=0x7f5ffc15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:15.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.391+0000 7f5ffaffd640 1 --2- 172.21.15.64:0/2049490770 >> v2:172.21.15.177:3300/0 conn(0x7f5ffc15f040 0x7f5ffc15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.391+0000 7f5ffaffd640 1 -- 172.21.15.64:0/2049490770 >> v1:172.21.15.177:6789/0 conn(0x7f5ffc0b0010 legacy=0x7f5ffc0b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.391+0000 7f5ffaffd640 1 -- 172.21.15.64:0/2049490770 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ffc15b4b0 con 0x7f5ffc15ad00 2023-10-14T12:29:15.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.393+0000 7f5ffaffd640 1 --2- 172.21.15.64:0/2049490770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15ad00 0x7f5ffc0701a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000dbc0 tx=0x7f5ff002fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d3af95ea0a81219 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:15.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f5ffa7fc640 1 -- 172.21.15.64:0/2049490770 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0030860 con 0x7f5ffc15ad00 2023-10-14T12:29:15.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f5ffa7fc640 1 -- 172.21.15.64:0/2049490770 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff00309c0 con 0x7f5ffc15ad00 2023-10-14T12:29:15.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f5ffa7fc640 1 -- 172.21.15.64:0/2049490770 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0030d50 con 0x7f5ffc15ad00 2023-10-14T12:29:15.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f6001ac9640 1 -- 172.21.15.64:0/2049490770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15ad00 msgr2=0x7f5ffc0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2049490770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15ad00 0x7f5ffc0701a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000dbc0 tx=0x7f5ff002fcc0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f6001ac9640 1 -- 172.21.15.64:0/2049490770 shutdown_connections 2023-10-14T12:29:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2049490770 >> v2:172.21.15.177:3300/0 conn(0x7f5ffc15f040 0x7f5ffc15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.394+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2049490770 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15ad00 0x7f5ffc0701a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.395+0000 7f6001ac9640 1 -- 172.21.15.64:0/2049490770 >> 172.21.15.64:0/2049490770 conn(0x7f5ffc06c1c0 msgr2=0x7f5ffc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:15.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.395+0000 7f6001ac9640 1 -- 172.21.15.64:0/2049490770 shutdown_connections 2023-10-14T12:29:15.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.395+0000 7f6001ac9640 1 -- 172.21.15.64:0/2049490770 wait complete. 2023-10-14T12:29:15.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.397+0000 7f6001ac9640 1 Processor -- start 2023-10-14T12:29:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.397+0000 7f6001ac9640 1 -- start start 2023-10-14T12:29:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.398+0000 7f6001ac9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ffc0b0010 0x7f5ffc150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.398+0000 7f6001ac9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ffc15ad00 0x7f5ffc153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.398+0000 7f6001ac9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15f040 0x7f5ffc151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.398+0000 7f6001ac9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1521b0 con 0x7f5ffc15ad00 2023-10-14T12:29:15.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.398+0000 7f6001ac9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1523c0 con 0x7f5ffc0b0010 2023-10-14T12:29:15.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.398+0000 7f6001ac9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ffc1526a0 con 0x7f5ffc15f040 2023-10-14T12:29:15.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ffc15ad00 0x7f5ffc153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ffc15ad00 0x7f5ffc153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:38030/0 (socket says 172.21.15.64:38030) 2023-10-14T12:29:15.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 -- 172.21.15.64:0/2818270544 learned_addr learned my addr 172.21.15.64:0/2818270544 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:15.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffb7fe640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ffc0b0010 0x7f5ffc150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffbfff640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15f040 0x7f5ffc151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 -- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15f040 msgr2=0x7f5ffc151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15f040 0x7f5ffc151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 -- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ffc0b0010 msgr2=0x7f5ffc150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ffc0b0010 0x7f5ffc150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.399+0000 7f5ffaffd640 1 -- 172.21.15.64:0/2818270544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff000d8a0 con 0x7f5ffc15ad00 2023-10-14T12:29:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.400+0000 7f5ffaffd640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ffc15ad00 0x7f5ffc153460 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000dbc0 tx=0x7f5ff00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.400+0000 7f5fe3fff640 1 -- 172.21.15.64:0/2818270544 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0006e10 con 0x7f5ffc15ad00 2023-10-14T12:29:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.400+0000 7f5fe3fff640 1 -- 172.21.15.64:0/2818270544 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff000ba90 con 0x7f5ffc15ad00 2023-10-14T12:29:15.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.400+0000 7f5fe3fff640 1 -- 172.21.15.64:0/2818270544 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000be40 con 0x7f5ffc15ad00 2023-10-14T12:29:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.400+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ffc152980 con 0x7f5ffc15ad00 2023-10-14T12:29:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.400+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ffc152f40 con 0x7f5ffc15ad00 2023-10-14T12:29:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.402+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ffc15a560 con 0x7f5ffc15ad00 2023-10-14T12:29:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.403+0000 7f5fe3fff640 1 -- 172.21.15.64:0/2818270544 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5ff0042450 con 0x7f5ffc15ad00 2023-10-14T12:29:15.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.403+0000 7f5fe3fff640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5fe806ae70 0x7f5fe806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.404+0000 7f5fe3fff640 1 -- 172.21.15.64:0/2818270544 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ff00b0100 con 0x7f5ffc15ad00 2023-10-14T12:29:15.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.404+0000 7f5ffb7fe640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5fe806ae70 0x7f5fe806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.405+0000 7f5ffb7fe640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5fe806ae70 0x7f5fe806d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0afa00 tx=0x7f5fec009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:15.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.408+0000 7f5fe3fff640 1 -- 172.21.15.64:0/2818270544 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5ff007b030 con 0x7f5ffc15ad00 2023-10-14T12:29:15.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.589+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ffc15f4d0 con 0x7f5fe806ae70 2023-10-14T12:29:15.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.616+0000 7f5fe3fff640 1 -- 172.21.15.64:0/2818270544 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345128 (secure 0 0 0) 0x7f5fec00fdd0 con 0x7f5fe806ae70 2023-10-14T12:29:15.623 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:15.625 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:29:15.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.623+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5fe806ae70 msgr2=0x7f5fe806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.623+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5fe806ae70 0x7f5fe806d330 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc0afa00 tx=0x7f5fec009040 comp rx=0 tx=0).stop 2023-10-14T12:29:15.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.623+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ffc15ad00 msgr2=0x7f5ffc153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.623+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ffc15ad00 0x7f5ffc153460 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000dbc0 tx=0x7f5ff00046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 shutdown_connections 2023-10-14T12:29:15.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5fe806ae70 0x7f5fe806d330 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5ffc15f040 0x7f5ffc151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5ffc15ad00 0x7f5ffc153460 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 --2- 172.21.15.64:0/2818270544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5ffc0b0010 0x7f5ffc150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 >> 172.21.15.64:0/2818270544 conn(0x7f5ffc06c1c0 msgr2=0x7f5ffc0cab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:15.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 shutdown_connections 2023-10-14T12:29:15.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.624+0000 7f6001ac9640 1 -- 172.21.15.64:0/2818270544 wait complete. 2023-10-14T12:29:15.643 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-10-14T12:29:13.734374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":213,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219624,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755096,"statfs":{"total":773094113280,"available":772869218304,"internally_reserved":0,"allocated":3547136,"data_stored":2107910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005244"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.913373+0000","last_change":"2023-10-14T12:28:46.080407+0000","last_active":"2023-10-14T12:28:51.913373+0000","last_peered":"2023-10-14T12:28:51.913373+0000","last_clean":"2023-10-14T12:28:51.913373+0000","last_became_active":"2023-10-14T12:28:46.080075+0000","last_became_peered":"2023-10-14T12:28:46.080075+0000","last_unstale":"2023-10-14T12:28:51.913373+0000","last_undegraded":"2023-10-14T12:28:51.913373+0000","last_fullsized":"2023-10-14T12:28:51.913373+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:34:41.571338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762559+0000","last_change":"2023-10-14T12:28:46.798279+0000","last_active":"2023-10-14T12:28:51.762559+0000","last_peered":"2023-10-14T12:28:51.762559+0000","last_clean":"2023-10-14T12:28:51.762559+0000","last_became_active":"2023-10-14T12:28:46.797918+0000","last_became_peered":"2023-10-14T12:28:46.797918+0000","last_unstale":"2023-10-14T12:28:51.762559+0000","last_undegraded":"2023-10-14T12:28:51.762559+0000","last_fullsized":"2023-10-14T12:28:51.762559+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765687+0000","last_change":"2023-10-14T12:28:51.919038+0000","last_active":"2023-10-14T12:28:52.765687+0000","last_peered":"2023-10-14T12:28:52.765687+0000","last_clean":"2023-10-14T12:28:52.765687+0000","last_became_active":"2023-10-14T12:28:51.917610+0000","last_became_peered":"2023-10-14T12:28:51.917610+0000","last_unstale":"2023-10-14T12:28:52.765687+0000","last_undegraded":"2023-10-14T12:28:52.765687+0000","last_fullsized":"2023-10-14T12:28:52.765687+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:53:07.544233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762860+0000","last_change":"2023-10-14T12:28:46.085671+0000","last_active":"2023-10-14T12:28:51.762860+0000","last_peered":"2023-10-14T12:28:51.762860+0000","last_clean":"2023-10-14T12:28:51.762860+0000","last_became_active":"2023-10-14T12:28:46.085352+0000","last_became_peered":"2023-10-14T12:28:46.085352+0000","last_unstale":"2023-10-14T12:28:51.762860+0000","last_undegraded":"2023-10-14T12:28:51.762860+0000","last_fullsized":"2023-10-14T12:28:51.762860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908566+0000","last_change":"2023-10-14T12:28:46.797554+0000","last_active":"2023-10-14T12:28:51.908566+0000","last_peered":"2023-10-14T12:28:51.908566+0000","last_clean":"2023-10-14T12:28:51.908566+0000","last_became_active":"2023-10-14T12:28:46.794880+0000","last_became_peered":"2023-10-14T12:28:46.794880+0000","last_unstale":"2023-10-14T12:28:51.908566+0000","last_undegraded":"2023-10-14T12:28:51.908566+0000","last_fullsized":"2023-10-14T12:28:51.908566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:37:52.797863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748815+0000","last_change":"2023-10-14T12:28:51.142417+0000","last_active":"2023-10-14T12:28:53.748815+0000","last_peered":"2023-10-14T12:28:53.748815+0000","last_clean":"2023-10-14T12:28:53.748815+0000","last_became_active":"2023-10-14T12:28:51.141839+0000","last_became_peered":"2023-10-14T12:28:51.141839+0000","last_unstale":"2023-10-14T12:28:53.748815+0000","last_undegraded":"2023-10-14T12:28:53.748815+0000","last_fullsized":"2023-10-14T12:28:53.748815+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:41.283159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903557+0000","last_change":"2023-10-14T12:28:46.086064+0000","last_active":"2023-10-14T12:28:51.903557+0000","last_peered":"2023-10-14T12:28:51.903557+0000","last_clean":"2023-10-14T12:28:51.903557+0000","last_became_active":"2023-10-14T12:28:46.083071+0000","last_became_peered":"2023-10-14T12:28:46.083071+0000","last_unstale":"2023-10-14T12:28:51.903557+0000","last_undegraded":"2023-10-14T12:28:51.903557+0000","last_fullsized":"2023-10-14T12:28:51.903557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922469+0000","last_change":"2023-10-14T12:28:46.784072+0000","last_active":"2023-10-14T12:28:51.922469+0000","last_peered":"2023-10-14T12:28:51.922469+0000","last_clean":"2023-10-14T12:28:51.922469+0000","last_became_active":"2023-10-14T12:28:46.783653+0000","last_became_peered":"2023-10-14T12:28:46.783653+0000","last_unstale":"2023-10-14T12:28:51.922469+0000","last_undegraded":"2023-10-14T12:28:51.922469+0000","last_fullsized":"2023-10-14T12:28:51.922469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749295+0000","last_change":"2023-10-14T12:28:51.141444+0000","last_active":"2023-10-14T12:28:53.749295+0000","last_peered":"2023-10-14T12:28:53.749295+0000","last_clean":"2023-10-14T12:28:53.749295+0000","last_became_active":"2023-10-14T12:28:51.140883+0000","last_became_peered":"2023-10-14T12:28:51.140883+0000","last_unstale":"2023-10-14T12:28:53.749295+0000","last_undegraded":"2023-10-14T12:28:53.749295+0000","last_fullsized":"2023-10-14T12:28:53.749295+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902128+0000","last_change":"2023-10-14T12:28:46.090824+0000","last_active":"2023-10-14T12:28:51.902128+0000","last_peered":"2023-10-14T12:28:51.902128+0000","last_clean":"2023-10-14T12:28:51.902128+0000","last_became_active":"2023-10-14T12:28:46.090494+0000","last_became_peered":"2023-10-14T12:28:46.090494+0000","last_unstale":"2023-10-14T12:28:51.902128+0000","last_undegraded":"2023-10-14T12:28:51.902128+0000","last_fullsized":"2023-10-14T12:28:51.902128+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922922+0000","last_change":"2023-10-14T12:28:46.795518+0000","last_active":"2023-10-14T12:28:51.922922+0000","last_peered":"2023-10-14T12:28:51.922922+0000","last_clean":"2023-10-14T12:28:51.922922+0000","last_became_active":"2023-10-14T12:28:46.794866+0000","last_became_peered":"2023-10-14T12:28:46.794866+0000","last_unstale":"2023-10-14T12:28:51.922922+0000","last_undegraded":"2023-10-14T12:28:51.922922+0000","last_fullsized":"2023-10-14T12:28:51.922922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748983+0000","last_change":"2023-10-14T12:28:51.145294+0000","last_active":"2023-10-14T12:28:53.748983+0000","last_peered":"2023-10-14T12:28:53.748983+0000","last_clean":"2023-10-14T12:28:53.748983+0000","last_became_active":"2023-10-14T12:28:51.144881+0000","last_became_peered":"2023-10-14T12:28:51.144881+0000","last_unstale":"2023-10-14T12:28:53.748983+0000","last_undegraded":"2023-10-14T12:28:53.748983+0000","last_fullsized":"2023-10-14T12:28:53.748983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:06:00.171951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763978+0000","last_change":"2023-10-14T12:28:46.787464+0000","last_active":"2023-10-14T12:28:51.763978+0000","last_peered":"2023-10-14T12:28:51.763978+0000","last_clean":"2023-10-14T12:28:51.763978+0000","last_became_active":"2023-10-14T12:28:46.787118+0000","last_became_peered":"2023-10-14T12:28:46.787118+0000","last_unstale":"2023-10-14T12:28:51.763978+0000","last_undegraded":"2023-10-14T12:28:51.763978+0000","last_fullsized":"2023-10-14T12:28:51.763978+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901958+0000","last_change":"2023-10-14T12:28:46.080330+0000","last_active":"2023-10-14T12:28:51.901958+0000","last_peered":"2023-10-14T12:28:51.901958+0000","last_clean":"2023-10-14T12:28:51.901958+0000","last_became_active":"2023-10-14T12:28:46.079439+0000","last_became_peered":"2023-10-14T12:28:46.079439+0000","last_unstale":"2023-10-14T12:28:51.901958+0000","last_undegraded":"2023-10-14T12:28:51.901958+0000","last_fullsized":"2023-10-14T12:28:51.901958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:34.159395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.750153+0000","last_change":"2023-10-14T12:28:51.140074+0000","last_active":"2023-10-14T12:28:53.750153+0000","last_peered":"2023-10-14T12:28:53.750153+0000","last_clean":"2023-10-14T12:28:53.750153+0000","last_became_active":"2023-10-14T12:28:51.139545+0000","last_became_peered":"2023-10-14T12:28:51.139545+0000","last_unstale":"2023-10-14T12:28:53.750153+0000","last_undegraded":"2023-10-14T12:28:53.750153+0000","last_fullsized":"2023-10-14T12:28:53.750153+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762014+0000","last_change":"2023-10-14T12:28:46.798887+0000","last_active":"2023-10-14T12:28:51.762014+0000","last_peered":"2023-10-14T12:28:51.762014+0000","last_clean":"2023-10-14T12:28:51.762014+0000","last_became_active":"2023-10-14T12:28:46.797610+0000","last_became_peered":"2023-10-14T12:28:46.797610+0000","last_unstale":"2023-10-14T12:28:51.762014+0000","last_undegraded":"2023-10-14T12:28:51.762014+0000","last_fullsized":"2023-10-14T12:28:51.762014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920774+0000","last_change":"2023-10-14T12:28:46.082663+0000","last_active":"2023-10-14T12:28:51.920774+0000","last_peered":"2023-10-14T12:28:51.920774+0000","last_clean":"2023-10-14T12:28:51.920774+0000","last_became_active":"2023-10-14T12:28:46.081809+0000","last_became_peered":"2023-10-14T12:28:46.081809+0000","last_unstale":"2023-10-14T12:28:51.920774+0000","last_undegraded":"2023-10-14T12:28:51.920774+0000","last_fullsized":"2023-10-14T12:28:51.920774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749519+0000","last_change":"2023-10-14T12:28:51.146584+0000","last_active":"2023-10-14T12:28:53.749519+0000","last_peered":"2023-10-14T12:28:53.749519+0000","last_clean":"2023-10-14T12:28:53.749519+0000","last_became_active":"2023-10-14T12:28:51.146146+0000","last_became_peered":"2023-10-14T12:28:51.146146+0000","last_unstale":"2023-10-14T12:28:53.749519+0000","last_undegraded":"2023-10-14T12:28:53.749519+0000","last_fullsized":"2023-10-14T12:28:53.749519+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761572+0000","last_change":"2023-10-14T12:28:46.789261+0000","last_active":"2023-10-14T12:28:51.761572+0000","last_peered":"2023-10-14T12:28:51.761572+0000","last_clean":"2023-10-14T12:28:51.761572+0000","last_became_active":"2023-10-14T12:28:46.788031+0000","last_became_peered":"2023-10-14T12:28:46.788031+0000","last_unstale":"2023-10-14T12:28:51.761572+0000","last_undegraded":"2023-10-14T12:28:51.761572+0000","last_fullsized":"2023-10-14T12:28:51.761572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.918090+0000","last_change":"2023-10-14T12:28:46.079896+0000","last_active":"2023-10-14T12:28:51.918090+0000","last_peered":"2023-10-14T12:28:51.918090+0000","last_clean":"2023-10-14T12:28:51.918090+0000","last_became_active":"2023-10-14T12:28:46.079498+0000","last_became_peered":"2023-10-14T12:28:46.079498+0000","last_unstale":"2023-10-14T12:28:51.918090+0000","last_undegraded":"2023-10-14T12:28:51.918090+0000","last_fullsized":"2023-10-14T12:28:51.918090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549998+0000","last_change":"2023-10-14T12:28:51.923834+0000","last_active":"2023-10-14T12:28:54.549998+0000","last_peered":"2023-10-14T12:28:54.549998+0000","last_clean":"2023-10-14T12:28:54.549998+0000","last_became_active":"2023-10-14T12:28:51.916869+0000","last_became_peered":"2023-10-14T12:28:51.916869+0000","last_unstale":"2023-10-14T12:28:54.549998+0000","last_undegraded":"2023-10-14T12:28:54.549998+0000","last_fullsized":"2023-10-14T12:28:54.549998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765552+0000","last_change":"2023-10-14T12:28:46.786929+0000","last_active":"2023-10-14T12:28:51.765552+0000","last_peered":"2023-10-14T12:28:51.765552+0000","last_clean":"2023-10-14T12:28:51.765552+0000","last_became_active":"2023-10-14T12:28:46.785285+0000","last_became_peered":"2023-10-14T12:28:46.785285+0000","last_unstale":"2023-10-14T12:28:51.765552+0000","last_undegraded":"2023-10-14T12:28:51.765552+0000","last_fullsized":"2023-10-14T12:28:51.765552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:06:14.608032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901022+0000","last_change":"2023-10-14T12:28:46.085793+0000","last_active":"2023-10-14T12:28:51.901022+0000","last_peered":"2023-10-14T12:28:51.901022+0000","last_clean":"2023-10-14T12:28:51.901022+0000","last_became_active":"2023-10-14T12:28:46.085539+0000","last_became_peered":"2023-10-14T12:28:46.085539+0000","last_unstale":"2023-10-14T12:28:51.901022+0000","last_undegraded":"2023-10-14T12:28:51.901022+0000","last_fullsized":"2023-10-14T12:28:51.901022+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749922+0000","last_change":"2023-10-14T12:28:51.142284+0000","last_active":"2023-10-14T12:28:53.749922+0000","last_peered":"2023-10-14T12:28:53.749922+0000","last_clean":"2023-10-14T12:28:53.749922+0000","last_became_active":"2023-10-14T12:28:51.141786+0000","last_became_peered":"2023-10-14T12:28:51.141786+0000","last_unstale":"2023-10-14T12:28:53.749922+0000","last_undegraded":"2023-10-14T12:28:53.749922+0000","last_fullsized":"2023-10-14T12:28:53.749922+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908548+0000","last_change":"2023-10-14T12:28:46.784288+0000","last_active":"2023-10-14T12:28:51.908548+0000","last_peered":"2023-10-14T12:28:51.908548+0000","last_clean":"2023-10-14T12:28:51.908548+0000","last_became_active":"2023-10-14T12:28:46.783048+0000","last_became_peered":"2023-10-14T12:28:46.783048+0000","last_unstale":"2023-10-14T12:28:51.908548+0000","last_undegraded":"2023-10-14T12:28:51.908548+0000","last_fullsized":"2023-10-14T12:28:51.908548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:25:10.556463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766748+0000","last_change":"2023-10-14T12:28:46.077038+0000","last_active":"2023-10-14T12:28:51.766748+0000","last_peered":"2023-10-14T12:28:51.766748+0000","last_clean":"2023-10-14T12:28:51.766748+0000","last_became_active":"2023-10-14T12:28:46.075513+0000","last_became_peered":"2023-10-14T12:28:46.075513+0000","last_unstale":"2023-10-14T12:28:51.766748+0000","last_undegraded":"2023-10-14T12:28:51.766748+0000","last_fullsized":"2023-10-14T12:28:51.766748+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.863719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748977+0000","last_change":"2023-10-14T12:28:51.911158+0000","last_active":"2023-10-14T12:28:53.748977+0000","last_peered":"2023-10-14T12:28:53.748977+0000","last_clean":"2023-10-14T12:28:53.748977+0000","last_became_active":"2023-10-14T12:28:51.910002+0000","last_became_peered":"2023-10-14T12:28:51.910002+0000","last_unstale":"2023-10-14T12:28:53.748977+0000","last_undegraded":"2023-10-14T12:28:53.748977+0000","last_fullsized":"2023-10-14T12:28:53.748977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:35:00.327936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763687+0000","last_change":"2023-10-14T12:28:46.796917+0000","last_active":"2023-10-14T12:28:51.763687+0000","last_peered":"2023-10-14T12:28:51.763687+0000","last_clean":"2023-10-14T12:28:51.763687+0000","last_became_active":"2023-10-14T12:28:46.796090+0000","last_became_peered":"2023-10-14T12:28:46.796090+0000","last_unstale":"2023-10-14T12:28:51.763687+0000","last_undegraded":"2023-10-14T12:28:51.763687+0000","last_fullsized":"2023-10-14T12:28:51.763687+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'3","reported_seq":20,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:29:04.249281+0000","last_change":"2023-10-14T12:28:46.072468+0000","last_active":"2023-10-14T12:29:04.249281+0000","last_peered":"2023-10-14T12:29:04.249281+0000","last_clean":"2023-10-14T12:29:04.249281+0000","last_became_active":"2023-10-14T12:28:46.071827+0000","last_became_peered":"2023-10-14T12:28:46.071827+0000","last_unstale":"2023-10-14T12:29:04.249281+0000","last_undegraded":"2023-10-14T12:29:04.249281+0000","last_fullsized":"2023-10-14T12:29:04.249281+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765187+0000","last_change":"2023-10-14T12:28:51.903366+0000","last_active":"2023-10-14T12:28:52.765187+0000","last_peered":"2023-10-14T12:28:52.765187+0000","last_clean":"2023-10-14T12:28:52.765187+0000","last_became_active":"2023-10-14T12:28:51.902191+0000","last_became_peered":"2023-10-14T12:28:51.902191+0000","last_unstale":"2023-10-14T12:28:52.765187+0000","last_undegraded":"2023-10-14T12:28:52.765187+0000","last_fullsized":"2023-10-14T12:28:52.765187+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920090+0000","last_change":"2023-10-14T12:28:46.786490+0000","last_active":"2023-10-14T12:28:51.920090+0000","last_peered":"2023-10-14T12:28:51.920090+0000","last_clean":"2023-10-14T12:28:51.920090+0000","last_became_active":"2023-10-14T12:28:46.785976+0000","last_became_peered":"2023-10-14T12:28:46.785976+0000","last_unstale":"2023-10-14T12:28:51.920090+0000","last_undegraded":"2023-10-14T12:28:51.920090+0000","last_fullsized":"2023-10-14T12:28:51.920090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905284+0000","last_change":"2023-10-14T12:28:46.087365+0000","last_active":"2023-10-14T12:28:51.905284+0000","last_peered":"2023-10-14T12:28:51.905284+0000","last_clean":"2023-10-14T12:28:51.905284+0000","last_became_active":"2023-10-14T12:28:46.087090+0000","last_became_peered":"2023-10-14T12:28:46.087090+0000","last_unstale":"2023-10-14T12:28:51.905284+0000","last_undegraded":"2023-10-14T12:28:51.905284+0000","last_fullsized":"2023-10-14T12:28:51.905284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409835+0000","last_change":"2023-10-14T12:28:51.909277+0000","last_active":"2023-10-14T12:28:54.409835+0000","last_peered":"2023-10-14T12:28:54.409835+0000","last_clean":"2023-10-14T12:28:54.409835+0000","last_became_active":"2023-10-14T12:28:51.907121+0000","last_became_peered":"2023-10-14T12:28:51.907121+0000","last_unstale":"2023-10-14T12:28:54.409835+0000","last_undegraded":"2023-10-14T12:28:54.409835+0000","last_fullsized":"2023-10-14T12:28:54.409835+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:58:31.934707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923040+0000","last_change":"2023-10-14T12:28:46.805297+0000","last_active":"2023-10-14T12:28:51.923040+0000","last_peered":"2023-10-14T12:28:51.923040+0000","last_clean":"2023-10-14T12:28:51.923040+0000","last_became_active":"2023-10-14T12:28:46.805000+0000","last_became_peered":"2023-10-14T12:28:46.805000+0000","last_unstale":"2023-10-14T12:28:51.923040+0000","last_undegraded":"2023-10-14T12:28:51.923040+0000","last_fullsized":"2023-10-14T12:28:51.923040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920314+0000","last_change":"2023-10-14T12:28:46.078052+0000","last_active":"2023-10-14T12:28:51.920314+0000","last_peered":"2023-10-14T12:28:51.920314+0000","last_clean":"2023-10-14T12:28:51.920314+0000","last_became_active":"2023-10-14T12:28:46.077730+0000","last_became_peered":"2023-10-14T12:28:46.077730+0000","last_unstale":"2023-10-14T12:28:51.920314+0000","last_undegraded":"2023-10-14T12:28:51.920314+0000","last_fullsized":"2023-10-14T12:28:51.920314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549170+0000","last_change":"2023-10-14T12:28:51.141425+0000","last_active":"2023-10-14T12:28:54.549170+0000","last_peered":"2023-10-14T12:28:54.549170+0000","last_clean":"2023-10-14T12:28:54.549170+0000","last_became_active":"2023-10-14T12:28:51.140998+0000","last_became_peered":"2023-10-14T12:28:51.140998+0000","last_unstale":"2023-10-14T12:28:54.549170+0000","last_undegraded":"2023-10-14T12:28:54.549170+0000","last_fullsized":"2023-10-14T12:28:54.549170+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:33.330311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766791+0000","last_change":"2023-10-14T12:28:46.791914+0000","last_active":"2023-10-14T12:28:51.766791+0000","last_peered":"2023-10-14T12:28:51.766791+0000","last_clean":"2023-10-14T12:28:51.766791+0000","last_became_active":"2023-10-14T12:28:46.790081+0000","last_became_peered":"2023-10-14T12:28:46.790081+0000","last_unstale":"2023-10-14T12:28:51.766791+0000","last_undegraded":"2023-10-14T12:28:51.766791+0000","last_fullsized":"2023-10-14T12:28:51.766791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:51.665543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919424+0000","last_change":"2023-10-14T12:28:46.087850+0000","last_active":"2023-10-14T12:28:51.919424+0000","last_peered":"2023-10-14T12:28:51.919424+0000","last_clean":"2023-10-14T12:28:51.919424+0000","last_became_active":"2023-10-14T12:28:46.087568+0000","last_became_peered":"2023-10-14T12:28:46.087568+0000","last_unstale":"2023-10-14T12:28:51.919424+0000","last_undegraded":"2023-10-14T12:28:51.919424+0000","last_fullsized":"2023-10-14T12:28:51.919424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:00.886203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549701+0000","last_change":"2023-10-14T12:28:51.140452+0000","last_active":"2023-10-14T12:28:54.549701+0000","last_peered":"2023-10-14T12:28:54.549701+0000","last_clean":"2023-10-14T12:28:54.549701+0000","last_became_active":"2023-10-14T12:28:51.140047+0000","last_became_peered":"2023-10-14T12:28:51.140047+0000","last_unstale":"2023-10-14T12:28:54.549701+0000","last_undegraded":"2023-10-14T12:28:54.549701+0000","last_fullsized":"2023-10-14T12:28:54.549701+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.915866+0000","last_change":"2023-10-14T12:28:46.785632+0000","last_active":"2023-10-14T12:28:51.915866+0000","last_peered":"2023-10-14T12:28:51.915866+0000","last_clean":"2023-10-14T12:28:51.915866+0000","last_became_active":"2023-10-14T12:28:46.785306+0000","last_became_peered":"2023-10-14T12:28:46.785306+0000","last_unstale":"2023-10-14T12:28:51.915866+0000","last_undegraded":"2023-10-14T12:28:51.915866+0000","last_fullsized":"2023-10-14T12:28:51.915866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140904+0000","last_change":"2023-10-14T12:28:46.079395+0000","last_active":"2023-10-14T12:28:52.140904+0000","last_peered":"2023-10-14T12:28:52.140904+0000","last_clean":"2023-10-14T12:28:52.140904+0000","last_became_active":"2023-10-14T12:28:46.079066+0000","last_became_peered":"2023-10-14T12:28:46.079066+0000","last_unstale":"2023-10-14T12:28:52.140904+0000","last_undegraded":"2023-10-14T12:28:52.140904+0000","last_fullsized":"2023-10-14T12:28:52.140904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:41:14.299609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.550104+0000","last_change":"2023-10-14T12:28:51.146682+0000","last_active":"2023-10-14T12:28:54.550104+0000","last_peered":"2023-10-14T12:28:54.550104+0000","last_clean":"2023-10-14T12:28:54.550104+0000","last_became_active":"2023-10-14T12:28:51.146103+0000","last_became_peered":"2023-10-14T12:28:51.146103+0000","last_unstale":"2023-10-14T12:28:54.550104+0000","last_undegraded":"2023-10-14T12:28:54.550104+0000","last_fullsized":"2023-10-14T12:28:54.550104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906672+0000","last_change":"2023-10-14T12:28:46.787997+0000","last_active":"2023-10-14T12:28:51.906672+0000","last_peered":"2023-10-14T12:28:51.906672+0000","last_clean":"2023-10-14T12:28:51.906672+0000","last_became_active":"2023-10-14T12:28:46.787646+0000","last_became_peered":"2023-10-14T12:28:46.787646+0000","last_unstale":"2023-10-14T12:28:51.906672+0000","last_undegraded":"2023-10-14T12:28:51.906672+0000","last_fullsized":"2023-10-14T12:28:51.906672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:39:23.732017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901433+0000","last_change":"2023-10-14T12:28:46.088704+0000","last_active":"2023-10-14T12:28:51.901433+0000","last_peered":"2023-10-14T12:28:51.901433+0000","last_clean":"2023-10-14T12:28:51.901433+0000","last_became_active":"2023-10-14T12:28:46.088429+0000","last_became_peered":"2023-10-14T12:28:46.088429+0000","last_unstale":"2023-10-14T12:28:51.901433+0000","last_undegraded":"2023-10-14T12:28:51.901433+0000","last_fullsized":"2023-10-14T12:28:51.901433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:08.064671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.411094+0000","last_change":"2023-10-14T12:28:51.920214+0000","last_active":"2023-10-14T12:28:54.411094+0000","last_peered":"2023-10-14T12:28:54.411094+0000","last_clean":"2023-10-14T12:28:54.411094+0000","last_became_active":"2023-10-14T12:28:51.918279+0000","last_became_peered":"2023-10-14T12:28:51.918279+0000","last_unstale":"2023-10-14T12:28:54.411094+0000","last_undegraded":"2023-10-14T12:28:54.411094+0000","last_fullsized":"2023-10-14T12:28:54.411094+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:30:32.336264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762038+0000","last_change":"2023-10-14T12:28:46.793764+0000","last_active":"2023-10-14T12:28:51.762038+0000","last_peered":"2023-10-14T12:28:51.762038+0000","last_clean":"2023-10-14T12:28:51.762038+0000","last_became_active":"2023-10-14T12:28:46.793460+0000","last_became_peered":"2023-10-14T12:28:46.793460+0000","last_unstale":"2023-10-14T12:28:51.762038+0000","last_undegraded":"2023-10-14T12:28:51.762038+0000","last_fullsized":"2023-10-14T12:28:51.762038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922056+0000","last_change":"2023-10-14T12:28:46.082037+0000","last_active":"2023-10-14T12:28:51.922056+0000","last_peered":"2023-10-14T12:28:51.922056+0000","last_clean":"2023-10-14T12:28:51.922056+0000","last_became_active":"2023-10-14T12:28:46.081174+0000","last_became_peered":"2023-10-14T12:28:46.081174+0000","last_unstale":"2023-10-14T12:28:51.922056+0000","last_undegraded":"2023-10-14T12:28:51.922056+0000","last_fullsized":"2023-10-14T12:28:51.922056+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:31.313890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":169,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901828+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:28:51.901828+0000","last_peered":"2023-10-14T12:28:51.901828+0000","last_clean":"2023-10-14T12:28:51.901828+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:28:51.901828+0000","last_undegraded":"2023-10-14T12:28:51.901828+0000","last_fullsized":"2023-10-14T12:28:51.901828+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.768326+0000","last_change":"2023-10-14T12:28:51.910300+0000","last_active":"2023-10-14T12:28:52.768326+0000","last_peered":"2023-10-14T12:28:52.768326+0000","last_clean":"2023-10-14T12:28:52.768326+0000","last_became_active":"2023-10-14T12:28:51.909121+0000","last_became_peered":"2023-10-14T12:28:51.909121+0000","last_unstale":"2023-10-14T12:28:52.768326+0000","last_undegraded":"2023-10-14T12:28:52.768326+0000","last_fullsized":"2023-10-14T12:28:52.768326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:43.101212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902148+0000","last_change":"2023-10-14T12:28:46.801572+0000","last_active":"2023-10-14T12:28:51.902148+0000","last_peered":"2023-10-14T12:28:51.902148+0000","last_clean":"2023-10-14T12:28:51.902148+0000","last_became_active":"2023-10-14T12:28:46.801273+0000","last_became_peered":"2023-10-14T12:28:46.801273+0000","last_unstale":"2023-10-14T12:28:51.902148+0000","last_undegraded":"2023-10-14T12:28:51.902148+0000","last_fullsized":"2023-10-14T12:28:51.902148+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.142466+0000","last_change":"2023-10-14T12:28:46.089021+0000","last_active":"2023-10-14T12:28:52.142466+0000","last_peered":"2023-10-14T12:28:52.142466+0000","last_clean":"2023-10-14T12:28:52.142466+0000","last_became_active":"2023-10-14T12:28:46.088640+0000","last_became_peered":"2023-10-14T12:28:46.088640+0000","last_unstale":"2023-10-14T12:28:52.142466+0000","last_undegraded":"2023-10-14T12:28:52.142466+0000","last_fullsized":"2023-10-14T12:28:52.142466+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:07:19.614243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766407+0000","last_change":"2023-10-14T12:28:51.909391+0000","last_active":"2023-10-14T12:28:52.766407+0000","last_peered":"2023-10-14T12:28:52.766407+0000","last_clean":"2023-10-14T12:28:52.766407+0000","last_became_active":"2023-10-14T12:28:51.908099+0000","last_became_peered":"2023-10-14T12:28:51.908099+0000","last_unstale":"2023-10-14T12:28:52.766407+0000","last_undegraded":"2023-10-14T12:28:52.766407+0000","last_fullsized":"2023-10-14T12:28:52.766407+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:28.364649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922641+0000","last_change":"2023-10-14T12:28:46.800329+0000","last_active":"2023-10-14T12:28:51.922641+0000","last_peered":"2023-10-14T12:28:51.922641+0000","last_clean":"2023-10-14T12:28:51.922641+0000","last_became_active":"2023-10-14T12:28:46.800007+0000","last_became_peered":"2023-10-14T12:28:46.800007+0000","last_unstale":"2023-10-14T12:28:51.922641+0000","last_undegraded":"2023-10-14T12:28:51.922641+0000","last_fullsized":"2023-10-14T12:28:51.922641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:02:24.314622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921828+0000","last_change":"2023-10-14T12:28:46.078949+0000","last_active":"2023-10-14T12:28:51.921828+0000","last_peered":"2023-10-14T12:28:51.921828+0000","last_clean":"2023-10-14T12:28:51.921828+0000","last_became_active":"2023-10-14T12:28:46.078670+0000","last_became_peered":"2023-10-14T12:28:46.078670+0000","last_unstale":"2023-10-14T12:28:51.921828+0000","last_undegraded":"2023-10-14T12:28:51.921828+0000","last_fullsized":"2023-10-14T12:28:51.921828+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:25:45.640103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.409867+0000","last_change":"2023-10-14T12:28:51.150655+0000","last_active":"2023-10-14T12:28:54.409867+0000","last_peered":"2023-10-14T12:28:54.409867+0000","last_clean":"2023-10-14T12:28:54.409867+0000","last_became_active":"2023-10-14T12:28:51.150108+0000","last_became_peered":"2023-10-14T12:28:51.150108+0000","last_unstale":"2023-10-14T12:28:54.409867+0000","last_undegraded":"2023-10-14T12:28:54.409867+0000","last_fullsized":"2023-10-14T12:28:54.409867+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:33:26.661167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905515+0000","last_change":"2023-10-14T12:28:46.799576+0000","last_active":"2023-10-14T12:28:51.905515+0000","last_peered":"2023-10-14T12:28:51.905515+0000","last_clean":"2023-10-14T12:28:51.905515+0000","last_became_active":"2023-10-14T12:28:46.798883+0000","last_became_peered":"2023-10-14T12:28:46.798883+0000","last_unstale":"2023-10-14T12:28:51.905515+0000","last_undegraded":"2023-10-14T12:28:51.905515+0000","last_fullsized":"2023-10-14T12:28:51.905515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:44.311419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141623+0000","last_change":"2023-10-14T12:28:46.082303+0000","last_active":"2023-10-14T12:28:52.141623+0000","last_peered":"2023-10-14T12:28:52.141623+0000","last_clean":"2023-10-14T12:28:52.141623+0000","last_became_active":"2023-10-14T12:28:46.081916+0000","last_became_peered":"2023-10-14T12:28:46.081916+0000","last_unstale":"2023-10-14T12:28:52.141623+0000","last_undegraded":"2023-10-14T12:28:52.141623+0000","last_fullsized":"2023-10-14T12:28:52.141623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:24:58.702563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765960+0000","last_change":"2023-10-14T12:28:51.922025+0000","last_active":"2023-10-14T12:28:52.765960+0000","last_peered":"2023-10-14T12:28:52.765960+0000","last_clean":"2023-10-14T12:28:52.765960+0000","last_became_active":"2023-10-14T12:28:51.918049+0000","last_became_peered":"2023-10-14T12:28:51.918049+0000","last_unstale":"2023-10-14T12:28:52.765960+0000","last_undegraded":"2023-10-14T12:28:52.765960+0000","last_fullsized":"2023-10-14T12:28:52.765960+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:26:01.908506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905811+0000","last_change":"2023-10-14T12:28:46.795831+0000","last_active":"2023-10-14T12:28:51.905811+0000","last_peered":"2023-10-14T12:28:51.905811+0000","last_clean":"2023-10-14T12:28:51.905811+0000","last_became_active":"2023-10-14T12:28:46.795571+0000","last_became_peered":"2023-10-14T12:28:46.795571+0000","last_unstale":"2023-10-14T12:28:51.905811+0000","last_undegraded":"2023-10-14T12:28:51.905811+0000","last_fullsized":"2023-10-14T12:28:51.905811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:48:29.280284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766935+0000","last_change":"2023-10-14T12:28:46.084244+0000","last_active":"2023-10-14T12:28:51.766935+0000","last_peered":"2023-10-14T12:28:51.766935+0000","last_clean":"2023-10-14T12:28:51.766935+0000","last_became_active":"2023-10-14T12:28:46.083772+0000","last_became_peered":"2023-10-14T12:28:46.083772+0000","last_unstale":"2023-10-14T12:28:51.766935+0000","last_undegraded":"2023-10-14T12:28:51.766935+0000","last_fullsized":"2023-10-14T12:28:51.766935+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:57:32.575699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.748760+0000","last_change":"2023-10-14T12:28:51.141542+0000","last_active":"2023-10-14T12:28:53.748760+0000","last_peered":"2023-10-14T12:28:53.748760+0000","last_clean":"2023-10-14T12:28:53.748760+0000","last_became_active":"2023-10-14T12:28:51.141066+0000","last_became_peered":"2023-10-14T12:28:51.141066+0000","last_unstale":"2023-10-14T12:28:53.748760+0000","last_undegraded":"2023-10-14T12:28:53.748760+0000","last_fullsized":"2023-10-14T12:28:53.748760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.902142+0000","last_change":"2023-10-14T12:28:46.799195+0000","last_active":"2023-10-14T12:28:51.902142+0000","last_peered":"2023-10-14T12:28:51.902142+0000","last_clean":"2023-10-14T12:28:51.902142+0000","last_became_active":"2023-10-14T12:28:46.798850+0000","last_became_peered":"2023-10-14T12:28:46.798850+0000","last_unstale":"2023-10-14T12:28:51.902142+0000","last_undegraded":"2023-10-14T12:28:51.902142+0000","last_fullsized":"2023-10-14T12:28:51.902142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140517+0000","last_change":"2023-10-14T12:28:46.074743+0000","last_active":"2023-10-14T12:28:52.140517+0000","last_peered":"2023-10-14T12:28:52.140517+0000","last_clean":"2023-10-14T12:28:52.140517+0000","last_became_active":"2023-10-14T12:28:46.074430+0000","last_became_peered":"2023-10-14T12:28:46.074430+0000","last_unstale":"2023-10-14T12:28:52.140517+0000","last_undegraded":"2023-10-14T12:28:52.140517+0000","last_fullsized":"2023-10-14T12:28:52.140517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:00:44.943766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410859+0000","last_change":"2023-10-14T12:28:51.147740+0000","last_active":"2023-10-14T12:28:54.410859+0000","last_peered":"2023-10-14T12:28:54.410859+0000","last_clean":"2023-10-14T12:28:54.410859+0000","last_became_active":"2023-10-14T12:28:51.147168+0000","last_became_peered":"2023-10-14T12:28:51.147168+0000","last_unstale":"2023-10-14T12:28:54.410859+0000","last_undegraded":"2023-10-14T12:28:54.410859+0000","last_fullsized":"2023-10-14T12:28:54.410859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:29:27.739547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763688+0000","last_change":"2023-10-14T12:28:46.796316+0000","last_active":"2023-10-14T12:28:51.763688+0000","last_peered":"2023-10-14T12:28:51.763688+0000","last_clean":"2023-10-14T12:28:51.763688+0000","last_became_active":"2023-10-14T12:28:46.795991+0000","last_became_peered":"2023-10-14T12:28:46.795991+0000","last_unstale":"2023-10-14T12:28:51.763688+0000","last_undegraded":"2023-10-14T12:28:51.763688+0000","last_fullsized":"2023-10-14T12:28:51.763688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763934+0000","last_change":"2023-10-14T12:28:46.078905+0000","last_active":"2023-10-14T12:28:51.763934+0000","last_peered":"2023-10-14T12:28:51.763934+0000","last_clean":"2023-10-14T12:28:51.763934+0000","last_became_active":"2023-10-14T12:28:46.078601+0000","last_became_peered":"2023-10-14T12:28:46.078601+0000","last_unstale":"2023-10-14T12:28:51.763934+0000","last_undegraded":"2023-10-14T12:28:51.763934+0000","last_fullsized":"2023-10-14T12:28:51.763934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:18:57.906243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767902+0000","last_change":"2023-10-14T12:28:51.912591+0000","last_active":"2023-10-14T12:28:52.767902+0000","last_peered":"2023-10-14T12:28:52.767902+0000","last_clean":"2023-10-14T12:28:52.767902+0000","last_became_active":"2023-10-14T12:28:51.911444+0000","last_became_peered":"2023-10-14T12:28:51.911444+0000","last_unstale":"2023-10-14T12:28:52.767902+0000","last_undegraded":"2023-10-14T12:28:52.767902+0000","last_fullsized":"2023-10-14T12:28:52.767902+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:45:01.865763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901725+0000","last_change":"2023-10-14T12:28:46.794280+0000","last_active":"2023-10-14T12:28:51.901725+0000","last_peered":"2023-10-14T12:28:51.901725+0000","last_clean":"2023-10-14T12:28:51.901725+0000","last_became_active":"2023-10-14T12:28:46.794011+0000","last_became_peered":"2023-10-14T12:28:46.794011+0000","last_unstale":"2023-10-14T12:28:51.901725+0000","last_undegraded":"2023-10-14T12:28:51.901725+0000","last_fullsized":"2023-10-14T12:28:51.901725+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:44.314576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921941+0000","last_change":"2023-10-14T12:28:46.087268+0000","last_active":"2023-10-14T12:28:51.921941+0000","last_peered":"2023-10-14T12:28:51.921941+0000","last_clean":"2023-10-14T12:28:51.921941+0000","last_became_active":"2023-10-14T12:28:46.086933+0000","last_became_peered":"2023-10-14T12:28:46.086933+0000","last_unstale":"2023-10-14T12:28:51.921941+0000","last_undegraded":"2023-10-14T12:28:51.921941+0000","last_fullsized":"2023-10-14T12:28:51.921941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:49.643084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.766946+0000","last_change":"2023-10-14T12:28:51.914988+0000","last_active":"2023-10-14T12:28:52.766946+0000","last_peered":"2023-10-14T12:28:52.766946+0000","last_clean":"2023-10-14T12:28:52.766946+0000","last_became_active":"2023-10-14T12:28:51.913882+0000","last_became_peered":"2023-10-14T12:28:51.913882+0000","last_unstale":"2023-10-14T12:28:52.766946+0000","last_undegraded":"2023-10-14T12:28:52.766946+0000","last_fullsized":"2023-10-14T12:28:52.766946+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:08:30.117146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908486+0000","last_change":"2023-10-14T12:28:46.788853+0000","last_active":"2023-10-14T12:28:51.908486+0000","last_peered":"2023-10-14T12:28:51.908486+0000","last_clean":"2023-10-14T12:28:51.908486+0000","last_became_active":"2023-10-14T12:28:46.788458+0000","last_became_peered":"2023-10-14T12:28:46.788458+0000","last_unstale":"2023-10-14T12:28:51.908486+0000","last_undegraded":"2023-10-14T12:28:51.908486+0000","last_fullsized":"2023-10-14T12:28:51.908486+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:34:10.344432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908891+0000","last_change":"2023-10-14T12:28:46.076853+0000","last_active":"2023-10-14T12:28:51.908891+0000","last_peered":"2023-10-14T12:28:51.908891+0000","last_clean":"2023-10-14T12:28:51.908891+0000","last_became_active":"2023-10-14T12:28:46.076541+0000","last_became_peered":"2023-10-14T12:28:46.076541+0000","last_unstale":"2023-10-14T12:28:51.908891+0000","last_undegraded":"2023-10-14T12:28:51.908891+0000","last_fullsized":"2023-10-14T12:28:51.908891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:26:17.061278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769108+0000","last_change":"2023-10-14T12:28:51.920296+0000","last_active":"2023-10-14T12:28:52.769108+0000","last_peered":"2023-10-14T12:28:52.769108+0000","last_clean":"2023-10-14T12:28:52.769108+0000","last_became_active":"2023-10-14T12:28:51.917580+0000","last_became_peered":"2023-10-14T12:28:51.917580+0000","last_unstale":"2023-10-14T12:28:52.769108+0000","last_undegraded":"2023-10-14T12:28:52.769108+0000","last_fullsized":"2023-10-14T12:28:52.769108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.903467+0000","last_change":"2023-10-14T12:28:46.801997+0000","last_active":"2023-10-14T12:28:51.903467+0000","last_peered":"2023-10-14T12:28:51.903467+0000","last_clean":"2023-10-14T12:28:51.903467+0000","last_became_active":"2023-10-14T12:28:46.801720+0000","last_became_peered":"2023-10-14T12:28:46.801720+0000","last_unstale":"2023-10-14T12:28:51.903467+0000","last_undegraded":"2023-10-14T12:28:51.903467+0000","last_fullsized":"2023-10-14T12:28:51.903467+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:16:17.677282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'11","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:29:05.089296+0000","last_change":"2023-10-14T12:28:46.076997+0000","last_active":"2023-10-14T12:29:05.089296+0000","last_peered":"2023-10-14T12:29:05.089296+0000","last_clean":"2023-10-14T12:29:05.089296+0000","last_became_active":"2023-10-14T12:28:46.076345+0000","last_became_peered":"2023-10-14T12:28:46.076345+0000","last_unstale":"2023-10-14T12:29:05.089296+0000","last_undegraded":"2023-10-14T12:29:05.089296+0000","last_fullsized":"2023-10-14T12:29:05.089296+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.549272+0000","last_change":"2023-10-14T12:28:51.138516+0000","last_active":"2023-10-14T12:28:54.549272+0000","last_peered":"2023-10-14T12:28:54.549272+0000","last_clean":"2023-10-14T12:28:54.549272+0000","last_became_active":"2023-10-14T12:28:51.137516+0000","last_became_peered":"2023-10-14T12:28:51.137516+0000","last_unstale":"2023-10-14T12:28:54.549272+0000","last_undegraded":"2023-10-14T12:28:54.549272+0000","last_fullsized":"2023-10-14T12:28:54.549272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:03:48.361446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767066+0000","last_change":"2023-10-14T12:28:46.792271+0000","last_active":"2023-10-14T12:28:51.767066+0000","last_peered":"2023-10-14T12:28:51.767066+0000","last_clean":"2023-10-14T12:28:51.767066+0000","last_became_active":"2023-10-14T12:28:46.789471+0000","last_became_peered":"2023-10-14T12:28:46.789471+0000","last_unstale":"2023-10-14T12:28:51.767066+0000","last_undegraded":"2023-10-14T12:28:51.767066+0000","last_fullsized":"2023-10-14T12:28:51.767066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:36.235202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.921217+0000","last_change":"2023-10-14T12:28:46.088735+0000","last_active":"2023-10-14T12:28:51.921217+0000","last_peered":"2023-10-14T12:28:51.921217+0000","last_clean":"2023-10-14T12:28:51.921217+0000","last_became_active":"2023-10-14T12:28:46.088457+0000","last_became_peered":"2023-10-14T12:28:46.088457+0000","last_unstale":"2023-10-14T12:28:51.921217+0000","last_undegraded":"2023-10-14T12:28:51.921217+0000","last_fullsized":"2023-10-14T12:28:51.921217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:34.747574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:53.749567+0000","last_change":"2023-10-14T12:28:51.139023+0000","last_active":"2023-10-14T12:28:53.749567+0000","last_peered":"2023-10-14T12:28:53.749567+0000","last_clean":"2023-10-14T12:28:53.749567+0000","last_became_active":"2023-10-14T12:28:51.138588+0000","last_became_peered":"2023-10-14T12:28:51.138588+0000","last_unstale":"2023-10-14T12:28:53.749567+0000","last_undegraded":"2023-10-14T12:28:53.749567+0000","last_fullsized":"2023-10-14T12:28:53.749567+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:31:54.454504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.909074+0000","last_change":"2023-10-14T12:28:46.795155+0000","last_active":"2023-10-14T12:28:51.909074+0000","last_peered":"2023-10-14T12:28:51.909074+0000","last_clean":"2023-10-14T12:28:51.909074+0000","last_became_active":"2023-10-14T12:28:46.794637+0000","last_became_peered":"2023-10-14T12:28:46.794637+0000","last_unstale":"2023-10-14T12:28:51.909074+0000","last_undegraded":"2023-10-14T12:28:51.909074+0000","last_fullsized":"2023-10-14T12:28:51.909074+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:28.917771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.086906+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.078677+0000","last_became_peered":"2023-10-14T12:28:46.078677+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765685+0000","last_change":"2023-10-14T12:28:51.150961+0000","last_active":"2023-10-14T12:28:52.765685+0000","last_peered":"2023-10-14T12:28:52.765685+0000","last_clean":"2023-10-14T12:28:52.765685+0000","last_became_active":"2023-10-14T12:28:51.147298+0000","last_became_peered":"2023-10-14T12:28:51.147298+0000","last_unstale":"2023-10-14T12:28:52.765685+0000","last_undegraded":"2023-10-14T12:28:52.765685+0000","last_fullsized":"2023-10-14T12:28:52.765685+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:23:44.659889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922854+0000","last_change":"2023-10-14T12:28:46.791198+0000","last_active":"2023-10-14T12:28:51.922854+0000","last_peered":"2023-10-14T12:28:51.922854+0000","last_clean":"2023-10-14T12:28:51.922854+0000","last_became_active":"2023-10-14T12:28:46.790867+0000","last_became_peered":"2023-10-14T12:28:46.790867+0000","last_unstale":"2023-10-14T12:28:51.922854+0000","last_undegraded":"2023-10-14T12:28:51.922854+0000","last_fullsized":"2023-10-14T12:28:51.922854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.766297+0000","last_change":"2023-10-14T12:28:46.082839+0000","last_active":"2023-10-14T12:28:51.766297+0000","last_peered":"2023-10-14T12:28:51.766297+0000","last_clean":"2023-10-14T12:28:51.766297+0000","last_became_active":"2023-10-14T12:28:46.082602+0000","last_became_peered":"2023-10-14T12:28:46.082602+0000","last_unstale":"2023-10-14T12:28:51.766297+0000","last_undegraded":"2023-10-14T12:28:51.766297+0000","last_fullsized":"2023-10-14T12:28:51.766297+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:55:50.177915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.765534+0000","last_change":"2023-10-14T12:28:51.907147+0000","last_active":"2023-10-14T12:28:52.765534+0000","last_peered":"2023-10-14T12:28:52.765534+0000","last_clean":"2023-10-14T12:28:52.765534+0000","last_became_active":"2023-10-14T12:28:51.905096+0000","last_became_peered":"2023-10-14T12:28:51.905096+0000","last_unstale":"2023-10-14T12:28:52.765534+0000","last_undegraded":"2023-10-14T12:28:52.765534+0000","last_fullsized":"2023-10-14T12:28:52.765534+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:11:29.019252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.410456+0000","last_change":"2023-10-14T12:28:51.924721+0000","last_active":"2023-10-14T12:28:54.410456+0000","last_peered":"2023-10-14T12:28:54.410456+0000","last_clean":"2023-10-14T12:28:54.410456+0000","last_became_active":"2023-10-14T12:28:51.922270+0000","last_became_peered":"2023-10-14T12:28:51.922270+0000","last_unstale":"2023-10-14T12:28:54.410456+0000","last_undegraded":"2023-10-14T12:28:54.410456+0000","last_fullsized":"2023-10-14T12:28:54.410456+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:49:45.274534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.916174+0000","last_change":"2023-10-14T12:28:46.787783+0000","last_active":"2023-10-14T12:28:51.916174+0000","last_peered":"2023-10-14T12:28:51.916174+0000","last_clean":"2023-10-14T12:28:51.916174+0000","last_became_active":"2023-10-14T12:28:46.787485+0000","last_became_peered":"2023-10-14T12:28:46.787485+0000","last_unstale":"2023-10-14T12:28:51.916174+0000","last_undegraded":"2023-10-14T12:28:51.916174+0000","last_fullsized":"2023-10-14T12:28:51.916174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:02.373831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919246+0000","last_change":"2023-10-14T12:28:46.081339+0000","last_active":"2023-10-14T12:28:51.919246+0000","last_peered":"2023-10-14T12:28:51.919246+0000","last_clean":"2023-10-14T12:28:51.919246+0000","last_became_active":"2023-10-14T12:28:46.080996+0000","last_became_peered":"2023-10-14T12:28:46.080996+0000","last_unstale":"2023-10-14T12:28:51.919246+0000","last_undegraded":"2023-10-14T12:28:51.919246+0000","last_fullsized":"2023-10-14T12:28:51.919246+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:02.408244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.769101+0000","last_change":"2023-10-14T12:28:51.140428+0000","last_active":"2023-10-14T12:28:52.769101+0000","last_peered":"2023-10-14T12:28:52.769101+0000","last_clean":"2023-10-14T12:28:52.769101+0000","last_became_active":"2023-10-14T12:28:51.139878+0000","last_became_peered":"2023-10-14T12:28:51.139878+0000","last_unstale":"2023-10-14T12:28:52.769101+0000","last_undegraded":"2023-10-14T12:28:52.769101+0000","last_fullsized":"2023-10-14T12:28:52.769101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:02:48.364603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761342+0000","last_change":"2023-10-14T12:28:46.796221+0000","last_active":"2023-10-14T12:28:51.761342+0000","last_peered":"2023-10-14T12:28:51.761342+0000","last_clean":"2023-10-14T12:28:51.761342+0000","last_became_active":"2023-10-14T12:28:46.795708+0000","last_became_peered":"2023-10-14T12:28:46.795708+0000","last_unstale":"2023-10-14T12:28:51.761342+0000","last_undegraded":"2023-10-14T12:28:51.761342+0000","last_fullsized":"2023-10-14T12:28:51.761342+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:14:51.130712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763958+0000","last_change":"2023-10-14T12:28:46.079635+0000","last_active":"2023-10-14T12:28:51.763958+0000","last_peered":"2023-10-14T12:28:51.763958+0000","last_clean":"2023-10-14T12:28:51.763958+0000","last_became_active":"2023-10-14T12:28:46.079237+0000","last_became_peered":"2023-10-14T12:28:46.079237+0000","last_unstale":"2023-10-14T12:28:51.763958+0000","last_undegraded":"2023-10-14T12:28:51.763958+0000","last_fullsized":"2023-10-14T12:28:51.763958+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:16:33.617207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.764406+0000","last_change":"2023-10-14T12:28:46.082807+0000","last_active":"2023-10-14T12:28:51.764406+0000","last_peered":"2023-10-14T12:28:51.764406+0000","last_clean":"2023-10-14T12:28:51.764406+0000","last_became_active":"2023-10-14T12:28:46.082446+0000","last_became_peered":"2023-10-14T12:28:46.082446+0000","last_unstale":"2023-10-14T12:28:51.764406+0000","last_undegraded":"2023-10-14T12:28:51.764406+0000","last_fullsized":"2023-10-14T12:28:51.764406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:25.200015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908770+0000","last_change":"2023-10-14T12:28:46.789200+0000","last_active":"2023-10-14T12:28:51.908770+0000","last_peered":"2023-10-14T12:28:51.908770+0000","last_clean":"2023-10-14T12:28:51.908770+0000","last_became_active":"2023-10-14T12:28:46.788290+0000","last_became_peered":"2023-10-14T12:28:46.788290+0000","last_unstale":"2023-10-14T12:28:51.908770+0000","last_undegraded":"2023-10-14T12:28:51.908770+0000","last_fullsized":"2023-10-14T12:28:51.908770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:53:29.931329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:54.405050+0000","last_change":"2023-10-14T12:28:51.139776+0000","last_active":"2023-10-14T12:28:54.405050+0000","last_peered":"2023-10-14T12:28:54.405050+0000","last_clean":"2023-10-14T12:28:54.405050+0000","last_became_active":"2023-10-14T12:28:51.139357+0000","last_became_peered":"2023-10-14T12:28:51.139357+0000","last_unstale":"2023-10-14T12:28:54.405050+0000","last_undegraded":"2023-10-14T12:28:54.405050+0000","last_fullsized":"2023-10-14T12:28:54.405050+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:08:32.967798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762275+0000","last_change":"2023-10-14T12:28:46.080941+0000","last_active":"2023-10-14T12:28:51.762275+0000","last_peered":"2023-10-14T12:28:51.762275+0000","last_clean":"2023-10-14T12:28:51.762275+0000","last_became_active":"2023-10-14T12:28:46.080441+0000","last_became_peered":"2023-10-14T12:28:46.080441+0000","last_unstale":"2023-10-14T12:28:51.762275+0000","last_undegraded":"2023-10-14T12:28:51.762275+0000","last_fullsized":"2023-10-14T12:28:51.762275+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:44.542189+0000","last_clean_scrub_stamp":"2023-10-14T12:28:44.542189+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:47:24.759750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765820+0000","last_change":"2023-10-14T12:28:46.783353+0000","last_active":"2023-10-14T12:28:51.765820+0000","last_peered":"2023-10-14T12:28:51.765820+0000","last_clean":"2023-10-14T12:28:51.765820+0000","last_became_active":"2023-10-14T12:28:46.780547+0000","last_became_peered":"2023-10-14T12:28:46.780547+0000","last_unstale":"2023-10-14T12:28:51.765820+0000","last_undegraded":"2023-10-14T12:28:51.765820+0000","last_fullsized":"2023-10-14T12:28:51.765820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:54:40.312389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.767132+0000","last_change":"2023-10-14T12:28:51.148240+0000","last_active":"2023-10-14T12:28:52.767132+0000","last_peered":"2023-10-14T12:28:52.767132+0000","last_clean":"2023-10-14T12:28:52.767132+0000","last_became_active":"2023-10-14T12:28:51.147866+0000","last_became_peered":"2023-10-14T12:28:51.147866+0000","last_unstale":"2023-10-14T12:28:52.767132+0000","last_undegraded":"2023-10-14T12:28:52.767132+0000","last_fullsized":"2023-10-14T12:28:52.767132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:50.079843+0000","last_clean_scrub_stamp":"2023-10-14T12:28:50.079843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:13:58.023924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763203+0000","last_change":"2023-10-14T12:28:46.796117+0000","last_active":"2023-10-14T12:28:51.763203+0000","last_peered":"2023-10-14T12:28:51.763203+0000","last_clean":"2023-10-14T12:28:51.763203+0000","last_became_active":"2023-10-14T12:28:46.795584+0000","last_became_peered":"2023-10-14T12:28:46.795584+0000","last_unstale":"2023-10-14T12:28:51.763203+0000","last_undegraded":"2023-10-14T12:28:51.763203+0000","last_fullsized":"2023-10-14T12:28:51.763203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.140779+0000","last_change":"2023-10-14T12:28:46.792780+0000","last_active":"2023-10-14T12:28:52.140779+0000","last_peered":"2023-10-14T12:28:52.140779+0000","last_clean":"2023-10-14T12:28:52.140779+0000","last_became_active":"2023-10-14T12:28:46.792468+0000","last_became_peered":"2023-10-14T12:28:46.792468+0000","last_unstale":"2023-10-14T12:28:52.140779+0000","last_undegraded":"2023-10-14T12:28:52.140779+0000","last_fullsized":"2023-10-14T12:28:52.140779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:12:50.924147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919258+0000","last_change":"2023-10-14T12:28:46.800621+0000","last_active":"2023-10-14T12:28:51.919258+0000","last_peered":"2023-10-14T12:28:51.919258+0000","last_clean":"2023-10-14T12:28:51.919258+0000","last_became_active":"2023-10-14T12:28:46.800259+0000","last_became_peered":"2023-10-14T12:28:46.800259+0000","last_unstale":"2023-10-14T12:28:51.919258+0000","last_undegraded":"2023-10-14T12:28:51.919258+0000","last_fullsized":"2023-10-14T12:28:51.919258+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908609+0000","last_change":"2023-10-14T12:28:46.798651+0000","last_active":"2023-10-14T12:28:51.908609+0000","last_peered":"2023-10-14T12:28:51.908609+0000","last_clean":"2023-10-14T12:28:51.908609+0000","last_became_active":"2023-10-14T12:28:46.798154+0000","last_became_peered":"2023-10-14T12:28:46.798154+0000","last_unstale":"2023-10-14T12:28:51.908609+0000","last_undegraded":"2023-10-14T12:28:51.908609+0000","last_fullsized":"2023-10-14T12:28:51.908609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:24:51.310465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.762274+0000","last_change":"2023-10-14T12:28:46.800534+0000","last_active":"2023-10-14T12:28:51.762274+0000","last_peered":"2023-10-14T12:28:51.762274+0000","last_clean":"2023-10-14T12:28:51.762274+0000","last_became_active":"2023-10-14T12:28:46.800209+0000","last_became_peered":"2023-10-14T12:28:46.800209+0000","last_unstale":"2023-10-14T12:28:51.762274+0000","last_undegraded":"2023-10-14T12:28:51.762274+0000","last_fullsized":"2023-10-14T12:28:51.762274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920892+0000","last_change":"2023-10-14T12:28:46.801224+0000","last_active":"2023-10-14T12:28:51.920892+0000","last_peered":"2023-10-14T12:28:51.920892+0000","last_clean":"2023-10-14T12:28:51.920892+0000","last_became_active":"2023-10-14T12:28:46.799754+0000","last_became_peered":"2023-10-14T12:28:46.799754+0000","last_unstale":"2023-10-14T12:28:51.920892+0000","last_undegraded":"2023-10-14T12:28:51.920892+0000","last_fullsized":"2023-10-14T12:28:51.920892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765879+0000","last_change":"2023-10-14T12:28:46.789306+0000","last_active":"2023-10-14T12:28:51.765879+0000","last_peered":"2023-10-14T12:28:51.765879+0000","last_clean":"2023-10-14T12:28:51.765879+0000","last_became_active":"2023-10-14T12:28:46.788994+0000","last_became_peered":"2023-10-14T12:28:46.788994+0000","last_unstale":"2023-10-14T12:28:51.765879+0000","last_undegraded":"2023-10-14T12:28:51.765879+0000","last_fullsized":"2023-10-14T12:28:51.765879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763488+0000","last_change":"2023-10-14T12:28:46.800979+0000","last_active":"2023-10-14T12:28:51.763488+0000","last_peered":"2023-10-14T12:28:51.763488+0000","last_clean":"2023-10-14T12:28:51.763488+0000","last_became_active":"2023-10-14T12:28:46.800583+0000","last_became_peered":"2023-10-14T12:28:46.800583+0000","last_unstale":"2023-10-14T12:28:51.763488+0000","last_undegraded":"2023-10-14T12:28:51.763488+0000","last_fullsized":"2023-10-14T12:28:51.763488+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919108+0000","last_change":"2023-10-14T12:28:46.804560+0000","last_active":"2023-10-14T12:28:51.919108+0000","last_peered":"2023-10-14T12:28:51.919108+0000","last_clean":"2023-10-14T12:28:51.919108+0000","last_became_active":"2023-10-14T12:28:46.804313+0000","last_became_peered":"2023-10-14T12:28:46.804313+0000","last_unstale":"2023-10-14T12:28:51.919108+0000","last_undegraded":"2023-10-14T12:28:51.919108+0000","last_fullsized":"2023-10-14T12:28:51.919108+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.763776+0000","last_change":"2023-10-14T12:28:46.787411+0000","last_active":"2023-10-14T12:28:51.763776+0000","last_peered":"2023-10-14T12:28:51.763776+0000","last_clean":"2023-10-14T12:28:51.763776+0000","last_became_active":"2023-10-14T12:28:46.787097+0000","last_became_peered":"2023-10-14T12:28:46.787097+0000","last_unstale":"2023-10-14T12:28:51.763776+0000","last_undegraded":"2023-10-14T12:28:51.763776+0000","last_fullsized":"2023-10-14T12:28:51.763776+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919180+0000","last_change":"2023-10-14T12:28:46.797642+0000","last_active":"2023-10-14T12:28:51.919180+0000","last_peered":"2023-10-14T12:28:51.919180+0000","last_clean":"2023-10-14T12:28:51.919180+0000","last_became_active":"2023-10-14T12:28:46.795817+0000","last_became_peered":"2023-10-14T12:28:46.795817+0000","last_unstale":"2023-10-14T12:28:51.919180+0000","last_undegraded":"2023-10-14T12:28:51.919180+0000","last_fullsized":"2023-10-14T12:28:51.919180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:17:12.195002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908111+0000","last_change":"2023-10-14T12:28:46.795955+0000","last_active":"2023-10-14T12:28:51.908111+0000","last_peered":"2023-10-14T12:28:51.908111+0000","last_clean":"2023-10-14T12:28:51.908111+0000","last_became_active":"2023-10-14T12:28:46.795662+0000","last_became_peered":"2023-10-14T12:28:46.795662+0000","last_unstale":"2023-10-14T12:28:51.908111+0000","last_undegraded":"2023-10-14T12:28:51.908111+0000","last_fullsized":"2023-10-14T12:28:51.908111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:24:25.092145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765436+0000","last_change":"2023-10-14T12:28:46.790373+0000","last_active":"2023-10-14T12:28:51.765436+0000","last_peered":"2023-10-14T12:28:51.765436+0000","last_clean":"2023-10-14T12:28:51.765436+0000","last_became_active":"2023-10-14T12:28:46.787302+0000","last_became_peered":"2023-10-14T12:28:46.787302+0000","last_unstale":"2023-10-14T12:28:51.765436+0000","last_undegraded":"2023-10-14T12:28:51.765436+0000","last_fullsized":"2023-10-14T12:28:51.765436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:54:03.895872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.906592+0000","last_change":"2023-10-14T12:28:46.795080+0000","last_active":"2023-10-14T12:28:51.906592+0000","last_peered":"2023-10-14T12:28:51.906592+0000","last_clean":"2023-10-14T12:28:51.906592+0000","last_became_active":"2023-10-14T12:28:46.793929+0000","last_became_peered":"2023-10-14T12:28:46.793929+0000","last_unstale":"2023-10-14T12:28:51.906592+0000","last_undegraded":"2023-10-14T12:28:51.906592+0000","last_fullsized":"2023-10-14T12:28:51.906592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:26:37.233132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:52.141500+0000","last_change":"2023-10-14T12:28:46.792079+0000","last_active":"2023-10-14T12:28:52.141500+0000","last_peered":"2023-10-14T12:28:52.141500+0000","last_clean":"2023-10-14T12:28:52.141500+0000","last_became_active":"2023-10-14T12:28:46.791050+0000","last_became_peered":"2023-10-14T12:28:46.791050+0000","last_unstale":"2023-10-14T12:28:52.141500+0000","last_undegraded":"2023-10-14T12:28:52.141500+0000","last_fullsized":"2023-10-14T12:28:52.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:40:09.407054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.923007+0000","last_change":"2023-10-14T12:28:46.792801+0000","last_active":"2023-10-14T12:28:51.923007+0000","last_peered":"2023-10-14T12:28:51.923007+0000","last_clean":"2023-10-14T12:28:51.923007+0000","last_became_active":"2023-10-14T12:28:46.792421+0000","last_became_peered":"2023-10-14T12:28:46.792421+0000","last_unstale":"2023-10-14T12:28:51.923007+0000","last_undegraded":"2023-10-14T12:28:51.923007+0000","last_fullsized":"2023-10-14T12:28:51.923007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922455+0000","last_change":"2023-10-14T12:28:46.792599+0000","last_active":"2023-10-14T12:28:51.922455+0000","last_peered":"2023-10-14T12:28:51.922455+0000","last_clean":"2023-10-14T12:28:51.922455+0000","last_became_active":"2023-10-14T12:28:46.792327+0000","last_became_peered":"2023-10-14T12:28:46.792327+0000","last_unstale":"2023-10-14T12:28:51.922455+0000","last_undegraded":"2023-10-14T12:28:51.922455+0000","last_fullsized":"2023-10-14T12:28:51.922455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:22:20.149536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.917660+0000","last_change":"2023-10-14T12:28:46.781418+0000","last_active":"2023-10-14T12:28:51.917660+0000","last_peered":"2023-10-14T12:28:51.917660+0000","last_clean":"2023-10-14T12:28:51.917660+0000","last_became_active":"2023-10-14T12:28:46.781029+0000","last_became_peered":"2023-10-14T12:28:46.781029+0000","last_unstale":"2023-10-14T12:28:51.917660+0000","last_undegraded":"2023-10-14T12:28:51.917660+0000","last_fullsized":"2023-10-14T12:28:51.917660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.908191+0000","last_change":"2023-10-14T12:28:46.789406+0000","last_active":"2023-10-14T12:28:51.908191+0000","last_peered":"2023-10-14T12:28:51.908191+0000","last_clean":"2023-10-14T12:28:51.908191+0000","last_became_active":"2023-10-14T12:28:46.788816+0000","last_became_peered":"2023-10-14T12:28:46.788816+0000","last_unstale":"2023-10-14T12:28:51.908191+0000","last_undegraded":"2023-10-14T12:28:51.908191+0000","last_fullsized":"2023-10-14T12:28:51.908191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:06:51.781330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761766+0000","last_change":"2023-10-14T12:28:46.796885+0000","last_active":"2023-10-14T12:28:51.761766+0000","last_peered":"2023-10-14T12:28:51.761766+0000","last_clean":"2023-10-14T12:28:51.761766+0000","last_became_active":"2023-10-14T12:28:46.796301+0000","last_became_peered":"2023-10-14T12:28:46.796301+0000","last_unstale":"2023-10-14T12:28:51.761766+0000","last_undegraded":"2023-10-14T12:28:51.761766+0000","last_fullsized":"2023-10-14T12:28:51.761766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.767000+0000","last_change":"2023-10-14T12:28:46.777441+0000","last_active":"2023-10-14T12:28:51.767000+0000","last_peered":"2023-10-14T12:28:51.767000+0000","last_clean":"2023-10-14T12:28:51.767000+0000","last_became_active":"2023-10-14T12:28:46.776829+0000","last_became_peered":"2023-10-14T12:28:46.776829+0000","last_unstale":"2023-10-14T12:28:51.767000+0000","last_undegraded":"2023-10-14T12:28:51.767000+0000","last_fullsized":"2023-10-14T12:28:51.767000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:36:26.687643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765557+0000","last_change":"2023-10-14T12:28:46.797878+0000","last_active":"2023-10-14T12:28:51.765557+0000","last_peered":"2023-10-14T12:28:51.765557+0000","last_clean":"2023-10-14T12:28:51.765557+0000","last_became_active":"2023-10-14T12:28:46.796270+0000","last_became_peered":"2023-10-14T12:28:46.796270+0000","last_unstale":"2023-10-14T12:28:51.765557+0000","last_undegraded":"2023-10-14T12:28:51.765557+0000","last_fullsized":"2023-10-14T12:28:51.765557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.765711+0000","last_change":"2023-10-14T12:28:46.789943+0000","last_active":"2023-10-14T12:28:51.765711+0000","last_peered":"2023-10-14T12:28:51.765711+0000","last_clean":"2023-10-14T12:28:51.765711+0000","last_became_active":"2023-10-14T12:28:46.789674+0000","last_became_peered":"2023-10-14T12:28:46.789674+0000","last_unstale":"2023-10-14T12:28:51.765711+0000","last_undegraded":"2023-10-14T12:28:51.765711+0000","last_fullsized":"2023-10-14T12:28:51.765711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:18:35.647022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.905479+0000","last_change":"2023-10-14T12:28:46.803906+0000","last_active":"2023-10-14T12:28:51.905479+0000","last_peered":"2023-10-14T12:28:51.905479+0000","last_clean":"2023-10-14T12:28:51.905479+0000","last_became_active":"2023-10-14T12:28:46.803546+0000","last_became_peered":"2023-10-14T12:28:46.803546+0000","last_unstale":"2023-10-14T12:28:51.905479+0000","last_undegraded":"2023-10-14T12:28:51.905479+0000","last_fullsized":"2023-10-14T12:28:51.905479+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:05:56.121924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.761095+0000","last_change":"2023-10-14T12:28:46.797087+0000","last_active":"2023-10-14T12:28:51.761095+0000","last_peered":"2023-10-14T12:28:51.761095+0000","last_clean":"2023-10-14T12:28:51.761095+0000","last_became_active":"2023-10-14T12:28:46.796131+0000","last_became_peered":"2023-10-14T12:28:46.796131+0000","last_unstale":"2023-10-14T12:28:51.761095+0000","last_undegraded":"2023-10-14T12:28:51.761095+0000","last_fullsized":"2023-10-14T12:28:51.761095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:16:19.111100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901832+0000","last_change":"2023-10-14T12:28:46.796853+0000","last_active":"2023-10-14T12:28:51.901832+0000","last_peered":"2023-10-14T12:28:51.901832+0000","last_clean":"2023-10-14T12:28:51.901832+0000","last_became_active":"2023-10-14T12:28:46.796587+0000","last_became_peered":"2023-10-14T12:28:46.796587+0000","last_unstale":"2023-10-14T12:28:51.901832+0000","last_undegraded":"2023-10-14T12:28:51.901832+0000","last_fullsized":"2023-10-14T12:28:51.901832+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:05:30.090252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.919066+0000","last_change":"2023-10-14T12:28:46.791836+0000","last_active":"2023-10-14T12:28:51.919066+0000","last_peered":"2023-10-14T12:28:51.919066+0000","last_clean":"2023-10-14T12:28:51.919066+0000","last_became_active":"2023-10-14T12:28:46.791576+0000","last_became_peered":"2023-10-14T12:28:46.791576+0000","last_unstale":"2023-10-14T12:28:51.919066+0000","last_undegraded":"2023-10-14T12:28:51.919066+0000","last_fullsized":"2023-10-14T12:28:51.919066+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:16:24.496998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.901570+0000","last_change":"2023-10-14T12:28:46.794780+0000","last_active":"2023-10-14T12:28:51.901570+0000","last_peered":"2023-10-14T12:28:51.901570+0000","last_clean":"2023-10-14T12:28:51.901570+0000","last_became_active":"2023-10-14T12:28:46.794505+0000","last_became_peered":"2023-10-14T12:28:46.794505+0000","last_unstale":"2023-10-14T12:28:51.901570+0000","last_undegraded":"2023-10-14T12:28:51.901570+0000","last_fullsized":"2023-10-14T12:28:51.901570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:33:39.051185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.922495+0000","last_change":"2023-10-14T12:28:46.803988+0000","last_active":"2023-10-14T12:28:51.922495+0000","last_peered":"2023-10-14T12:28:51.922495+0000","last_clean":"2023-10-14T12:28:51.922495+0000","last_became_active":"2023-10-14T12:28:46.803738+0000","last_became_peered":"2023-10-14T12:28:46.803738+0000","last_unstale":"2023-10-14T12:28:51.922495+0000","last_undegraded":"2023-10-14T12:28:51.922495+0000","last_fullsized":"2023-10-14T12:28:51.922495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:09:23.607661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.907759+0000","last_change":"2023-10-14T12:28:46.794216+0000","last_active":"2023-10-14T12:28:51.907759+0000","last_peered":"2023-10-14T12:28:51.907759+0000","last_clean":"2023-10-14T12:28:51.907759+0000","last_became_active":"2023-10-14T12:28:46.792243+0000","last_became_peered":"2023-10-14T12:28:46.792243+0000","last_unstale":"2023-10-14T12:28:51.907759+0000","last_undegraded":"2023-10-14T12:28:51.907759+0000","last_fullsized":"2023-10-14T12:28:51.907759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:39:12.370839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.920339+0000","last_change":"2023-10-14T12:28:46.792759+0000","last_active":"2023-10-14T12:28:51.920339+0000","last_peered":"2023-10-14T12:28:51.920339+0000","last_clean":"2023-10-14T12:28:51.920339+0000","last_became_active":"2023-10-14T12:28:46.791814+0000","last_became_peered":"2023-10-14T12:28:46.791814+0000","last_unstale":"2023-10-14T12:28:51.920339+0000","last_undegraded":"2023-10-14T12:28:51.920339+0000","last_fullsized":"2023-10-14T12:28:51.920339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:45:09.552298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-10-14T12:28:51.904779+0000","last_change":"2023-10-14T12:28:46.791353+0000","last_active":"2023-10-14T12:28:51.904779+0000","last_peered":"2023-10-14T12:28:51.904779+0000","last_clean":"2023-10-14T12:28:51.904779+0000","last_became_active":"2023-10-14T12:28:46.791059+0000","last_became_peered":"2023-10-14T12:28:46.791059+0000","last_unstale":"2023-10-14T12:28:51.904779+0000","last_undegraded":"2023-10-14T12:28:51.904779+0000","last_fullsized":"2023-10-14T12:28:51.904779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:46.029816+0000","last_clean_scrub_stamp":"2023-10-14T12:28:46.029816+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:34:56.277909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":884736,"data_stored":705687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71099999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.698}]}]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":114827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.226}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91600000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.177}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":114863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.095}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2450000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.55}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":118578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.103}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5820000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.238}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":114737,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":114897,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2769999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.395}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6539999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542152,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":705743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.141}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0390000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.681}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:29:15.651 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T12:29:15.651 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-14T12:29:15.651 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-14T12:29:15.652 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-14T12:29:15.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.910+0000 7f14c7fff640 1 Processor -- start 2023-10-14T12:29:15.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.910+0000 7f14c7fff640 1 -- start start 2023-10-14T12:29:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c7fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f14c8070400 0x7f14c815e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f14c80c8930 0x7f14c80707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80cacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c7fff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80c8e40 con 0x7f14c8070400 2023-10-14T12:29:15.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c7fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14c80c9090 con 0x7f14c80c8930 2023-10-14T12:29:15.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c7fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80c9370 con 0x7f14c80ca640 2023-10-14T12:29:15.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c6ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f14c8070400 0x7f14c815e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c6ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f14c8070400 0x7f14c815e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51404/0 (socket says 172.21.15.64:51404) 2023-10-14T12:29:15.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1688388959 learned_addr learned my addr 172.21.15.64:0/1688388959 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:15.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.912+0000 7f14c67fc640 1 --2- 172.21.15.64:0/1688388959 >> v2:172.21.15.177:3300/0 conn(0x7f14c80c8930 0x7f14c80707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c77fe640 1 --2- 172.21.15.64:0/1688388959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80cacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1688388959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 msgr2=0x7f14c80cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c6ffd640 1 --2- 172.21.15.64:0/1688388959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80cacf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1688388959 >> v2:172.21.15.177:3300/0 conn(0x7f14c80c8930 msgr2=0x7f14c80707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:15.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c6ffd640 1 --2- 172.21.15.64:0/1688388959 >> v2:172.21.15.177:3300/0 conn(0x7f14c80c8930 0x7f14c80707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1688388959 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c80c9650 con 0x7f14c8070400 2023-10-14T12:29:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c77fe640 1 --2- 172.21.15.64:0/1688388959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.913+0000 7f14c67fc640 1 --2- 172.21.15.64:0/1688388959 >> v2:172.21.15.177:3300/0 conn(0x7f14c80c8930 0x7f14c80707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.914+0000 7f14c6ffd640 1 --2- 172.21.15.64:0/1688388959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c815e210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14c80cb8d0 tx=0x7f14b802b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fb29bf20f6e8dc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:15.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.914+0000 7f14c5ffb640 1 -- 172.21.15.64:0/1688388959 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b80317f0 con 0x7f14c8070400 2023-10-14T12:29:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.914+0000 7f14c5ffb640 1 -- 172.21.15.64:0/1688388959 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8031950 con 0x7f14c8070400 2023-10-14T12:29:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.914+0000 7f14c5ffb640 1 -- 172.21.15.64:0/1688388959 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8031ce0 con 0x7f14c8070400 2023-10-14T12:29:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 -- 172.21.15.64:0/1688388959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 msgr2=0x7f14c815e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.919 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1688388959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c815e210 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14c80cb8d0 tx=0x7f14b802b890 comp rx=0 tx=0).stop 2023-10-14T12:29:15.921 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 -- 172.21.15.64:0/1688388959 shutdown_connections 2023-10-14T12:29:15.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1688388959 >> v2:172.21.15.177:3300/0 conn(0x7f14c80c8930 0x7f14c80707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1688388959 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80cacf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1688388959 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c815e210 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 -- 172.21.15.64:0/1688388959 >> 172.21.15.64:0/1688388959 conn(0x7f14c806a470 msgr2=0x7f14c80afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 -- 172.21.15.64:0/1688388959 shutdown_connections 2023-10-14T12:29:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.915+0000 7f14c7fff640 1 -- 172.21.15.64:0/1688388959 wait complete. 2023-10-14T12:29:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.917+0000 7f14c7fff640 1 Processor -- start 2023-10-14T12:29:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.917+0000 7f14c7fff640 1 -- start start 2023-10-14T12:29:15.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c8154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80c8930 0x7f14c815e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c7fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80c7f10 con 0x7f14c8070400 2023-10-14T12:29:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c7fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14c8154db0 con 0x7f14c80c8930 2023-10-14T12:29:15.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c7fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14c80b1f80 con 0x7f14c80ca640 2023-10-14T12:29:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c8154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c8154870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51412/0 (socket says 172.21.15.64:51412) 2023-10-14T12:29:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.918+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1669147203 learned_addr learned my addr 172.21.15.64:0/1669147203 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c67fc640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80c8930 0x7f14c815e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c77fe640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 msgr2=0x7f14c80c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c6ffd640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80c8930 msgr2=0x7f14c815e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c6ffd640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80c8930 0x7f14c815e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:15.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c6ffd640 1 -- 172.21.15.64:0/1669147203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b80094d0 con 0x7f14c8070400 2023-10-14T12:29:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c77fe640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c6ffd640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c8154870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14b802b8d0 tx=0x7f14b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14af7fe640 1 -- 172.21.15.64:0/1669147203 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8032890 con 0x7f14c8070400 2023-10-14T12:29:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14af7fe640 1 -- 172.21.15.64:0/1669147203 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14b8032a10 con 0x7f14c8070400 2023-10-14T12:29:15.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14af7fe640 1 -- 172.21.15.64:0/1669147203 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14b8032dc0 con 0x7f14c8070400 2023-10-14T12:29:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.919+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14c80c7390 con 0x7f14c8070400 2023-10-14T12:29:15.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.920+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14c80c7950 con 0x7f14c8070400 2023-10-14T12:29:15.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.921+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14c80b2140 con 0x7f14c8070400 2023-10-14T12:29:15.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.922+0000 7f14af7fe640 1 -- 172.21.15.64:0/1669147203 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f14b804d3f0 con 0x7f14c8070400 2023-10-14T12:29:15.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.923+0000 7f14af7fe640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f14b406aea0 0x7f14b406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:15.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.923+0000 7f14af7fe640 1 -- 172.21.15.64:0/1669147203 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f14b80ab920 con 0x7f14c8070400 2023-10-14T12:29:15.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.923+0000 7f14c67fc640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f14b406aea0 0x7f14b406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:15.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.924+0000 7f14c67fc640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f14b406aea0 0x7f14b406d360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006fd0 tx=0x7f14bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:15.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:15.927+0000 7f14af7fe640 1 -- 172.21.15.64:0/1669147203 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14b8076640 con 0x7f14c8070400 2023-10-14T12:29:16.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.159+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f14c804e9b0 con 0x7f14c8070400 2023-10-14T12:29:16.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.159+0000 7f14af7fe640 1 -- 172.21.15.64:0/1669147203 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f14b8079c60 con 0x7f14c8070400 2023-10-14T12:29:16.161 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:16.162 INFO:teuthology.orchestra.run.smithi064.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-14T12:29:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.162+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f14b406aea0 msgr2=0x7f14b406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.162+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f14b406aea0 0x7f14b406d360 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f14bc006fd0 tx=0x7f14bc008040 comp rx=0 tx=0).stop 2023-10-14T12:29:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.162+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 msgr2=0x7f14c8154870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.162+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c8154870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f14b802b8d0 tx=0x7f14b80046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.162+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 shutdown_connections 2023-10-14T12:29:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.162+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f14b406aea0 0x7f14b406d360 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.163+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14c80ca640 0x7f14c80c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.163+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14c80c8930 0x7f14c815e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.163+0000 7f14c7fff640 1 --2- 172.21.15.64:0/1669147203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f14c8070400 0x7f14c8154870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.163+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 >> 172.21.15.64:0/1669147203 conn(0x7f14c806a470 msgr2=0x7f14c815ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:16.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.163+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 shutdown_connections 2023-10-14T12:29:16.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.163+0000 7f14c7fff640 1 -- 172.21.15.64:0/1669147203 wait complete. 2023-10-14T12:29:16.183 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-14T12:29:16.184 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.404+0000 7f2baee39640 1 Processor -- start 2023-10-14T12:29:16.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.405+0000 7f2baee39640 1 -- start start 2023-10-14T12:29:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.406+0000 7f2baee39640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2ba815a8d0 0x7f2ba80cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.406+0000 7f2baee39640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba806ff40 0x7f2ba80cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.406+0000 7f2baee39640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ba815acb0 con 0x7f2ba80ca660 2023-10-14T12:29:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.406+0000 7f2baee39640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ba80c1c60 con 0x7f2ba815a8d0 2023-10-14T12:29:16.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.406+0000 7f2baee39640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba815e350 con 0x7f2ba806ff40 2023-10-14T12:29:16.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.407+0000 7f2bade37640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2ba815a8d0 0x7f2ba80cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.407+0000 7f2bae638640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba806ff40 0x7f2ba80cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.407+0000 7f2bae638640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba806ff40 0x7f2ba80cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:37546/0 (socket says 172.21.15.64:37546) 2023-10-14T12:29:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.407+0000 7f2bade37640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2ba815a8d0 0x7f2ba80cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:34160/0 (socket says 172.21.15.64:34160) 2023-10-14T12:29:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.407+0000 7f2bae638640 1 -- 172.21.15.64:0/2282480003 learned_addr learned my addr 172.21.15.64:0/2282480003 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:16.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.408+0000 7f2bae638640 1 -- 172.21.15.64:0/2282480003 >> v2:172.21.15.177:3300/0 conn(0x7f2ba815a8d0 msgr2=0x7f2ba80cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.408+0000 7f2bae638640 1 --2- 172.21.15.64:0/2282480003 >> v2:172.21.15.177:3300/0 conn(0x7f2ba815a8d0 0x7f2ba80cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.408+0000 7f2bae638640 1 -- 172.21.15.64:0/2282480003 >> v1:172.21.15.177:6789/0 conn(0x7f2ba80ca660 legacy=0x7f2ba806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.408+0000 7f2bae638640 1 -- 172.21.15.64:0/2282480003 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba815e630 con 0x7f2ba806ff40 2023-10-14T12:29:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.409+0000 7f2bae638640 1 --2- 172.21.15.64:0/2282480003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba806ff40 0x7f2ba80cb080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009e50 tx=0x7f2ba002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1239d431dc4d40cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.410+0000 7f2bace35640 1 -- 172.21.15.64:0/2282480003 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba002cb00 con 0x7f2ba806ff40 2023-10-14T12:29:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.410+0000 7f2bace35640 1 -- 172.21.15.64:0/2282480003 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba002cc60 con 0x7f2ba806ff40 2023-10-14T12:29:16.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.410+0000 7f2bace35640 1 -- 172.21.15.64:0/2282480003 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba00343f0 con 0x7f2ba806ff40 2023-10-14T12:29:16.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 -- 172.21.15.64:0/2282480003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba806ff40 msgr2=0x7f2ba80cb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 --2- 172.21.15.64:0/2282480003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba806ff40 0x7f2ba80cb080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009e50 tx=0x7f2ba002bf60 comp rx=0 tx=0).stop 2023-10-14T12:29:16.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 -- 172.21.15.64:0/2282480003 shutdown_connections 2023-10-14T12:29:16.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 --2- 172.21.15.64:0/2282480003 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba806ff40 0x7f2ba80cb080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 --2- 172.21.15.64:0/2282480003 >> v2:172.21.15.177:3300/0 conn(0x7f2ba815a8d0 0x7f2ba80cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 -- 172.21.15.64:0/2282480003 >> 172.21.15.64:0/2282480003 conn(0x7f2ba806a470 msgr2=0x7f2ba80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:16.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 -- 172.21.15.64:0/2282480003 shutdown_connections 2023-10-14T12:29:16.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.411+0000 7f2baee39640 1 -- 172.21.15.64:0/2282480003 wait complete. 2023-10-14T12:29:16.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.414+0000 7f2baee39640 1 Processor -- start 2023-10-14T12:29:16.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.414+0000 7f2baee39640 1 -- start start 2023-10-14T12:29:16.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2baee39640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba806ff40 0x7f2ba80b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2baee39640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba80ca660 0x7f2ba8158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2baee39640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba815a8d0 0x7f2ba80b3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2baee39640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80b1620 con 0x7f2ba815a8d0 2023-10-14T12:29:16.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2baee39640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80c45a0 con 0x7f2ba806ff40 2023-10-14T12:29:16.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2baee39640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ba80c5570 con 0x7f2ba80ca660 2023-10-14T12:29:16.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2bae638640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba815a8d0 0x7f2ba80b3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2bae638640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba815a8d0 0x7f2ba80b3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51418/0 (socket says 172.21.15.64:51418) 2023-10-14T12:29:16.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.415+0000 7f2bae638640 1 -- 172.21.15.64:0/1629675666 learned_addr learned my addr 172.21.15.64:0/1629675666 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:16.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bade37640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba806ff40 0x7f2ba80b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bad636640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba80ca660 0x7f2ba8158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bae638640 1 -- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba80ca660 msgr2=0x7f2ba8158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bae638640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba80ca660 0x7f2ba8158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bae638640 1 -- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba806ff40 msgr2=0x7f2ba80b0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bae638640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba806ff40 0x7f2ba80b0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bae638640 1 -- 172.21.15.64:0/1629675666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009b30 con 0x7f2ba815a8d0 2023-10-14T12:29:16.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.416+0000 7f2bae638640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba815a8d0 0x7f2ba80b3550 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009e50 tx=0x7f2ba0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:16.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.417+0000 7f2b9e7fc640 1 -- 172.21.15.64:0/1629675666 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0009510 con 0x7f2ba815a8d0 2023-10-14T12:29:16.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.417+0000 7f2b9e7fc640 1 -- 172.21.15.64:0/1629675666 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba003e450 con 0x7f2ba815a8d0 2023-10-14T12:29:16.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.417+0000 7f2b9e7fc640 1 -- 172.21.15.64:0/1629675666 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba003e800 con 0x7f2ba815a8d0 2023-10-14T12:29:16.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.417+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ba80c5850 con 0x7f2ba815a8d0 2023-10-14T12:29:16.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.417+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ba80c5e10 con 0x7f2ba815a8d0 2023-10-14T12:29:16.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.418+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ba80c6030 con 0x7f2ba815a8d0 2023-10-14T12:29:16.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.419+0000 7f2b9e7fc640 1 -- 172.21.15.64:0/1629675666 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ba003e960 con 0x7f2ba815a8d0 2023-10-14T12:29:16.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.420+0000 7f2b9e7fc640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2b8c06ae70 0x7f2b8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.420+0000 7f2b9e7fc640 1 -- 172.21.15.64:0/1629675666 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2ba00ac600 con 0x7f2ba815a8d0 2023-10-14T12:29:16.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.420+0000 7f2bade37640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2b8c06ae70 0x7f2b8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.421+0000 7f2bade37640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2b8c06ae70 0x7f2b8c06d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009a20 tx=0x7f2ba4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:16.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.424+0000 7f2b9e7fc640 1 -- 172.21.15.64:0/1629675666 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2ba00773b0 con 0x7f2ba815a8d0 2023-10-14T12:29:16.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.617+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ba804e9b0 con 0x7f2ba815a8d0 2023-10-14T12:29:16.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.620+0000 7f2b9e7fc640 1 -- 172.21.15.64:0/1629675666 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f2ba007a9d0 con 0x7f2ba815a8d0 2023-10-14T12:29:16.622 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:16.622 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:16.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2b8c06ae70 msgr2=0x7f2b8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2b8c06ae70 0x7f2b8c06d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4009a20 tx=0x7f2ba4008040 comp rx=0 tx=0).stop 2023-10-14T12:29:16.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba815a8d0 msgr2=0x7f2ba80b3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba815a8d0 0x7f2ba80b3550 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2ba0009e50 tx=0x7f2ba0004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:16.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 shutdown_connections 2023-10-14T12:29:16.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2b8c06ae70 0x7f2b8c06d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2ba815a8d0 0x7f2ba80b3550 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2ba80ca660 0x7f2ba8158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 --2- 172.21.15.64:0/1629675666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2ba806ff40 0x7f2ba80b0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 >> 172.21.15.64:0/1629675666 conn(0x7f2ba806a470 msgr2=0x7f2ba80ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:16.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 shutdown_connections 2023-10-14T12:29:16.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.623+0000 7f2baee39640 1 -- 172.21.15.64:0/1629675666 wait complete. 2023-10-14T12:29:16.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:16.643 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:16.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.861+0000 7fdabffff640 1 Processor -- start 2023-10-14T12:29:16.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.861+0000 7fdabffff640 1 -- start start 2023-10-14T12:29:16.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.862+0000 7fdabffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdac0071f30 0x7fdac0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.862+0000 7fdabffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdac00cdc00 0x7fdac006bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.862+0000 7fdabffff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdac00c89d0 con 0x7fdac0071b50 2023-10-14T12:29:16.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.862+0000 7fdabffff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac0071600 con 0x7fdac00cdc00 2023-10-14T12:29:16.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.862+0000 7fdabffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdac015a260 con 0x7fdac0071f30 2023-10-14T12:29:16.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabf7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdac00cdc00 0x7fdac006bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabf7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdac00cdc00 0x7fdac006bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51430/0 (socket says 172.21.15.64:51430) 2023-10-14T12:29:16.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabf7fe640 1 -- 172.21.15.64:0/2096741356 learned_addr learned my addr 172.21.15.64:0/2096741356 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:16.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabe7fc640 1 --2- 172.21.15.64:0/2096741356 >> v2:172.21.15.177:3300/0 conn(0x7fdac0071f30 0x7fdac0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabf7fe640 1 -- 172.21.15.64:0/2096741356 >> v2:172.21.15.177:3300/0 conn(0x7fdac0071f30 msgr2=0x7fdac0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:16.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabf7fe640 1 --2- 172.21.15.64:0/2096741356 >> v2:172.21.15.177:3300/0 conn(0x7fdac0071f30 0x7fdac0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabf7fe640 1 -- 172.21.15.64:0/2096741356 >> v1:172.21.15.177:6789/0 conn(0x7fdac0071b50 legacy=0x7fdac0070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:16.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.863+0000 7fdabf7fe640 1 -- 172.21.15.64:0/2096741356 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac015a540 con 0x7fdac00cdc00 2023-10-14T12:29:16.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.864+0000 7fdabf7fe640 1 --2- 172.21.15.64:0/2096741356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac006bf20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdac00b4420 tx=0x7fdab802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce283e762fa48c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:16.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabdffb640 1 -- 172.21.15.64:0/2096741356 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab802ca80 con 0x7fdac00cdc00 2023-10-14T12:29:16.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabdffb640 1 -- 172.21.15.64:0/2096741356 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab802cbe0 con 0x7fdac00cdc00 2023-10-14T12:29:16.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabdffb640 1 -- 172.21.15.64:0/2096741356 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab80343f0 con 0x7fdac00cdc00 2023-10-14T12:29:16.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 -- 172.21.15.64:0/2096741356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 msgr2=0x7fdac006bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 --2- 172.21.15.64:0/2096741356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac006bf20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fdac00b4420 tx=0x7fdab802bee0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 -- 172.21.15.64:0/2096741356 shutdown_connections 2023-10-14T12:29:16.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 --2- 172.21.15.64:0/2096741356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac006bf20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 --2- 172.21.15.64:0/2096741356 >> v2:172.21.15.177:3300/0 conn(0x7fdac0071f30 0x7fdac0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 -- 172.21.15.64:0/2096741356 >> 172.21.15.64:0/2096741356 conn(0x7fdac006a470 msgr2=0x7fdac00afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:16.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 -- 172.21.15.64:0/2096741356 shutdown_connections 2023-10-14T12:29:16.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.865+0000 7fdabffff640 1 -- 172.21.15.64:0/2096741356 wait complete. 2023-10-14T12:29:16.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.867+0000 7fdabffff640 1 Processor -- start 2023-10-14T12:29:16.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.867+0000 7fdabffff640 1 -- start start 2023-10-14T12:29:16.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac0071b50 0x7fdac01ee7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdac0071f30 0x7fdac0141440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac0151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac0144330 con 0x7fdac00cdc00 2023-10-14T12:29:16.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdac014ffd0 con 0x7fdac0071b50 2023-10-14T12:29:16.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdac01502b0 con 0x7fdac0071f30 2023-10-14T12:29:16.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac0151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabf7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac0151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51434/0 (socket says 172.21.15.64:51434) 2023-10-14T12:29:16.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.868+0000 7fdabf7fe640 1 -- 172.21.15.64:0/3373253598 learned_addr learned my addr 172.21.15.64:0/3373253598 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabeffd640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac0071b50 0x7fdac01ee7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabf7fe640 1 -- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdac0071f30 msgr2=0x7fdac0141440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabf7fe640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdac0071f30 0x7fdac0141440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabf7fe640 1 -- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac0071b50 msgr2=0x7fdac01ee7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabf7fe640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac0071b50 0x7fdac01ee7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:16.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabf7fe640 1 -- 172.21.15.64:0/3373253598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab8009b30 con 0x7fdac00cdc00 2023-10-14T12:29:16.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabeffd640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac0071b50 0x7fdac01ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:16.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabf7fe640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac0151070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdab8036040 tx=0x7fdab8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:16.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdaa77fe640 1 -- 172.21.15.64:0/3373253598 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab8009510 con 0x7fdac00cdc00 2023-10-14T12:29:16.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdaa77fe640 1 -- 172.21.15.64:0/3373253598 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdab803e450 con 0x7fdac00cdc00 2023-10-14T12:29:16.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdaa77fe640 1 -- 172.21.15.64:0/3373253598 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdab803e7e0 con 0x7fdac00cdc00 2023-10-14T12:29:16.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.869+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdac0150590 con 0x7fdac00cdc00 2023-10-14T12:29:16.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.870+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdac0150b50 con 0x7fdac00cdc00 2023-10-14T12:29:16.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.871+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdac004e9b0 con 0x7fdac00cdc00 2023-10-14T12:29:16.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.872+0000 7fdaa77fe640 1 -- 172.21.15.64:0/3373253598 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdab802cd50 con 0x7fdac00cdc00 2023-10-14T12:29:16.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.872+0000 7fdaa77fe640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdaac06ae70 0x7fdaac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:16.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.873+0000 7fdaa77fe640 1 -- 172.21.15.64:0/3373253598 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdab80ac460 con 0x7fdac00cdc00 2023-10-14T12:29:16.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.873+0000 7fdabeffd640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdaac06ae70 0x7fdaac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:16.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.874+0000 7fdabeffd640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdaac06ae70 0x7fdaac06d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdab0003eb0 tx=0x7fdab0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:16.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:16.877+0000 7fdaa77fe640 1 -- 172.21.15.64:0/3373253598 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdab8077220 con 0x7fdac00cdc00 2023-10-14T12:29:17.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.072+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdac00ca6e0 con 0x7fdac00cdc00 2023-10-14T12:29:17.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.073+0000 7fdaa77fe640 1 -- 172.21.15.64:0/3373253598 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdab803e940 con 0x7fdac00cdc00 2023-10-14T12:29:17.075 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:17.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdaac06ae70 msgr2=0x7fdaac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdaac06ae70 0x7fdaac06d330 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdab0003eb0 tx=0x7fdab0009040 comp rx=0 tx=0).stop 2023-10-14T12:29:17.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 msgr2=0x7fdac0151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac0151070 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdab8036040 tx=0x7fdab8004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 shutdown_connections 2023-10-14T12:29:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdaac06ae70 0x7fdaac06d330 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdac00cdc00 0x7fdac0151070 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdac0071f30 0x7fdac0141440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 --2- 172.21.15.64:0/3373253598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdac0071b50 0x7fdac01ee7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 >> 172.21.15.64:0/3373253598 conn(0x7fdac006a470 msgr2=0x7fdac00c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:17.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 shutdown_connections 2023-10-14T12:29:17.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.076+0000 7fdabffff640 1 -- 172.21.15.64:0/3373253598 wait complete. 2023-10-14T12:29:17.097 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:17.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.328+0000 7fb8715a0640 1 Processor -- start 2023-10-14T12:29:17.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.328+0000 7fb8715a0640 1 -- start start 2023-10-14T12:29:17.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.329+0000 7fb8715a0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb86c154d10 0x7fb86c0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.329+0000 7fb8715a0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb86c0cee60 0x7fb86c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.329+0000 7fb8715a0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb86c1550f0 con 0x7fb86c06d360 2023-10-14T12:29:17.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.329+0000 7fb8715a0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c0cf310 con 0x7fb86c0cee60 2023-10-14T12:29:17.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.329+0000 7fb8715a0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb86c06db50 con 0x7fb86c154d10 2023-10-14T12:29:17.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb863fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb86c0cee60 0x7fb86c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb863fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb86c0cee60 0x7fb86c06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51440/0 (socket says 172.21.15.64:51440) 2023-10-14T12:29:17.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb870d9f640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fb86c06d360 0x7fb86c0ac1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:57398/0 (socket says 172.21.15.64:57398) 2023-10-14T12:29:17.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb863fff640 1 -- 172.21.15.64:0/3539418803 learned_addr learned my addr 172.21.15.64:0/3539418803 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:17.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb86bfff640 1 --2- 172.21.15.64:0/3539418803 >> v2:172.21.15.177:3300/0 conn(0x7fb86c154d10 0x7fb86c0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb863fff640 1 -- 172.21.15.64:0/3539418803 >> v2:172.21.15.177:3300/0 conn(0x7fb86c154d10 msgr2=0x7fb86c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb863fff640 1 --2- 172.21.15.64:0/3539418803 >> v2:172.21.15.177:3300/0 conn(0x7fb86c154d10 0x7fb86c0ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb863fff640 1 -- 172.21.15.64:0/3539418803 >> v1:172.21.15.64:6789/0 conn(0x7fb86c06d360 legacy=0x7fb86c0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.330+0000 7fb863fff640 1 -- 172.21.15.64:0/3539418803 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c0b13f0 con 0x7fb86c0cee60 2023-10-14T12:29:17.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.332+0000 7fb863fff640 1 --2- 172.21.15.64:0/3539418803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c0cee60 0x7fb86c06ce20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0724f0 tx=0x7fb85402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e9ada45f6764176 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:17.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.332+0000 7fb86b7fe640 1 -- 172.21.15.64:0/3539418803 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854030860 con 0x7fb86c0cee60 2023-10-14T12:29:17.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.332+0000 7fb86b7fe640 1 -- 172.21.15.64:0/3539418803 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8540309c0 con 0x7fb86c0cee60 2023-10-14T12:29:17.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.332+0000 7fb86b7fe640 1 -- 172.21.15.64:0/3539418803 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854030d50 con 0x7fb86c0cee60 2023-10-14T12:29:17.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.332+0000 7fb8715a0640 1 -- 172.21.15.64:0/3539418803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c0cee60 msgr2=0x7fb86c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.332+0000 7fb8715a0640 1 --2- 172.21.15.64:0/3539418803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c0cee60 0x7fb86c06ce20 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb86c0724f0 tx=0x7fb85402b9a0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.333+0000 7fb8715a0640 1 -- 172.21.15.64:0/3539418803 shutdown_connections 2023-10-14T12:29:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.333+0000 7fb8715a0640 1 --2- 172.21.15.64:0/3539418803 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c0cee60 0x7fb86c06ce20 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.333+0000 7fb8715a0640 1 --2- 172.21.15.64:0/3539418803 >> v2:172.21.15.177:3300/0 conn(0x7fb86c154d10 0x7fb86c0ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.333+0000 7fb8715a0640 1 -- 172.21.15.64:0/3539418803 >> 172.21.15.64:0/3539418803 conn(0x7fb86c06a200 msgr2=0x7fb86c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:17.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.333+0000 7fb8715a0640 1 -- 172.21.15.64:0/3539418803 shutdown_connections 2023-10-14T12:29:17.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.333+0000 7fb8715a0640 1 -- 172.21.15.64:0/3539418803 wait complete. 2023-10-14T12:29:17.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.334+0000 7fb8715a0640 1 Processor -- start 2023-10-14T12:29:17.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.335+0000 7fb8715a0640 1 -- start start 2023-10-14T12:29:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb8715a0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb86c06d360 0x7fb86c070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb8715a0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb86c0cee60 0x7fb86c0aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb8715a0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c154d10 0x7fb86c1f16f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb8715a0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c15bdf0 con 0x7fb86c154d10 2023-10-14T12:29:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb8715a0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0715e0 con 0x7fb86c0cee60 2023-10-14T12:29:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb8715a0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb86c0718c0 con 0x7fb86c06d360 2023-10-14T12:29:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c154d10 0x7fb86c1f16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c154d10 0x7fb86c1f16f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51442/0 (socket says 172.21.15.64:51442) 2023-10-14T12:29:17.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 -- 172.21.15.64:0/1625984148 learned_addr learned my addr 172.21.15.64:0/1625984148 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb863fff640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb86c0cee60 0x7fb86c0aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb86bfff640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb86c06d360 0x7fb86c070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 -- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb86c06d360 msgr2=0x7fb86c070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb86c06d360 0x7fb86c070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 -- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb86c0cee60 msgr2=0x7fb86c0aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb86c0cee60 0x7fb86c0aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.336+0000 7fb870d9f640 1 -- 172.21.15.64:0/1625984148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8540094d0 con 0x7fb86c154d10 2023-10-14T12:29:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.337+0000 7fb870d9f640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c154d10 0x7fb86c1f16f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c780 tx=0x7fb86400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.337+0000 7fb8697fa640 1 -- 172.21.15.64:0/1625984148 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400ce90 con 0x7fb86c154d10 2023-10-14T12:29:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.337+0000 7fb8697fa640 1 -- 172.21.15.64:0/1625984148 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb86400a640 con 0x7fb86c154d10 2023-10-14T12:29:17.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.337+0000 7fb8697fa640 1 -- 172.21.15.64:0/1625984148 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400a9f0 con 0x7fb86c154d10 2023-10-14T12:29:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.337+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86c071ba0 con 0x7fb86c154d10 2023-10-14T12:29:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.337+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86c0ca190 con 0x7fb86c154d10 2023-10-14T12:29:17.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.338+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb86c15bf60 con 0x7fb86c154d10 2023-10-14T12:29:17.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.339+0000 7fb8697fa640 1 -- 172.21.15.64:0/1625984148 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb86400ab50 con 0x7fb86c154d10 2023-10-14T12:29:17.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.340+0000 7fb8697fa640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.340+0000 7fb8697fa640 1 -- 172.21.15.64:0/1625984148 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb864089090 con 0x7fb86c154d10 2023-10-14T12:29:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.341+0000 7fb86bfff640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.342+0000 7fb86bfff640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb84c06ae70 0x7fb84c06d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006fd0 tx=0x7fb85c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:17.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.344+0000 7fb8697fa640 1 -- 172.21.15.64:0/1625984148 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb864053e60 con 0x7fb86c154d10 2023-10-14T12:29:17.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.537+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb86c04e9b0 con 0x7fb86c154d10 2023-10-14T12:29:17.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.538+0000 7fb8697fa640 1 -- 172.21.15.64:0/1625984148 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb864017020 con 0x7fb86c154d10 2023-10-14T12:29:17.540 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:17.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.540+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb84c06ae70 msgr2=0x7fb84c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.540+0000 7fb8715a0640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb84c06ae70 0x7fb84c06d330 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb85c006fd0 tx=0x7fb85c008040 comp rx=0 tx=0).stop 2023-10-14T12:29:17.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.540+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c154d10 msgr2=0x7fb86c1f16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.540+0000 7fb8715a0640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c154d10 0x7fb86c1f16f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb86400c780 tx=0x7fb86400cc40 comp rx=0 tx=0).stop 2023-10-14T12:29:17.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 shutdown_connections 2023-10-14T12:29:17.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb84c06ae70 0x7fb84c06d330 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb86c154d10 0x7fb86c1f16f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb86c0cee60 0x7fb86c0aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 --2- 172.21.15.64:0/1625984148 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb86c06d360 0x7fb86c070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 >> 172.21.15.64:0/1625984148 conn(0x7fb86c06a200 msgr2=0x7fb86c0af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:17.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 shutdown_connections 2023-10-14T12:29:17.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.541+0000 7fb8715a0640 1 -- 172.21.15.64:0/1625984148 wait complete. 2023-10-14T12:29:17.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:17.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.786+0000 7f04e8c96640 1 Processor -- start 2023-10-14T12:29:17.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.786+0000 7f04e8c96640 1 -- start start 2023-10-14T12:29:17.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.787+0000 7f04e8c96640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f04e4159890 0x7f04e4071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.788+0000 7f04e8c96640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e4072480 con 0x7f04e40ca5a0 2023-10-14T12:29:17.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.788+0000 7f04e8c96640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e40cd0c0 con 0x7f04e40ca110 2023-10-14T12:29:17.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.788+0000 7f04e8c96640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e415e210 con 0x7f04e4159890 2023-10-14T12:29:17.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.788+0000 7f04e259c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f04e4159890 0x7f04e4071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.788+0000 7f04e259c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f04e4159890 0x7f04e4071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51454/0 (socket says 172.21.15.64:51454) 2023-10-14T12:29:17.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.788+0000 7f04e259c640 1 -- 172.21.15.64:0/1427451334 learned_addr learned my addr 172.21.15.64:0/1427451334 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:17.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.789+0000 7f04e259c640 1 -- 172.21.15.64:0/1427451334 >> v1:172.21.15.177:6789/0 conn(0x7f04e40ca110 legacy=0x7f04e415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:17.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.789+0000 7f04e259c640 1 -- 172.21.15.64:0/1427451334 >> v1:172.21.15.64:6789/0 conn(0x7f04e40ca5a0 legacy=0x7f04e415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.789+0000 7f04e259c640 1 -- 172.21.15.64:0/1427451334 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40caa10 con 0x7f04e4159890 2023-10-14T12:29:17.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.789+0000 7f04e1d9b640 1 -- 172.21.15.64:0/1427451334 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2731554250 0 0) 0x7f04e4072480 con 0x7f04e40ca5a0 2023-10-14T12:29:17.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.790+0000 7f04e259c640 1 --2- 172.21.15.64:0/1427451334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e4071f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009870 tx=0x7f04d402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5cec1db7afab757 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:17.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.790+0000 7f04e1d9b640 1 -- 172.21.15.64:0/1427451334 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4030860 con 0x7f04e4159890 2023-10-14T12:29:17.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.790+0000 7f04e1d9b640 1 -- 172.21.15.64:0/1427451334 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d40309c0 con 0x7f04e4159890 2023-10-14T12:29:17.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.790+0000 7f04e1d9b640 1 -- 172.21.15.64:0/1427451334 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d4030d50 con 0x7f04e4159890 2023-10-14T12:29:17.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.791+0000 7f04e8c96640 1 -- 172.21.15.64:0/1427451334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 msgr2=0x7f04e4071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.791+0000 7f04e8c96640 1 --2- 172.21.15.64:0/1427451334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e4071f40 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009870 tx=0x7f04d402b9a0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.791+0000 7f04e8c96640 1 -- 172.21.15.64:0/1427451334 shutdown_connections 2023-10-14T12:29:17.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.791+0000 7f04e8c96640 1 --2- 172.21.15.64:0/1427451334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e4071f40 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.791+0000 7f04e8c96640 1 -- 172.21.15.64:0/1427451334 >> 172.21.15.64:0/1427451334 conn(0x7f04e40b0030 msgr2=0x7f04e40b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:17.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.791+0000 7f04e8c96640 1 -- 172.21.15.64:0/1427451334 shutdown_connections 2023-10-14T12:29:17.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.791+0000 7f04e8c96640 1 -- 172.21.15.64:0/1427451334 wait complete. 2023-10-14T12:29:17.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.793+0000 7f04e8c96640 1 Processor -- start 2023-10-14T12:29:17.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.793+0000 7f04e8c96640 1 -- start start 2023-10-14T12:29:17.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.794+0000 7f04e8c96640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04e40ca110 0x7f04e41f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.794+0000 7f04e8c96640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04e40ca5a0 0x7f04e40c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.794+0000 7f04e8c96640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e40c9670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.794+0000 7f04e8c96640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40c6f10 con 0x7f04e4159890 2023-10-14T12:29:17.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.794+0000 7f04e8c96640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40b1170 con 0x7f04e40ca110 2023-10-14T12:29:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.794+0000 7f04e8c96640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e40b1450 con 0x7f04e40ca5a0 2023-10-14T12:29:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.794+0000 7f04e2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e40c9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e40c9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51460/0 (socket says 172.21.15.64:51460) 2023-10-14T12:29:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 -- 172.21.15.64:0/3363658355 learned_addr learned my addr 172.21.15.64:0/3363658355 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:17.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e259c640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04e40ca110 0x7f04e41f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04dbfff640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04e40ca5a0 0x7f04e40c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 -- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04e40ca5a0 msgr2=0x7f04e40c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04e40ca5a0 0x7f04e40c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 -- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04e40ca110 msgr2=0x7f04e41f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:17.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04e40ca110 0x7f04e41f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:17.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 -- 172.21.15.64:0/3363658355 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d40094d0 con 0x7f04e4159890 2023-10-14T12:29:17.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04dbfff640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04e40ca5a0 0x7f04e40c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:17.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.795+0000 7f04e2d9d640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e40c9670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00c730 tx=0x7f04dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:17.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.796+0000 7f04daffd640 1 -- 172.21.15.64:0/3363658355 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc003b90 con 0x7f04e4159890 2023-10-14T12:29:17.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.796+0000 7f04daffd640 1 -- 172.21.15.64:0/3363658355 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04dc003d10 con 0x7f04e4159890 2023-10-14T12:29:17.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.796+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e40b1730 con 0x7f04e4159890 2023-10-14T12:29:17.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.796+0000 7f04daffd640 1 -- 172.21.15.64:0/3363658355 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc00aa90 con 0x7f04e4159890 2023-10-14T12:29:17.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.796+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e40c6170 con 0x7f04e4159890 2023-10-14T12:29:17.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.797+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e40b0fd0 con 0x7f04e4159890 2023-10-14T12:29:17.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.798+0000 7f04daffd640 1 -- 172.21.15.64:0/3363658355 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f04dc00abf0 con 0x7f04e4159890 2023-10-14T12:29:17.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.799+0000 7f04daffd640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04c406ae70 0x7f04c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:17.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.799+0000 7f04daffd640 1 -- 172.21.15.64:0/3363658355 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f04dc0897f0 con 0x7f04e4159890 2023-10-14T12:29:17.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.800+0000 7f04e259c640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04c406ae70 0x7f04c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:17.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.801+0000 7f04e259c640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04c406ae70 0x7f04c406d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f04d4036000 tx=0x7f04d4008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:17.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.803+0000 7f04daffd640 1 -- 172.21.15.64:0/3363658355 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04e40b0fd0 con 0x7f04e4159890 2023-10-14T12:29:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.997+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f04e40b0fd0 con 0x7f04e4159890 2023-10-14T12:29:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:17.998+0000 7f04daffd640 1 -- 172.21.15.64:0/3363658355 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04e40b0fd0 con 0x7f04e4159890 2023-10-14T12:29:18.000 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:18.002 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.000+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04c406ae70 msgr2=0x7f04c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.000+0000 7f04e8c96640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04c406ae70 0x7f04c406d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f04d4036000 tx=0x7f04d4008030 comp rx=0 tx=0).stop 2023-10-14T12:29:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.000+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 msgr2=0x7f04e40c9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.000+0000 7f04e8c96640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e40c9670 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00c730 tx=0x7f04dc00cbf0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.000+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 shutdown_connections 2023-10-14T12:29:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.000+0000 7f04e8c96640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04c406ae70 0x7f04c406d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.000+0000 7f04e8c96640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04e4159890 0x7f04e40c9670 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.001+0000 7f04e8c96640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04e40ca5a0 0x7f04e40c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.001+0000 7f04e8c96640 1 --2- 172.21.15.64:0/3363658355 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04e40ca110 0x7f04e41f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.001+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 >> 172.21.15.64:0/3363658355 conn(0x7f04e40b0030 msgr2=0x7f04e40cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.001+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 shutdown_connections 2023-10-14T12:29:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.001+0000 7f04e8c96640 1 -- 172.21.15.64:0/3363658355 wait complete. 2023-10-14T12:29:18.023 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:18.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.253+0000 7f8b8c497640 1 Processor -- start 2023-10-14T12:29:18.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.253+0000 7f8b8c497640 1 -- start start 2023-10-14T12:29:18.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.254+0000 7f8b8c497640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8b84159890 0x7f8b84071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.254+0000 7f8b8c497640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b840ca5a0 0x7f8b8415db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8c497640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b84072480 con 0x7f8b840ca110 2023-10-14T12:29:18.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8c497640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b840cd0c0 con 0x7f8b84159890 2023-10-14T12:29:18.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8c497640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b840caa30 con 0x7f8b840ca5a0 2023-10-14T12:29:18.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8a233640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8b84159890 0x7f8b84071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8a233640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8b84159890 0x7f8b84071f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51464/0 (socket says 172.21.15.64:51464) 2023-10-14T12:29:18.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8a233640 1 -- 172.21.15.64:0/648125725 learned_addr learned my addr 172.21.15.64:0/648125725 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:18.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8aa34640 1 --2- 172.21.15.64:0/648125725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b840ca5a0 0x7f8b8415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8a233640 1 -- 172.21.15.64:0/648125725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b840ca5a0 msgr2=0x7f8b8415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:18.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.255+0000 7f8b8a233640 1 --2- 172.21.15.64:0/648125725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b840ca5a0 0x7f8b8415db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.256+0000 7f8b8a233640 1 -- 172.21.15.64:0/648125725 >> v1:172.21.15.177:6789/0 conn(0x7f8b840ca110 legacy=0x7f8b8415d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.256+0000 7f8b8a233640 1 -- 172.21.15.64:0/648125725 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b840cc540 con 0x7f8b84159890 2023-10-14T12:29:18.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.257+0000 7f8b8a233640 1 --2- 172.21.15.64:0/648125725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84159890 0x7f8b84071f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009e50 tx=0x7f8b8002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0f6f0b384a5fd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:18.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.257+0000 7f8b89231640 1 -- 172.21.15.64:0/648125725 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8002cb00 con 0x7f8b84159890 2023-10-14T12:29:18.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.257+0000 7f8b89231640 1 -- 172.21.15.64:0/648125725 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8002cc60 con 0x7f8b84159890 2023-10-14T12:29:18.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.257+0000 7f8b89231640 1 -- 172.21.15.64:0/648125725 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800343f0 con 0x7f8b84159890 2023-10-14T12:29:18.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 -- 172.21.15.64:0/648125725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84159890 msgr2=0x7f8b84071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 --2- 172.21.15.64:0/648125725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84159890 0x7f8b84071f40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009e50 tx=0x7f8b8002bf60 comp rx=0 tx=0).stop 2023-10-14T12:29:18.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 -- 172.21.15.64:0/648125725 shutdown_connections 2023-10-14T12:29:18.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 --2- 172.21.15.64:0/648125725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b840ca5a0 0x7f8b8415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 --2- 172.21.15.64:0/648125725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b84159890 0x7f8b84071f40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 -- 172.21.15.64:0/648125725 >> 172.21.15.64:0/648125725 conn(0x7f8b840b0030 msgr2=0x7f8b840b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:18.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 -- 172.21.15.64:0/648125725 shutdown_connections 2023-10-14T12:29:18.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.258+0000 7f8b8c497640 1 -- 172.21.15.64:0/648125725 wait complete. 2023-10-14T12:29:18.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.260+0000 7f8b8c497640 1 Processor -- start 2023-10-14T12:29:18.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.260+0000 7f8b8c497640 1 -- start start 2023-10-14T12:29:18.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.261+0000 7f8b8c497640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b840ca110 0x7f8b841e63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.261+0000 7f8b8c497640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b840ca5a0 0x7f8b84159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.261+0000 7f8b8c497640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b84159890 0x7f8b8415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.261+0000 7f8b8c497640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415a6f0 con 0x7f8b840ca110 2023-10-14T12:29:18.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.261+0000 7f8b8c497640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415b9d0 con 0x7f8b840ca5a0 2023-10-14T12:29:18.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.261+0000 7f8b8c497640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8415a930 con 0x7f8b84159890 2023-10-14T12:29:18.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.261+0000 7f8b8a233640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b840ca110 0x7f8b841e63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b840ca110 0x7f8b841e63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51468/0 (socket says 172.21.15.64:51468) 2023-10-14T12:29:18.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 -- 172.21.15.64:0/941983652 learned_addr learned my addr 172.21.15.64:0/941983652 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:18.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b89a32640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b840ca5a0 0x7f8b84159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8aa34640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b84159890 0x7f8b8415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 -- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b84159890 msgr2=0x7f8b8415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b84159890 0x7f8b8415a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 -- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b840ca5a0 msgr2=0x7f8b84159c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b840ca5a0 0x7f8b84159c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 -- 172.21.15.64:0/941983652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b80009b30 con 0x7f8b840ca110 2023-10-14T12:29:18.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b89a32640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b840ca5a0 0x7f8b84159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:18.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.262+0000 7f8b8a233640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b840ca110 0x7f8b841e63b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000f80 tx=0x7f8b80004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.263+0000 7f8b7affd640 1 -- 172.21.15.64:0/941983652 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b80009510 con 0x7f8b840ca110 2023-10-14T12:29:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.263+0000 7f8b7affd640 1 -- 172.21.15.64:0/941983652 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8003e450 con 0x7f8b840ca110 2023-10-14T12:29:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.263+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8415ac10 con 0x7f8b840ca110 2023-10-14T12:29:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.263+0000 7f8b7affd640 1 -- 172.21.15.64:0/941983652 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8003e800 con 0x7f8b840ca110 2023-10-14T12:29:18.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.263+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8415b1d0 con 0x7f8b840ca110 2023-10-14T12:29:18.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.264+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b84073ef0 con 0x7f8b840ca110 2023-10-14T12:29:18.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.265+0000 7f8b7affd640 1 -- 172.21.15.64:0/941983652 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8b8003e960 con 0x7f8b840ca110 2023-10-14T12:29:18.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.266+0000 7f8b7affd640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8b6806ae70 0x7f8b6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.266+0000 7f8b7affd640 1 -- 172.21.15.64:0/941983652 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8b800ac7c0 con 0x7f8b840ca110 2023-10-14T12:29:18.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.267+0000 7f8b89a32640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8b6806ae70 0x7f8b6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.268+0000 7f8b89a32640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8b6806ae70 0x7f8b6806d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b841f5a20 tx=0x7f8b74009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:18.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.270+0000 7f8b7affd640 1 -- 172.21.15.64:0/941983652 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8b80077610 con 0x7f8b840ca110 2023-10-14T12:29:18.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.465+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8b840cd290 con 0x7f8b840ca110 2023-10-14T12:29:18.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.467+0000 7f8b7affd640 1 -- 172.21.15.64:0/941983652 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8b8007ac30 con 0x7f8b840ca110 2023-10-14T12:29:18.468 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:18.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8b6806ae70 msgr2=0x7f8b6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8b6806ae70 0x7f8b6806d330 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f8b841f5a20 tx=0x7f8b74009040 comp rx=0 tx=0).stop 2023-10-14T12:29:18.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b840ca110 msgr2=0x7f8b841e63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b840ca110 0x7f8b841e63b0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8b80000f80 tx=0x7f8b80004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:18.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 shutdown_connections 2023-10-14T12:29:18.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8b6806ae70 0x7f8b6806d330 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8b84159890 0x7f8b8415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8b840ca5a0 0x7f8b84159c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 --2- 172.21.15.64:0/941983652 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8b840ca110 0x7f8b841e63b0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 >> 172.21.15.64:0/941983652 conn(0x7f8b840b0030 msgr2=0x7f8b840b3210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:18.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 shutdown_connections 2023-10-14T12:29:18.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.469+0000 7f8b8c497640 1 -- 172.21.15.64:0/941983652 wait complete. 2023-10-14T12:29:18.491 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:29:18.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.721+0000 7f98bbfff640 1 Processor -- start 2023-10-14T12:29:18.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.721+0000 7f98bbfff640 1 -- start start 2023-10-14T12:29:18.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.723+0000 7f98bbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc15cd60 0x7f98bc0cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.723+0000 7f98bbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f98bc071190 0x7f98bc0b1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.723+0000 7f98bbfff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98bc0ca030 con 0x7f98bc0b16a0 2023-10-14T12:29:18.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.723+0000 7f98bbfff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98bc0b1b30 con 0x7f98bc071190 2023-10-14T12:29:18.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.723+0000 7f98bbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc071610 con 0x7f98bc15cd60 2023-10-14T12:29:18.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.723+0000 7f98ba7fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f98bc071190 0x7f98bc0b1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98bb7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f98bc0b16a0 0x7f98bc069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:57412/0 (socket says 172.21.15.64:57412) 2023-10-14T12:29:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98bb7fe640 1 -- 172.21.15.64:0/3210730909 learned_addr learned my addr 172.21.15.64:0/3210730909 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98baffd640 1 --2- 172.21.15.64:0/3210730909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc15cd60 0x7f98bc0cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98ba7fc640 1 -- 172.21.15.64:0/3210730909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc15cd60 msgr2=0x7f98bc0cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:18.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98ba7fc640 1 --2- 172.21.15.64:0/3210730909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc15cd60 0x7f98bc0cdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98ba7fc640 1 -- 172.21.15.64:0/3210730909 >> v1:172.21.15.64:6789/0 conn(0x7f98bc0b16a0 legacy=0x7f98bc069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98b9ffb640 1 -- 172.21.15.64:0/3210730909 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2782717248 0 0) 0x7f98bc0ca030 con 0x7f98bc0b16a0 2023-10-14T12:29:18.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.724+0000 7f98ba7fc640 1 -- 172.21.15.64:0/3210730909 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98bc06f960 con 0x7f98bc071190 2023-10-14T12:29:18.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.726+0000 7f98ba7fc640 1 --2- 172.21.15.64:0/3210730909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc071190 0x7f98bc0b1160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009d90 tx=0x7f98a402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=820b44ed5b898471 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:18.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.726+0000 7f98b9ffb640 1 -- 172.21.15.64:0/3210730909 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a402cc50 con 0x7f98bc071190 2023-10-14T12:29:18.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.726+0000 7f98b9ffb640 1 -- 172.21.15.64:0/3210730909 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a402cdb0 con 0x7f98bc071190 2023-10-14T12:29:18.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.726+0000 7f98b9ffb640 1 -- 172.21.15.64:0/3210730909 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4034660 con 0x7f98bc071190 2023-10-14T12:29:18.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 -- 172.21.15.64:0/3210730909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc071190 msgr2=0x7f98bc0b1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3210730909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc071190 0x7f98bc0b1160 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98a4009d90 tx=0x7f98a402bea0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 -- 172.21.15.64:0/3210730909 shutdown_connections 2023-10-14T12:29:18.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3210730909 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc071190 0x7f98bc0b1160 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3210730909 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc15cd60 0x7f98bc0cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 -- 172.21.15.64:0/3210730909 >> 172.21.15.64:0/3210730909 conn(0x7f98bc0cf660 msgr2=0x7f98bc0cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:18.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 -- 172.21.15.64:0/3210730909 shutdown_connections 2023-10-14T12:29:18.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.727+0000 7f98bbfff640 1 -- 172.21.15.64:0/3210730909 wait complete. 2023-10-14T12:29:18.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.729+0000 7f98bbfff640 1 Processor -- start 2023-10-14T12:29:18.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.729+0000 7f98bbfff640 1 -- start start 2023-10-14T12:29:18.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98bbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc071190 0x7f98bc0af450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98bbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc0b16a0 0x7f98bc159500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98bc15cd60 0x7f98bc0cb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98bbfff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0ab900 con 0x7f98bc0b16a0 2023-10-14T12:29:18.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98bbfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0abba0 con 0x7f98bc15cd60 2023-10-14T12:29:18.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98bbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98bc0abe80 con 0x7f98bc071190 2023-10-14T12:29:18.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98ba7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc0b16a0 0x7f98bc159500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98ba7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc0b16a0 0x7f98bc159500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51488/0 (socket says 172.21.15.64:51488) 2023-10-14T12:29:18.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.730+0000 7f98ba7fc640 1 -- 172.21.15.64:0/3157411566 learned_addr learned my addr 172.21.15.64:0/3157411566 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:18.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98baffd640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc071190 0x7f98bc0af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98bb7fe640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98bc15cd60 0x7f98bc0cb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98ba7fc640 1 -- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc071190 msgr2=0x7f98bc0af450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98ba7fc640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc071190 0x7f98bc0af450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98ba7fc640 1 -- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98bc15cd60 msgr2=0x7f98bc0cb4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98ba7fc640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98bc15cd60 0x7f98bc0cb4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98ba7fc640 1 -- 172.21.15.64:0/3157411566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a4009a70 con 0x7f98bc0b16a0 2023-10-14T12:29:18.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98ba7fc640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc0b16a0 0x7f98bc159500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f98a4037040 tx=0x7f98a4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:18.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98b37fe640 1 -- 172.21.15.64:0/3157411566 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a403e610 con 0x7f98bc0b16a0 2023-10-14T12:29:18.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98b37fe640 1 -- 172.21.15.64:0/3157411566 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a403e7b0 con 0x7f98bc0b16a0 2023-10-14T12:29:18.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98b37fe640 1 -- 172.21.15.64:0/3157411566 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a403eb60 con 0x7f98bc0b16a0 2023-10-14T12:29:18.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.731+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98bc0aef30 con 0x7f98bc0b16a0 2023-10-14T12:29:18.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.732+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98bc0b06c0 con 0x7f98bc0b16a0 2023-10-14T12:29:18.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.733+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98bc0af150 con 0x7f98bc0b16a0 2023-10-14T12:29:18.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.734+0000 7f98b37fe640 1 -- 172.21.15.64:0/3157411566 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f98a403b050 con 0x7f98bc0b16a0 2023-10-14T12:29:18.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.735+0000 7f98b37fe640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f989c06aea0 0x7f989c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:18.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.735+0000 7f98b37fe640 1 -- 172.21.15.64:0/3157411566 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98a40abf80 con 0x7f98bc0b16a0 2023-10-14T12:29:18.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.735+0000 7f98baffd640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f989c06aea0 0x7f989c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:18.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.736+0000 7f98baffd640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f989c06aea0 0x7f989c06d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009a30 tx=0x7f98ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:18.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.739+0000 7f98b37fe640 1 -- 172.21.15.64:0/3157411566 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f98a4076ca0 con 0x7f98bc0b16a0 2023-10-14T12:29:18.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.979+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f98bc04e9b0 con 0x7f98bc0b16a0 2023-10-14T12:29:18.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.980+0000 7f98b37fe640 1 -- 172.21.15.64:0/3157411566 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f98a4039090 con 0x7f98bc0b16a0 2023-10-14T12:29:18.982 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:18.982 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:29:18.982 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:29:18.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f989c06aea0 msgr2=0x7f989c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f989c06aea0 0x7f989c06d360 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f98ac009a30 tx=0x7f98ac008040 comp rx=0 tx=0).stop 2023-10-14T12:29:18.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc0b16a0 msgr2=0x7f98bc159500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:18.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc0b16a0 0x7f98bc159500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f98a4037040 tx=0x7f98a4004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:18.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 shutdown_connections 2023-10-14T12:29:18.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f989c06aea0 0x7f989c06d360 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f98bc15cd60 0x7f98bc0cb4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f98bc0b16a0 0x7f98bc159500 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 --2- 172.21.15.64:0/3157411566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f98bc071190 0x7f98bc0af450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:18.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 >> 172.21.15.64:0/3157411566 conn(0x7f98bc0cf660 msgr2=0x7f98bc15ef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:18.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 shutdown_connections 2023-10-14T12:29:18.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:18.983+0000 7f98bbfff640 1 -- 172.21.15.64:0/3157411566 wait complete. 2023-10-14T12:29:19.004 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:19.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.219+0000 7ff0680fc640 1 Processor -- start 2023-10-14T12:29:19.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.219+0000 7ff0680fc640 1 -- start start 2023-10-14T12:29:19.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff0680fc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff0600cd9b0 0x7ff0600cde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff0680fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff060160aa0 0x7ff060160eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff0680fc640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0601617d0 con 0x7ff06015cd10 2023-10-14T12:29:19.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff0680fc640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600ce3a0 con 0x7ff060160aa0 2023-10-14T12:29:19.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff0680fc640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0600d2100 con 0x7ff0600cd9b0 2023-10-14T12:29:19.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff066699640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff060160aa0 0x7ff060160eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff066699640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff060160aa0 0x7ff060160eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51504/0 (socket says 172.21.15.64:51504) 2023-10-14T12:29:19.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.220+0000 7ff066699640 1 -- 172.21.15.64:0/3000150903 learned_addr learned my addr 172.21.15.64:0/3000150903 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:19.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.221+0000 7ff066699640 1 -- 172.21.15.64:0/3000150903 >> v2:172.21.15.177:3300/0 conn(0x7ff0600cd9b0 msgr2=0x7ff0600cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:19.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.221+0000 7ff065697640 1 --2- 172.21.15.64:0/3000150903 >> v2:172.21.15.177:3300/0 conn(0x7ff0600cd9b0 0x7ff0600cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.221+0000 7ff066699640 1 --2- 172.21.15.64:0/3000150903 >> v2:172.21.15.177:3300/0 conn(0x7ff0600cd9b0 0x7ff0600cde60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.221+0000 7ff066699640 1 -- 172.21.15.64:0/3000150903 >> v1:172.21.15.177:6789/0 conn(0x7ff06015cd10 legacy=0x7ff0600d19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:19.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.221+0000 7ff066699640 1 -- 172.21.15.64:0/3000150903 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0600d0c30 con 0x7ff060160aa0 2023-10-14T12:29:19.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.221+0000 7ff065697640 1 --2- 172.21.15.64:0/3000150903 >> v2:172.21.15.177:3300/0 conn(0x7ff0600cd9b0 0x7ff0600cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:19.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.222+0000 7ff066699640 1 --2- 172.21.15.64:0/3000150903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060160eb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0600d05f0 tx=0x7ff05802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9de729f2ef9ebc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:19.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.222+0000 7ff064e96640 1 -- 172.21.15.64:0/3000150903 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05802c9f0 con 0x7ff060160aa0 2023-10-14T12:29:19.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.222+0000 7ff064e96640 1 -- 172.21.15.64:0/3000150903 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05802cb50 con 0x7ff060160aa0 2023-10-14T12:29:19.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.222+0000 7ff064e96640 1 -- 172.21.15.64:0/3000150903 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0580343f0 con 0x7ff060160aa0 2023-10-14T12:29:19.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 -- 172.21.15.64:0/3000150903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 msgr2=0x7ff060160eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 --2- 172.21.15.64:0/3000150903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060160eb0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff0600d05f0 tx=0x7ff05802be50 comp rx=0 tx=0).stop 2023-10-14T12:29:19.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 -- 172.21.15.64:0/3000150903 shutdown_connections 2023-10-14T12:29:19.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 --2- 172.21.15.64:0/3000150903 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060160eb0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 --2- 172.21.15.64:0/3000150903 >> v2:172.21.15.177:3300/0 conn(0x7ff0600cd9b0 0x7ff0600cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 -- 172.21.15.64:0/3000150903 >> 172.21.15.64:0/3000150903 conn(0x7ff0600b44a0 msgr2=0x7ff0600b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:19.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 -- 172.21.15.64:0/3000150903 shutdown_connections 2023-10-14T12:29:19.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.223+0000 7ff0680fc640 1 -- 172.21.15.64:0/3000150903 wait complete. 2023-10-14T12:29:19.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.225+0000 7ff0680fc640 1 Processor -- start 2023-10-14T12:29:19.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.225+0000 7ff0680fc640 1 -- start start 2023-10-14T12:29:19.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff0680fc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0600cd9b0 0x7ff06014cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff0680fc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff06015cd10 0x7ff0601515a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff0680fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff0680fc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060152a40 con 0x7ff060160aa0 2023-10-14T12:29:19.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff0680fc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff060151e30 con 0x7ff0600cd9b0 2023-10-14T12:29:19.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff0680fc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff060152110 con 0x7ff06015cd10 2023-10-14T12:29:19.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff066699640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff066699640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51514/0 (socket says 172.21.15.64:51514) 2023-10-14T12:29:19.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.226+0000 7ff066699640 1 -- 172.21.15.64:0/1348127993 learned_addr learned my addr 172.21.15.64:0/1348127993 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:19.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff065697640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff06015cd10 0x7ff0601515a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff065e98640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0600cd9b0 0x7ff06014cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff066699640 1 -- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff06015cd10 msgr2=0x7ff0601515a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff066699640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff06015cd10 0x7ff0601515a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff066699640 1 -- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0600cd9b0 msgr2=0x7ff06014cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff066699640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0600cd9b0 0x7ff06014cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff066699640 1 -- 172.21.15.64:0/1348127993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff058009b30 con 0x7ff060160aa0 2023-10-14T12:29:19.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff065e98640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0600cd9b0 0x7ff06014cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:19.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.227+0000 7ff066699640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060157dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff058036040 tx=0x7ff058004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:19.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.228+0000 7ff0567fc640 1 -- 172.21.15.64:0/1348127993 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05803e450 con 0x7ff060160aa0 2023-10-14T12:29:19.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.228+0000 7ff0567fc640 1 -- 172.21.15.64:0/1348127993 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff05803e5d0 con 0x7ff060160aa0 2023-10-14T12:29:19.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.228+0000 7ff0567fc640 1 -- 172.21.15.64:0/1348127993 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff05803e980 con 0x7ff060160aa0 2023-10-14T12:29:19.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.228+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0601523f0 con 0x7ff060160aa0 2023-10-14T12:29:19.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.228+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff060151ae0 con 0x7ff060160aa0 2023-10-14T12:29:19.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.229+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff060158cc0 con 0x7ff060160aa0 2023-10-14T12:29:19.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.230+0000 7ff0567fc640 1 -- 172.21.15.64:0/1348127993 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff05803eae0 con 0x7ff060160aa0 2023-10-14T12:29:19.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.231+0000 7ff0567fc640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff04406ae70 0x7ff04406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.231+0000 7ff0567fc640 1 -- 172.21.15.64:0/1348127993 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0580ac790 con 0x7ff060160aa0 2023-10-14T12:29:19.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.231+0000 7ff065e98640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff04406ae70 0x7ff04406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.232+0000 7ff065e98640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff04406ae70 0x7ff04406d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff05c003eb0 tx=0x7ff05c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:19.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.235+0000 7ff0567fc640 1 -- 172.21.15.64:0/1348127993 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff058077600 con 0x7ff060160aa0 2023-10-14T12:29:19.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.434+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0600d11c0 con 0x7ff060160aa0 2023-10-14T12:29:19.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.437+0000 7ff0567fc640 1 -- 172.21.15.64:0/1348127993 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7ff05807ac20 con 0x7ff060160aa0 2023-10-14T12:29:19.439 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:19.439 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:19.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.439+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff04406ae70 msgr2=0x7ff04406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.439+0000 7ff0680fc640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff04406ae70 0x7ff04406d330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff05c003eb0 tx=0x7ff05c009040 comp rx=0 tx=0).stop 2023-10-14T12:29:19.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.439+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 msgr2=0x7ff060157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.439+0000 7ff0680fc640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060157dd0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff058036040 tx=0x7ff058004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:19.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 shutdown_connections 2023-10-14T12:29:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff04406ae70 0x7ff04406d330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff060160aa0 0x7ff060157dd0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff06015cd10 0x7ff0601515a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 --2- 172.21.15.64:0/1348127993 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff0600cd9b0 0x7ff06014cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 >> 172.21.15.64:0/1348127993 conn(0x7ff0600b44a0 msgr2=0x7ff0600cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:19.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 shutdown_connections 2023-10-14T12:29:19.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.440+0000 7ff0680fc640 1 -- 172.21.15.64:0/1348127993 wait complete. 2023-10-14T12:29:19.459 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:19.459 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:19.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.673+0000 7f9c989c4640 1 Processor -- start 2023-10-14T12:29:19.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.673+0000 7f9c989c4640 1 -- start start 2023-10-14T12:29:19.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.674+0000 7f9c989c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c9415e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.674+0000 7f9c989c4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c940c8e40 con 0x7f9c940c8930 2023-10-14T12:29:19.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.675+0000 7f9c989c4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c940c9090 con 0x7f9c940cb400 2023-10-14T12:29:19.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.675+0000 7f9c989c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c9370 con 0x7f9c94070400 2023-10-14T12:29:19.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.675+0000 7f9c9259c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f9c940c8930 0x7f9c940cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:57426/0 (socket says 172.21.15.64:57426) 2023-10-14T12:29:19.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.675+0000 7f9c9259c640 1 -- 172.21.15.64:0/3677533143 learned_addr learned my addr 172.21.15.64:0/3677533143 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:19.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.675+0000 7f9c92d9d640 1 --2- 172.21.15.64:0/3677533143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c9415e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.675+0000 7f9c91d9b640 1 -- 172.21.15.64:0/3677533143 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108880385 0 0) 0x7f9c940c8e40 con 0x7f9c940c8930 2023-10-14T12:29:19.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.675+0000 7f9c91d9b640 1 -- 172.21.15.64:0/3677533143 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c7c003520 con 0x7f9c940c8930 2023-10-14T12:29:19.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.676+0000 7f9c91d9b640 1 -- 172.21.15.64:0/3677533143 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1008227018 0 0) 0x7f9c7c003520 con 0x7f9c940c8930 2023-10-14T12:29:19.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.676+0000 7f9c92d9d640 1 -- 172.21.15.64:0/3677533143 >> v1:172.21.15.177:6789/0 conn(0x7f9c940cb400 legacy=0x7f9c9415af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.676+0000 7f9c92d9d640 1 -- 172.21.15.64:0/3677533143 >> v1:172.21.15.64:6789/0 conn(0x7f9c940c8930 legacy=0x7f9c940cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.676+0000 7f9c92d9d640 1 -- 172.21.15.64:0/3677533143 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940c9650 con 0x7f9c94070400 2023-10-14T12:29:19.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.677+0000 7f9c92d9d640 1 --2- 172.21.15.64:0/3677533143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c9415e210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c840097d0 tx=0x7f9c8402b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95e1f02b7138145c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:19.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.678+0000 7f9c91d9b640 1 -- 172.21.15.64:0/3677533143 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c88001670 con 0x7f9c94070400 2023-10-14T12:29:19.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.678+0000 7f9c91d9b640 1 -- 172.21.15.64:0/3677533143 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8402e050 con 0x7f9c94070400 2023-10-14T12:29:19.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.678+0000 7f9c91d9b640 1 -- 172.21.15.64:0/3677533143 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84030730 con 0x7f9c94070400 2023-10-14T12:29:19.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.678+0000 7f9c989c4640 1 -- 172.21.15.64:0/3677533143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 msgr2=0x7f9c9415e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.678+0000 7f9c989c4640 1 --2- 172.21.15.64:0/3677533143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c9415e210 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9c840097d0 tx=0x7f9c8402b800 comp rx=0 tx=0).stop 2023-10-14T12:29:19.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.679+0000 7f9c989c4640 1 -- 172.21.15.64:0/3677533143 shutdown_connections 2023-10-14T12:29:19.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.679+0000 7f9c989c4640 1 --2- 172.21.15.64:0/3677533143 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c9415e210 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.679+0000 7f9c989c4640 1 -- 172.21.15.64:0/3677533143 >> 172.21.15.64:0/3677533143 conn(0x7f9c9406a470 msgr2=0x7f9c940afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:19.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.679+0000 7f9c989c4640 1 -- 172.21.15.64:0/3677533143 shutdown_connections 2023-10-14T12:29:19.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.679+0000 7f9c989c4640 1 -- 172.21.15.64:0/3677533143 wait complete. 2023-10-14T12:29:19.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.680+0000 7f9c989c4640 1 Processor -- start 2023-10-14T12:29:19.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.680+0000 7f9c989c4640 1 -- start start 2023-10-14T12:29:19.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.681+0000 7f9c989c4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c941558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.681+0000 7f9c989c4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c940c8930 0x7f9c9415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.681+0000 7f9c989c4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c940cb400 0x7f9c9415d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.681+0000 7f9c989c4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c6ac0 con 0x7f9c940cb400 2023-10-14T12:29:19.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.681+0000 7f9c989c4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c6da0 con 0x7f9c940c8930 2023-10-14T12:29:19.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.681+0000 7f9c989c4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c940c7080 con 0x7f9c94070400 2023-10-14T12:29:19.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c940cb400 0x7f9c9415d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c940cb400 0x7f9c9415d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51520/0 (socket says 172.21.15.64:51520) 2023-10-14T12:29:19.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 -- 172.21.15.64:0/2287818206 learned_addr learned my addr 172.21.15.64:0/2287818206 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:19.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c92d9d640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c941558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9259c640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c940c8930 0x7f9c9415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 -- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 msgr2=0x7f9c941558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c941558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 -- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c940c8930 msgr2=0x7f9c9415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c940c8930 0x7f9c9415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.682+0000 7f9c9359e640 1 -- 172.21.15.64:0/2287818206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84009400 con 0x7f9c940cb400 2023-10-14T12:29:19.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.683+0000 7f9c9359e640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c940cb400 0x7f9c9415d160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c680 tx=0x7f9c8c00cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:19.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.683+0000 7f9c7b7fe640 1 -- 172.21.15.64:0/2287818206 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c003b70 con 0x7f9c940cb400 2023-10-14T12:29:19.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.683+0000 7f9c7b7fe640 1 -- 172.21.15.64:0/2287818206 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c8c003cd0 con 0x7f9c940cb400 2023-10-14T12:29:19.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.683+0000 7f9c7b7fe640 1 -- 172.21.15.64:0/2287818206 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8c005310 con 0x7f9c940cb400 2023-10-14T12:29:19.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.683+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c940c7360 con 0x7f9c940cb400 2023-10-14T12:29:19.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.683+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c94155de0 con 0x7f9c940cb400 2023-10-14T12:29:19.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.684+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9404e9b0 con 0x7f9c940cb400 2023-10-14T12:29:19.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.685+0000 7f9c7b7fe640 1 -- 172.21.15.64:0/2287818206 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9c8c005470 con 0x7f9c940cb400 2023-10-14T12:29:19.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.686+0000 7f9c7b7fe640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9c8006ae70 0x7f9c8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:19.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.686+0000 7f9c7b7fe640 1 -- 172.21.15.64:0/2287818206 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9c8c089740 con 0x7f9c940cb400 2023-10-14T12:29:19.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.687+0000 7f9c92d9d640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9c8006ae70 0x7f9c8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:19.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.687+0000 7f9c92d9d640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9c8006ae70 0x7f9c8006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c84034000 tx=0x7f9c84008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:19.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.690+0000 7f9c7b7fe640 1 -- 172.21.15.64:0/2287818206 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c8c054460 con 0x7f9c940cb400 2023-10-14T12:29:19.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.883+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9c941f0350 con 0x7f9c940cb400 2023-10-14T12:29:19.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.884+0000 7f9c7b7fe640 1 -- 172.21.15.64:0/2287818206 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9c8c057a80 con 0x7f9c940cb400 2023-10-14T12:29:19.886 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:19.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9c8006ae70 msgr2=0x7f9c8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9c8006ae70 0x7f9c8006d330 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9c84034000 tx=0x7f9c84008030 comp rx=0 tx=0).stop 2023-10-14T12:29:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c940cb400 msgr2=0x7f9c9415d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c940cb400 0x7f9c9415d160 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9c8c00c680 tx=0x7f9c8c00cb40 comp rx=0 tx=0).stop 2023-10-14T12:29:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 shutdown_connections 2023-10-14T12:29:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9c8006ae70 0x7f9c8006d330 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c940cb400 0x7f9c9415d160 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c940c8930 0x7f9c9415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 --2- 172.21.15.64:0/2287818206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c94070400 0x7f9c941558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:19.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 >> 172.21.15.64:0/2287818206 conn(0x7f9c9406a470 msgr2=0x7f9c940cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 shutdown_connections 2023-10-14T12:29:19.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:19.887+0000 7f9c989c4640 1 -- 172.21.15.64:0/2287818206 wait complete. 2023-10-14T12:29:19.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:20.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.134+0000 7f5e09235640 1 Processor -- start 2023-10-14T12:29:20.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.134+0000 7f5e09235640 1 -- start start 2023-10-14T12:29:20.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.136+0000 7f5e09235640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 0x7f5e0406c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.136+0000 7f5e09235640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e04159ca0 con 0x7f5e0406cbf0 2023-10-14T12:29:20.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.136+0000 7f5e09235640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e040cac20 con 0x7f5e040cf0c0 2023-10-14T12:29:20.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.136+0000 7f5e09235640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040b34c0 con 0x7f5e040ad940 2023-10-14T12:29:20.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.136+0000 7f5dfbfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f5e0406cbf0 0x7f5e040ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:57442/0 (socket says 172.21.15.64:57442) 2023-10-14T12:29:20.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.136+0000 7f5dfbfff640 1 -- 172.21.15.64:0/2584486062 learned_addr learned my addr 172.21.15.64:0/2584486062 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:20.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.136+0000 7f5e03fff640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 0x7f5e0406c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2965686850 0 0) 0x7f5e04159ca0 con 0x7f5e0406cbf0 2023-10-14T12:29:20.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5df0005730 con 0x7f5e0406cbf0 2023-10-14T12:29:20.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3098523820 0 0) 0x7f5df0005730 con 0x7f5e0406cbf0 2023-10-14T12:29:20.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 msgr2=0x7f5e0406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:20.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 0x7f5e0406c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 >> v1:172.21.15.177:6789/0 conn(0x7f5e040cf0c0 legacy=0x7f5e0415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e040add20 con 0x7f5e0406cbf0 2023-10-14T12:29:20.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f5dec001670 con 0x7f5e0406cbf0 2023-10-14T12:29:20.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 >> v1:172.21.15.64:6789/0 conn(0x7f5e0406cbf0 legacy=0x7f5e040ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df0005c20 0x7f5df0006040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5df0006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.137+0000 7f5e037fe640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 0x7f5df00073f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040b34c0 con 0x7f5df00069d0 2023-10-14T12:29:20.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df000dd50 con 0x7f5df0005c20 2023-10-14T12:29:20.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df000df10 con 0x7f5e040ad940 2023-10-14T12:29:20.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5dfbfff640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5df0006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5e03fff640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df0005c20 0x7f5df0006040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5e08a34640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 0x7f5df00073f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5dfbfff640 1 -- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 msgr2=0x7f5df00073f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:20.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5dfbfff640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e040ad940 0x7f5df00073f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5dfbfff640 1 -- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df0005c20 msgr2=0x7f5df0006040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:20.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5dfbfff640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df0005c20 0x7f5df0006040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5dfbfff640 1 -- 172.21.15.64:0/2584486062 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df0005730 con 0x7f5df00069d0 2023-10-14T12:29:20.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.138+0000 7f5e03fff640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5df0005c20 0x7f5df0006040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:20.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.139+0000 7f5dfbfff640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5df0006e50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c0e0 tx=0x7f5df0007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d287cbca595f7a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:20.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.140+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec005ad0 con 0x7f5df00069d0 2023-10-14T12:29:20.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.140+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dec005c30 con 0x7f5df00069d0 2023-10-14T12:29:20.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.140+0000 7f5e037fe640 1 -- 172.21.15.64:0/2584486062 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dec02c810 con 0x7f5df00069d0 2023-10-14T12:29:20.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.140+0000 7f5e09235640 1 -- 172.21.15.64:0/2584486062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 msgr2=0x7f5df0006e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.140+0000 7f5e09235640 1 --2- 172.21.15.64:0/2584486062 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5df0006e50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f5dec00c0e0 tx=0x7f5df0007a00 comp rx=0 tx=0).stop 2023-10-14T12:29:20.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.140+0000 7f5e08a34640 1 -- 172.21.15.64:0/2584486062 reap_dead start 2023-10-14T12:29:20.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.141+0000 7f5e09235640 1 -- 172.21.15.64:0/2584486062 shutdown_connections 2023-10-14T12:29:20.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.141+0000 7f5e09235640 1 -- 172.21.15.64:0/2584486062 >> 172.21.15.64:0/2584486062 conn(0x7f5e0406a200 msgr2=0x7f5e0406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:20.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.141+0000 7f5e09235640 1 -- 172.21.15.64:0/2584486062 shutdown_connections 2023-10-14T12:29:20.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.141+0000 7f5e09235640 1 -- 172.21.15.64:0/2584486062 wait complete. 2023-10-14T12:29:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.142+0000 7f5e09235640 1 Processor -- start 2023-10-14T12:29:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.143+0000 7f5e09235640 1 -- start start 2023-10-14T12:29:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e09235640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5e04158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e09235640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e040ac2d0 0x7f5e040ac750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e09235640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e0415aec0 0x7f5e0415b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e09235640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e0415c8b0 con 0x7f5df00069d0 2023-10-14T12:29:20.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e09235640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e040acc90 con 0x7f5e040ac2d0 2023-10-14T12:29:20.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e09235640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e04158c90 con 0x7f5e0415aec0 2023-10-14T12:29:20.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5e04158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5e04158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51542/0 (socket says 172.21.15.64:51542) 2023-10-14T12:29:20.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 -- 172.21.15.64:0/541171881 learned_addr learned my addr 172.21.15.64:0/541171881 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:20.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5dfbfff640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e040ac2d0 0x7f5e040ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 -- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e0415aec0 msgr2=0x7f5e0415b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e0415aec0 0x7f5e0415b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 -- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e040ac2d0 msgr2=0x7f5e040ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e040ac2d0 0x7f5e040ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.144+0000 7f5e03fff640 1 -- 172.21.15.64:0/541171881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e0415ccd0 con 0x7f5df00069d0 2023-10-14T12:29:20.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.145+0000 7f5e03fff640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5e04158750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5df40116d0 tx=0x7f5df4011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:20.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.145+0000 7f5e017fa640 1 -- 172.21.15.64:0/541171881 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400f9c0 con 0x7f5df00069d0 2023-10-14T12:29:20.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.145+0000 7f5e017fa640 1 -- 172.21.15.64:0/541171881 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5df400fb20 con 0x7f5df00069d0 2023-10-14T12:29:20.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.145+0000 7f5e017fa640 1 -- 172.21.15.64:0/541171881 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5df400fed0 con 0x7f5df00069d0 2023-10-14T12:29:20.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.145+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e0415bc30 con 0x7f5df00069d0 2023-10-14T12:29:20.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.145+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e0415c1f0 con 0x7f5df00069d0 2023-10-14T12:29:20.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.146+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e0404e9b0 con 0x7f5df00069d0 2023-10-14T12:29:20.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.147+0000 7f5e017fa640 1 -- 172.21.15.64:0/541171881 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5df4015460 con 0x7f5df00069d0 2023-10-14T12:29:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.148+0000 7f5e017fa640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5de406ae70 0x7f5de406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.148+0000 7f5e017fa640 1 -- 172.21.15.64:0/541171881 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5df408a290 con 0x7f5df00069d0 2023-10-14T12:29:20.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.149+0000 7f5dfbfff640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5de406ae70 0x7f5de406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.150+0000 7f5dfbfff640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5de406ae70 0x7f5de406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5dec034000 tx=0x7f5dec009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:20.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.153+0000 7f5e017fa640 1 -- 172.21.15.64:0/541171881 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5df4054fb0 con 0x7f5df00069d0 2023-10-14T12:29:20.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.345+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5e0406dc30 con 0x7f5df00069d0 2023-10-14T12:29:20.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.346+0000 7f5e017fa640 1 -- 172.21.15.64:0/541171881 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5df40585d0 con 0x7f5df00069d0 2023-10-14T12:29:20.348 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:20.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.348+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5de406ae70 msgr2=0x7f5de406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.348+0000 7f5e09235640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5de406ae70 0x7f5de406d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5dec034000 tx=0x7f5dec009030 comp rx=0 tx=0).stop 2023-10-14T12:29:20.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.348+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 msgr2=0x7f5e04158750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5e04158750 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5df40116d0 tx=0x7f5df4011b90 comp rx=0 tx=0).stop 2023-10-14T12:29:20.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 shutdown_connections 2023-10-14T12:29:20.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5de406ae70 0x7f5de406d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5e0415aec0 0x7f5e0415b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5e040ac2d0 0x7f5e040ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 --2- 172.21.15.64:0/541171881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5df00069d0 0x7f5e04158750 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 >> 172.21.15.64:0/541171881 conn(0x7f5e0406a200 msgr2=0x7f5e04071620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:20.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 shutdown_connections 2023-10-14T12:29:20.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.349+0000 7f5e09235640 1 -- 172.21.15.64:0/541171881 wait complete. 2023-10-14T12:29:20.370 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:20.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.582+0000 7fdf925a9640 1 Processor -- start 2023-10-14T12:29:20.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.583+0000 7fdf925a9640 1 -- start start 2023-10-14T12:29:20.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.584+0000 7fdf925a9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf8c15cf90 0x7fdf8c15d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.584+0000 7fdf925a9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf8c15d8b0 0x7fdf8c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.584+0000 7fdf925a9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf8c160990 con 0x7fdf8c071950 2023-10-14T12:29:20.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf925a9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0ccff0 con 0x7fdf8c15cf90 2023-10-14T12:29:20.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf925a9640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf8c0ce1b0 con 0x7fdf8c15d8b0 2023-10-14T12:29:20.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf8bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf8c15cf90 0x7fdf8c15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf8bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf8c15cf90 0x7fdf8c15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51554/0 (socket says 172.21.15.64:51554) 2023-10-14T12:29:20.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf8bfff640 1 -- 172.21.15.64:0/2599042867 learned_addr learned my addr 172.21.15.64:0/2599042867 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:20.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf83fff640 1 --2- 172.21.15.64:0/2599042867 >> v2:172.21.15.177:3300/0 conn(0x7fdf8c15d8b0 0x7fdf8c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf8bfff640 1 -- 172.21.15.64:0/2599042867 >> v2:172.21.15.177:3300/0 conn(0x7fdf8c15d8b0 msgr2=0x7fdf8c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:20.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf8bfff640 1 --2- 172.21.15.64:0/2599042867 >> v2:172.21.15.177:3300/0 conn(0x7fdf8c15d8b0 0x7fdf8c069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf8bfff640 1 -- 172.21.15.64:0/2599042867 >> v1:172.21.15.177:6789/0 conn(0x7fdf8c071950 legacy=0x7fdf8c160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf8bfff640 1 -- 172.21.15.64:0/2599042867 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf8c0ccd10 con 0x7fdf8c15cf90 2023-10-14T12:29:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.585+0000 7fdf83fff640 1 --2- 172.21.15.64:0/2599042867 >> v2:172.21.15.177:3300/0 conn(0x7fdf8c15d8b0 0x7fdf8c069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.587+0000 7fdf8bfff640 1 --2- 172.21.15.64:0/2599042867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c15d370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c071e50 tx=0x7fdf7c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d77ec98c2bcc95a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:20.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.587+0000 7fdf8b7fe640 1 -- 172.21.15.64:0/2599042867 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c0317e0 con 0x7fdf8c15cf90 2023-10-14T12:29:20.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.587+0000 7fdf8b7fe640 1 -- 172.21.15.64:0/2599042867 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf7c031940 con 0x7fdf8c15cf90 2023-10-14T12:29:20.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.587+0000 7fdf8b7fe640 1 -- 172.21.15.64:0/2599042867 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf7c031cd0 con 0x7fdf8c15cf90 2023-10-14T12:29:20.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 -- 172.21.15.64:0/2599042867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 msgr2=0x7fdf8c15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 --2- 172.21.15.64:0/2599042867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c15d370 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c071e50 tx=0x7fdf7c02b880 comp rx=0 tx=0).stop 2023-10-14T12:29:20.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 -- 172.21.15.64:0/2599042867 shutdown_connections 2023-10-14T12:29:20.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 --2- 172.21.15.64:0/2599042867 >> v2:172.21.15.177:3300/0 conn(0x7fdf8c15d8b0 0x7fdf8c069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 --2- 172.21.15.64:0/2599042867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c15d370 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 -- 172.21.15.64:0/2599042867 >> 172.21.15.64:0/2599042867 conn(0x7fdf8c0cc080 msgr2=0x7fdf8c0cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:20.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 -- 172.21.15.64:0/2599042867 shutdown_connections 2023-10-14T12:29:20.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.588+0000 7fdf925a9640 1 -- 172.21.15.64:0/2599042867 wait complete. 2023-10-14T12:29:20.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.590+0000 7fdf925a9640 1 Processor -- start 2023-10-14T12:29:20.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.590+0000 7fdf925a9640 1 -- start start 2023-10-14T12:29:20.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf925a9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf8c071950 0x7fdf8c0b2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf925a9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf925a9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c15d8b0 0x7fdf8c0c3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf925a9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c0ac980 con 0x7fdf8c15cf90 2023-10-14T12:29:20.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf925a9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c1591b0 con 0x7fdf8c15d8b0 2023-10-14T12:29:20.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf925a9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf8c159450 con 0x7fdf8c071950 2023-10-14T12:29:20.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c158c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51566/0 (socket says 172.21.15.64:51566) 2023-10-14T12:29:20.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 -- 172.21.15.64:0/1350768595 learned_addr learned my addr 172.21.15.64:0/1350768595 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:20.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf90b46640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c15d8b0 0x7fdf8c0c3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf8bfff640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf8c071950 0x7fdf8c0b2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 -- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf8c071950 msgr2=0x7fdf8c0b2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf8c071950 0x7fdf8c0b2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 -- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c15d8b0 msgr2=0x7fdf8c0c3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c15d8b0 0x7fdf8c0c3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf83fff640 1 -- 172.21.15.64:0/1350768595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf7c0094d0 con 0x7fdf8c15cf90 2023-10-14T12:29:20.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf8bfff640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf8c071950 0x7fdf8c0b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:20.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.591+0000 7fdf90b46640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c15d8b0 0x7fdf8c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:20.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.592+0000 7fdf83fff640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c158c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400d800 tx=0x7fdf7400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:20.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.592+0000 7fdf897fa640 1 -- 172.21.15.64:0/1350768595 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74004030 con 0x7fdf8c15cf90 2023-10-14T12:29:20.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.592+0000 7fdf897fa640 1 -- 172.21.15.64:0/1350768595 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf74004190 con 0x7fdf8c15cf90 2023-10-14T12:29:20.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.592+0000 7fdf897fa640 1 -- 172.21.15.64:0/1350768595 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf74004520 con 0x7fdf8c15cf90 2023-10-14T12:29:20.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.592+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf8c159730 con 0x7fdf8c15cf90 2023-10-14T12:29:20.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.592+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf8c159a10 con 0x7fdf8c15cf90 2023-10-14T12:29:20.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.593+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf8c073ef0 con 0x7fdf8c15cf90 2023-10-14T12:29:20.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.594+0000 7fdf897fa640 1 -- 172.21.15.64:0/1350768595 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf740096a0 con 0x7fdf8c15cf90 2023-10-14T12:29:20.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.595+0000 7fdf897fa640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf6c06ae70 0x7fdf6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:20.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.595+0000 7fdf897fa640 1 -- 172.21.15.64:0/1350768595 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdf74089a70 con 0x7fdf8c15cf90 2023-10-14T12:29:20.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.596+0000 7fdf8bfff640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf6c06ae70 0x7fdf6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:20.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.597+0000 7fdf8bfff640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf6c06ae70 0x7fdf6c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c036000 tx=0x7fdf7c03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:20.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.599+0000 7fdf897fa640 1 -- 172.21.15.64:0/1350768595 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf74054820 con 0x7fdf8c15cf90 2023-10-14T12:29:20.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.792+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdf8c0ae850 con 0x7fdf8c15cf90 2023-10-14T12:29:20.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.792+0000 7fdf897fa640 1 -- 172.21.15.64:0/1350768595 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdf74057e40 con 0x7fdf8c15cf90 2023-10-14T12:29:20.794 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:20.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.795+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf6c06ae70 msgr2=0x7fdf6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.795+0000 7fdf925a9640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf6c06ae70 0x7fdf6c06d330 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdf7c036000 tx=0x7fdf7c03d040 comp rx=0 tx=0).stop 2023-10-14T12:29:20.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.795+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 msgr2=0x7fdf8c158c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:20.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.795+0000 7fdf925a9640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c158c70 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fdf7400d800 tx=0x7fdf7400dcc0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 shutdown_connections 2023-10-14T12:29:20.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf6c06ae70 0x7fdf6c06d330 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf8c15d8b0 0x7fdf8c0c3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf8c15cf90 0x7fdf8c158c70 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 --2- 172.21.15.64:0/1350768595 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf8c071950 0x7fdf8c0b2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:20.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 >> 172.21.15.64:0/1350768595 conn(0x7fdf8c0cc080 msgr2=0x7fdf8c15fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:20.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 shutdown_connections 2023-10-14T12:29:20.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:20.796+0000 7fdf925a9640 1 -- 172.21.15.64:0/1350768595 wait complete. 2023-10-14T12:29:20.817 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:21.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.041+0000 7f6abd21a640 1 Processor -- start 2023-10-14T12:29:21.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.041+0000 7f6abd21a640 1 -- start start 2023-10-14T12:29:21.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.042+0000 7f6abd21a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6ab80d0d80 0x7f6ab80d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.042+0000 7f6abd21a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6ab80b5fd0 0x7f6ab80b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6abd21a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ab80ce810 con 0x7f6ab815c940 2023-10-14T12:29:21.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6abd21a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab80d1740 con 0x7f6ab80d0d80 2023-10-14T12:29:21.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6abd21a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ab80b5b40 con 0x7f6ab80b5fd0 2023-10-14T12:29:21.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab7fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f6ab815c940 0x7f6ab80d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:57456/0 (socket says 172.21.15.64:57456) 2023-10-14T12:29:21.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab7fff640 1 -- 172.21.15.64:0/1943106709 learned_addr learned my addr 172.21.15.64:0/1943106709 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:21.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab77fe640 1 --2- 172.21.15.64:0/1943106709 >> v2:172.21.15.64:3300/0 conn(0x7f6ab80d0d80 0x7f6ab80d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6abca19640 1 --2- 172.21.15.64:0/1943106709 >> v2:172.21.15.177:3300/0 conn(0x7f6ab80b5fd0 0x7f6ab80b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab6ffd640 1 -- 172.21.15.64:0/1943106709 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1494480273 0 0) 0x7f6ab80ce810 con 0x7f6ab815c940 2023-10-14T12:29:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab6ffd640 1 -- 172.21.15.64:0/1943106709 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6aa0003520 con 0x7f6ab815c940 2023-10-14T12:29:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab77fe640 1 -- 172.21.15.64:0/1943106709 >> v2:172.21.15.177:3300/0 conn(0x7f6ab80b5fd0 msgr2=0x7f6ab80b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab77fe640 1 --2- 172.21.15.64:0/1943106709 >> v2:172.21.15.177:3300/0 conn(0x7f6ab80b5fd0 0x7f6ab80b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab77fe640 1 -- 172.21.15.64:0/1943106709 >> v1:172.21.15.64:6789/0 conn(0x7f6ab815c940 legacy=0x7f6ab80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.043+0000 7f6ab77fe640 1 -- 172.21.15.64:0/1943106709 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab80d0b10 con 0x7f6ab80d0d80 2023-10-14T12:29:21.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.044+0000 7f6ab77fe640 1 --2- 172.21.15.64:0/1943106709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80d1200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8160460 tx=0x7f6aac02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50da1a707a948f8d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.045+0000 7f6ab6ffd640 1 -- 172.21.15.64:0/1943106709 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac02e070 con 0x7f6ab80d0d80 2023-10-14T12:29:21.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.045+0000 7f6ab6ffd640 1 -- 172.21.15.64:0/1943106709 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac0315a0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.045+0000 7f6ab6ffd640 1 -- 172.21.15.64:0/1943106709 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac031930 con 0x7f6ab80d0d80 2023-10-14T12:29:21.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.045+0000 7f6abd21a640 1 -- 172.21.15.64:0/1943106709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 msgr2=0x7f6ab80d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.045+0000 7f6abd21a640 1 --2- 172.21.15.64:0/1943106709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80d1200 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8160460 tx=0x7f6aac02b840 comp rx=0 tx=0).stop 2023-10-14T12:29:21.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.046+0000 7f6abd21a640 1 -- 172.21.15.64:0/1943106709 shutdown_connections 2023-10-14T12:29:21.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.046+0000 7f6abd21a640 1 --2- 172.21.15.64:0/1943106709 >> v2:172.21.15.177:3300/0 conn(0x7f6ab80b5fd0 0x7f6ab80b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.046+0000 7f6abd21a640 1 --2- 172.21.15.64:0/1943106709 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80d1200 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.046+0000 7f6abd21a640 1 -- 172.21.15.64:0/1943106709 >> 172.21.15.64:0/1943106709 conn(0x7f6ab809bb30 msgr2=0x7f6ab80d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:21.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.046+0000 7f6abd21a640 1 -- 172.21.15.64:0/1943106709 shutdown_connections 2023-10-14T12:29:21.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.046+0000 7f6abd21a640 1 -- 172.21.15.64:0/1943106709 wait complete. 2023-10-14T12:29:21.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.048+0000 7f6abd21a640 1 Processor -- start 2023-10-14T12:29:21.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.048+0000 7f6abd21a640 1 -- start start 2023-10-14T12:29:21.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6abd21a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab80b5fd0 0x7f6ab8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6abd21a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6abd21a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab815c940 0x7f6ab80c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6abd21a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab81555c0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6abd21a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8156f50 con 0x7f6ab815c940 2023-10-14T12:29:21.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6abd21a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab8156c70 con 0x7f6ab80b5fd0 2023-10-14T12:29:21.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80c88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51578/0 (socket says 172.21.15.64:51578) 2023-10-14T12:29:21.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 -- 172.21.15.64:0/338594503 learned_addr learned my addr 172.21.15.64:0/338594503 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:21.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab7fff640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab80b5fd0 0x7f6ab8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6abca19640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab815c940 0x7f6ab80c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 -- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab80b5fd0 msgr2=0x7f6ab8155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab80b5fd0 0x7f6ab8155080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 -- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab815c940 msgr2=0x7f6ab80c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab815c940 0x7f6ab80c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.049+0000 7f6ab77fe640 1 -- 172.21.15.64:0/338594503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac009400 con 0x7f6ab80d0d80 2023-10-14T12:29:21.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.050+0000 7f6ab77fe640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80c88f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.050+0000 7f6ab4ff9640 1 -- 172.21.15.64:0/338594503 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac032840 con 0x7f6ab80d0d80 2023-10-14T12:29:21.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.050+0000 7f6ab4ff9640 1 -- 172.21.15.64:0/338594503 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac0329c0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.050+0000 7f6ab4ff9640 1 -- 172.21.15.64:0/338594503 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac032d70 con 0x7f6ab80d0d80 2023-10-14T12:29:21.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.050+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ab8157430 con 0x7f6ab80d0d80 2023-10-14T12:29:21.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.050+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ab81579f0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.051+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ab8157be0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.052+0000 7f6ab4ff9640 1 -- 172.21.15.64:0/338594503 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6aac04d3f0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.053+0000 7f6ab4ff9640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6aa406ae70 0x7f6aa406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.053+0000 7f6ab4ff9640 1 -- 172.21.15.64:0/338594503 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6aac0ab3d0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.054+0000 7f6ab7fff640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6aa406ae70 0x7f6aa406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.055+0000 7f6ab7fff640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6aa406ae70 0x7f6aa406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8001560 tx=0x7f6aa8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.057+0000 7f6ab4ff9640 1 -- 172.21.15.64:0/338594503 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6aac076200 con 0x7f6ab80d0d80 2023-10-14T12:29:21.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.242+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6ab804e9b0 con 0x7f6ab80d0d80 2023-10-14T12:29:21.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.243+0000 7f6ab4ff9640 1 -- 172.21.15.64:0/338594503 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6aac079820 con 0x7f6ab80d0d80 2023-10-14T12:29:21.244 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:21.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6aa406ae70 msgr2=0x7f6aa406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6aa406ae70 0x7f6aa406d330 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6aa8001560 tx=0x7f6aa8009040 comp rx=0 tx=0).stop 2023-10-14T12:29:21.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 msgr2=0x7f6ab80c88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80c88f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f6aac000c00 tx=0x7f6aac0046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 shutdown_connections 2023-10-14T12:29:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6aa406ae70 0x7f6aa406d330 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6ab815c940 0x7f6ab80c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ab80d0d80 0x7f6ab80c88f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 --2- 172.21.15.64:0/338594503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ab80b5fd0 0x7f6ab8155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 >> 172.21.15.64:0/338594503 conn(0x7f6ab809bb30 msgr2=0x7f6ab80b7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:21.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.245+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 shutdown_connections 2023-10-14T12:29:21.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.246+0000 7f6abd21a640 1 -- 172.21.15.64:0/338594503 wait complete. 2023-10-14T12:29:21.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:29:21.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.482+0000 7f8529a10640 1 Processor -- start 2023-10-14T12:29:21.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.482+0000 7f8529a10640 1 -- start start 2023-10-14T12:29:21.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.484+0000 7f8529a10640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f852415ca80 0x7f85240cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.484+0000 7f8529a10640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f852415ce60 0x7f85240b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.484+0000 7f8529a10640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85240b0550 0x7f85240c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.484+0000 7f8529a10640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85240b0980 con 0x7f852415ce60 2023-10-14T12:29:21.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.484+0000 7f8529a10640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8524161620 con 0x7f852415ca80 2023-10-14T12:29:21.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.484+0000 7f8529a10640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240cafa0 con 0x7f85240b0550 2023-10-14T12:29:21.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f852415ce60 0x7f85240b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f852415ce60 0x7f85240b0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51590/0 (socket says 172.21.15.64:51590) 2023-10-14T12:29:21.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 -- 172.21.15.64:0/218686789 learned_addr learned my addr 172.21.15.64:0/218686789 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:21.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f85237fe640 1 --2- 172.21.15.64:0/218686789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85240b0550 0x7f85240c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 -- 172.21.15.64:0/218686789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85240b0550 msgr2=0x7f85240c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:21.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 --2- 172.21.15.64:0/218686789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85240b0550 0x7f85240c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 -- 172.21.15.64:0/218686789 >> v2:172.21.15.177:3300/0 conn(0x7f852415ca80 msgr2=0x7f85240cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:21.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 --2- 172.21.15.64:0/218686789 >> v2:172.21.15.177:3300/0 conn(0x7f852415ca80 0x7f85240cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f851bfff640 1 -- 172.21.15.64:0/218686789 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85240cb280 con 0x7f852415ce60 2023-10-14T12:29:21.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.485+0000 7f85237fe640 1 --2- 172.21.15.64:0/218686789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85240b0550 0x7f85240c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:21.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.486+0000 7f851bfff640 1 --2- 172.21.15.64:0/218686789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b0010 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f85240b0cd0 tx=0x7f850c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a899f87506a86af4 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f85227fc640 1 -- 172.21.15.64:0/218686789 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c031880 con 0x7f852415ce60 2023-10-14T12:29:21.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f85227fc640 1 -- 172.21.15.64:0/218686789 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c0319e0 con 0x7f852415ce60 2023-10-14T12:29:21.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f85227fc640 1 -- 172.21.15.64:0/218686789 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c031d70 con 0x7f852415ce60 2023-10-14T12:29:21.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f8529a10640 1 -- 172.21.15.64:0/218686789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 msgr2=0x7f85240b0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f8529a10640 1 --2- 172.21.15.64:0/218686789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b0010 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f85240b0cd0 tx=0x7f850c02b920 comp rx=0 tx=0).stop 2023-10-14T12:29:21.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f8529a10640 1 -- 172.21.15.64:0/218686789 shutdown_connections 2023-10-14T12:29:21.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f8529a10640 1 --2- 172.21.15.64:0/218686789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f85240b0550 0x7f85240c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f8529a10640 1 --2- 172.21.15.64:0/218686789 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b0010 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f8529a10640 1 --2- 172.21.15.64:0/218686789 >> v2:172.21.15.177:3300/0 conn(0x7f852415ca80 0x7f85240cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.487+0000 7f8529a10640 1 -- 172.21.15.64:0/218686789 >> 172.21.15.64:0/218686789 conn(0x7f852406c1c0 msgr2=0x7f852406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:21.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.488+0000 7f8529a10640 1 -- 172.21.15.64:0/218686789 shutdown_connections 2023-10-14T12:29:21.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.488+0000 7f8529a10640 1 -- 172.21.15.64:0/218686789 wait complete. 2023-10-14T12:29:21.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.489+0000 7f8529a10640 1 Processor -- start 2023-10-14T12:29:21.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.489+0000 7f8529a10640 1 -- start start 2023-10-14T12:29:21.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.490+0000 7f8529a10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b0550 0x7f852415d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.490+0000 7f8529a10640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f852415ca80 0x7f85241f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.490+0000 7f8529a10640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.490+0000 7f8529a10640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85240c3100 con 0x7f852415ce60 2023-10-14T12:29:21.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.490+0000 7f8529a10640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852414d790 con 0x7f85240b0550 2023-10-14T12:29:21.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.490+0000 7f8529a10640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85240c37f0 con 0x7f852415ca80 2023-10-14T12:29:21.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b1e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51598/0 (socket says 172.21.15.64:51598) 2023-10-14T12:29:21.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 -- 172.21.15.64:0/2073597494 learned_addr learned my addr 172.21.15.64:0/2073597494 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:21.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f8522ffd640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b0550 0x7f852415d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f851bfff640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f852415ca80 0x7f85241f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 -- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f852415ca80 msgr2=0x7f85241f64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f852415ca80 0x7f85241f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 -- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b0550 msgr2=0x7f852415d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b0550 0x7f852415d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 -- 172.21.15.64:0/2073597494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f850c0094d0 con 0x7f852415ce60 2023-10-14T12:29:21.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.491+0000 7f85237fe640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b1e60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f851c00cd50 tx=0x7f851c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.492+0000 7f8520ff9640 1 -- 172.21.15.64:0/2073597494 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00f680 con 0x7f852415ce60 2023-10-14T12:29:21.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.492+0000 7f8520ff9640 1 -- 172.21.15.64:0/2073597494 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851c00f800 con 0x7f852415ce60 2023-10-14T12:29:21.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.492+0000 7f8520ff9640 1 -- 172.21.15.64:0/2073597494 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00fbb0 con 0x7f852415ce60 2023-10-14T12:29:21.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.492+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85241f6a10 con 0x7f852415ce60 2023-10-14T12:29:21.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.492+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85240c2860 con 0x7f852415ce60 2023-10-14T12:29:21.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.493+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8524073ef0 con 0x7f852415ce60 2023-10-14T12:29:21.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.494+0000 7f8520ff9640 1 -- 172.21.15.64:0/2073597494 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f851c00b040 con 0x7f852415ce60 2023-10-14T12:29:21.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.495+0000 7f8520ff9640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f850406ae70 0x7f850406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.495+0000 7f8520ff9640 1 -- 172.21.15.64:0/2073597494 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f851c08a300 con 0x7f852415ce60 2023-10-14T12:29:21.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.495+0000 7f8522ffd640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f850406ae70 0x7f850406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.496+0000 7f8522ffd640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f850406ae70 0x7f850406d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f851400b810 tx=0x7f8514008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.499+0000 7f8520ff9640 1 -- 172.21.15.64:0/2073597494 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f851c0550c0 con 0x7f852415ce60 2023-10-14T12:29:21.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.729+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85240b4510 con 0x7f852415ce60 2023-10-14T12:29:21.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.731+0000 7f8520ff9640 1 -- 172.21.15.64:0/2073597494 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f851c0586e0 con 0x7f852415ce60 2023-10-14T12:29:21.732 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:21.733 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:29:21.733 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:29:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f850406ae70 msgr2=0x7f850406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f850406ae70 0x7f850406d330 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f851400b810 tx=0x7f8514008040 comp rx=0 tx=0).stop 2023-10-14T12:29:21.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 msgr2=0x7f85240b1e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b1e60 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f851c00cd50 tx=0x7f851c00a650 comp rx=0 tx=0).stop 2023-10-14T12:29:21.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 shutdown_connections 2023-10-14T12:29:21.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f850406ae70 0x7f850406d330 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f852415ce60 0x7f85240b1e60 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f852415ca80 0x7f85241f64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 --2- 172.21.15.64:0/2073597494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f85240b0550 0x7f852415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.733+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 >> 172.21.15.64:0/2073597494 conn(0x7f852406c1c0 msgr2=0x7f85240700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.734+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 shutdown_connections 2023-10-14T12:29:21.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.734+0000 7f8529a10640 1 -- 172.21.15.64:0/2073597494 wait complete. 2023-10-14T12:29:21.755 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:21.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.981+0000 7f1c4c8bb640 1 Processor -- start 2023-10-14T12:29:21.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.981+0000 7f1c4c8bb640 1 -- start start 2023-10-14T12:29:21.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.983+0000 7f1c4c8bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c4815ad00 0x7f1c480701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.983+0000 7f1c4c8bb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1c4815f040 0x7f1c4815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.983+0000 7f1c4c8bb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c480707f0 con 0x7f1c480b0010 2023-10-14T12:29:21.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.983+0000 7f1c4c8bb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c48070ad0 con 0x7f1c4815f040 2023-10-14T12:29:21.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.983+0000 7f1c4c8bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4815b1d0 con 0x7f1c4815ad00 2023-10-14T12:29:21.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c45d9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c4815ad00 0x7f1c480701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c46d9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1c4815f040 0x7f1c4815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c45d9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c4815ad00 0x7f1c480701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:37718/0 (socket says 172.21.15.64:37718) 2023-10-14T12:29:21.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c45d9b640 1 -- 172.21.15.64:0/1665815838 learned_addr learned my addr 172.21.15.64:0/1665815838 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:21.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c46d9d640 1 -- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c4815ad00 msgr2=0x7f1c480701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:21.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c46d9d640 1 --2- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c4815ad00 0x7f1c480701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c46d9d640 1 -- 172.21.15.64:0/1665815838 >> v1:172.21.15.177:6789/0 conn(0x7f1c480b0010 legacy=0x7f1c480b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c46d9d640 1 -- 172.21.15.64:0/1665815838 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4815b4b0 con 0x7f1c4815f040 2023-10-14T12:29:21.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.984+0000 7f1c45d9b640 1 --2- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c4815ad00 0x7f1c480701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:21.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.986+0000 7f1c46d9d640 1 --2- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815f040 0x7f1c4815b9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009d90 tx=0x7f1c4002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cf3a723acf732c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.987+0000 7f1c4559a640 1 -- 172.21.15.64:0/1665815838 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4002cc50 con 0x7f1c4815f040 2023-10-14T12:29:21.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.987+0000 7f1c4559a640 1 -- 172.21.15.64:0/1665815838 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4002cdb0 con 0x7f1c4815f040 2023-10-14T12:29:21.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.987+0000 7f1c4559a640 1 -- 172.21.15.64:0/1665815838 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40034660 con 0x7f1c4815f040 2023-10-14T12:29:21.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.987+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815f040 msgr2=0x7f1c4815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.987+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815f040 0x7f1c4815b9d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009d90 tx=0x7f1c4002bea0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.988+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/1665815838 shutdown_connections 2023-10-14T12:29:21.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.988+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815f040 0x7f1c4815b9d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.988+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/1665815838 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c4815ad00 0x7f1c480701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.988+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/1665815838 >> 172.21.15.64:0/1665815838 conn(0x7f1c4806c1c0 msgr2=0x7f1c4806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:21.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.988+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/1665815838 shutdown_connections 2023-10-14T12:29:21.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.988+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/1665815838 wait complete. 2023-10-14T12:29:21.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.990+0000 7f1c4c8bb640 1 Processor -- start 2023-10-14T12:29:21.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.990+0000 7f1c4c8bb640 1 -- start start 2023-10-14T12:29:21.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.991+0000 7f1c4c8bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c480b0010 0x7f1c48151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.991+0000 7f1c4c8bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815ad00 0x7f1c480c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c4c8bb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c4815f040 0x7f1c48156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:21.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c4c8bb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c481522b0 con 0x7f1c4815f040 2023-10-14T12:29:21.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c4c8bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480c6310 con 0x7f1c4815ad00 2023-10-14T12:29:21.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c4c8bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c480c5700 con 0x7f1c480b0010 2023-10-14T12:29:21.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c4815f040 0x7f1c48156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c4815f040 0x7f1c48156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51614/0 (socket says 172.21.15.64:51614) 2023-10-14T12:29:21.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 -- 172.21.15.64:0/3126623119 learned_addr learned my addr 172.21.15.64:0/3126623119 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:21.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c45d9b640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815ad00 0x7f1c480c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c4659c640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c480b0010 0x7f1c48151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:21.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 -- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c480b0010 msgr2=0x7f1c48151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c480b0010 0x7f1c48151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 -- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815ad00 msgr2=0x7f1c480c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815ad00 0x7f1c480c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:21.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.992+0000 7f1c46d9d640 1 -- 172.21.15.64:0/3126623119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c0094d0 con 0x7f1c4815f040 2023-10-14T12:29:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.993+0000 7f1c45d9b640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815ad00 0x7f1c480c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.993+0000 7f1c46d9d640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c4815f040 0x7f1c48156c10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009d90 tx=0x7f1c40004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.993+0000 7f1c36ffd640 1 -- 172.21.15.64:0/3126623119 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40040650 con 0x7f1c4815f040 2023-10-14T12:29:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.994+0000 7f1c36ffd640 1 -- 172.21.15.64:0/3126623119 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c400407b0 con 0x7f1c4815f040 2023-10-14T12:29:21.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.994+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c40009a70 con 0x7f1c4815f040 2023-10-14T12:29:21.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.994+0000 7f1c36ffd640 1 -- 172.21.15.64:0/3126623119 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40040b60 con 0x7f1c4815f040 2023-10-14T12:29:21.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.994+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c480c5cc0 con 0x7f1c4815f040 2023-10-14T12:29:21.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.995+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c480c64c0 con 0x7f1c4815f040 2023-10-14T12:29:22.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.996+0000 7f1c36ffd640 1 -- 172.21.15.64:0/3126623119 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1c40040cc0 con 0x7f1c4815f040 2023-10-14T12:29:22.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.997+0000 7f1c36ffd640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1c2806ae70 0x7f1c2806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:22.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.997+0000 7f1c36ffd640 1 -- 172.21.15.64:0/3126623119 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1c400ac640 con 0x7f1c4815f040 2023-10-14T12:29:22.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.998+0000 7f1c4659c640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1c2806ae70 0x7f1c2806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:22.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:21.999+0000 7f1c4659c640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1c2806ae70 0x7f1c2806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f60 tx=0x7f1c38009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:22.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.001+0000 7f1c36ffd640 1 -- 172.21.15.64:0/3126623119 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1c480c64c0 con 0x7f1c4815f040 2023-10-14T12:29:22.197 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.195+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c480c6480 con 0x7f1c4815f040 2023-10-14T12:29:22.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.199+0000 7f1c36ffd640 1 -- 172.21.15.64:0/3126623119 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18334 (secure 0 0 0) 0x7f1c400773f0 con 0x7f1c4815f040 2023-10-14T12:29:22.201 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:22.201 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":27,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:28:52.755450+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:22.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.201+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1c2806ae70 msgr2=0x7f1c2806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.201+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1c2806ae70 0x7f1c2806d330 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1c38000f60 tx=0x7f1c38009040 comp rx=0 tx=0).stop 2023-10-14T12:29:22.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.201+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c4815f040 msgr2=0x7f1c48156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.201+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c4815f040 0x7f1c48156c10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1c40009d90 tx=0x7f1c40004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:22.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 shutdown_connections 2023-10-14T12:29:22.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1c2806ae70 0x7f1c2806d330 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1c4815f040 0x7f1c48156c10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1c4815ad00 0x7f1c480c2e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 --2- 172.21.15.64:0/3126623119 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1c480b0010 0x7f1c48151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 >> 172.21.15.64:0/3126623119 conn(0x7f1c4806c1c0 msgr2=0x7f1c480adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:22.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 shutdown_connections 2023-10-14T12:29:22.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.202+0000 7f1c4c8bb640 1 -- 172.21.15.64:0/3126623119 wait complete. 2023-10-14T12:29:22.224 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:29:22.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.449+0000 7fb0f62bb640 1 Processor -- start 2023-10-14T12:29:22.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.449+0000 7fb0f62bb640 1 -- start start 2023-10-14T12:29:22.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f62bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f00c20e0 0x7fb0f00710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:22.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f62bb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb0f0071630 0x7fb0f00cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:22.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f62bb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0f00c2570 con 0x7fb0f00c9e00 2023-10-14T12:29:22.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f62bb640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0f00cde00 con 0x7fb0f0071630 2023-10-14T12:29:22.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f62bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0071e40 con 0x7fb0f00c20e0 2023-10-14T12:29:22.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f4858640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb0f0071630 0x7fb0f00cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:22.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f4858640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb0f0071630 0x7fb0f00cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51620/0 (socket says 172.21.15.64:51620) 2023-10-14T12:29:22.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0f4858640 1 -- 172.21.15.64:0/1924179816 learned_addr learned my addr 172.21.15.64:0/1924179816 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:22.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.451+0000 7fb0ef7fe640 1 --2- 172.21.15.64:0/1924179816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f00c20e0 0x7fb0f00710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.452+0000 7fb0f4858640 1 -- 172.21.15.64:0/1924179816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f00c20e0 msgr2=0x7fb0f00710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.452+0000 7fb0f4858640 1 --2- 172.21.15.64:0/1924179816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f00c20e0 0x7fb0f00710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.452+0000 7fb0f4858640 1 -- 172.21.15.64:0/1924179816 >> v1:172.21.15.177:6789/0 conn(0x7fb0f00c9e00 legacy=0x7fb0f00ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.452+0000 7fb0f4858640 1 -- 172.21.15.64:0/1924179816 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f0072120 con 0x7fb0f0071630 2023-10-14T12:29:22.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.453+0000 7fb0f4858640 1 --2- 172.21.15.64:0/1924179816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f0071630 0x7fb0f00cca00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009e50 tx=0x7fb0e802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c037cf0e1f3dc3d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:22.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.453+0000 7fb0eeffd640 1 -- 172.21.15.64:0/1924179816 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e802cb00 con 0x7fb0f0071630 2023-10-14T12:29:22.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.453+0000 7fb0eeffd640 1 -- 172.21.15.64:0/1924179816 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e802cc60 con 0x7fb0f0071630 2023-10-14T12:29:22.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.453+0000 7fb0eeffd640 1 -- 172.21.15.64:0/1924179816 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e80343f0 con 0x7fb0f0071630 2023-10-14T12:29:22.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 -- 172.21.15.64:0/1924179816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f0071630 msgr2=0x7fb0f00cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/1924179816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f0071630 0x7fb0f00cca00 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb0e8009e50 tx=0x7fb0e802bf60 comp rx=0 tx=0).stop 2023-10-14T12:29:22.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 -- 172.21.15.64:0/1924179816 shutdown_connections 2023-10-14T12:29:22.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/1924179816 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f0071630 0x7fb0f00cca00 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/1924179816 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f00c20e0 0x7fb0f00710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 -- 172.21.15.64:0/1924179816 >> 172.21.15.64:0/1924179816 conn(0x7fb0f006c1c0 msgr2=0x7fb0f006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:22.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 -- 172.21.15.64:0/1924179816 shutdown_connections 2023-10-14T12:29:22.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.454+0000 7fb0f62bb640 1 -- 172.21.15.64:0/1924179816 wait complete. 2023-10-14T12:29:22.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.456+0000 7fb0f62bb640 1 Processor -- start 2023-10-14T12:29:22.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.456+0000 7fb0f62bb640 1 -- start start 2023-10-14T12:29:22.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0f62bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f0071630 0x7fb0f014f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:22.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0f62bb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f00c20e0 0x7fb0f0158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:22.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0f62bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0f00c9e00 0x7fb0f0158880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:22.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0f62bb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0152f40 con 0x7fb0f00c20e0 2023-10-14T12:29:22.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0f62bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0153a80 con 0x7fb0f00c9e00 2023-10-14T12:29:22.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0f62bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0f0153150 con 0x7fb0f0071630 2023-10-14T12:29:22.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0ef7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f00c20e0 0x7fb0f0158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:22.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0ef7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f00c20e0 0x7fb0f0158340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51622/0 (socket says 172.21.15.64:51622) 2023-10-14T12:29:22.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.457+0000 7fb0ef7fe640 1 -- 172.21.15.64:0/539845707 learned_addr learned my addr 172.21.15.64:0/539845707 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:22.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0f4858640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0f00c9e00 0x7fb0f0158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:22.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0effff640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f0071630 0x7fb0f014f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:22.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ef7fe640 1 -- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f0071630 msgr2=0x7fb0f014f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ef7fe640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f0071630 0x7fb0f014f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ef7fe640 1 -- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0f00c9e00 msgr2=0x7fb0f0158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ef7fe640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0f00c9e00 0x7fb0f0158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ef7fe640 1 -- 172.21.15.64:0/539845707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8009b30 con 0x7fb0f00c20e0 2023-10-14T12:29:22.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0f4858640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0f00c9e00 0x7fb0f0158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:22.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0effff640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f0071630 0x7fb0f014f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:22.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ef7fe640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f00c20e0 0x7fb0f0158340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400d5f0 tx=0x7fb0e400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:22.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ecff9640 1 -- 172.21.15.64:0/539845707 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e40125f0 con 0x7fb0f00c20e0 2023-10-14T12:29:22.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ecff9640 1 -- 172.21.15.64:0/539845707 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0e4012750 con 0x7fb0f00c20e0 2023-10-14T12:29:22.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0ecff9640 1 -- 172.21.15.64:0/539845707 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4012b00 con 0x7fb0f00c20e0 2023-10-14T12:29:22.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.458+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f0153430 con 0x7fb0f00c20e0 2023-10-14T12:29:22.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.459+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f0151540 con 0x7fb0f00c20e0 2023-10-14T12:29:22.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.460+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0f00ae700 con 0x7fb0f00c20e0 2023-10-14T12:29:22.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.461+0000 7fb0ecff9640 1 -- 172.21.15.64:0/539845707 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb0e4012c60 con 0x7fb0f00c20e0 2023-10-14T12:29:22.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.462+0000 7fb0ecff9640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0dc06ae70 0x7fb0dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:22.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.462+0000 7fb0ecff9640 1 -- 172.21.15.64:0/539845707 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb0e4089d90 con 0x7fb0f00c20e0 2023-10-14T12:29:22.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.462+0000 7fb0effff640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0dc06ae70 0x7fb0dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:22.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.463+0000 7fb0effff640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0dc06ae70 0x7fb0dc06d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0158fd0 tx=0x7fb0e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:22.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.466+0000 7fb0ecff9640 1 -- 172.21.15.64:0/539845707 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb0e4054b50 con 0x7fb0f00c20e0 2023-10-14T12:29:22.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.698+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0f0073ef0 con 0x7fb0f00c20e0 2023-10-14T12:29:22.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.699+0000 7fb0ecff9640 1 -- 172.21.15.64:0/539845707 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fb0e4058170 con 0x7fb0f00c20e0 2023-10-14T12:29:22.701 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:22.702 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:29:22.702 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:29:22.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0dc06ae70 msgr2=0x7fb0dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0dc06ae70 0x7fb0dc06d330 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0158fd0 tx=0x7fb0e0009040 comp rx=0 tx=0).stop 2023-10-14T12:29:22.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f00c20e0 msgr2=0x7fb0f0158340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:22.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f00c20e0 0x7fb0f0158340 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb0e400d5f0 tx=0x7fb0e400dab0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 shutdown_connections 2023-10-14T12:29:22.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0dc06ae70 0x7fb0dc06d330 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0f00c9e00 0x7fb0f0158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0f00c20e0 0x7fb0f0158340 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 --2- 172.21.15.64:0/539845707 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0f0071630 0x7fb0f014f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:22.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.702+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 >> 172.21.15.64:0/539845707 conn(0x7fb0f006c1c0 msgr2=0x7fb0f00adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:22.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.703+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 shutdown_connections 2023-10-14T12:29:22.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:22.703+0000 7fb0f62bb640 1 -- 172.21.15.64:0/539845707 wait complete. 2023-10-14T12:29:23.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:28:46.535748+0000', 'modified': '2023-10-14T12:29:07.332595+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.177:6837/150618122', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.177:6835', 'nonce': 150618122}, {'type': 'v1', 'addr': '172.21.15.177:6837', 'nonce': 150618122}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T12:29:23.126 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:29:23.126 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-14T12:29:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.360+0000 7f9491fbf640 1 Processor -- start 2023-10-14T12:29:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.360+0000 7f9491fbf640 1 -- start start 2023-10-14T12:29:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.361+0000 7f9491fbf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f948c15cc90 0x7f948c0d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.361+0000 7f9491fbf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c0d05c0 0x7f948c0ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.361+0000 7f9491fbf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0d3760 con 0x7f948c0cfe70 2023-10-14T12:29:23.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.361+0000 7f9491fbf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f948c0cf9e0 con 0x7f948c15cc90 2023-10-14T12:29:23.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.361+0000 7f9491fbf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c15d070 con 0x7f948c0d05c0 2023-10-14T12:29:23.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.362+0000 7f94917be640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c0d05c0 0x7f948c0ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.362+0000 7f9490fbd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f948c15cc90 0x7f948c0d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.362+0000 7f9490fbd640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f948c15cc90 0x7f948c0d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:34366/0 (socket says 172.21.15.64:34366) 2023-10-14T12:29:23.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.362+0000 7f94917be640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c0d05c0 0x7f948c0ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:37752/0 (socket says 172.21.15.64:37752) 2023-10-14T12:29:23.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.362+0000 7f9490fbd640 1 -- 172.21.15.64:0/797121789 learned_addr learned my addr 172.21.15.64:0/797121789 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:23.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.364+0000 7f9490fbd640 1 -- 172.21.15.64:0/797121789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c0d05c0 msgr2=0x7f948c0ce300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.364+0000 7f9490fbd640 1 --2- 172.21.15.64:0/797121789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c0d05c0 0x7f948c0ce300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.364+0000 7f9490fbd640 1 -- 172.21.15.64:0/797121789 >> v1:172.21.15.177:6789/0 conn(0x7f948c0cfe70 legacy=0x7f948c06af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.364+0000 7f9490fbd640 1 -- 172.21.15.64:0/797121789 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c0b1870 con 0x7f948c15cc90 2023-10-14T12:29:23.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.364+0000 7f9490fbd640 1 --2- 172.21.15.64:0/797121789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c15cc90 0x7f948c0d0dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f947c009e50 tx=0x7f947c02bed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81782ac0ea9f2d7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:23.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.365+0000 7f948b7fe640 1 -- 172.21.15.64:0/797121789 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c02ca70 con 0x7f948c15cc90 2023-10-14T12:29:23.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.365+0000 7f948b7fe640 1 -- 172.21.15.64:0/797121789 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c02cbd0 con 0x7f948c15cc90 2023-10-14T12:29:23.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.365+0000 7f948b7fe640 1 -- 172.21.15.64:0/797121789 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c0343f0 con 0x7f948c15cc90 2023-10-14T12:29:23.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 -- 172.21.15.64:0/797121789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c15cc90 msgr2=0x7f948c0d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 --2- 172.21.15.64:0/797121789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c15cc90 0x7f948c0d0dc0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f947c009e50 tx=0x7f947c02bed0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 -- 172.21.15.64:0/797121789 shutdown_connections 2023-10-14T12:29:23.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 --2- 172.21.15.64:0/797121789 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c0d05c0 0x7f948c0ce300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 --2- 172.21.15.64:0/797121789 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c15cc90 0x7f948c0d0dc0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 -- 172.21.15.64:0/797121789 >> 172.21.15.64:0/797121789 conn(0x7f948c0d27e0 msgr2=0x7f948c0d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:23.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 -- 172.21.15.64:0/797121789 shutdown_connections 2023-10-14T12:29:23.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.366+0000 7f9491fbf640 1 -- 172.21.15.64:0/797121789 wait complete. 2023-10-14T12:29:23.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.368+0000 7f9491fbf640 1 Processor -- start 2023-10-14T12:29:23.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.368+0000 7f9491fbf640 1 -- start start 2023-10-14T12:29:23.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f9491fbf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c0cfe70 0x7f948c156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f9491fbf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f948c0d05c0 0x7f948c150780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f9491fbf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c15cc90 0x7f948c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f9491fbf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0cc730 con 0x7f948c0d05c0 2023-10-14T12:29:23.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f9491fbf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b61e0 con 0x7f948c0cfe70 2023-10-14T12:29:23.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f9491fbf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0b64c0 con 0x7f948c15cc90 2023-10-14T12:29:23.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f948c0d05c0 0x7f948c150780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f948c0d05c0 0x7f948c150780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51624/0 (socket says 172.21.15.64:51624) 2023-10-14T12:29:23.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f948bfff640 1 -- 172.21.15.64:0/822823623 learned_addr learned my addr 172.21.15.64:0/822823623 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:23.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f9490fbd640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c0cfe70 0x7f948c156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.370+0000 7f94917be640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c15cc90 0x7f948c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f948bfff640 1 -- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c15cc90 msgr2=0x7f948c0cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f948bfff640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c15cc90 0x7f948c0cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f948bfff640 1 -- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c0cfe70 msgr2=0x7f948c156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f948bfff640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c0cfe70 0x7f948c156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f948bfff640 1 -- 172.21.15.64:0/822823623 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f947c009b30 con 0x7f948c0d05c0 2023-10-14T12:29:23.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f948bfff640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f948c0d05c0 0x7f948c150780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f948000c400 tx=0x7f948000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:23.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f94897fa640 1 -- 172.21.15.64:0/822823623 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800052d0 con 0x7f948c0d05c0 2023-10-14T12:29:23.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f94897fa640 1 -- 172.21.15.64:0/822823623 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480005430 con 0x7f948c0d05c0 2023-10-14T12:29:23.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c0b67a0 con 0x7f948c0d05c0 2023-10-14T12:29:23.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f94897fa640 1 -- 172.21.15.64:0/822823623 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480003830 con 0x7f948c0d05c0 2023-10-14T12:29:23.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.371+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c150f60 con 0x7f948c0d05c0 2023-10-14T12:29:23.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.374+0000 7f94897fa640 1 -- 172.21.15.64:0/822823623 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9480003990 con 0x7f948c0d05c0 2023-10-14T12:29:23.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.374+0000 7f94897fa640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f947806ae70 0x7f947806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.375+0000 7f94897fa640 1 -- 172.21.15.64:0/822823623 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9480088f40 con 0x7f948c0d05c0 2023-10-14T12:29:23.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.375+0000 7f9490fbd640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f947806ae70 0x7f947806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.375+0000 7f9495db3740 1 Processor -- start 2023-10-14T12:29:23.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.375+0000 7f9495db3740 1 -- start start 2023-10-14T12:29:23.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.376+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c2170 0x560056995070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.376+0000 7f9495db3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.376+0000 7f9490fbd640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f947806ae70 0x7f947806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f947c035000 tx=0x7f947c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:23.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.376+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569955b0 0x5600569c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.376+0000 7f9495db3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600568b57a0 con 0x5600569c2550 2023-10-14T12:29:23.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.376+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560056907740 con 0x5600569955b0 2023-10-14T12:29:23.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.376+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560056904e30 con 0x5600569c2170 2023-10-14T12:29:23.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51630/0 (socket says 172.21.15.64:51630) 2023-10-14T12:29:23.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 -- 172.21.15.64:0/1598673272 learned_addr learned my addr 172.21.15.64:0/1598673272 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:23.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f9490fbd640 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c2170 0x560056995070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f94917be640 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569955b0 0x5600569c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 -- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c2170 msgr2=0x560056995070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c2170 0x560056995070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 -- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569955b0 msgr2=0x5600569c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569955b0 0x5600569c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 -- 172.21.15.64:0/1598673272 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600568c4910 con 0x5600569c2550 2023-10-14T12:29:23.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f94917be640 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569955b0 0x5600569c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:23.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.377+0000 7f948bfff640 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4f00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f948005f780 tx=0x7f948001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2908fb5f753b357f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:23.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f94727fc640 1 -- 172.21.15.64:0/1598673272 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948005fcb0 con 0x5600569c2550 2023-10-14T12:29:23.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f94727fc640 1 -- 172.21.15.64:0/1598673272 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480055d50 con 0x5600569c2550 2023-10-14T12:29:23.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f94727fc640 1 -- 172.21.15.64:0/1598673272 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94800540c0 con 0x5600569c2550 2023-10-14T12:29:23.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f9495db3740 1 -- 172.21.15.64:0/1598673272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 msgr2=0x5600569c4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f9495db3740 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4f00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f948005f780 tx=0x7f948001a000 comp rx=0 tx=0).stop 2023-10-14T12:29:23.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f9495db3740 1 -- 172.21.15.64:0/1598673272 shutdown_connections 2023-10-14T12:29:23.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f9495db3740 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569955b0 0x5600569c5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f9495db3740 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4f00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f9495db3740 1 --2- 172.21.15.64:0/1598673272 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c2170 0x560056995070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.378+0000 7f9495db3740 1 -- 172.21.15.64:0/1598673272 >> 172.21.15.64:0/1598673272 conn(0x560056997380 msgr2=0x5600569dff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:23.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.379+0000 7f9495db3740 1 -- 172.21.15.64:0/1598673272 shutdown_connections 2023-10-14T12:29:23.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.379+0000 7f9495db3740 1 -- 172.21.15.64:0/1598673272 wait complete. 2023-10-14T12:29:23.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.379+0000 7f9495db3740 1 -- start start 2023-10-14T12:29:23.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.380+0000 7f9495db3740 1 Processor -- start 2023-10-14T12:29:23.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569b6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9495db3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569cd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9495db3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x560056900720 con 0x5600569c2550 2023-10-14T12:29:23.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005689e970 con 0x5600569c2170 2023-10-14T12:29:23.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x56005689e610 con 0x5600569c8a10 2023-10-14T12:29:23.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9495db3740 10 client.0 _ll_register_callbacks cb 0x5600568c09d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:29:23.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51636/0 (socket says 172.21.15.64:51636) 2023-10-14T12:29:23.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 -- 172.21.15.64:0/3236970881 learned_addr learned my addr 172.21.15.64:0/3236970881 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:23.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9490fbd640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569b6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f94917be640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 -- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 msgr2=0x5600569cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 -- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 msgr2=0x5600569b6660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569b6660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f948bfff640 1 -- 172.21.15.64:0/3236970881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c150f60 con 0x5600569c2550 2023-10-14T12:29:23.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f9490fbd640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:23.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.381+0000 7f94917be640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:23.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f948bfff640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c84d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f948000cdc0 tx=0x7f94800055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7053b9ecd059c0f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:23.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f946b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2023-10-14T12:29:23.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f946b7fe640 1 -- 172.21.15.64:0/3236970881 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480073070 con 0x5600569c2550 2023-10-14T12:29:23.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f946b7fe640 1 -- 172.21.15.64:0/3236970881 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9480084070 con 0x5600569c2550 2023-10-14T12:29:23.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560056927160 con 0x5600569c2550 2023-10-14T12:29:23.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f946b7fe640 1 -- 172.21.15.64:0/3236970881 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9480083030 con 0x5600569c2550 2023-10-14T12:29:23.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f9495db3740 10 client.4800 fetch_fsmap learned FSMap version 9 2023-10-14T12:29:23.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5600568feda0 con 0x5600569c2550 2023-10-14T12:29:23.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f946b7fe640 1 -- 172.21.15.64:0/3236970881 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560056927160 con 0x5600569c2550 2023-10-14T12:29:23.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.382+0000 7f946b7fe640 1 -- 172.21.15.64:0/3236970881 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9480076020 con 0x5600569c2550 2023-10-14T12:29:23.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.383+0000 7f9495db3740 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2023-10-14T12:29:23.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.383+0000 7f9495db3740 10 client.4800 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:29:23.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.383+0000 7f9495db3740 20 client.4800 populate_metadata read hostname 'smithi064' 2023-10-14T12:29:23.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.383+0000 7f9495db3740 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569cc540 0x5600569f0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.383+0000 7f9495db3740 4 client.4800 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:29:23.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.383+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 --> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600568d2cc0 con 0x5600569cc540 2023-10-14T12:29:23.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.383+0000 7f9490fbd640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569cc540 0x5600569f0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.384+0000 7f946b7fe640 10 client.4800 ms_handle_connect on v2:172.21.15.177:6835/150618122 2023-10-14T12:29:23.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.384+0000 7f9490fbd640 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569cc540 0x5600569f0190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef87d8d2c13c2c2e server_cookie=cbe39b0be8255719 in_seq=0 out_seq=0 2023-10-14T12:29:23.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.386+0000 7f946b7fe640 1 -- 172.21.15.64:0/3236970881 <== mds.0 v2:172.21.15.177:6835/150618122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5600568d2cc0 con 0x5600569cc540 2023-10-14T12:29:23.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.386+0000 7f946b7fe640 10 client.4800 handle_command_reply: tid=0 2023-10-14T12:29:23.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.386+0000 7f9495db3740 1 client.4800 shutdown 2023-10-14T12:29:23.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.386+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 msgr2=0x5600569c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.386+0000 7f9495db3740 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c84d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f948000cdc0 tx=0x7f94800055e0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 shutdown_connections 2023-10-14T12:29:23.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569cc540 0x5600569f0190 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c84d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 --2- 172.21.15.64:0/3236970881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569b6660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f946b7fe640 0 client.4800 ms_handle_reset on v2:172.21.15.177:6835/150618122 2023-10-14T12:29:23.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 >> 172.21.15.64:0/3236970881 conn(0x5600569955b0 msgr2=0x5600569c4940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:23.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 shutdown_connections 2023-10-14T12:29:23.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 1 -- 172.21.15.64:0/3236970881 wait complete. 2023-10-14T12:29:23.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.387+0000 7f9495db3740 20 client.4800 trim_cache size 0 max 16384 2023-10-14T12:29:23.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.404+0000 7f9495db3740 1 Processor -- start 2023-10-14T12:29:23.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.404+0000 7f9495db3740 1 -- start start 2023-10-14T12:29:23.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f9495db3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f9495db3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x560056664f20 con 0x5600569c2550 2023-10-14T12:29:23.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x560056999080 con 0x5600569c2170 2023-10-14T12:29:23.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600569986e0 con 0x5600569c8a10 2023-10-14T12:29:23.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f948bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51640/0 (socket says 172.21.15.64:51640) 2023-10-14T12:29:23.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f948bfff640 1 -- 172.21.15.64:0/396658076 learned_addr learned my addr 172.21.15.64:0/396658076 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:23.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f948bfff640 1 -- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 msgr2=0x5600569b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f948bfff640 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f948bfff640 1 -- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 msgr2=0x5600569993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.405+0000 7f9490fbd640 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.406+0000 7f948bfff640 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.406+0000 7f948bfff640 1 -- 172.21.15.64:0/396658076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005689db80 con 0x5600569c2550 2023-10-14T12:29:23.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.406+0000 7f9490fbd640 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:23.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.406+0000 7f948bfff640 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f948005f780 tx=0x7f948006d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f48ab027a9e60f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:23.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.406+0000 7f9472ffd640 1 -- 172.21.15.64:0/396658076 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9480057a30 con 0x5600569c2550 2023-10-14T12:29:23.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.406+0000 7f9472ffd640 1 -- 172.21.15.64:0/396658076 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480085050 con 0x5600569c2550 2023-10-14T12:29:23.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.406+0000 7f9472ffd640 1 -- 172.21.15.64:0/396658076 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f948005fa40 con 0x5600569c2550 2023-10-14T12:29:23.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 -- 172.21.15.64:0/396658076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 msgr2=0x5600569c4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4940 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f948005f780 tx=0x7f948006d070 comp rx=0 tx=0).stop 2023-10-14T12:29:23.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 -- 172.21.15.64:0/396658076 shutdown_connections 2023-10-14T12:29:23.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2550 0x5600569c4940 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 --2- 172.21.15.64:0/396658076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2170 0x5600569993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 -- 172.21.15.64:0/396658076 >> 172.21.15.64:0/396658076 conn(0x5600569955b0 msgr2=0x5600569c7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:23.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 -- 172.21.15.64:0/396658076 shutdown_connections 2023-10-14T12:29:23.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.407+0000 7f9495db3740 1 -- 172.21.15.64:0/396658076 wait complete. 2023-10-14T12:29:23.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.408+0000 7f9495db3740 1 -- start start 2023-10-14T12:29:23.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.408+0000 7f9495db3740 1 Processor -- start 2023-10-14T12:29:23.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9495db3740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2170 0x5600569b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2550 0x5600569b4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9495db3740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9495db3740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x560056a484d0 con 0x5600569c2170 2023-10-14T12:29:23.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600569f0210 con 0x5600569c2550 2023-10-14T12:29:23.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9495db3740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x560056999770 con 0x5600569c8a10 2023-10-14T12:29:23.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9495db3740 10 client.0 _ll_register_callbacks cb 0x7f948006e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:29:23.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2170 0x5600569b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2170 0x5600569b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51648/0 (socket says 172.21.15.64:51648) 2023-10-14T12:29:23.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 -- 172.21.15.64:0/1586491058 learned_addr learned my addr 172.21.15.64:0/1586491058 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:23.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 -- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 msgr2=0x5600569b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 -- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2550 msgr2=0x5600569b4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:23.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2550 0x5600569b4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.409+0000 7f9490fbd640 1 -- 172.21.15.64:0/1586491058 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600568feda0 con 0x5600569c2170 2023-10-14T12:29:23.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f9490fbd640 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2170 0x5600569b41f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f80 tx=0x7f947c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4be3f1af97863d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:23.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f946b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2023-10-14T12:29:23.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f946b7fe640 1 -- 172.21.15.64:0/1586491058 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c04f3c0 con 0x5600569c2170 2023-10-14T12:29:23.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f946b7fe640 1 -- 172.21.15.64:0/1586491058 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f947c04f520 con 0x5600569c2170 2023-10-14T12:29:23.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9480055d50 con 0x5600569c2170 2023-10-14T12:29:23.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f946b7fe640 1 -- 172.21.15.64:0/1586491058 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f947c03e7d0 con 0x5600569c2170 2023-10-14T12:29:23.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f9495db3740 10 client.4806 fetch_fsmap learned FSMap version 9 2023-10-14T12:29:23.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x5600568c3170 con 0x5600569c2170 2023-10-14T12:29:23.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.410+0000 7f946b7fe640 1 -- 172.21.15.64:0/1586491058 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9480055d50 con 0x5600569c2170 2023-10-14T12:29:23.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f946b7fe640 1 -- 172.21.15.64:0/1586491058 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f947c04a040 con 0x5600569c2170 2023-10-14T12:29:23.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f9495db3740 10 client.4806 fetch_fsmap finished waiting for FSMap version 9 2023-10-14T12:29:23.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f9495db3740 10 client.4806 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-14T12:29:23.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f9495db3740 20 client.4806 populate_metadata read hostname 'smithi064' 2023-10-14T12:29:23.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f9495db3740 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569ce7f0 0x5600569cebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:23.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f9495db3740 4 client.4806 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:29:23.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 --> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5600568f9700 con 0x5600569ce7f0 2023-10-14T12:29:23.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.411+0000 7f948bfff640 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569ce7f0 0x5600569cebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:23.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.412+0000 7f948bfff640 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569ce7f0 0x5600569cebd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5457ba7d460323a server_cookie=5354246fa4f8f2cd in_seq=0 out_seq=0 2023-10-14T12:29:23.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.412+0000 7f946b7fe640 10 client.4806 ms_handle_connect on v2:172.21.15.177:6835/150618122 2023-10-14T12:29:23.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f946b7fe640 1 -- 172.21.15.64:0/1586491058 <== mds.0 v2:172.21.15.177:6835/150618122 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5600568f9700 con 0x5600569ce7f0 2023-10-14T12:29:23.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f946b7fe640 10 client.4806 handle_command_reply: tid=0 2023-10-14T12:29:23.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 client.4806 shutdown 2023-10-14T12:29:23.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2170 msgr2=0x5600569b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2170 0x5600569b41f0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f80 tx=0x7f947c004ab0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 shutdown_connections 2023-10-14T12:29:23.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:6835/150618122,v1:172.21.15.177:6837/150618122] conn(0x5600569ce7f0 0x5600569cebd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x5600569c8a10 0x5600569b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x5600569c2550 0x5600569b4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 --2- 172.21.15.64:0/1586491058 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x5600569c2170 0x5600569b41f0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f946b7fe640 0 client.4806 ms_handle_reset on v2:172.21.15.177:6835/150618122 2023-10-14T12:29:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 >> 172.21.15.64:0/1586491058 conn(0x5600569955b0 msgr2=0x5600569e2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 shutdown_connections 2023-10-14T12:29:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 1 -- 172.21.15.64:0/1586491058 wait complete. 2023-10-14T12:29:23.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.413+0000 7f9495db3740 20 client.4806 trim_cache size 0 max 16384 2023-10-14T12:29:23.426 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:29:23.426 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "0b341ded-8bb8-4993-857a-677cfc30784b", 2023-10-14T12:29:23.426 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2023-10-14T12:29:23.427 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4267, 2023-10-14T12:29:23.427 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2023-10-14T12:29:23.427 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2023-10-14T12:29:23.427 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs", 2023-10-14T12:29:23.427 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 36.364088279000001, 2023-10-14T12:29:23.428 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 9, 2023-10-14T12:29:23.428 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 27, 2023-10-14T12:29:23.428 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 27, 2023-10-14T12:29:23.428 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 44.172503442999997 2023-10-14T12:29:23.428 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:29:23.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f947806ae70 msgr2=0x7f947806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f947806ae70 0x7f947806d330 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f947c035000 tx=0x7f947c030000 comp rx=0 tx=0).stop 2023-10-14T12:29:23.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f948c0d05c0 msgr2=0x7f948c150780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f948c0d05c0 0x7f948c150780 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f948000c400 tx=0x7f948000c8c0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 shutdown_connections 2023-10-14T12:29:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f947806ae70 0x7f947806d330 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f948c15cc90 0x7f948c0cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f948c0d05c0 0x7f948c150780 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 --2- 172.21.15.64:0/822823623 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f948c0cfe70 0x7f948c156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:23.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 >> 172.21.15.64:0/822823623 conn(0x7f948c0d27e0 msgr2=0x7f948c0b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:23.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 shutdown_connections 2023-10-14T12:29:23.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:23.414+0000 7f9491fbf640 1 -- 172.21.15.64:0/822823623 wait complete. 2023-10-14T12:29:23.435 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-10-14T12:29:23.446 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-10-14T12:29:23.446 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-14T12:29:23.447 INFO:tasks.ceph_fuse:client.0 config is {} 2023-10-14T12:29:23.447 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:29:23.447 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:23.447 INFO:tasks.ceph_fuse:client.2 config is {} 2023-10-14T12:29:23.448 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:29:23.448 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T12:29:23.448 INFO:tasks.ceph_fuse:client.1 config is {} 2023-10-14T12:29:23.448 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:29:23.449 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:23.449 INFO:tasks.ceph_fuse:client.3 config is {} 2023-10-14T12:29:23.449 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-10-14T12:29:23.449 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T12:29:23.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:23.450 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-14T12:29:23.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:23.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-10-14T12:29:23.614 INFO:teuthology.orchestra.run.smithi177.stderr:Cannot find device "ceph-brx" 2023-10-14T12:29:23.618 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:29:23.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:23.619 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-10-14T12:29:23.684 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-10-14T12:29:23.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:23.685 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-10-14T12:29:23.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:23.796 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-10-14T12:29:23.944 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-10-14T12:29:23.945 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:29:24.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.139+0000 7f3bb29dc640 1 Processor -- start 2023-10-14T12:29:24.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.139+0000 7f3bb29dc640 1 -- start start 2023-10-14T12:29:24.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.140+0000 7f3bb29dc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0c9e00 0x7f3bac0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:24.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.140+0000 7f3bb29dc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3bac071800 0x7f3bac0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:24.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.140+0000 7f3bb29dc640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bac071e40 con 0x7f3bac0ca1e0 2023-10-14T12:29:24.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.140+0000 7f3bb29dc640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bac071c30 con 0x7f3bac071800 2023-10-14T12:29:24.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.140+0000 7f3bb29dc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac0cde00 con 0x7f3bac0c9e00 2023-10-14T12:29:24.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.141+0000 7f3bb0f79640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3bac071800 0x7f3bac0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:24.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.141+0000 7f3babfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0c9e00 0x7f3bac0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:24.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.141+0000 7f3bb0f79640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3bac071800 0x7f3bac0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:34438/0 (socket says 172.21.15.64:34438) 2023-10-14T12:29:24.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.141+0000 7f3bb0f79640 1 -- 172.21.15.64:0/2523650867 learned_addr learned my addr 172.21.15.64:0/2523650867 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:24.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.142+0000 7f3bb0f79640 1 -- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0c9e00 msgr2=0x7f3bac0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:24.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.142+0000 7f3bb0f79640 1 --2- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0c9e00 0x7f3bac0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.142+0000 7f3bb0f79640 1 -- 172.21.15.64:0/2523650867 >> v1:172.21.15.177:6789/0 conn(0x7f3bac0ca1e0 legacy=0x7f3bac0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:24.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.142+0000 7f3bb0f79640 1 -- 172.21.15.64:0/2523650867 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac072120 con 0x7f3bac071800 2023-10-14T12:29:24.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.142+0000 7f3babfff640 1 --2- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0c9e00 0x7f3bac0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:24.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.143+0000 7f3bb0f79640 1 --2- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 0x7f3bac0cca00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009e50 tx=0x7f3ba402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f86d7c81d6a75e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:24.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.144+0000 7f3bab7fe640 1 -- 172.21.15.64:0/2523650867 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba402cb00 con 0x7f3bac071800 2023-10-14T12:29:24.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.144+0000 7f3bab7fe640 1 -- 172.21.15.64:0/2523650867 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba402cc60 con 0x7f3bac071800 2023-10-14T12:29:24.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.144+0000 7f3bab7fe640 1 -- 172.21.15.64:0/2523650867 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40343f0 con 0x7f3bac071800 2023-10-14T12:29:24.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.144+0000 7f3bb29dc640 1 -- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 msgr2=0x7f3bac0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:24.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.144+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 0x7f3bac0cca00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3ba4009e50 tx=0x7f3ba402bf60 comp rx=0 tx=0).stop 2023-10-14T12:29:24.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.145+0000 7f3bb29dc640 1 -- 172.21.15.64:0/2523650867 shutdown_connections 2023-10-14T12:29:24.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.145+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 0x7f3bac0cca00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.145+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/2523650867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0c9e00 0x7f3bac0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.145+0000 7f3bb29dc640 1 -- 172.21.15.64:0/2523650867 >> 172.21.15.64:0/2523650867 conn(0x7f3bac06c1c0 msgr2=0x7f3bac06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:24.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.145+0000 7f3bb29dc640 1 -- 172.21.15.64:0/2523650867 shutdown_connections 2023-10-14T12:29:24.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.145+0000 7f3bb29dc640 1 -- 172.21.15.64:0/2523650867 wait complete. 2023-10-14T12:29:24.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.147+0000 7f3bb29dc640 1 Processor -- start 2023-10-14T12:29:24.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.147+0000 7f3bb29dc640 1 -- start start 2023-10-14T12:29:24.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 0x7f3bac152eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:24.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bac0c9e00 0x7f3bac14fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:24.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0ca1e0 0x7f3bac14ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:24.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac152a80 con 0x7f3bac0c9e00 2023-10-14T12:29:24.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac157100 con 0x7f3bac071800 2023-10-14T12:29:24.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bac1533f0 con 0x7f3bac0ca1e0 2023-10-14T12:29:24.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bac0c9e00 0x7f3bac14fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:24.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bac0c9e00 0x7f3bac14fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51660/0 (socket says 172.21.15.64:51660) 2023-10-14T12:29:24.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 -- 172.21.15.64:0/810943071 learned_addr learned my addr 172.21.15.64:0/810943071 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:24.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3babfff640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 0x7f3bac152eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:24.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb0f79640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0ca1e0 0x7f3bac14ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:24.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 -- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0ca1e0 msgr2=0x7f3bac14ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:24.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0ca1e0 0x7f3bac14ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 -- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 msgr2=0x7f3bac152eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:24.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 0x7f3bac152eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 -- 172.21.15.64:0/810943071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b9c009400 con 0x7f3bac0c9e00 2023-10-14T12:29:24.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb0f79640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0ca1e0 0x7f3bac14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:24.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba3fff640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bac0c9e00 0x7f3bac14fa30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c3f0 tx=0x7f3b9400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:24.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba97fa640 1 -- 172.21.15.64:0/810943071 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b940052d0 con 0x7f3bac0c9e00 2023-10-14T12:29:24.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba97fa640 1 -- 172.21.15.64:0/810943071 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b94005450 con 0x7f3bac0c9e00 2023-10-14T12:29:24.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3ba97fa640 1 -- 172.21.15.64:0/810943071 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b94007260 con 0x7f3bac0c9e00 2023-10-14T12:29:24.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba4009b30 con 0x7f3bac0c9e00 2023-10-14T12:29:24.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.149+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bac157310 con 0x7f3bac0c9e00 2023-10-14T12:29:24.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.151+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bac152bd0 con 0x7f3bac0c9e00 2023-10-14T12:29:24.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.152+0000 7f3ba97fa640 1 -- 172.21.15.64:0/810943071 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3b940073c0 con 0x7f3bac0c9e00 2023-10-14T12:29:24.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.153+0000 7f3ba97fa640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3b8c06ae70 0x7f3b8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:24.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.153+0000 7f3ba97fa640 1 -- 172.21.15.64:0/810943071 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b94088bf0 con 0x7f3bac0c9e00 2023-10-14T12:29:24.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.154+0000 7f3babfff640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3b8c06ae70 0x7f3b8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:24.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.155+0000 7f3babfff640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3b8c06ae70 0x7f3b8c06d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0c4530 tx=0x7f3b9c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:24.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.157+0000 7f3ba97fa640 1 -- 172.21.15.64:0/810943071 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3bac152bd0 con 0x7f3bac0c9e00 2023-10-14T12:29:24.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.389+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3bac152bd0 con 0x7f3bac0c9e00 2023-10-14T12:29:24.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.390+0000 7f3ba97fa640 1 -- 172.21.15.64:0/810943071 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3bac152bd0 con 0x7f3bac0c9e00 2023-10-14T12:29:24.392 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:29:24.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3b8c06ae70 msgr2=0x7f3b8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:24.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3b8c06ae70 0x7f3b8c06d330 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3bac0c4530 tx=0x7f3b9c008040 comp rx=0 tx=0).stop 2023-10-14T12:29:24.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bac0c9e00 msgr2=0x7f3bac14fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:24.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bac0c9e00 0x7f3bac14fa30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3b9400c3f0 tx=0x7f3b9400c8b0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 shutdown_connections 2023-10-14T12:29:24.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3b8c06ae70 0x7f3b8c06d330 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3bac0ca1e0 0x7f3bac14ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3bac0c9e00 0x7f3bac14fa30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 --2- 172.21.15.64:0/810943071 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3bac071800 0x7f3bac152eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:24.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.393+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 >> 172.21.15.64:0/810943071 conn(0x7f3bac06c1c0 msgr2=0x7f3bac0af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:24.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.394+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 shutdown_connections 2023-10-14T12:29:24.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:24.394+0000 7f3bb29dc640 1 -- 172.21.15.64:0/810943071 wait complete. 2023-10-14T12:29:24.413 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:29:24.414 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:29:24.414 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2023-10-14T12:29:24.414 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T12:29:24.415 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:24.415 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:29:24.415 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:29:24.415 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:29:24.416 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:29:24.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:24.416 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2023-10-14T12:29:24.475 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:24.476 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:24.476 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:24.476 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:24.476 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:24.476 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:24.477 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:24.477 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:24.477 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2023-10-14T12:29:24.477 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:24.477 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:24.478 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2023-10-14T12:29:24.478 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:24.478 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:24.478 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:29:24.478 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:24.479 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:29:24.479 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42349sec preferred_lft 42349sec 2023-10-14T12:29:24.479 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-10-14T12:29:24.479 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:24.480 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:29:24.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:24.480 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:24.481 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:24.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:29:24.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr flush dev ceph-brx 2023-10-14T12:29:24.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set ceph-brx up 2023-10-14T12:29:24.482 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:29:24.482 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:24.720 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:24.720 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:29:24.795 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-10-14T12:29:24.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:24.800 DEBUG:teuthology.orchestra.run.smithi064:> route 2023-10-14T12:29:24.858 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2023-10-14T12:29:24.858 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:29:24.858 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:29:24.859 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:29:24.859 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:29:24.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:24.860 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:24.860 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:24.860 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:29:24.861 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:29:24.861 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:29:24.861 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:25.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:25.059 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-10-14T12:29:25.116 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:25.116 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2023-10-14T12:29:25.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:25.173 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:25.173 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:25.174 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:25.174 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-14T12:29:25.174 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:25.323 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-14T12:29:25.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:25.324 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:25.324 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:25.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-14T12:29:25.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:29:25.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-14T12:29:25.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-14T12:29:25.326 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-14T12:29:25.326 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:25.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:25.590 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:25.590 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:25.595 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2023-10-14T12:29:25.595 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:29:25.595 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:25.769 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T12:29:25.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:25.770 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:25.828 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:29:25.829 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:25.829 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:25.884 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:29:25.988 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:26.049 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:29:26.049 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:29:26.049 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:29:26.050 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:29:26.050 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:29:26.050 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:29:26.050 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:29:26.050 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:29:26.051 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:29:26.051 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:29:26.051 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:29:26.051 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:26.051 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:29:26.051 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:29:26.052 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:29:26.052 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:29:26.052 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:26.052 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:29:26.052 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:26.053 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:26.053 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:26.053 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:26.053 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:29:26.054 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:29:26.054 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:29:26.054 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:29:26.054 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:29:26.055 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:29:26.055 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:29:26.055 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:26.055 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:26.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:26.057 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:29:26.115 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T12:29:26.116 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T12:29:26.122 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:29:26.207 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:26.253 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:29:26.253 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:29:26.254 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:29:26.254 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:29:26.254 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:29:26.254 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:29:26.254 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:29:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:29:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:29:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:29:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:29:26.255 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:26.256 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:29:26.256 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:29:26.256 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:29:26.256 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:29:26.256 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:26.257 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:29:26.257 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:26.257 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:26.257 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:26.257 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:26.257 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:29:26.258 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:29:26.258 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:29:26.258 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:29:26.258 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:29:26.258 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:29:26.259 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:29:26.259 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:26.259 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:26.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:26.260 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:29:26.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi064.stderr:2023-10-14T12:29:26.326+0000 7f619df85480 -1 init, newargv = 0x5638313ffd40 newargc=15 2023-10-14T12:29:26.327 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi064.stderr:ceph-fuse[96459]: starting ceph client 2023-10-14T12:29:26.338 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi064.stderr:ceph-fuse[96459]: starting fuse 2023-10-14T12:29:26.351 INFO:teuthology.orchestra.run.smithi064.stdout:39 2023-10-14T12:29:26.351 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-14T12:29:26.351 DEBUG:teuthology.orchestra.run.smithi064:> sudo stdin-killer -- python3 -c ' 2023-10-14T12:29:26.352 DEBUG:teuthology.orchestra.run.smithi064:> import glob 2023-10-14T12:29:26.352 DEBUG:teuthology.orchestra.run.smithi064:> import re 2023-10-14T12:29:26.352 DEBUG:teuthology.orchestra.run.smithi064:> import os 2023-10-14T12:29:26.353 DEBUG:teuthology.orchestra.run.smithi064:> import subprocess 2023-10-14T12:29:26.353 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:26.353 DEBUG:teuthology.orchestra.run.smithi064:> def _find_admin_socket(client_name): 2023-10-14T12:29:26.354 DEBUG:teuthology.orchestra.run.smithi064:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T12:29:26.354 DEBUG:teuthology.orchestra.run.smithi064:> files = glob.glob(asok_path) 2023-10-14T12:29:26.354 DEBUG:teuthology.orchestra.run.smithi064:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T12:29:26.354 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:26.355 DEBUG:teuthology.orchestra.run.smithi064:> # Given a non-glob path, it better be there 2023-10-14T12:29:26.355 DEBUG:teuthology.orchestra.run.smithi064:> if "*" not in asok_path: 2023-10-14T12:29:26.355 DEBUG:teuthology.orchestra.run.smithi064:> assert(len(files) == 1) 2023-10-14T12:29:26.356 DEBUG:teuthology.orchestra.run.smithi064:> return files[0] 2023-10-14T12:29:26.356 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:26.356 DEBUG:teuthology.orchestra.run.smithi064:> for f in files: 2023-10-14T12:29:26.357 DEBUG:teuthology.orchestra.run.smithi064:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T12:29:26.357 DEBUG:teuthology.orchestra.run.smithi064:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T12:29:26.357 DEBUG:teuthology.orchestra.run.smithi064:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T12:29:26.357 DEBUG:teuthology.orchestra.run.smithi064:> contents = proc_f.read() 2023-10-14T12:29:26.358 DEBUG:teuthology.orchestra.run.smithi064:> if mountpoint in contents: 2023-10-14T12:29:26.358 DEBUG:teuthology.orchestra.run.smithi064:> return f 2023-10-14T12:29:26.358 DEBUG:teuthology.orchestra.run.smithi064:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T12:29:26.359 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:26.359 DEBUG:teuthology.orchestra.run.smithi064:> print(_find_admin_socket("client.0")) 2023-10-14T12:29:26.359 DEBUG:teuthology.orchestra.run.smithi064:> ' 2023-10-14T12:29:26.564 INFO:teuthology.orchestra.run.smithi064.stdout:/var/run/ceph/ceph-client.0.96459.asok 2023-10-14T12:29:26.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T12:29:26.581 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.96459.asok 2023-10-14T12:29:26.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:26.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.96459.asok status 2023-10-14T12:29:26.833 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:29:26.834 INFO:teuthology.orchestra.run.smithi064.stdout: "metadata": { 2023-10-14T12:29:26.834 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T12:29:26.834 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T12:29:26.834 INFO:teuthology.orchestra.run.smithi064.stdout: "entity_id": "0", 2023-10-14T12:29:26.835 INFO:teuthology.orchestra.run.smithi064.stdout: "hostname": "smithi064", 2023-10-14T12:29:26.835 INFO:teuthology.orchestra.run.smithi064.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T12:29:26.835 INFO:teuthology.orchestra.run.smithi064.stdout: "pid": "96459", 2023-10-14T12:29:26.835 INFO:teuthology.orchestra.run.smithi064.stdout: "root": "/" 2023-10-14T12:29:26.835 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:26.836 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_count": 0, 2023-10-14T12:29:26.836 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_pinned_count": 0, 2023-10-14T12:29:26.836 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4815, 2023-10-14T12:29:26.836 INFO:teuthology.orchestra.run.smithi064.stdout: "inst": { 2023-10-14T12:29:26.836 INFO:teuthology.orchestra.run.smithi064.stdout: "name": { 2023-10-14T12:29:26.837 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "client", 2023-10-14T12:29:26.837 INFO:teuthology.orchestra.run.smithi064.stdout: "num": 4815 2023-10-14T12:29:26.837 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:26.837 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:29:26.837 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:29:26.837 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:29:26.838 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 329961367 2023-10-14T12:29:26.838 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:29:26.838 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:26.838 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:29:26.838 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:29:26.839 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:29:26.839 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 329961367 2023-10-14T12:29:26.839 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:26.839 INFO:teuthology.orchestra.run.smithi064.stdout: "inst_str": "client.4815 192.168.0.1:0/329961367", 2023-10-14T12:29:26.839 INFO:teuthology.orchestra.run.smithi064.stdout: "addr_str": "192.168.0.1:0/329961367", 2023-10-14T12:29:26.840 INFO:teuthology.orchestra.run.smithi064.stdout: "inode_count": 1, 2023-10-14T12:29:26.840 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_epoch": 9, 2023-10-14T12:29:26.840 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch": 27, 2023-10-14T12:29:26.840 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch_barrier": 0, 2023-10-14T12:29:26.840 INFO:teuthology.orchestra.run.smithi064.stdout: "blocklisted": false, 2023-10-14T12:29:26.841 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs" 2023-10-14T12:29:26.841 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:29:26.849 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:29:27.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.068+0000 7f9d6d354640 1 Processor -- start 2023-10-14T12:29:27.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.068+0000 7f9d6d354640 1 -- start start 2023-10-14T12:29:27.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.069+0000 7f9d6d354640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 0x7f9d680cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.070+0000 7f9d6d354640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d680cfc20 con 0x7f9d680d0cd0 2023-10-14T12:29:27.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.070+0000 7f9d6d354640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d680cd4a0 con 0x7f9d6806b570 2023-10-14T12:29:27.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.070+0000 7f9d6d354640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680cd780 con 0x7f9d680b1a30 2023-10-14T12:29:27.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.070+0000 7f9d677fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f9d680d0cd0 0x7f9d680d10b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:37628/0 (socket says 172.21.15.64:37628) 2023-10-14T12:29:27.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.070+0000 7f9d677fe640 1 -- 172.21.15.64:0/986553778 learned_addr learned my addr 172.21.15.64:0/986553778 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:27.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.070+0000 7f9d67fff640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 0x7f9d680cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3831340810 0 0) 0x7f9d680cfc20 con 0x7f9d680d0cd0 2023-10-14T12:29:27.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d50003520 con 0x7f9d680d0cd0 2023-10-14T12:29:27.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1344356442 0 0) 0x7f9d680cd4a0 con 0x7f9d6806b570 2023-10-14T12:29:27.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d680cfc20 con 0x7f9d6806b570 2023-10-14T12:29:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1857560953 0 0) 0x7f9d50003520 con 0x7f9d680d0cd0 2023-10-14T12:29:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 msgr2=0x7f9d680cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 0x7f9d680cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 >> v1:172.21.15.177:6789/0 conn(0x7f9d6806b570 legacy=0x7f9d6806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680cda60 con 0x7f9d680d0cd0 2023-10-14T12:29:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f9d5c001670 con 0x7f9d680d0cd0 2023-10-14T12:29:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d67fff640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 0x7f9d680cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:29:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 >> v1:172.21.15.64:6789/0 conn(0x7f9d680d0cd0 legacy=0x7f9d680d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d50003c10 0x7f9d50004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 0x7f9d500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50004d00 0x7f9d50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680cd780 con 0x7f9d50003c10 2023-10-14T12:29:27.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5000ba90 con 0x7f9d50004d00 2023-10-14T12:29:27.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.071+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5000bc50 con 0x7f9d680b1a30 2023-10-14T12:29:27.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d67fff640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d50003c10 0x7f9d50004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d677fe640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 0x7f9d500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d6cb53640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50004d00 0x7f9d50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d67fff640 1 -- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 msgr2=0x7f9d500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:27.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d67fff640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680b1a30 0x7f9d500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d67fff640 1 -- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50004d00 msgr2=0x7f9d50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:27.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d67fff640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50004d00 0x7f9d50005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.072+0000 7f9d67fff640 1 -- 172.21.15.64:0/986553778 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d58009a70 con 0x7f9d50003c10 2023-10-14T12:29:27.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.073+0000 7f9d67fff640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d50003c10 0x7f9d50004010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800e350 tx=0x7f9d500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf1e76b275946eb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:27.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d5802ccb0 con 0x7f9d50003c10 2023-10-14T12:29:27.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d5800f040 con 0x7f9d50003c10 2023-10-14T12:29:27.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d66ffd640 1 -- 172.21.15.64:0/986553778 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d58034640 con 0x7f9d50003c10 2023-10-14T12:29:27.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d6d354640 1 -- 172.21.15.64:0/986553778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d50003c10 msgr2=0x7f9d50004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:27.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d6d354640 1 --2- 172.21.15.64:0/986553778 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d50003c10 0x7f9d50004010 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9d5800e350 tx=0x7f9d500057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d6cb53640 1 -- 172.21.15.64:0/986553778 reap_dead start 2023-10-14T12:29:27.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d6d354640 1 -- 172.21.15.64:0/986553778 shutdown_connections 2023-10-14T12:29:27.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d6d354640 1 -- 172.21.15.64:0/986553778 >> 172.21.15.64:0/986553778 conn(0x7f9d6808c140 msgr2=0x7f9d6809ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:27.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d6d354640 1 -- 172.21.15.64:0/986553778 shutdown_connections 2023-10-14T12:29:27.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.074+0000 7f9d6d354640 1 -- 172.21.15.64:0/986553778 wait complete. 2023-10-14T12:29:27.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.076+0000 7f9d6d354640 1 Processor -- start 2023-10-14T12:29:27.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.076+0000 7f9d6d354640 1 -- start start 2023-10-14T12:29:27.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.077+0000 7f9d6d354640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50003c10 0x7f9d680c8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.077+0000 7f9d6d354640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680c97c0 0x7f9d681f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.077+0000 7f9d6d354640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f3670 0x7f9d680cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.077+0000 7f9d6d354640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680c9fa0 con 0x7f9d681f3670 2023-10-14T12:29:27.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.077+0000 7f9d6d354640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680ca280 con 0x7f9d50003c10 2023-10-14T12:29:27.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.077+0000 7f9d6d354640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d680ca560 con 0x7f9d680c97c0 2023-10-14T12:29:27.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f3670 0x7f9d680cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f3670 0x7f9d680cb040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57466/0 (socket says 172.21.15.64:57466) 2023-10-14T12:29:27.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 -- 172.21.15.64:0/2049424082 learned_addr learned my addr 172.21.15.64:0/2049424082 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:27.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d677fe640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680c97c0 0x7f9d681f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d67fff640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50003c10 0x7f9d680c8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 -- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680c97c0 msgr2=0x7f9d681f3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:27.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680c97c0 0x7f9d681f3130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 -- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50003c10 msgr2=0x7f9d680c8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:27.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50003c10 0x7f9d680c8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d6cb53640 1 -- 172.21.15.64:0/2049424082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d680ca840 con 0x7f9d681f3670 2023-10-14T12:29:27.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.078+0000 7f9d67fff640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50003c10 0x7f9d680c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:27.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.079+0000 7f9d6cb53640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f3670 0x7f9d680cb040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d6808cdf0 tx=0x7f9d6000e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:27.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.079+0000 7f9d64ff9640 1 -- 172.21.15.64:0/2049424082 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600050d0 con 0x7f9d681f3670 2023-10-14T12:29:27.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.079+0000 7f9d64ff9640 1 -- 172.21.15.64:0/2049424082 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d60005250 con 0x7f9d681f3670 2023-10-14T12:29:27.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.079+0000 7f9d64ff9640 1 -- 172.21.15.64:0/2049424082 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d600069e0 con 0x7f9d681f3670 2023-10-14T12:29:27.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.079+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d680cab20 con 0x7f9d681f3670 2023-10-14T12:29:27.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.079+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d681f2df0 con 0x7f9d681f3670 2023-10-14T12:29:27.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.080+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d6804e9b0 con 0x7f9d681f3670 2023-10-14T12:29:27.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.081+0000 7f9d64ff9640 1 -- 172.21.15.64:0/2049424082 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9d60006b60 con 0x7f9d681f3670 2023-10-14T12:29:27.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.082+0000 7f9d64ff9640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9d5406ae70 0x7f9d5406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:27.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.082+0000 7f9d64ff9640 1 -- 172.21.15.64:0/2049424082 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d60088d70 con 0x7f9d681f3670 2023-10-14T12:29:27.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.083+0000 7f9d67fff640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9d5406ae70 0x7f9d5406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:27.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.084+0000 7f9d67fff640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9d5406ae70 0x7f9d5406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9d58036000 tx=0x7f9d5802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:27.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.087+0000 7f9d64ff9640 1 -- 172.21.15.64:0/2049424082 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9d60053a90 con 0x7f9d681f3670 2023-10-14T12:29:27.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.329+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9d680d3120 con 0x7f9d681f3670 2023-10-14T12:29:27.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.330+0000 7f9d64ff9640 1 -- 172.21.15.64:0/2049424082 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f9d6001b020 con 0x7f9d681f3670 2023-10-14T12:29:27.330 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:29:27.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9d5406ae70 msgr2=0x7f9d5406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:27.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9d5406ae70 0x7f9d5406d330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9d58036000 tx=0x7f9d5802e000 comp rx=0 tx=0).stop 2023-10-14T12:29:27.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f3670 msgr2=0x7f9d680cb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:27.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f3670 0x7f9d680cb040 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9d6808cdf0 tx=0x7f9d6000e820 comp rx=0 tx=0).stop 2023-10-14T12:29:27.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 shutdown_connections 2023-10-14T12:29:27.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9d5406ae70 0x7f9d5406d330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9d681f3670 0x7f9d680cb040 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9d680c97c0 0x7f9d681f3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 --2- 172.21.15.64:0/2049424082 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9d50003c10 0x7f9d680c8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:27.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 >> 172.21.15.64:0/2049424082 conn(0x7f9d6808c140 msgr2=0x7f9d680af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:27.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 shutdown_connections 2023-10-14T12:29:27.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:27.332+0000 7f9d6d354640 1 -- 172.21.15.64:0/2049424082 wait complete. 2023-10-14T12:29:27.350 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:29:27.351 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:29:27.351 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2023-10-14T12:29:27.351 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-14T12:29:27.352 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-14T12:29:27.352 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:29:27.352 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:29:27.352 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:29:27.352 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-14T12:29:27.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:27.353 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2023-10-14T12:29:27.411 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:27.411 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:27.411 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:27.411 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:27.411 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:27.412 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:27.412 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:27.412 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:27.412 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2023-10-14T12:29:27.412 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:27.413 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:27.413 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2023-10-14T12:29:27.413 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:27.413 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:27.413 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:29:27.414 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:27.414 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:29:27.414 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42346sec preferred_lft 42346sec 2023-10-14T12:29:27.414 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-10-14T12:29:27.414 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:27.414 INFO:teuthology.orchestra.run.smithi064.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:29:27.415 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether d2:57:ab:74:ce:78 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:27.415 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:29:27.415 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:27.415 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::f853:96ff:fe9b:a6cf/64 scope link 2023-10-14T12:29:27.415 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:27.416 INFO:teuthology.orchestra.run.smithi064.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:29:27.416 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether d2:57:ab:74:ce:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:27.416 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::d057:abff:fe74:ce78/64 scope link tentative 2023-10-14T12:29:27.416 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:27.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:27.418 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:29:27.518 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-10-14T12:29:27.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:27.523 DEBUG:teuthology.orchestra.run.smithi064:> route 2023-10-14T12:29:27.578 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2023-10-14T12:29:27.578 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:29:27.578 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:29:27.578 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:29:27.579 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:29:27.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:27.579 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:27.580 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:27.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:29:27.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:29:27.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:29:27.581 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:27.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:27.780 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-10-14T12:29:27.833 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:29:27.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:27.835 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list-id 2023-10-14T12:29:27.889 INFO:teuthology.orchestra.run.smithi064.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-14T12:29:27.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:27.890 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:27.891 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:27.891 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:29:27.891 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-14T12:29:27.892 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:28.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:28.047 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T12:29:28.143 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:28.143 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:28.143 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:28.144 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.144 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:28.144 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.144 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:29:28.144 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether be:97:dc:9c:d7:c3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:29:28.145 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:29:28.145 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.145 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::bc97:dcff:fe9c:d7c3/64 scope link 2023-10-14T12:29:28.145 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:28.147 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-14T12:29:28.242 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:28.242 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:28.242 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:28.242 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.243 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:28.243 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.243 INFO:teuthology.orchestra.run.smithi064.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:29:28.243 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether be:97:dc:9c:d7:c3 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:29:28.243 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:29:28.244 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.244 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::bc97:dcff:fe9c:d7c3/64 scope link 2023-10-14T12:29:28.244 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:28.245 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-14T12:29:28.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:28.246 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:28.246 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:28.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-14T12:29:28.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T12:29:28.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-14T12:29:28.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-14T12:29:28.248 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-14T12:29:28.248 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:28.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:28.528 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:29:28.528 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:29:28.528 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.1 up 2023-10-14T12:29:28.528 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T12:29:28.529 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:29:28.708 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-10-14T12:29:28.709 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:28.709 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-14T12:29:28.764 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-14T12:29:28.764 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:28.765 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-14T12:29:28.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:29:28.916 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:28.966 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:29:28.967 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:29:28.967 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:29:28.967 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:29:28.967 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:29:28.967 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:29:28.968 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:29:28.968 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:29:28.968 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:29:28.968 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:29:28.968 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:29:28.968 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:28.969 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:29:28.969 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:29:28.969 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:29:28.969 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:29:28.969 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:28.970 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:29:28.970 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:28.970 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:28.970 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:28.970 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:28.971 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:29:28.971 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:29:28.971 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:29:28.971 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:29:28.971 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:29:28.971 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:29:28.972 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:29:28.972 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:28.972 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:28.972 INFO:teuthology.orchestra.run.smithi064.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:28.972 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:29:28.973 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:29:28.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:28.974 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:29:29.021 INFO:teuthology.orchestra.run.smithi064.stdout:39 2023-10-14T12:29:29.021 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [39] 2023-10-14T12:29:29.022 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-10-14T12:29:29.070 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:29:29.148 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:29.190 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:29:29.190 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:29:29.190 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:29:29.191 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:29:29.191 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:29:29.191 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:29:29.191 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:29:29.191 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:29:29.192 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:29:29.192 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:29:29.192 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:29:29.192 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:29.192 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:29:29.193 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:29:29.193 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:29:29.193 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:29:29.193 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:29.193 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:29:29.194 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:29.194 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:29.194 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:29.194 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:29.194 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:29:29.195 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:29:29.195 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:29:29.195 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:29:29.195 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:29:29.195 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:29:29.195 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:29:29.196 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:29.196 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:29:29.196 INFO:teuthology.orchestra.run.smithi064.stdout:/home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:29.196 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:29:29.196 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:29:29.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:29.198 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:29:29.259 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi064.stderr:2023-10-14T12:29:29.259+0000 7f75df2fa480 -1 init, newargv = 0x55b93bf07dd0 newargc=15 2023-10-14T12:29:29.260 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi064.stderr:ceph-fuse[96954]: starting ceph client 2023-10-14T12:29:29.271 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi064.stderr:ceph-fuse[96954]: starting fuse 2023-10-14T12:29:29.286 INFO:teuthology.orchestra.run.smithi064.stdout:39 2023-10-14T12:29:29.286 INFO:teuthology.orchestra.run.smithi064.stdout:42 2023-10-14T12:29:29.287 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39, 42] 2023-10-14T12:29:29.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo stdin-killer -- python3 -c ' 2023-10-14T12:29:29.287 DEBUG:teuthology.orchestra.run.smithi064:> import glob 2023-10-14T12:29:29.288 DEBUG:teuthology.orchestra.run.smithi064:> import re 2023-10-14T12:29:29.288 DEBUG:teuthology.orchestra.run.smithi064:> import os 2023-10-14T12:29:29.288 DEBUG:teuthology.orchestra.run.smithi064:> import subprocess 2023-10-14T12:29:29.289 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:29.289 DEBUG:teuthology.orchestra.run.smithi064:> def _find_admin_socket(client_name): 2023-10-14T12:29:29.289 DEBUG:teuthology.orchestra.run.smithi064:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-10-14T12:29:29.290 DEBUG:teuthology.orchestra.run.smithi064:> files = glob.glob(asok_path) 2023-10-14T12:29:29.290 DEBUG:teuthology.orchestra.run.smithi064:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-10-14T12:29:29.290 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:29.291 DEBUG:teuthology.orchestra.run.smithi064:> # Given a non-glob path, it better be there 2023-10-14T12:29:29.291 DEBUG:teuthology.orchestra.run.smithi064:> if "*" not in asok_path: 2023-10-14T12:29:29.291 DEBUG:teuthology.orchestra.run.smithi064:> assert(len(files) == 1) 2023-10-14T12:29:29.292 DEBUG:teuthology.orchestra.run.smithi064:> return files[0] 2023-10-14T12:29:29.292 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:29.292 DEBUG:teuthology.orchestra.run.smithi064:> for f in files: 2023-10-14T12:29:29.292 DEBUG:teuthology.orchestra.run.smithi064:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T12:29:29.293 DEBUG:teuthology.orchestra.run.smithi064:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T12:29:29.293 DEBUG:teuthology.orchestra.run.smithi064:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T12:29:29.293 DEBUG:teuthology.orchestra.run.smithi064:> contents = proc_f.read() 2023-10-14T12:29:29.294 DEBUG:teuthology.orchestra.run.smithi064:> if mountpoint in contents: 2023-10-14T12:29:29.294 DEBUG:teuthology.orchestra.run.smithi064:> return f 2023-10-14T12:29:29.294 DEBUG:teuthology.orchestra.run.smithi064:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T12:29:29.295 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:29:29.295 DEBUG:teuthology.orchestra.run.smithi064:> print(_find_admin_socket("client.2")) 2023-10-14T12:29:29.295 DEBUG:teuthology.orchestra.run.smithi064:> ' 2023-10-14T12:29:29.490 INFO:teuthology.orchestra.run.smithi064.stdout:/var/run/ceph/ceph-client.2.96954.asok 2023-10-14T12:29:29.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T12:29:29.506 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.96954.asok 2023-10-14T12:29:29.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:29.506 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.96954.asok status 2023-10-14T12:29:29.741 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:29:29.741 INFO:teuthology.orchestra.run.smithi064.stdout: "metadata": { 2023-10-14T12:29:29.741 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T12:29:29.742 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T12:29:29.742 INFO:teuthology.orchestra.run.smithi064.stdout: "entity_id": "2", 2023-10-14T12:29:29.742 INFO:teuthology.orchestra.run.smithi064.stdout: "hostname": "smithi064", 2023-10-14T12:29:29.742 INFO:teuthology.orchestra.run.smithi064.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-10-14T12:29:29.742 INFO:teuthology.orchestra.run.smithi064.stdout: "pid": "96954", 2023-10-14T12:29:29.743 INFO:teuthology.orchestra.run.smithi064.stdout: "root": "/" 2023-10-14T12:29:29.743 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:29.743 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_count": 0, 2023-10-14T12:29:29.743 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_pinned_count": 0, 2023-10-14T12:29:29.743 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 4827, 2023-10-14T12:29:29.744 INFO:teuthology.orchestra.run.smithi064.stdout: "inst": { 2023-10-14T12:29:29.744 INFO:teuthology.orchestra.run.smithi064.stdout: "name": { 2023-10-14T12:29:29.744 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "client", 2023-10-14T12:29:29.744 INFO:teuthology.orchestra.run.smithi064.stdout: "num": 4827 2023-10-14T12:29:29.744 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:29.745 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:29:29.745 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:29:29.745 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.2:0", 2023-10-14T12:29:29.745 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 2284721886 2023-10-14T12:29:29.745 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:29:29.746 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:29.746 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:29:29.746 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:29:29.746 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.2:0", 2023-10-14T12:29:29.746 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 2284721886 2023-10-14T12:29:29.746 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:29:29.747 INFO:teuthology.orchestra.run.smithi064.stdout: "inst_str": "client.4827 192.168.0.2:0/2284721886", 2023-10-14T12:29:29.747 INFO:teuthology.orchestra.run.smithi064.stdout: "addr_str": "192.168.0.2:0/2284721886", 2023-10-14T12:29:29.747 INFO:teuthology.orchestra.run.smithi064.stdout: "inode_count": 1, 2023-10-14T12:29:29.747 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_epoch": 9, 2023-10-14T12:29:29.747 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch": 27, 2023-10-14T12:29:29.748 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch_barrier": 0, 2023-10-14T12:29:29.748 INFO:teuthology.orchestra.run.smithi064.stdout: "blocklisted": false, 2023-10-14T12:29:29.748 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "cephfs" 2023-10-14T12:29:29.748 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:29:29.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:29:29.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.954+0000 7f9226bd0640 1 Processor -- start 2023-10-14T12:29:29.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.955+0000 7f9226bd0640 1 -- start start 2023-10-14T12:29:29.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.956+0000 7f9226bd0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 0x7f92200701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.956+0000 7f9226bd0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f922015f040 0x7f922015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.956+0000 7f9226bd0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92200707f0 con 0x7f92200b0010 2023-10-14T12:29:29.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.956+0000 7f9226bd0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9220070ad0 con 0x7f922015f040 2023-10-14T12:29:29.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.956+0000 7f9226bd0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f922015b1d0 con 0x7f922015ad00 2023-10-14T12:29:29.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.956+0000 7f922496c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f92200b0010 0x7f92200b03f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:37630/0 (socket says 172.21.15.64:37630) 2023-10-14T12:29:29.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.956+0000 7f922496c640 1 -- 172.21.15.64:0/2718622074 learned_addr learned my addr 172.21.15.64:0/2718622074 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:29.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f922516d640 1 --2- 172.21.15.64:0/2718622074 >> v2:172.21.15.177:3300/0 conn(0x7f922015f040 0x7f922015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:29.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921ffff640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 0x7f92200701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:29.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3613409056 0 0) 0x7f92200707f0 con 0x7f92200b0010 2023-10-14T12:29:29.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9208003520 con 0x7f92200b0010 2023-10-14T12:29:29.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 697092458 0 0) 0x7f9208003520 con 0x7f92200b0010 2023-10-14T12:29:29.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 msgr2=0x7f92200701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:29.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 0x7f92200701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:29.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 >> v2:172.21.15.177:3300/0 conn(0x7f922015f040 msgr2=0x7f922015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:29.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 --2- 172.21.15.64:0/2718622074 >> v2:172.21.15.177:3300/0 conn(0x7f922015f040 0x7f922015b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:29.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f922015b4b0 con 0x7f92200b0010 2023-10-14T12:29:29.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f9214001670 con 0x7f92200b0010 2023-10-14T12:29:29.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.957+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 >> v1:172.21.15.64:6789/0 conn(0x7f92200b0010 legacy=0x7f92200b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:29.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f921f7fe640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 0x7f92080039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f921f7fe640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9208003fb0 0x7f92080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f921f7fe640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9208004d00 0x7f9208005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9220070ad0 con 0x7f9208004d00 2023-10-14T12:29:29.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922015b1d0 con 0x7f9208003fb0 2023-10-14T12:29:29.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920800ba00 con 0x7f922015ad00 2023-10-14T12:29:29.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f922516d640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9208004d00 0x7f9208005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:29.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f922496c640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 0x7f92080039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:29.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f921ffff640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9208003fb0 0x7f92080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:29.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f922516d640 1 -- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 msgr2=0x7f92080039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:29.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f922516d640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f922015ad00 0x7f92080039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:29.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f922516d640 1 -- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9208003fb0 msgr2=0x7f92080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:29.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f922516d640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9208003fb0 0x7f92080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:29.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.958+0000 7f922516d640 1 -- 172.21.15.64:0/2718622074 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9208003520 con 0x7f9208004d00 2023-10-14T12:29:29.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.960+0000 7f922516d640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9208004d00 0x7f9208005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9218009fc0 tx=0x7f92080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=260667cf44f99923 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:29.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.960+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921802cc60 con 0x7f9208004d00 2023-10-14T12:29:29.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.960+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f921800f040 con 0x7f9208004d00 2023-10-14T12:29:29.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.960+0000 7f921f7fe640 1 -- 172.21.15.64:0/2718622074 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9218034440 con 0x7f9208004d00 2023-10-14T12:29:29.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.960+0000 7f9226bd0640 1 -- 172.21.15.64:0/2718622074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9208004d00 msgr2=0x7f9208005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:29.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.960+0000 7f9226bd0640 1 --2- 172.21.15.64:0/2718622074 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9208004d00 0x7f9208005180 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9218009fc0 tx=0x7f92080057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:29.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.960+0000 7f922516d640 1 -- 172.21.15.64:0/2718622074 reap_dead start 2023-10-14T12:29:29.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.961+0000 7f9226bd0640 1 -- 172.21.15.64:0/2718622074 shutdown_connections 2023-10-14T12:29:29.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.961+0000 7f9226bd0640 1 -- 172.21.15.64:0/2718622074 >> 172.21.15.64:0/2718622074 conn(0x7f922006c1c0 msgr2=0x7f922006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:29.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.961+0000 7f9226bd0640 1 -- 172.21.15.64:0/2718622074 shutdown_connections 2023-10-14T12:29:29.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.961+0000 7f9226bd0640 1 -- 172.21.15.64:0/2718622074 wait complete. 2023-10-14T12:29:29.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.963+0000 7f9226bd0640 1 Processor -- start 2023-10-14T12:29:29.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.963+0000 7f9226bd0640 1 -- start start 2023-10-14T12:29:29.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f9226bd0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9208004d00 0x7f92200c2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f9226bd0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220150c60 0x7f92200c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f9226bd0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f922015d580 0x7f922015da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f9226bd0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922015eb60 con 0x7f9220150c60 2023-10-14T12:29:29.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f9226bd0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922015df40 con 0x7f922015d580 2023-10-14T12:29:29.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f9226bd0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92200c5c90 con 0x7f9208004d00 2023-10-14T12:29:29.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f921ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220150c60 0x7f92200c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:29.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f921ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220150c60 0x7f92200c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57486/0 (socket says 172.21.15.64:57486) 2023-10-14T12:29:29.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f921ffff640 1 -- 172.21.15.64:0/1278281582 learned_addr learned my addr 172.21.15.64:0/1278281582 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:29.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f921ffff640 1 -- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9208004d00 msgr2=0x7f92200c2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:29.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f921ffff640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9208004d00 0x7f92200c2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:29.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f921ffff640 1 -- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f922015d580 msgr2=0x7f922015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:29.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.964+0000 7f921ffff640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f922015d580 0x7f922015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:29.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.965+0000 7f921ffff640 1 -- 172.21.15.64:0/1278281582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92200c4890 con 0x7f9220150c60 2023-10-14T12:29:29.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.965+0000 7f921ffff640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220150c60 0x7f92200c4350 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9210011560 tx=0x7f9210011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:29.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.965+0000 7f921d7fa640 1 -- 172.21.15.64:0/1278281582 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210004220 con 0x7f9220150c60 2023-10-14T12:29:29.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.965+0000 7f921d7fa640 1 -- 172.21.15.64:0/1278281582 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9210004380 con 0x7f9220150c60 2023-10-14T12:29:29.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.965+0000 7f921d7fa640 1 -- 172.21.15.64:0/1278281582 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9210015870 con 0x7f9220150c60 2023-10-14T12:29:29.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.965+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92200c5660 con 0x7f9220150c60 2023-10-14T12:29:29.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.965+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92200c4e10 con 0x7f9220150c60 2023-10-14T12:29:29.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.966+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9220073ef0 con 0x7f9220150c60 2023-10-14T12:29:29.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.968+0000 7f921d7fa640 1 -- 172.21.15.64:0/1278281582 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92100159d0 con 0x7f9220150c60 2023-10-14T12:29:29.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.969+0000 7f921d7fa640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f920c06ae70 0x7f920c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:29.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.969+0000 7f921d7fa640 1 -- 172.21.15.64:0/1278281582 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f921008a180 con 0x7f9220150c60 2023-10-14T12:29:29.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.970+0000 7f922496c640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f920c06ae70 0x7f920c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:29.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.971+0000 7f922496c640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f920c06ae70 0x7f920c06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f92140058b0 tx=0x7f9214000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:29.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:29.972+0000 7f921d7fa640 1 -- 172.21.15.64:0/1278281582 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9210054fb0 con 0x7f9220150c60 2023-10-14T12:29:30.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.203+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f92200c5dd0 con 0x7f9220150c60 2023-10-14T12:29:30.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.204+0000 7f921d7fa640 1 -- 172.21.15.64:0/1278281582 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f92100585d0 con 0x7f9220150c60 2023-10-14T12:29:30.204 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:29:30.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f920c06ae70 msgr2=0x7f920c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:30.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f920c06ae70 0x7f920c06d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f92140058b0 tx=0x7f9214000ed0 comp rx=0 tx=0).stop 2023-10-14T12:29:30.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220150c60 msgr2=0x7f92200c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:30.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220150c60 0x7f92200c4350 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9210011560 tx=0x7f9210011a20 comp rx=0 tx=0).stop 2023-10-14T12:29:30.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 shutdown_connections 2023-10-14T12:29:30.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f920c06ae70 0x7f920c06d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:30.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f922015d580 0x7f922015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:30.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9220150c60 0x7f92200c4350 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:30.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 --2- 172.21.15.64:0/1278281582 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9208004d00 0x7f92200c2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:30.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 >> 172.21.15.64:0/1278281582 conn(0x7f922006c1c0 msgr2=0x7f92200cc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:30.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.206+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 shutdown_connections 2023-10-14T12:29:30.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:30.207+0000 7f9226bd0640 1 -- 172.21.15.64:0/1278281582 wait complete. 2023-10-14T12:29:30.225 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:29:30.226 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:29:30.226 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-14T12:29:30.226 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-14T12:29:30.226 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:30.227 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:29:30.227 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:29:30.227 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:29:30.227 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-14T12:29:30.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:30.228 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-14T12:29:30.289 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:30.289 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:30.289 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:30.289 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:30.290 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:30.290 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:30.290 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:30.290 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:30.290 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-14T12:29:30.291 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:30.291 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:30.291 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-14T12:29:30.291 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:30.291 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:30.292 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:29:30.292 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:30.292 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:29:30.292 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42328sec preferred_lft 42328sec 2023-10-14T12:29:30.292 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-14T12:29:30.293 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:30.294 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-14T12:29:30.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:30.294 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:30.295 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:30.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add name ceph-brx type bridge 2023-10-14T12:29:30.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr flush dev ceph-brx 2023-10-14T12:29:30.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set ceph-brx up 2023-10-14T12:29:30.296 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-14T12:29:30.296 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:30.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:30.752 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:29:30.831 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-14T12:29:30.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:30.834 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-14T12:29:30.894 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-14T12:29:30.895 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:29:30.895 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:29:30.895 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:29:30.895 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:29:30.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:30.896 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:30.896 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:30.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:29:30.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:29:30.897 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:29:30.897 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:31.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:31.633 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-14T12:29:31.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:31.691 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-10-14T12:29:31.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:31.744 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:31.744 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:31.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:31.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-14T12:29:31.745 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:31.879 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-14T12:29:31.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:31.880 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:31.880 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:31.880 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-14T12:29:31.881 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-14T12:29:31.881 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-14T12:29:31.881 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-14T12:29:31.882 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-14T12:29:31.882 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:32.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:32.153 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:32.153 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:32.153 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.0 up 2023-10-14T12:29:32.154 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.0 master ceph-brx 2023-10-14T12:29:32.154 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:32.316 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-10-14T12:29:32.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:32.317 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:32.364 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-14T12:29:32.364 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:32.364 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:32.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-10-14T12:29:32.554 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:32.605 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-14T12:29:32.606 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-14T12:29:32.606 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-14T12:29:32.606 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-14T12:29:32.606 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-14T12:29:32.607 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-14T12:29:32.607 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-14T12:29:32.607 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-14T12:29:32.607 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-14T12:29:32.607 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-14T12:29:32.608 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/selinux 2023-10-14T12:29:32.608 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:32.608 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-14T12:29:32.608 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-14T12:29:32.608 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-14T12:29:32.609 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-14T12:29:32.609 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:32.609 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-14T12:29:32.609 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:32.610 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:32.610 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:32.610 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:32.610 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-14T12:29:32.610 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-14T12:29:32.611 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T12:29:32.611 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T12:29:32.611 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T12:29:32.611 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T12:29:32.611 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-14T12:29:32.612 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:32.612 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:32.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:32.613 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-14T12:29:32.661 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T12:29:32.661 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-10-14T12:29:32.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-10-14T12:29:32.793 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:32.839 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-14T12:29:32.840 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-14T12:29:32.840 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-14T12:29:32.840 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-14T12:29:32.840 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-14T12:29:32.841 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-14T12:29:32.841 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-14T12:29:32.841 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-14T12:29:32.841 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-14T12:29:32.841 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-14T12:29:32.842 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/selinux 2023-10-14T12:29:32.842 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:32.842 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-14T12:29:32.842 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-14T12:29:32.843 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-14T12:29:32.843 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-14T12:29:32.843 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:32.843 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-14T12:29:32.843 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-14T12:29:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-14T12:29:32.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T12:29:32.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T12:29:32.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T12:29:32.845 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T12:29:32.845 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-14T12:29:32.846 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:32.846 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:32.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:32.847 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-14T12:29:32.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi177.stderr:2023-10-14T12:29:32.912+0000 7f82e9662480 -1 init, newargv = 0x55776e1f2b90 newargc=15 2023-10-14T12:29:32.912 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi177.stderr:ceph-fuse[93746]: starting ceph client 2023-10-14T12:29:32.927 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi177.stderr:ceph-fuse[93746]: starting fuse 2023-10-14T12:29:33.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-10-14T12:29:34.092 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:34.146 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-14T12:29:34.147 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-14T12:29:34.147 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-14T12:29:34.147 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-14T12:29:34.147 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-14T12:29:34.147 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-14T12:29:34.147 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-14T12:29:34.148 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-14T12:29:34.148 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-14T12:29:34.148 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-14T12:29:34.148 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/selinux 2023-10-14T12:29:34.148 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:34.149 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-14T12:29:34.149 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-14T12:29:34.149 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-14T12:29:34.149 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-14T12:29:34.149 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:34.149 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-14T12:29:34.150 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:34.150 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:34.150 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:34.150 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:34.150 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-14T12:29:34.151 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-14T12:29:34.151 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T12:29:34.151 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T12:29:34.151 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T12:29:34.151 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T12:29:34.152 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-14T12:29:34.152 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:34.152 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:34.152 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:34.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:34.153 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-14T12:29:34.206 INFO:teuthology.orchestra.run.smithi177.stdout:40 2023-10-14T12:29:34.206 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2023-10-14T12:29:34.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-14T12:29:34.207 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-14T12:29:34.207 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-14T12:29:34.207 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-14T12:29:34.208 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-14T12:29:34.208 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:34.208 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-14T12:29:34.208 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-10-14T12:29:34.209 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-14T12:29:34.209 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-10-14T12:29:34.209 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:34.210 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-14T12:29:34.210 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-14T12:29:34.210 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-14T12:29:34.211 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-14T12:29:34.211 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:34.211 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-14T12:29:34.211 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T12:29:34.212 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T12:29:34.212 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T12:29:34.212 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-14T12:29:34.213 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-14T12:29:34.213 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-14T12:29:34.213 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T12:29:34.213 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:34.214 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.1")) 2023-10-14T12:29:34.214 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-14T12:29:34.390 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.1.93746.asok 2023-10-14T12:29:34.394 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:29:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T12:29:34.408 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.93746.asok 2023-10-14T12:29:34.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:34.408 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.93746.asok status 2023-10-14T12:29:34.650 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-14T12:29:34.650 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-14T12:29:34.651 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T12:29:34.651 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T12:29:34.651 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "1", 2023-10-14T12:29:34.651 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-14T12:29:34.651 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-10-14T12:29:34.652 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "93746", 2023-10-14T12:29:34.652 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-14T12:29:34.652 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:34.652 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-14T12:29:34.652 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-14T12:29:34.652 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4699, 2023-10-14T12:29:34.653 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-14T12:29:34.653 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-14T12:29:34.653 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-14T12:29:34.653 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 4699 2023-10-14T12:29:34.653 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:34.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-14T12:29:34.654 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-14T12:29:34.654 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:29:34.654 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2976632773 2023-10-14T12:29:34.654 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-14T12:29:34.655 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:34.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-14T12:29:34.655 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-14T12:29:34.655 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:29:34.655 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2976632773 2023-10-14T12:29:34.656 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:34.656 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.4699 192.168.0.1:0/2976632773", 2023-10-14T12:29:34.656 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.1:0/2976632773", 2023-10-14T12:29:34.656 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-14T12:29:34.656 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 9, 2023-10-14T12:29:34.656 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 29, 2023-10-14T12:29:34.657 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-14T12:29:34.657 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-14T12:29:34.657 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-14T12:29:34.657 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-14T12:29:34.665 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:29:34.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.904+0000 7fbf14875640 1 Processor -- start 2023-10-14T12:29:34.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.904+0000 7fbf14875640 1 -- start start 2023-10-14T12:29:34.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf14875640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbf100cb400 0x7fbf1015e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf14875640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100c8e40 con 0x7fbf10070400 2023-10-14T12:29:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf14875640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100c9090 con 0x7fbf100c8930 2023-10-14T12:29:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf14875640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf100c9370 con 0x7fbf100cb400 2023-10-14T12:29:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf0effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbf100cb400 0x7fbf1015e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:34.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf0f7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fbf10070400 0x7fbf100cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:37640/0 (socket says 172.21.15.64:37640) 2023-10-14T12:29:34.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/1802407510 learned_addr learned my addr 172.21.15.64:0/1802407510 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:34.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.906+0000 7fbf0effd640 1 -- 172.21.15.64:0/1802407510 >> v1:172.21.15.177:6789/0 conn(0x7fbf100c8930 legacy=0x7fbf1015af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:34.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.907+0000 7fbf0effd640 1 -- 172.21.15.64:0/1802407510 >> v1:172.21.15.64:6789/0 conn(0x7fbf10070400 legacy=0x7fbf100cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:34.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.907+0000 7fbf0effd640 1 -- 172.21.15.64:0/1802407510 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf100c9650 con 0x7fbf100cb400 2023-10-14T12:29:34.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.908+0000 7fbf0effd640 1 --2- 172.21.15.64:0/1802407510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cb400 0x7fbf1015e210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf040097a0 tx=0x7fbf0402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db89dab900c95628 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:34.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.908+0000 7fbf0e7fc640 1 -- 172.21.15.64:0/1802407510 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04031830 con 0x7fbf100cb400 2023-10-14T12:29:34.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.908+0000 7fbf0e7fc640 1 -- 172.21.15.64:0/1802407510 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04031990 con 0x7fbf100cb400 2023-10-14T12:29:34.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.908+0000 7fbf0e7fc640 1 -- 172.21.15.64:0/1802407510 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04031d20 con 0x7fbf100cb400 2023-10-14T12:29:34.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.909+0000 7fbf14875640 1 -- 172.21.15.64:0/1802407510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cb400 msgr2=0x7fbf1015e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:34.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.909+0000 7fbf14875640 1 --2- 172.21.15.64:0/1802407510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cb400 0x7fbf1015e210 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbf040097a0 tx=0x7fbf0402b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:34.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.909+0000 7fbf14875640 1 -- 172.21.15.64:0/1802407510 shutdown_connections 2023-10-14T12:29:34.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.909+0000 7fbf14875640 1 --2- 172.21.15.64:0/1802407510 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cb400 0x7fbf1015e210 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:34.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.909+0000 7fbf14875640 1 -- 172.21.15.64:0/1802407510 >> 172.21.15.64:0/1802407510 conn(0x7fbf1006a470 msgr2=0x7fbf100afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:34.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.909+0000 7fbf14875640 1 -- 172.21.15.64:0/1802407510 shutdown_connections 2023-10-14T12:29:34.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.909+0000 7fbf14875640 1 -- 172.21.15.64:0/1802407510 wait complete. 2023-10-14T12:29:34.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.911+0000 7fbf14875640 1 Processor -- start 2023-10-14T12:29:34.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.911+0000 7fbf14875640 1 -- start start 2023-10-14T12:29:34.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf14875640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10070400 0x7fbf101f4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:34.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf14875640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100c8930 0x7fbf100ce240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:34.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf14875640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf100cb400 0x7fbf100ce780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:34.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf14875640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf101f2ea0 con 0x7fbf10070400 2023-10-14T12:29:34.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf14875640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf101f2240 con 0x7fbf100c8930 2023-10-14T12:29:34.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf14875640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf101f2500 con 0x7fbf100cb400 2023-10-14T12:29:34.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10070400 0x7fbf101f4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:34.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10070400 0x7fbf101f4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:57510/0 (socket says 172.21.15.64:57510) 2023-10-14T12:29:34.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/3740536559 learned_addr learned my addr 172.21.15.64:0/3740536559 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:34.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0ffff640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf100cb400 0x7fbf100ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:34.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0effd640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100c8930 0x7fbf100ce240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:34.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf100cb400 msgr2=0x7fbf100ce780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:34.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf100cb400 0x7fbf100ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:34.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100c8930 msgr2=0x7fbf100ce240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:34.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100c8930 0x7fbf100ce240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:34.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.912+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/3740536559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf04009400 con 0x7fbf10070400 2023-10-14T12:29:34.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.913+0000 7fbf0f7fe640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10070400 0x7fbf101f4fa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000c4a0 tx=0x7fbf0000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:34.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.913+0000 7fbef7fff640 1 -- 172.21.15.64:0/3740536559 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00005ce0 con 0x7fbf10070400 2023-10-14T12:29:34.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.913+0000 7fbef7fff640 1 -- 172.21.15.64:0/3740536559 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf00005e40 con 0x7fbf10070400 2023-10-14T12:29:34.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.913+0000 7fbef7fff640 1 -- 172.21.15.64:0/3740536559 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf00007270 con 0x7fbf10070400 2023-10-14T12:29:34.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.913+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf101f27e0 con 0x7fbf10070400 2023-10-14T12:29:34.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.913+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf101f54e0 con 0x7fbf10070400 2023-10-14T12:29:34.919 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.914+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf101f2fe0 con 0x7fbf10070400 2023-10-14T12:29:34.920 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.915+0000 7fbef7fff640 1 -- 172.21.15.64:0/3740536559 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbf00007490 con 0x7fbf10070400 2023-10-14T12:29:34.920 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.916+0000 7fbef7fff640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbefc06ae70 0x7fbefc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:34.920 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.916+0000 7fbef7fff640 1 -- 172.21.15.64:0/3740536559 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbf00088ea0 con 0x7fbf10070400 2023-10-14T12:29:34.920 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.917+0000 7fbf0effd640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbefc06ae70 0x7fbefc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:34.921 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.918+0000 7fbf0effd640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbefc06ae70 0x7fbefc06d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf04036000 tx=0x7fbf0403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:34.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:34.922+0000 7fbef7fff640 1 -- 172.21.15.64:0/3740536559 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbf00053c30 con 0x7fbf10070400 2023-10-14T12:29:35.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.154+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbf1004e9b0 con 0x7fbf10070400 2023-10-14T12:29:35.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.154+0000 7fbef7fff640 1 -- 172.21.15.64:0/3740536559 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fbf00017020 con 0x7fbf10070400 2023-10-14T12:29:35.155 INFO:teuthology.orchestra.run.smithi064.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-10-14T12:29:35.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbefc06ae70 msgr2=0x7fbefc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:35.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbefc06ae70 0x7fbefc06d330 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbf04036000 tx=0x7fbf0403c040 comp rx=0 tx=0).stop 2023-10-14T12:29:35.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10070400 msgr2=0x7fbf101f4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:35.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10070400 0x7fbf101f4fa0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000c4a0 tx=0x7fbf0000c960 comp rx=0 tx=0).stop 2023-10-14T12:29:35.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 shutdown_connections 2023-10-14T12:29:35.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbefc06ae70 0x7fbefc06d330 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:35.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf100cb400 0x7fbf100ce780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:35.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf100c8930 0x7fbf100ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:35.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 --2- 172.21.15.64:0/3740536559 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10070400 0x7fbf101f4fa0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:35.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 >> 172.21.15.64:0/3740536559 conn(0x7fbf1006a470 msgr2=0x7fbf10072870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:35.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.157+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 shutdown_connections 2023-10-14T12:29:35.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:35.158+0000 7fbf14875640 1 -- 172.21.15.64:0/3740536559 wait complete. 2023-10-14T12:29:35.175 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:29:35.176 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:29:35.176 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi177.front.sepia.ceph.com 2023-10-14T12:29:35.176 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-14T12:29:35.177 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-14T12:29:35.177 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:29:35.177 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:29:35.177 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:29:35.178 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-14T12:29:35.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.178 DEBUG:teuthology.orchestra.run.smithi177:> ip addr 2023-10-14T12:29:35.240 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:35.241 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:35.241 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:35.241 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.241 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:35.241 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.242 INFO:teuthology.orchestra.run.smithi177.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:35.242 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:40 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:35.242 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f0 2023-10-14T12:29:35.242 INFO:teuthology.orchestra.run.smithi177.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:35.243 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:d9:19:41 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:35.243 INFO:teuthology.orchestra.run.smithi177.stdout: altname enp7s0f1 2023-10-14T12:29:35.243 INFO:teuthology.orchestra.run.smithi177.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:29:35.243 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4a brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:35.243 INFO:teuthology.orchestra.run.smithi177.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:29:35.244 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 0c:c4:7a:ea:b0:4b brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:35.244 INFO:teuthology.orchestra.run.smithi177.stdout: inet 172.21.15.177/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:29:35.244 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft 42323sec preferred_lft 42323sec 2023-10-14T12:29:35.244 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::ec4:7aff:feea:b04b/64 scope link 2023-10-14T12:29:35.244 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.244 INFO:teuthology.orchestra.run.smithi177.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:29:35.245 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 4e:97:19:05:60:25 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:29:35.245 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:29:35.245 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.245 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::8c1c:4eff:fe24:9e10/64 scope link 2023-10-14T12:29:35.245 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.246 INFO:teuthology.orchestra.run.smithi177.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:29:35.246 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether 4e:97:19:05:60:25 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:35.246 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::4c97:19ff:fe05:6025/64 scope link 2023-10-14T12:29:35.246 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.248 DEBUG:teuthology.orchestra.run.smithi177:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:29:35.341 INFO:teuthology.orchestra.run.smithi177.stdout:1 2023-10-14T12:29:35.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.345 DEBUG:teuthology.orchestra.run.smithi177:> route 2023-10-14T12:29:35.400 INFO:teuthology.orchestra.run.smithi177.stdout:Kernel IP routing table 2023-10-14T12:29:35.400 INFO:teuthology.orchestra.run.smithi177.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:29:35.400 INFO:teuthology.orchestra.run.smithi177.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:29:35.400 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:29:35.401 INFO:teuthology.orchestra.run.smithi177.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:29:35.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.401 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:35.402 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:35.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:29:35.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:29:35.402 DEBUG:teuthology.orchestra.run.smithi177:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:29:35.403 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:35.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.574 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-14T12:29:35.624 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T12:29:35.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.625 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list-id 2023-10-14T12:29:35.677 INFO:teuthology.orchestra.run.smithi177.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-14T12:29:35.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.678 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:35.679 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:35.679 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:29:35.679 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-14T12:29:35.679 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:35.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.822 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T12:29:35.909 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:35.909 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:35.909 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:35.909 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.910 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:35.910 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.910 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:29:35.910 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether f2:62:51:6b:2f:2e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:29:35.911 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:29:35.911 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.911 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::f062:51ff:fe6b:2f2e/64 scope link 2023-10-14T12:29:35.911 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:35.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:35.913 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-14T12:29:36.005 INFO:teuthology.orchestra.run.smithi177.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:29:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:29:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:29:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 ::1/128 scope host 2023-10-14T12:29:36.006 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:36.007 INFO:teuthology.orchestra.run.smithi177.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:29:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: link/ether f2:62:51:6b:2f:2e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-14T12:29:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-14T12:29:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:36.007 INFO:teuthology.orchestra.run.smithi177.stdout: inet6 fe80::f062:51ff:fe6b:2f2e/64 scope link 2023-10-14T12:29:36.008 INFO:teuthology.orchestra.run.smithi177.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:29:36.010 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-14T12:29:36.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:36.011 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:36.011 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:36.011 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-14T12:29:36.012 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-14T12:29:36.012 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-14T12:29:36.012 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-14T12:29:36.013 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-14T12:29:36.013 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:36.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:36.263 DEBUG:teuthology.orchestra.run.smithi177:> (cd / && exec bash -c ' 2023-10-14T12:29:36.263 DEBUG:teuthology.orchestra.run.smithi177:> set -e 2023-10-14T12:29:36.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set brx.1 up 2023-10-14T12:29:36.264 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link set dev brx.1 master ceph-brx 2023-10-14T12:29:36.264 DEBUG:teuthology.orchestra.run.smithi177:> ') 2023-10-14T12:29:36.426 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-10-14T12:29:36.426 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:36.427 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-14T12:29:36.479 INFO:teuthology.orchestra.run.smithi177.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-14T12:29:36.479 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:29:36.480 DEBUG:teuthology.orchestra.run.smithi177:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-14T12:29:36.531 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-10-14T12:29:36.624 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:36.677 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-14T12:29:36.677 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-14T12:29:36.678 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-14T12:29:36.678 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-14T12:29:36.678 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-14T12:29:36.678 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-14T12:29:36.679 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-14T12:29:36.679 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-14T12:29:36.679 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-14T12:29:36.679 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-14T12:29:36.679 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/selinux 2023-10-14T12:29:36.680 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:36.680 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-14T12:29:36.680 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-14T12:29:36.680 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-14T12:29:36.680 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-14T12:29:36.680 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:36.681 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-14T12:29:36.681 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:36.681 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:36.681 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:36.681 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:36.682 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-14T12:29:36.682 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-14T12:29:36.682 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T12:29:36.682 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T12:29:36.682 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T12:29:36.683 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T12:29:36.683 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-14T12:29:36.683 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:36.683 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:36.683 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:36.684 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:29:36.684 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:29:36.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:36.685 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-14T12:29:36.741 INFO:teuthology.orchestra.run.smithi177.stdout:40 2023-10-14T12:29:36.742 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [40] 2023-10-14T12:29:36.742 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-10-14T12:29:36.748 DEBUG:teuthology.orchestra.run.smithi177:> sudo modprobe fuse 2023-10-14T12:29:36.826 DEBUG:teuthology.orchestra.run.smithi177:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:29:36.868 INFO:teuthology.orchestra.run.smithi177.stdout:/proc 2023-10-14T12:29:36.868 INFO:teuthology.orchestra.run.smithi177.stdout:/sys 2023-10-14T12:29:36.868 INFO:teuthology.orchestra.run.smithi177.stdout:/dev 2023-10-14T12:29:36.869 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/security 2023-10-14T12:29:36.869 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/shm 2023-10-14T12:29:36.869 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/pts 2023-10-14T12:29:36.869 INFO:teuthology.orchestra.run.smithi177.stdout:/run 2023-10-14T12:29:36.870 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/cgroup 2023-10-14T12:29:36.870 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/pstore 2023-10-14T12:29:36.870 INFO:teuthology.orchestra.run.smithi177.stdout:/ 2023-10-14T12:29:36.870 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/selinux 2023-10-14T12:29:36.870 INFO:teuthology.orchestra.run.smithi177.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:29:36.871 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/mqueue 2023-10-14T12:29:36.871 INFO:teuthology.orchestra.run.smithi177.stdout:/dev/hugepages 2023-10-14T12:29:36.871 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/debug 2023-10-14T12:29:36.871 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/tracing 2023-10-14T12:29:36.871 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/fs/fuse/connections 2023-10-14T12:29:36.872 INFO:teuthology.orchestra.run.smithi177.stdout:/sys/kernel/config 2023-10-14T12:29:36.872 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:29:36.872 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:29:36.872 INFO:teuthology.orchestra.run.smithi177.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:29:36.872 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:29:36.873 INFO:teuthology.orchestra.run.smithi177.stdout:/run/user/1000 2023-10-14T12:29:36.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph 2023-10-14T12:29:36.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-4 2023-10-14T12:29:36.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-5 2023-10-14T12:29:36.873 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-6 2023-10-14T12:29:36.874 INFO:teuthology.orchestra.run.smithi177.stdout:/var/lib/ceph/osd/ceph-7 2023-10-14T12:29:36.874 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns 2023-10-14T12:29:36.874 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:36.874 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T12:29:36.875 INFO:teuthology.orchestra.run.smithi177.stdout:/home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:36.875 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:29:36.875 INFO:teuthology.orchestra.run.smithi177.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T12:29:36.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:36.876 DEBUG:teuthology.orchestra.run.smithi177:> ls /sys/fs/fuse/connections 2023-10-14T12:29:36.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi177.stderr:2023-10-14T12:29:36.936+0000 7febe523c480 -1 init, newargv = 0x5652cc0d4db0 newargc=15 2023-10-14T12:29:36.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi177.stderr:ceph-fuse[94254]: starting ceph client 2023-10-14T12:29:36.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi177.stderr:ceph-fuse[94254]: starting fuse 2023-10-14T12:29:36.964 INFO:teuthology.orchestra.run.smithi177.stdout:40 2023-10-14T12:29:36.964 INFO:teuthology.orchestra.run.smithi177.stdout:42 2023-10-14T12:29:36.965 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40, 42] 2023-10-14T12:29:36.965 DEBUG:teuthology.orchestra.run.smithi177:> sudo stdin-killer -- python3 -c ' 2023-10-14T12:29:36.965 DEBUG:teuthology.orchestra.run.smithi177:> import glob 2023-10-14T12:29:36.965 DEBUG:teuthology.orchestra.run.smithi177:> import re 2023-10-14T12:29:36.966 DEBUG:teuthology.orchestra.run.smithi177:> import os 2023-10-14T12:29:36.966 DEBUG:teuthology.orchestra.run.smithi177:> import subprocess 2023-10-14T12:29:36.966 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:36.967 DEBUG:teuthology.orchestra.run.smithi177:> def _find_admin_socket(client_name): 2023-10-14T12:29:36.967 DEBUG:teuthology.orchestra.run.smithi177:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-10-14T12:29:36.967 DEBUG:teuthology.orchestra.run.smithi177:> files = glob.glob(asok_path) 2023-10-14T12:29:36.967 DEBUG:teuthology.orchestra.run.smithi177:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-10-14T12:29:36.968 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:36.968 DEBUG:teuthology.orchestra.run.smithi177:> # Given a non-glob path, it better be there 2023-10-14T12:29:36.968 DEBUG:teuthology.orchestra.run.smithi177:> if "*" not in asok_path: 2023-10-14T12:29:36.968 DEBUG:teuthology.orchestra.run.smithi177:> assert(len(files) == 1) 2023-10-14T12:29:36.969 DEBUG:teuthology.orchestra.run.smithi177:> return files[0] 2023-10-14T12:29:36.969 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:36.969 DEBUG:teuthology.orchestra.run.smithi177:> for f in files: 2023-10-14T12:29:36.970 DEBUG:teuthology.orchestra.run.smithi177:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T12:29:36.970 DEBUG:teuthology.orchestra.run.smithi177:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T12:29:36.970 DEBUG:teuthology.orchestra.run.smithi177:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T12:29:36.971 DEBUG:teuthology.orchestra.run.smithi177:> contents = proc_f.read() 2023-10-14T12:29:36.971 DEBUG:teuthology.orchestra.run.smithi177:> if mountpoint in contents: 2023-10-14T12:29:36.971 DEBUG:teuthology.orchestra.run.smithi177:> return f 2023-10-14T12:29:36.972 DEBUG:teuthology.orchestra.run.smithi177:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T12:29:36.972 DEBUG:teuthology.orchestra.run.smithi177:> 2023-10-14T12:29:36.972 DEBUG:teuthology.orchestra.run.smithi177:> print(_find_admin_socket("client.3")) 2023-10-14T12:29:36.972 DEBUG:teuthology.orchestra.run.smithi177:> ' 2023-10-14T12:29:37.164 INFO:teuthology.orchestra.run.smithi177.stdout:/var/run/ceph/ceph-client.3.94254.asok 2023-10-14T12:29:37.168 INFO:teuthology.orchestra.run.smithi177.stderr:2023-10-14T12:29:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T12:29:37.181 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.94254.asok 2023-10-14T12:29:37.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.181 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.94254.asok status 2023-10-14T12:29:37.414 INFO:teuthology.orchestra.run.smithi177.stdout:{ 2023-10-14T12:29:37.414 INFO:teuthology.orchestra.run.smithi177.stdout: "metadata": { 2023-10-14T12:29:37.415 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T12:29:37.415 INFO:teuthology.orchestra.run.smithi177.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T12:29:37.415 INFO:teuthology.orchestra.run.smithi177.stdout: "entity_id": "3", 2023-10-14T12:29:37.415 INFO:teuthology.orchestra.run.smithi177.stdout: "hostname": "smithi177", 2023-10-14T12:29:37.416 INFO:teuthology.orchestra.run.smithi177.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-10-14T12:29:37.416 INFO:teuthology.orchestra.run.smithi177.stdout: "pid": "94254", 2023-10-14T12:29:37.416 INFO:teuthology.orchestra.run.smithi177.stdout: "root": "/" 2023-10-14T12:29:37.416 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:37.417 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_count": 0, 2023-10-14T12:29:37.417 INFO:teuthology.orchestra.run.smithi177.stdout: "dentry_pinned_count": 0, 2023-10-14T12:29:37.417 INFO:teuthology.orchestra.run.smithi177.stdout: "id": 4705, 2023-10-14T12:29:37.417 INFO:teuthology.orchestra.run.smithi177.stdout: "inst": { 2023-10-14T12:29:37.417 INFO:teuthology.orchestra.run.smithi177.stdout: "name": { 2023-10-14T12:29:37.418 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "client", 2023-10-14T12:29:37.418 INFO:teuthology.orchestra.run.smithi177.stdout: "num": 4705 2023-10-14T12:29:37.418 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:37.418 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-14T12:29:37.418 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-14T12:29:37.419 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.2:0", 2023-10-14T12:29:37.419 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2432976945 2023-10-14T12:29:37.419 INFO:teuthology.orchestra.run.smithi177.stdout: } 2023-10-14T12:29:37.419 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:37.419 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": { 2023-10-14T12:29:37.420 INFO:teuthology.orchestra.run.smithi177.stdout: "type": "v1", 2023-10-14T12:29:37.420 INFO:teuthology.orchestra.run.smithi177.stdout: "addr": "192.168.0.2:0", 2023-10-14T12:29:37.420 INFO:teuthology.orchestra.run.smithi177.stdout: "nonce": 2432976945 2023-10-14T12:29:37.420 INFO:teuthology.orchestra.run.smithi177.stdout: }, 2023-10-14T12:29:37.421 INFO:teuthology.orchestra.run.smithi177.stdout: "inst_str": "client.4705 192.168.0.2:0/2432976945", 2023-10-14T12:29:37.421 INFO:teuthology.orchestra.run.smithi177.stdout: "addr_str": "192.168.0.2:0/2432976945", 2023-10-14T12:29:37.421 INFO:teuthology.orchestra.run.smithi177.stdout: "inode_count": 1, 2023-10-14T12:29:37.421 INFO:teuthology.orchestra.run.smithi177.stdout: "mds_epoch": 9, 2023-10-14T12:29:37.421 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch": 29, 2023-10-14T12:29:37.422 INFO:teuthology.orchestra.run.smithi177.stdout: "osd_epoch_barrier": 0, 2023-10-14T12:29:37.422 INFO:teuthology.orchestra.run.smithi177.stdout: "blocklisted": false, 2023-10-14T12:29:37.422 INFO:teuthology.orchestra.run.smithi177.stdout: "fs_name": "cephfs" 2023-10-14T12:29:37.422 INFO:teuthology.orchestra.run.smithi177.stdout:} 2023-10-14T12:29:37.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.430 DEBUG:teuthology.orchestra.run.smithi064:> stat --file-system '--printf=%T 2023-10-14T12:29:37.430 DEBUG:teuthology.orchestra.run.smithi064:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:37.495 INFO:teuthology.orchestra.run.smithi064.stdout:fuseblk 2023-10-14T12:29:37.495 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:37.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.496 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:37.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.599 DEBUG:teuthology.orchestra.run.smithi064:> stat --file-system '--printf=%T 2023-10-14T12:29:37.600 DEBUG:teuthology.orchestra.run.smithi064:> ' -- /home/ubuntu/cephtest/mnt.2 2023-10-14T12:29:37.658 INFO:teuthology.orchestra.run.smithi064.stdout:fuseblk 2023-10-14T12:29:37.659 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-10-14T12:29:37.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.659 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-14T12:29:37.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.744 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-10-14T12:29:37.745 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:37.805 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-14T12:29:37.805 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:37.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.806 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-14T12:29:37.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.900 DEBUG:teuthology.orchestra.run.smithi177:> stat --file-system '--printf=%T 2023-10-14T12:29:37.901 DEBUG:teuthology.orchestra.run.smithi177:> ' -- /home/ubuntu/cephtest/mnt.3 2023-10-14T12:29:37.955 INFO:teuthology.orchestra.run.smithi177.stdout:fuseblk 2023-10-14T12:29:37.955 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-10-14T12:29:37.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:37.956 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-14T12:29:38.050 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-14T12:29:38.066 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:38.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.302+0000 7fc4f359e640 1 Processor -- start 2023-10-14T12:29:38.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.302+0000 7fc4f359e640 1 -- start start 2023-10-14T12:29:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.303+0000 7fc4f359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 0x7fc4f40c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.303+0000 7fc4f359e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc4f40ca660 0x7fc4f40c9350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.303+0000 7fc4f359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4f415acb0 con 0x7fc4f415a8d0 2023-10-14T12:29:38.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.303+0000 7fc4f359e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4f40c1c60 con 0x7fc4f40ca660 2023-10-14T12:29:38.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.303+0000 7fc4f359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f415e350 con 0x7fc4f40cb250 2023-10-14T12:29:38.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.303+0000 7fc4f259c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fc4f415a8d0 0x7fc4f40cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:33744/0 (socket says 172.21.15.64:33744) 2023-10-14T12:29:38.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.303+0000 7fc4f259c640 1 -- 172.21.15.64:0/1692672124 learned_addr learned my addr 172.21.15.64:0/1692672124 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:38.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252439576 0 0) 0x7fc4e4001290 con 0x7fc4f415a8d0 2023-10-14T12:29:38.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc4e0003520 con 0x7fc4f415a8d0 2023-10-14T12:29:38.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f1d9b640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 0x7fc4f40c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/1692672124 >> v2:172.21.15.177:3300/0 conn(0x7fc4f40ca660 0x7fc4f40c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2361677483 0 0) 0x7fc4e0003520 con 0x7fc4f415a8d0 2023-10-14T12:29:38.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 msgr2=0x7fc4f40c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:38.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 0x7fc4f40c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 >> v2:172.21.15.177:3300/0 conn(0x7fc4f40ca660 msgr2=0x7fc4f40c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:38.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 --2- 172.21.15.64:0/1692672124 >> v2:172.21.15.177:3300/0 conn(0x7fc4f40ca660 0x7fc4f40c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f415e630 con 0x7fc4f415a8d0 2023-10-14T12:29:38.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.304+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fc4e4001980 con 0x7fc4f415a8d0 2023-10-14T12:29:38.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 >> v1:172.21.15.64:6789/0 conn(0x7fc4f415a8d0 legacy=0x7fc4f40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f159a640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0003970 0x7fc4e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f159a640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 0x7fc4e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f159a640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e0004d00 0x7fc4e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40c1c60 con 0x7fc4e0004d00 2023-10-14T12:29:38.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f415e350 con 0x7fc4e0003970 2023-10-14T12:29:38.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e000b980 con 0x7fc4f40cb250 2023-10-14T12:29:38.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e0004d00 0x7fc4e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f259c640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0003970 0x7fc4e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f1d9b640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 0x7fc4e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 msgr2=0x7fc4e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:38.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f40cb250 0x7fc4e00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0003970 msgr2=0x7fc4e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:38.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0003970 0x7fc4e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/1692672124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0003520 con 0x7fc4e0004d00 2023-10-14T12:29:38.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.305+0000 7fc4f259c640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0003970 0x7fc4e0003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:38.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e0004d00 0x7fc4e0005180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009f90 tx=0x7fc4e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41e92ac75e4b7cba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:38.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec02cc20 con 0x7fc4e0004d00 2023-10-14T12:29:38.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec00f040 con 0x7fc4e0004d00 2023-10-14T12:29:38.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f159a640 1 -- 172.21.15.64:0/1692672124 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec034440 con 0x7fc4e0004d00 2023-10-14T12:29:38.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f359e640 1 -- 172.21.15.64:0/1692672124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e0004d00 msgr2=0x7fc4e0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f359e640 1 --2- 172.21.15.64:0/1692672124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4e0004d00 0x7fc4e0005180 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009f90 tx=0x7fc4e00057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/1692672124 reap_dead start 2023-10-14T12:29:38.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.307+0000 7fc4f359e640 1 -- 172.21.15.64:0/1692672124 shutdown_connections 2023-10-14T12:29:38.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.308+0000 7fc4f359e640 1 -- 172.21.15.64:0/1692672124 >> 172.21.15.64:0/1692672124 conn(0x7fc4f406a470 msgr2=0x7fc4f40afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:38.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.308+0000 7fc4f359e640 1 -- 172.21.15.64:0/1692672124 shutdown_connections 2023-10-14T12:29:38.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.308+0000 7fc4f359e640 1 -- 172.21.15.64:0/1692672124 wait complete. 2023-10-14T12:29:38.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.309+0000 7fc4f359e640 1 Processor -- start 2023-10-14T12:29:38.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.310+0000 7fc4f359e640 1 -- start start 2023-10-14T12:29:38.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.310+0000 7fc4f359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0004d00 0x7fc4f40c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.310+0000 7fc4f359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f415d810 0x7fc4f414c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.310+0000 7fc4f359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4f40c5440 0x7fc4f40c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f40c5e00 con 0x7fc4f40c5440 2023-10-14T12:29:38.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f415d080 con 0x7fc4e0004d00 2023-10-14T12:29:38.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4f415c500 con 0x7fc4f415d810 2023-10-14T12:29:38.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4f40c5440 0x7fc4f40c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4f40c5440 0x7fc4f40c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51386/0 (socket says 172.21.15.64:51386) 2023-10-14T12:29:38.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/770421085 learned_addr learned my addr 172.21.15.64:0/770421085 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:38.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f259c640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0004d00 0x7fc4f40c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f1d9b640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f415d810 0x7fc4f414c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f415d810 msgr2=0x7fc4f414c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f415d810 0x7fc4f414c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0004d00 msgr2=0x7fc4f40c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0004d00 0x7fc4f40c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f2d9d640 1 -- 172.21.15.64:0/770421085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f415c7e0 con 0x7fc4f40c5440 2023-10-14T12:29:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.311+0000 7fc4f1d9b640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f415d810 0x7fc4f414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.312+0000 7fc4f2d9d640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4f40c5440 0x7fc4f40c58c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009f90 tx=0x7fc4ec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.312+0000 7fc4eaffd640 1 -- 172.21.15.64:0/770421085 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec02cea0 con 0x7fc4f40c5440 2023-10-14T12:29:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.312+0000 7fc4eaffd640 1 -- 172.21.15.64:0/770421085 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4ec034d70 con 0x7fc4f40c5440 2023-10-14T12:29:38.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.312+0000 7fc4eaffd640 1 -- 172.21.15.64:0/770421085 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4ec03e680 con 0x7fc4f40c5440 2023-10-14T12:29:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.312+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4f415cac0 con 0x7fc4f40c5440 2023-10-14T12:29:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.312+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4f415dc70 con 0x7fc4f40c5440 2023-10-14T12:29:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.313+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4f404e9b0 con 0x7fc4f40c5440 2023-10-14T12:29:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.314+0000 7fc4eaffd640 1 -- 172.21.15.64:0/770421085 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc4ec03e7e0 con 0x7fc4f40c5440 2023-10-14T12:29:38.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.315+0000 7fc4eaffd640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc4d406ae70 0x7fc4d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.315+0000 7fc4eaffd640 1 -- 172.21.15.64:0/770421085 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc4ec0ab560 con 0x7fc4f40c5440 2023-10-14T12:29:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.316+0000 7fc4f259c640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc4d406ae70 0x7fc4d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.317+0000 7fc4f259c640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc4d406ae70 0x7fc4d406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4001ab0 tx=0x7fc4e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:38.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.320+0000 7fc4eaffd640 1 -- 172.21.15.64:0/770421085 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc4ec0762e0 con 0x7fc4f40c5440 2023-10-14T12:29:38.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.513+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4f4159e30 con 0x7fc4f40c5440 2023-10-14T12:29:38.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.515+0000 7fc4eaffd640 1 -- 172.21.15.64:0/770421085 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fc4ec079900 con 0x7fc4f40c5440 2023-10-14T12:29:38.516 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:38.517 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc4d406ae70 msgr2=0x7fc4d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc4d406ae70 0x7fc4d406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4001ab0 tx=0x7fc4e4009040 comp rx=0 tx=0).stop 2023-10-14T12:29:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4f40c5440 msgr2=0x7fc4f40c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4f40c5440 0x7fc4f40c58c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc4ec009f90 tx=0x7fc4ec009750 comp rx=0 tx=0).stop 2023-10-14T12:29:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 shutdown_connections 2023-10-14T12:29:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc4d406ae70 0x7fc4d406d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc4f40c5440 0x7fc4f40c58c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc4f415d810 0x7fc4f414c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 --2- 172.21.15.64:0/770421085 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc4e0004d00 0x7fc4f40c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.518+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 >> 172.21.15.64:0/770421085 conn(0x7fc4f406a470 msgr2=0x7fc4f40af110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.519+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 shutdown_connections 2023-10-14T12:29:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.519+0000 7fc4f359e640 1 -- 172.21.15.64:0/770421085 wait complete. 2023-10-14T12:29:38.541 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:38.541 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:38.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.774+0000 7f4e8a225640 1 Processor -- start 2023-10-14T12:29:38.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.774+0000 7f4e8a225640 1 -- start start 2023-10-14T12:29:38.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e8a225640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4e840d0cd0 0x7f4e840d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e8a225640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e8406b570 0x7f4e8406ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e8a225640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e840ce690 con 0x7f4e840b1a30 2023-10-14T12:29:38.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e8a225640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e8406bf40 con 0x7f4e840d0cd0 2023-10-14T12:29:38.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e8a225640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840d1620 con 0x7f4e8406b570 2023-10-14T12:29:38.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e89223640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f4e840b1a30 0x7f4e840cdf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:33754/0 (socket says 172.21.15.64:33754) 2023-10-14T12:29:38.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e89223640 1 -- 172.21.15.64:0/951545274 learned_addr learned my addr 172.21.15.64:0/951545274 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:38.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e89a24640 1 --2- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e8406b570 0x7f4e8406ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.776+0000 7f4e88a22640 1 --2- 172.21.15.64:0/951545274 >> v2:172.21.15.177:3300/0 conn(0x7f4e840d0cd0 0x7f4e840d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.777+0000 7f4e88a22640 1 -- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e8406b570 msgr2=0x7f4e8406ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:38.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.777+0000 7f4e88a22640 1 --2- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e8406b570 0x7f4e8406ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.777+0000 7f4e88a22640 1 -- 172.21.15.64:0/951545274 >> v1:172.21.15.64:6789/0 conn(0x7f4e840b1a30 legacy=0x7f4e840cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.777+0000 7f4e88a22640 1 -- 172.21.15.64:0/951545274 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e840cfc20 con 0x7f4e840d0cd0 2023-10-14T12:29:38.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.779+0000 7f4e88a22640 1 --2- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e840d0cd0 0x7f4e840d10e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4e740097a0 tx=0x7f4e7402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921a04e20c0770bc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:38.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.781+0000 7f4e7bfff640 1 -- 172.21.15.64:0/951545274 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74031830 con 0x7f4e840d0cd0 2023-10-14T12:29:38.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.781+0000 7f4e7bfff640 1 -- 172.21.15.64:0/951545274 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e74031990 con 0x7f4e840d0cd0 2023-10-14T12:29:38.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.781+0000 7f4e7bfff640 1 -- 172.21.15.64:0/951545274 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e74031d20 con 0x7f4e840d0cd0 2023-10-14T12:29:38.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 -- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e840d0cd0 msgr2=0x7f4e840d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 --2- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e840d0cd0 0x7f4e840d10e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f4e740097a0 tx=0x7f4e7402b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 -- 172.21.15.64:0/951545274 shutdown_connections 2023-10-14T12:29:38.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 --2- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e8406b570 0x7f4e8406ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 --2- 172.21.15.64:0/951545274 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e840d0cd0 0x7f4e840d10e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 -- 172.21.15.64:0/951545274 >> 172.21.15.64:0/951545274 conn(0x7f4e8408c140 msgr2=0x7f4e8409ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:38.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 -- 172.21.15.64:0/951545274 shutdown_connections 2023-10-14T12:29:38.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.782+0000 7f4e8a225640 1 -- 172.21.15.64:0/951545274 wait complete. 2023-10-14T12:29:38.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.784+0000 7f4e8a225640 1 Processor -- start 2023-10-14T12:29:38.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.784+0000 7f4e8a225640 1 -- start start 2023-10-14T12:29:38.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e8a225640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b570 0x7f4e84159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e8a225640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840b1a30 0x7f4e840c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e8a225640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e840d0cd0 0x7f4e841f2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e8a225640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e8415a330 con 0x7f4e840b1a30 2023-10-14T12:29:38.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e8a225640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840c7150 con 0x7f4e8406b570 2023-10-14T12:29:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e8a225640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e840b5490 con 0x7f4e840d0cd0 2023-10-14T12:29:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e88a22640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840b1a30 0x7f4e840c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e88a22640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840b1a30 0x7f4e840c6c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51388/0 (socket says 172.21.15.64:51388) 2023-10-14T12:29:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.785+0000 7f4e88a22640 1 -- 172.21.15.64:0/69304946 learned_addr learned my addr 172.21.15.64:0/69304946 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:38.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e88a22640 1 -- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e840d0cd0 msgr2=0x7f4e841f2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e88a22640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e840d0cd0 0x7f4e841f2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e88a22640 1 -- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b570 msgr2=0x7f4e84159df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e89223640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b570 0x7f4e84159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e88a22640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b570 0x7f4e84159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e88a22640 1 -- 172.21.15.64:0/69304946 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74009400 con 0x7f4e840b1a30 2023-10-14T12:29:38.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e88a22640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840b1a30 0x7f4e840c6c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e74000c00 tx=0x7f4e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:38.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.786+0000 7f4e79ffb640 1 -- 172.21.15.64:0/69304946 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7403a830 con 0x7f4e840b1a30 2023-10-14T12:29:38.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.787+0000 7f4e79ffb640 1 -- 172.21.15.64:0/69304946 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e7403a9b0 con 0x7f4e840b1a30 2023-10-14T12:29:38.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.787+0000 7f4e79ffb640 1 -- 172.21.15.64:0/69304946 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e7403ad60 con 0x7f4e840b1a30 2023-10-14T12:29:38.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.787+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e840b5770 con 0x7f4e840b1a30 2023-10-14T12:29:38.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.787+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e840b5d30 con 0x7f4e840b1a30 2023-10-14T12:29:38.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.788+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e84067670 con 0x7f4e840b1a30 2023-10-14T12:29:38.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.789+0000 7f4e79ffb640 1 -- 172.21.15.64:0/69304946 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4e7404d450 con 0x7f4e840b1a30 2023-10-14T12:29:38.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.790+0000 7f4e79ffb640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4e6806ae70 0x7f4e6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:38.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.790+0000 7f4e79ffb640 1 -- 172.21.15.64:0/69304946 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4e740ab950 con 0x7f4e840b1a30 2023-10-14T12:29:38.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.791+0000 7f4e89223640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4e6806ae70 0x7f4e6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:38.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.792+0000 7f4e89223640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4e6806ae70 0x7f4e6806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005880 tx=0x7f4e80009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:38.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.795+0000 7f4e79ffb640 1 -- 172.21.15.64:0/69304946 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4e740766d0 con 0x7f4e840b1a30 2023-10-14T12:29:38.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.988+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e8404e9b0 con 0x7f4e840b1a30 2023-10-14T12:29:38.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.990+0000 7f4e79ffb640 1 -- 172.21.15.64:0/69304946 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e74035020 con 0x7f4e840b1a30 2023-10-14T12:29:38.990 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:38.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4e6806ae70 msgr2=0x7f4e6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4e6806ae70 0x7f4e6806d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4e80005880 tx=0x7f4e80009040 comp rx=0 tx=0).stop 2023-10-14T12:29:38.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840b1a30 msgr2=0x7f4e840c6c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:38.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840b1a30 0x7f4e840c6c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4e74000c00 tx=0x7f4e740046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 shutdown_connections 2023-10-14T12:29:38.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4e6806ae70 0x7f4e6806d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4e840d0cd0 0x7f4e841f2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4e840b1a30 0x7f4e840c6c10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 --2- 172.21.15.64:0/69304946 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4e8406b570 0x7f4e84159df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:38.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 >> 172.21.15.64:0/69304946 conn(0x7f4e8408c140 msgr2=0x7f4e840b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:38.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 shutdown_connections 2023-10-14T12:29:38.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:38.992+0000 7f4e8a225640 1 -- 172.21.15.64:0/69304946 wait complete. 2023-10-14T12:29:39.013 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:39.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.248+0000 7f37af59e640 1 Processor -- start 2023-10-14T12:29:39.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.248+0000 7f37af59e640 1 -- start start 2023-10-14T12:29:39.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.249+0000 7f37af59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f37b0154d10 0x7f37b00ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.249+0000 7f37af59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f37b00cee60 0x7f37b006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37af59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37b01550f0 con 0x7f37b006d360 2023-10-14T12:29:39.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37af59e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b00cf310 con 0x7f37b00cee60 2023-10-14T12:29:39.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37af59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37b006db50 con 0x7f37b0154d10 2023-10-14T12:29:39.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37add9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f37b00cee60 0x7f37b006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37aed9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f37b006d360 0x7f37b00ac1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:33756/0 (socket says 172.21.15.64:33756) 2023-10-14T12:29:39.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37aed9d640 1 -- 172.21.15.64:0/1835736772 learned_addr learned my addr 172.21.15.64:0/1835736772 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:39.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37add9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f37b00cee60 0x7f37b006ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51396/0 (socket says 172.21.15.64:51396) 2023-10-14T12:29:39.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37ae59c640 1 --2- 172.21.15.64:0/1835736772 >> v2:172.21.15.177:3300/0 conn(0x7f37b0154d10 0x7f37b00ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37add9b640 1 -- 172.21.15.64:0/1835736772 >> v2:172.21.15.177:3300/0 conn(0x7f37b0154d10 msgr2=0x7f37b00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:39.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.250+0000 7f37add9b640 1 --2- 172.21.15.64:0/1835736772 >> v2:172.21.15.177:3300/0 conn(0x7f37b0154d10 0x7f37b00ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.251+0000 7f37add9b640 1 -- 172.21.15.64:0/1835736772 >> v1:172.21.15.64:6789/0 conn(0x7f37b006d360 legacy=0x7f37b00ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.251+0000 7f37add9b640 1 -- 172.21.15.64:0/1835736772 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b00b13f0 con 0x7f37b00cee60 2023-10-14T12:29:39.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.252+0000 7f37add9b640 1 --2- 172.21.15.64:0/1835736772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b00cee60 0x7f37b006ce20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f37b00724f0 tx=0x7f379802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2e8f8036e76001 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:39.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.252+0000 7f37ad59a640 1 -- 172.21.15.64:0/1835736772 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798031830 con 0x7f37b00cee60 2023-10-14T12:29:39.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.252+0000 7f37ad59a640 1 -- 172.21.15.64:0/1835736772 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3798031990 con 0x7f37b00cee60 2023-10-14T12:29:39.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.252+0000 7f37ad59a640 1 -- 172.21.15.64:0/1835736772 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798031d20 con 0x7f37b00cee60 2023-10-14T12:29:39.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.252+0000 7f37af59e640 1 -- 172.21.15.64:0/1835736772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b00cee60 msgr2=0x7f37b006ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.252+0000 7f37af59e640 1 --2- 172.21.15.64:0/1835736772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b00cee60 0x7f37b006ce20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f37b00724f0 tx=0x7f379802b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.253+0000 7f37af59e640 1 -- 172.21.15.64:0/1835736772 shutdown_connections 2023-10-14T12:29:39.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.253+0000 7f37af59e640 1 --2- 172.21.15.64:0/1835736772 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b00cee60 0x7f37b006ce20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.253+0000 7f37af59e640 1 --2- 172.21.15.64:0/1835736772 >> v2:172.21.15.177:3300/0 conn(0x7f37b0154d10 0x7f37b00ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.253+0000 7f37af59e640 1 -- 172.21.15.64:0/1835736772 >> 172.21.15.64:0/1835736772 conn(0x7f37b006a200 msgr2=0x7f37b006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:39.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.253+0000 7f37af59e640 1 -- 172.21.15.64:0/1835736772 shutdown_connections 2023-10-14T12:29:39.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.253+0000 7f37af59e640 1 -- 172.21.15.64:0/1835736772 wait complete. 2023-10-14T12:29:39.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.254+0000 7f37af59e640 1 Processor -- start 2023-10-14T12:29:39.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.255+0000 7f37af59e640 1 -- start start 2023-10-14T12:29:39.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37af59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b006d360 0x7f37b01f90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37af59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cee60 0x7f37b00c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37af59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37b0154d10 0x7f37b00c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37af59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b01f9620 con 0x7f37b006d360 2023-10-14T12:29:39.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37af59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00c7240 con 0x7f37b00cee60 2023-10-14T12:29:39.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37af59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37b00cc640 con 0x7f37b0154d10 2023-10-14T12:29:39.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b006d360 0x7f37b01f90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b006d360 0x7f37b01f90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51406/0 (socket says 172.21.15.64:51406) 2023-10-14T12:29:39.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 -- 172.21.15.64:0/2686362453 learned_addr learned my addr 172.21.15.64:0/2686362453 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:39.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 -- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37b0154d10 msgr2=0x7f37b00c4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37b0154d10 0x7f37b00c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 -- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cee60 msgr2=0x7f37b00c56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cee60 0x7f37b00c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.256+0000 7f37ae59c640 1 -- 172.21.15.64:0/2686362453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3798009400 con 0x7f37b006d360 2023-10-14T12:29:39.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.257+0000 7f37ae59c640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b006d360 0x7f37b01f90e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007e70 tx=0x7f37a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:39.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.257+0000 7f37a6ffd640 1 -- 172.21.15.64:0/2686362453 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0014620 con 0x7f37b006d360 2023-10-14T12:29:39.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.257+0000 7f37a6ffd640 1 -- 172.21.15.64:0/2686362453 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a0014780 con 0x7f37b006d360 2023-10-14T12:29:39.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.257+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37b00cc920 con 0x7f37b006d360 2023-10-14T12:29:39.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.257+0000 7f37a6ffd640 1 -- 172.21.15.64:0/2686362453 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a0014b30 con 0x7f37b006d360 2023-10-14T12:29:39.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.257+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37b00ccee0 con 0x7f37b006d360 2023-10-14T12:29:39.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.258+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37b00c7500 con 0x7f37b006d360 2023-10-14T12:29:39.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.259+0000 7f37a6ffd640 1 -- 172.21.15.64:0/2686362453 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f37a0014c90 con 0x7f37b006d360 2023-10-14T12:29:39.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.260+0000 7f37a6ffd640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f379006ae70 0x7f379006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.260+0000 7f37a6ffd640 1 -- 172.21.15.64:0/2686362453 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f37a008a3c0 con 0x7f37b006d360 2023-10-14T12:29:39.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.261+0000 7f37add9b640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f379006ae70 0x7f379006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.262+0000 7f37add9b640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f379006ae70 0x7f379006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3798036000 tx=0x7f3798030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:39.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.265+0000 7f37a6ffd640 1 -- 172.21.15.64:0/2686362453 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f37a0055010 con 0x7f37b006d360 2023-10-14T12:29:39.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.460+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f37b004e9b0 con 0x7f37b006d360 2023-10-14T12:29:39.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.461+0000 7f37a6ffd640 1 -- 172.21.15.64:0/2686362453 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f37a0058630 con 0x7f37b006d360 2023-10-14T12:29:39.462 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f379006ae70 msgr2=0x7f379006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f379006ae70 0x7f379006d330 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3798036000 tx=0x7f3798030000 comp rx=0 tx=0).stop 2023-10-14T12:29:39.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b006d360 msgr2=0x7f37b01f90e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b006d360 0x7f37b01f90e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f37a0007e70 tx=0x7f37a000e4b0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 shutdown_connections 2023-10-14T12:29:39.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f379006ae70 0x7f379006d330 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37b0154d10 0x7f37b00c4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37b00cee60 0x7f37b00c56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 --2- 172.21.15.64:0/2686362453 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37b006d360 0x7f37b01f90e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 >> 172.21.15.64:0/2686362453 conn(0x7f37b006a200 msgr2=0x7f37b00af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 shutdown_connections 2023-10-14T12:29:39.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.464+0000 7f37af59e640 1 -- 172.21.15.64:0/2686362453 wait complete. 2023-10-14T12:29:39.485 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:39.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.711+0000 7fc05b0bb640 1 Processor -- start 2023-10-14T12:29:39.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.712+0000 7fc05b0bb640 1 -- start start 2023-10-14T12:29:39.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.713+0000 7fc05b0bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc054160d90 0x7fc0540ad970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.713+0000 7fc05b0bb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc0540c14d0 0x7fc0540c1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.713+0000 7fc05b0bb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0540c1ea0 con 0x7fc0540b1d60 2023-10-14T12:29:39.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.713+0000 7fc05b0bb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0540ccfa0 con 0x7fc0540c14d0 2023-10-14T12:29:39.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.713+0000 7fc05b0bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540cc6d0 con 0x7fc054160d90 2023-10-14T12:29:39.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.714+0000 7fc05a0b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc054160d90 0x7fc0540ad970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.714+0000 7fc05a0b9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc054160d90 0x7fc0540ad970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:35114/0 (socket says 172.21.15.64:35114) 2023-10-14T12:29:39.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.714+0000 7fc05a0b9640 1 -- 172.21.15.64:0/3276791126 learned_addr learned my addr 172.21.15.64:0/3276791126 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:39.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.714+0000 7fc05a8ba640 1 --2- 172.21.15.64:0/3276791126 >> v2:172.21.15.177:3300/0 conn(0x7fc0540c14d0 0x7fc0540c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.715+0000 7fc05a0b9640 1 -- 172.21.15.64:0/3276791126 >> v2:172.21.15.177:3300/0 conn(0x7fc0540c14d0 msgr2=0x7fc0540c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:39.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.715+0000 7fc05a0b9640 1 --2- 172.21.15.64:0/3276791126 >> v2:172.21.15.177:3300/0 conn(0x7fc0540c14d0 0x7fc0540c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.715+0000 7fc05a0b9640 1 -- 172.21.15.64:0/3276791126 >> v1:172.21.15.177:6789/0 conn(0x7fc0540b1d60 legacy=0x7fc0540cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.715+0000 7fc05a0b9640 1 -- 172.21.15.64:0/3276791126 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0540b2770 con 0x7fc054160d90 2023-10-14T12:29:39.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.716+0000 7fc05a0b9640 1 --2- 172.21.15.64:0/3276791126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc054160d90 0x7fc0540ad970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc050009870 tx=0x7fc05002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c7ea97eed640f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:39.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.717+0000 7fc0590b7640 1 -- 172.21.15.64:0/3276791126 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050030840 con 0x7fc054160d90 2023-10-14T12:29:39.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.717+0000 7fc0590b7640 1 -- 172.21.15.64:0/3276791126 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0500309a0 con 0x7fc054160d90 2023-10-14T12:29:39.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.717+0000 7fc0590b7640 1 -- 172.21.15.64:0/3276791126 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050030d30 con 0x7fc054160d90 2023-10-14T12:29:39.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 -- 172.21.15.64:0/3276791126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc054160d90 msgr2=0x7fc0540ad970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/3276791126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc054160d90 0x7fc0540ad970 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc050009870 tx=0x7fc05002b980 comp rx=0 tx=0).stop 2023-10-14T12:29:39.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 -- 172.21.15.64:0/3276791126 shutdown_connections 2023-10-14T12:29:39.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/3276791126 >> v2:172.21.15.177:3300/0 conn(0x7fc0540c14d0 0x7fc0540c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/3276791126 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc054160d90 0x7fc0540ad970 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 -- 172.21.15.64:0/3276791126 >> 172.21.15.64:0/3276791126 conn(0x7fc05406a200 msgr2=0x7fc05406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:39.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 -- 172.21.15.64:0/3276791126 shutdown_connections 2023-10-14T12:29:39.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.718+0000 7fc05b0bb640 1 -- 172.21.15.64:0/3276791126 wait complete. 2023-10-14T12:29:39.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.719+0000 7fc05b0bb640 1 Processor -- start 2023-10-14T12:29:39.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.720+0000 7fc05b0bb640 1 -- start start 2023-10-14T12:29:39.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05b0bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540b1d60 0x7fc0540c8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05b0bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0540c14d0 0x7fc054158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05b0bb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc054160d90 0x7fc0541f9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05b0bb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540c7b70 con 0x7fc054160d90 2023-10-14T12:29:39.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05b0bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0540c75a0 con 0x7fc0540b1d60 2023-10-14T12:29:39.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05b0bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0541fa900 con 0x7fc0540c14d0 2023-10-14T12:29:39.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc054160d90 0x7fc0541f9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc054160d90 0x7fc0541f9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51420/0 (socket says 172.21.15.64:51420) 2023-10-14T12:29:39.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 -- 172.21.15.64:0/34027043 learned_addr learned my addr 172.21.15.64:0/34027043 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:39.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a0b9640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540b1d60 0x7fc0540c8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc0598b8640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0540c14d0 0x7fc054158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 -- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0540c14d0 msgr2=0x7fc054158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0540c14d0 0x7fc054158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 -- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540b1d60 msgr2=0x7fc0540c8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540b1d60 0x7fc0540c8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.721+0000 7fc05a8ba640 1 -- 172.21.15.64:0/34027043 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500094d0 con 0x7fc054160d90 2023-10-14T12:29:39.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.722+0000 7fc05a8ba640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc054160d90 0x7fc0541f9f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00efc0 tx=0x7fc04c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:39.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.722+0000 7fc04affd640 1 -- 172.21.15.64:0/34027043 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c014480 con 0x7fc054160d90 2023-10-14T12:29:39.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.722+0000 7fc04affd640 1 -- 172.21.15.64:0/34027043 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c00f040 con 0x7fc054160d90 2023-10-14T12:29:39.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.722+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0541fabe0 con 0x7fc054160d90 2023-10-14T12:29:39.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.722+0000 7fc04affd640 1 -- 172.21.15.64:0/34027043 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c014820 con 0x7fc054160d90 2023-10-14T12:29:39.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.722+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0540c8540 con 0x7fc054160d90 2023-10-14T12:29:39.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.724+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0540c7d20 con 0x7fc054160d90 2023-10-14T12:29:39.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.725+0000 7fc04affd640 1 -- 172.21.15.64:0/34027043 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc04c014980 con 0x7fc054160d90 2023-10-14T12:29:39.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.726+0000 7fc04affd640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc03806aea0 0x7fc03806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:39.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.726+0000 7fc04affd640 1 -- 172.21.15.64:0/34027043 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc04c08a920 con 0x7fc054160d90 2023-10-14T12:29:39.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.727+0000 7fc05a0b9640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc03806aea0 0x7fc03806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:39.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.728+0000 7fc05a0b9640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc03806aea0 0x7fc03806d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc050036000 tx=0x7fc050008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:39.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.730+0000 7fc04affd640 1 -- 172.21.15.64:0/34027043 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc0540c7d20 con 0x7fc054160d90 2023-10-14T12:29:39.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.936+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc0541fae20 con 0x7fc054160d90 2023-10-14T12:29:39.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.937+0000 7fc04affd640 1 -- 172.21.15.64:0/34027043 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc04c018020 con 0x7fc054160d90 2023-10-14T12:29:39.938 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:39.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc03806aea0 msgr2=0x7fc03806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc03806aea0 0x7fc03806d360 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc050036000 tx=0x7fc050008030 comp rx=0 tx=0).stop 2023-10-14T12:29:39.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc054160d90 msgr2=0x7fc0541f9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:39.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc054160d90 0x7fc0541f9f20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00efc0 tx=0x7fc04c00c490 comp rx=0 tx=0).stop 2023-10-14T12:29:39.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 shutdown_connections 2023-10-14T12:29:39.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc03806aea0 0x7fc03806d360 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc054160d90 0x7fc0541f9f20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc0540c14d0 0x7fc054158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 --2- 172.21.15.64:0/34027043 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc0540b1d60 0x7fc0540c8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:39.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 >> 172.21.15.64:0/34027043 conn(0x7fc05406a200 msgr2=0x7fc05406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:39.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 shutdown_connections 2023-10-14T12:29:39.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:39.939+0000 7fc05b0bb640 1 -- 172.21.15.64:0/34027043 wait complete. 2023-10-14T12:29:39.960 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:40.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.152+0000 7fe2bca10640 1 Processor -- start 2023-10-14T12:29:40.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.152+0000 7fe2bca10640 1 -- start start 2023-10-14T12:29:40.153 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:29:40.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2bca10640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe2b80ca820 0x7fe2b8071f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2bca10640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b80c8ea0 0x7fe2b80c9310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2bca10640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2b8072480 con 0x7fe2b8159890 2023-10-14T12:29:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2bca10640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2b80cd0c0 con 0x7fe2b80ca820 2023-10-14T12:29:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2bca10640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80cc540 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2b659c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fe2b8159890 0x7fe2b80ca110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:33770/0 (socket says 172.21.15.64:33770) 2023-10-14T12:29:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2b5d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe2b80ca820 0x7fe2b8071f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.153+0000 7fe2b659c640 1 -- 172.21.15.64:0/3660545982 learned_addr learned my addr 172.21.15.64:0/3660545982 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:40.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.154+0000 7fe2b6d9d640 1 --2- 172.21.15.64:0/3660545982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b80c8ea0 0x7fe2b80c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.154+0000 7fe2b5d9b640 1 -- 172.21.15.64:0/3660545982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b80c8ea0 msgr2=0x7fe2b80c9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:40.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.154+0000 7fe2b5d9b640 1 --2- 172.21.15.64:0/3660545982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b80c8ea0 0x7fe2b80c9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.154+0000 7fe2b5d9b640 1 -- 172.21.15.64:0/3660545982 >> v1:172.21.15.64:6789/0 conn(0x7fe2b8159890 legacy=0x7fe2b80ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:40.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.154+0000 7fe2b5d9b640 1 -- 172.21.15.64:0/3660545982 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b80cc820 con 0x7fe2b80ca820 2023-10-14T12:29:40.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.154+0000 7fe2b6d9d640 1 --2- 172.21.15.64:0/3660545982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b80c8ea0 0x7fe2b80c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:40.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:29:40.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.155+0000 7fe2b5d9b640 1 --2- 172.21.15.64:0/3660545982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80ca820 0x7fe2b8071f40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80b0fd0 tx=0x7fe2ac02da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=722ab88adcca3688 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:40.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.156+0000 7fe2b559a640 1 -- 172.21.15.64:0/3660545982 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac031820 con 0x7fe2b80ca820 2023-10-14T12:29:40.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.156+0000 7fe2b559a640 1 -- 172.21.15.64:0/3660545982 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ac031980 con 0x7fe2b80ca820 2023-10-14T12:29:40.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.156+0000 7fe2b559a640 1 -- 172.21.15.64:0/3660545982 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac031d10 con 0x7fe2b80ca820 2023-10-14T12:29:40.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.156+0000 7fe2bca10640 1 -- 172.21.15.64:0/3660545982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80ca820 msgr2=0x7fe2b8071f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.156+0000 7fe2bca10640 1 --2- 172.21.15.64:0/3660545982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80ca820 0x7fe2b8071f40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80b0fd0 tx=0x7fe2ac02da00 comp rx=0 tx=0).stop 2023-10-14T12:29:40.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.157+0000 7fe2bca10640 1 -- 172.21.15.64:0/3660545982 shutdown_connections 2023-10-14T12:29:40.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.157+0000 7fe2bca10640 1 --2- 172.21.15.64:0/3660545982 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b80c8ea0 0x7fe2b80c9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.157+0000 7fe2bca10640 1 --2- 172.21.15.64:0/3660545982 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80ca820 0x7fe2b8071f40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.157+0000 7fe2bca10640 1 -- 172.21.15.64:0/3660545982 >> 172.21.15.64:0/3660545982 conn(0x7fe2b80b0030 msgr2=0x7fe2b80b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:40.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.157+0000 7fe2bca10640 1 -- 172.21.15.64:0/3660545982 shutdown_connections 2023-10-14T12:29:40.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.157+0000 7fe2bca10640 1 -- 172.21.15.64:0/3660545982 wait complete. 2023-10-14T12:29:40.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.159+0000 7fe2bca10640 1 Processor -- start 2023-10-14T12:29:40.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.159+0000 7fe2bca10640 1 -- start start 2023-10-14T12:29:40.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.160+0000 7fe2bca10640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80c8ea0 0x7fe2b81efa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.160+0000 7fe2bca10640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b80ca820 0x7fe2b80c77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2bca10640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b8159890 0x7fe2b80ae770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2bca10640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b81eff70 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2bca10640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80c83f0 con 0x7fe2b80ca820 2023-10-14T12:29:40.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2bca10640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2b80c8110 con 0x7fe2b8159890 2023-10-14T12:29:40.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80c8ea0 0x7fe2b81efa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80c8ea0 0x7fe2b81efa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51436/0 (socket says 172.21.15.64:51436) 2023-10-14T12:29:40.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 -- 172.21.15.64:0/227537446 learned_addr learned my addr 172.21.15.64:0/227537446 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:40.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b5d9b640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b80ca820 0x7fe2b80c77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b6d9d640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b8159890 0x7fe2b80ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 -- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b8159890 msgr2=0x7fe2b80ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b8159890 0x7fe2b80ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 -- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b80ca820 msgr2=0x7fe2b80c77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b80ca820 0x7fe2b80c77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.161+0000 7fe2b659c640 1 -- 172.21.15.64:0/227537446 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ac009400 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.162+0000 7fe2b659c640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80c8ea0 0x7fe2b81efa30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800c460 tx=0x7fe2a800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:40.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.162+0000 7fe2a6ffd640 1 -- 172.21.15.64:0/227537446 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8005ce0 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.162+0000 7fe2a6ffd640 1 -- 172.21.15.64:0/227537446 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2a8005e60 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.162+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2b81f2650 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.162+0000 7fe2a6ffd640 1 -- 172.21.15.64:0/227537446 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2a80072b0 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.162+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2b81f2c10 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.163+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2b81f2e00 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.164+0000 7fe2a6ffd640 1 -- 172.21.15.64:0/227537446 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe2a8007410 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.166+0000 7fe2a6ffd640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe29806ae70 0x7fe29806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.166+0000 7fe2a6ffd640 1 -- 172.21.15.64:0/227537446 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe2a80895e0 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.167+0000 7fe2b5d9b640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe29806ae70 0x7fe29806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.168+0000 7fe2b5d9b640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe29806ae70 0x7fe29806d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac038000 tx=0x7fe2ac03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:40.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.171+0000 7fe2a6ffd640 1 -- 172.21.15.64:0/227537446 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2a80542c0 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.360+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe2b8073ef0 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.361+0000 7fe2a6ffd640 1 -- 172.21.15.64:0/227537446 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe2a80076c0 con 0x7fe2b80c8ea0 2023-10-14T12:29:40.362 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe29806ae70 msgr2=0x7fe29806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe29806ae70 0x7fe29806d330 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac038000 tx=0x7fe2ac03b040 comp rx=0 tx=0).stop 2023-10-14T12:29:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80c8ea0 msgr2=0x7fe2b81efa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80c8ea0 0x7fe2b81efa30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2a800c460 tx=0x7fe2a800c920 comp rx=0 tx=0).stop 2023-10-14T12:29:40.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 shutdown_connections 2023-10-14T12:29:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe29806ae70 0x7fe29806d330 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2b8159890 0x7fe2b80ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2b80ca820 0x7fe2b80c77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 --2- 172.21.15.64:0/227537446 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2b80c8ea0 0x7fe2b81efa30 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 >> 172.21.15.64:0/227537446 conn(0x7fe2b80b0030 msgr2=0x7fe2b80c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:40.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 shutdown_connections 2023-10-14T12:29:40.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.364+0000 7fe2bca10640 1 -- 172.21.15.64:0/227537446 wait complete. 2023-10-14T12:29:40.383 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:40.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.611+0000 7efe893e4640 1 Processor -- start 2023-10-14T12:29:40.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.611+0000 7efe893e4640 1 -- start start 2023-10-14T12:29:40.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe893e4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7efe840cd980 0x7efe840cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe893e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe84159c00 0x7efe8415d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe893e4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efe8415def0 0x7efe8406bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe893e4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe84154110 con 0x7efe8415def0 2023-10-14T12:29:40.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe893e4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8415d1f0 con 0x7efe840cd980 2023-10-14T12:29:40.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe893e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8415a4c0 con 0x7efe84159c00 2023-10-14T12:29:40.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe88be3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efe8415def0 0x7efe8406bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe88be3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7efe8415def0 0x7efe8406bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51444/0 (socket says 172.21.15.64:51444) 2023-10-14T12:29:40.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.613+0000 7efe88be3640 1 -- 172.21.15.64:0/1969562725 learned_addr learned my addr 172.21.15.64:0/1969562725 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:40.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe83fff640 1 --2- 172.21.15.64:0/1969562725 >> v2:172.21.15.177:3300/0 conn(0x7efe840cd980 0x7efe840cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe837fe640 1 --2- 172.21.15.64:0/1969562725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe84159c00 0x7efe8415d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe88be3640 1 -- 172.21.15.64:0/1969562725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe84159c00 msgr2=0x7efe8415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:40.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe88be3640 1 --2- 172.21.15.64:0/1969562725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe84159c00 0x7efe8415d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe88be3640 1 -- 172.21.15.64:0/1969562725 >> v2:172.21.15.177:3300/0 conn(0x7efe840cd980 msgr2=0x7efe840cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:40.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe88be3640 1 --2- 172.21.15.64:0/1969562725 >> v2:172.21.15.177:3300/0 conn(0x7efe840cd980 0x7efe840cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe88be3640 1 -- 172.21.15.64:0/1969562725 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8415a7a0 con 0x7efe8415def0 2023-10-14T12:29:40.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.614+0000 7efe837fe640 1 --2- 172.21.15.64:0/1969562725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe84159c00 0x7efe8415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:40.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.615+0000 7efe88be3640 1 --2- 172.21.15.64:0/1969562725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe8415def0 0x7efe8406bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efe8406e320 tx=0x7efe7c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5f9930950652519 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:40.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.615+0000 7efe82ffd640 1 -- 172.21.15.64:0/1969562725 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c02ca80 con 0x7efe8415def0 2023-10-14T12:29:40.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.615+0000 7efe82ffd640 1 -- 172.21.15.64:0/1969562725 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c02cbe0 con 0x7efe8415def0 2023-10-14T12:29:40.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.615+0000 7efe82ffd640 1 -- 172.21.15.64:0/1969562725 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c0343f0 con 0x7efe8415def0 2023-10-14T12:29:40.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 -- 172.21.15.64:0/1969562725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe8415def0 msgr2=0x7efe8406bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 --2- 172.21.15.64:0/1969562725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe8415def0 0x7efe8406bf30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efe8406e320 tx=0x7efe7c02bee0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 -- 172.21.15.64:0/1969562725 shutdown_connections 2023-10-14T12:29:40.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 --2- 172.21.15.64:0/1969562725 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe8415def0 0x7efe8406bf30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 --2- 172.21.15.64:0/1969562725 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe84159c00 0x7efe8415d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 --2- 172.21.15.64:0/1969562725 >> v2:172.21.15.177:3300/0 conn(0x7efe840cd980 0x7efe840cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 -- 172.21.15.64:0/1969562725 >> 172.21.15.64:0/1969562725 conn(0x7efe8406a470 msgr2=0x7efe840afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:40.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 -- 172.21.15.64:0/1969562725 shutdown_connections 2023-10-14T12:29:40.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.616+0000 7efe893e4640 1 -- 172.21.15.64:0/1969562725 wait complete. 2023-10-14T12:29:40.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.618+0000 7efe893e4640 1 Processor -- start 2023-10-14T12:29:40.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.618+0000 7efe893e4640 1 -- start start 2023-10-14T12:29:40.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe893e4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe840cd980 0x7efe84149520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe893e4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe84159c00 0x7efe840adc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe893e4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe840ae190 0x7efe840c3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe893e4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe840ae640 con 0x7efe840ae190 2023-10-14T12:29:40.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe893e4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe84149a60 con 0x7efe84159c00 2023-10-14T12:29:40.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe893e4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe840c4750 con 0x7efe840cd980 2023-10-14T12:29:40.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe88be3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe840ae190 0x7efe840c3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe88be3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe840ae190 0x7efe840c3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51456/0 (socket says 172.21.15.64:51456) 2023-10-14T12:29:40.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.619+0000 7efe88be3640 1 -- 172.21.15.64:0/3974776211 learned_addr learned my addr 172.21.15.64:0/3974776211 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:40.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe837fe640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe84159c00 0x7efe840adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe88be3640 1 -- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe840cd980 msgr2=0x7efe84149520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe88be3640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe840cd980 0x7efe84149520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe88be3640 1 -- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe84159c00 msgr2=0x7efe840adc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe88be3640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe84159c00 0x7efe840adc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe88be3640 1 -- 172.21.15.64:0/3974776211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c009b30 con 0x7efe840ae190 2023-10-14T12:29:40.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe837fe640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe84159c00 0x7efe840adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:40.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe88be3640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe840ae190 0x7efe840c3a60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efe7c036040 tx=0x7efe7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:40.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe80ff9640 1 -- 172.21.15.64:0/3974776211 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c009510 con 0x7efe840ae190 2023-10-14T12:29:40.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe80ff9640 1 -- 172.21.15.64:0/3974776211 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7c03e450 con 0x7efe840ae190 2023-10-14T12:29:40.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe80ff9640 1 -- 172.21.15.64:0/3974776211 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7c03e800 con 0x7efe840ae190 2023-10-14T12:29:40.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.620+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe840c4a30 con 0x7efe840ae190 2023-10-14T12:29:40.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.621+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe840b1290 con 0x7efe840ae190 2023-10-14T12:29:40.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.622+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8404e9b0 con 0x7efe840ae190 2023-10-14T12:29:40.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.623+0000 7efe80ff9640 1 -- 172.21.15.64:0/3974776211 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7efe7c02cd50 con 0x7efe840ae190 2023-10-14T12:29:40.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.623+0000 7efe80ff9640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efe7006ae70 0x7efe7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:40.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.624+0000 7efe80ff9640 1 -- 172.21.15.64:0/3974776211 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe7c0ac530 con 0x7efe840ae190 2023-10-14T12:29:40.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.624+0000 7efe83fff640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efe7006ae70 0x7efe7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:40.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.625+0000 7efe83fff640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efe7006ae70 0x7efe7006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe74006ea0 tx=0x7efe74008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:40.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.627+0000 7efe80ff9640 1 -- 172.21.15.64:0/3974776211 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7efe7c077200 con 0x7efe840ae190 2023-10-14T12:29:40.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.830+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe840cd020 con 0x7efe840ae190 2023-10-14T12:29:40.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.832+0000 7efe80ff9640 1 -- 172.21.15.64:0/3974776211 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7efe7c03e960 con 0x7efe840ae190 2023-10-14T12:29:40.833 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:40.833 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:40.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.834+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efe7006ae70 msgr2=0x7efe7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.834+0000 7efe893e4640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efe7006ae70 0x7efe7006d330 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7efe74006ea0 tx=0x7efe74008040 comp rx=0 tx=0).stop 2023-10-14T12:29:40.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.834+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe840ae190 msgr2=0x7efe840c3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:40.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.834+0000 7efe893e4640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe840ae190 0x7efe840c3a60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7efe7c036040 tx=0x7efe7c004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:40.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 shutdown_connections 2023-10-14T12:29:40.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7efe7006ae70 0x7efe7006d330 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7efe840ae190 0x7efe840c3a60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7efe84159c00 0x7efe840adc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 --2- 172.21.15.64:0/3974776211 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7efe840cd980 0x7efe84149520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:40.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 >> 172.21.15.64:0/3974776211 conn(0x7efe8406a470 msgr2=0x7efe8415c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:40.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 shutdown_connections 2023-10-14T12:29:40.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:40.835+0000 7efe893e4640 1 -- 172.21.15.64:0/3974776211 wait complete. 2023-10-14T12:29:40.854 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:40.855 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:41.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.079+0000 7f32f4452640 1 Processor -- start 2023-10-14T12:29:41.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.079+0000 7f32f4452640 1 -- start start 2023-10-14T12:29:41.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.080+0000 7f32f4452640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32ec15cbf0 0x7f32ec0d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.080+0000 7f32f4452640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b4410 0x7f32ec0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.080+0000 7f32f4452640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32ec15cfd0 con 0x7f32ec0b8400 2023-10-14T12:29:41.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.080+0000 7f32f4452640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec0d0dc0 con 0x7f32ec15cbf0 2023-10-14T12:29:41.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.080+0000 7f32f4452640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec0d18f0 con 0x7f32ec0b4410 2023-10-14T12:29:41.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.081+0000 7f32f21ee640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32ec15cbf0 0x7f32ec0d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.081+0000 7f32f29ef640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b4410 0x7f32ec0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.081+0000 7f32f21ee640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f32ec15cbf0 0x7f32ec0d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:40650/0 (socket says 172.21.15.64:40650) 2023-10-14T12:29:41.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.081+0000 7f32f21ee640 1 -- 172.21.15.64:0/2180269248 learned_addr learned my addr 172.21.15.64:0/2180269248 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:41.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.081+0000 7f32f19ed640 1 --1- 172.21.15.64:0/2180269248 >> v1:172.21.15.177:6789/0 conn(0x7f32ec0b8400 0x7f32ec0d11e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:48874/0 (socket says 172.21.15.64:48874) 2023-10-14T12:29:41.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.082+0000 7f32f29ef640 1 -- 172.21.15.64:0/2180269248 >> v2:172.21.15.177:3300/0 conn(0x7f32ec15cbf0 msgr2=0x7f32ec0d29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:41.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.082+0000 7f32f29ef640 1 --2- 172.21.15.64:0/2180269248 >> v2:172.21.15.177:3300/0 conn(0x7f32ec15cbf0 0x7f32ec0d29d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.082+0000 7f32f29ef640 1 -- 172.21.15.64:0/2180269248 >> v1:172.21.15.177:6789/0 conn(0x7f32ec0b8400 legacy=0x7f32ec0d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.082+0000 7f32f29ef640 1 -- 172.21.15.64:0/2180269248 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec0d30b0 con 0x7f32ec0b4410 2023-10-14T12:29:41.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.083+0000 7f32f29ef640 1 --2- 172.21.15.64:0/2180269248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b4410 0x7f32ec0b4880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d16af5aa44ab135 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:41.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.084+0000 7f32f11ec640 1 -- 172.21.15.64:0/2180269248 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e402cc50 con 0x7f32ec0b4410 2023-10-14T12:29:41.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.084+0000 7f32f11ec640 1 -- 172.21.15.64:0/2180269248 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e402cdb0 con 0x7f32ec0b4410 2023-10-14T12:29:41.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.084+0000 7f32f11ec640 1 -- 172.21.15.64:0/2180269248 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4034660 con 0x7f32ec0b4410 2023-10-14T12:29:41.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 -- 172.21.15.64:0/2180269248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b4410 msgr2=0x7f32ec0b4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 --2- 172.21.15.64:0/2180269248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b4410 0x7f32ec0b4880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f32e4009d90 tx=0x7f32e402bea0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 -- 172.21.15.64:0/2180269248 shutdown_connections 2023-10-14T12:29:41.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 --2- 172.21.15.64:0/2180269248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b4410 0x7f32ec0b4880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 --2- 172.21.15.64:0/2180269248 >> v2:172.21.15.177:3300/0 conn(0x7f32ec15cbf0 0x7f32ec0d29d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 -- 172.21.15.64:0/2180269248 >> 172.21.15.64:0/2180269248 conn(0x7f32ec071900 msgr2=0x7f32ec071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:41.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 -- 172.21.15.64:0/2180269248 shutdown_connections 2023-10-14T12:29:41.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.085+0000 7f32f4452640 1 -- 172.21.15.64:0/2180269248 wait complete. 2023-10-14T12:29:41.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.087+0000 7f32f4452640 1 Processor -- start 2023-10-14T12:29:41.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.088+0000 7f32f4452640 1 -- start start 2023-10-14T12:29:41.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f4452640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ec0b4410 0x7f32ec150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f4452640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b8400 0x7f32ec0cba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f4452640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec15cbf0 0x7f32ec15dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f4452640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec15e150 con 0x7f32ec0b4410 2023-10-14T12:29:41.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f4452640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec15f400 con 0x7f32ec15cbf0 2023-10-14T12:29:41.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f4452640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec15ef70 con 0x7f32ec0b8400 2023-10-14T12:29:41.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f21ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ec0b4410 0x7f32ec150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f21ee640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ec0b4410 0x7f32ec150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51470/0 (socket says 172.21.15.64:51470) 2023-10-14T12:29:41.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.089+0000 7f32f21ee640 1 -- 172.21.15.64:0/2256811151 learned_addr learned my addr 172.21.15.64:0/2256811151 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:41.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f29ef640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec15cbf0 0x7f32ec15dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f19ed640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b8400 0x7f32ec0cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f21ee640 1 -- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b8400 msgr2=0x7f32ec0cba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f21ee640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b8400 0x7f32ec0cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f21ee640 1 -- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec15cbf0 msgr2=0x7f32ec15dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f21ee640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec15cbf0 0x7f32ec15dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f21ee640 1 -- 172.21.15.64:0/2256811151 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4009a70 con 0x7f32ec0b4410 2023-10-14T12:29:41.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f29ef640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec15cbf0 0x7f32ec15dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:41.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f21ee640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ec0b4410 0x7f32ec150090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f32e800e870 tx=0x7f32e800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:41.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32e2ffd640 1 -- 172.21.15.64:0/2256811151 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800c8e0 con 0x7f32ec0b4410 2023-10-14T12:29:41.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32e2ffd640 1 -- 172.21.15.64:0/2256811151 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e800ca40 con 0x7f32ec0b4410 2023-10-14T12:29:41.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32e2ffd640 1 -- 172.21.15.64:0/2256811151 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e800cdf0 con 0x7f32ec0b4410 2023-10-14T12:29:41.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.090+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec15e360 con 0x7f32ec0b4410 2023-10-14T12:29:41.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.091+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec15e920 con 0x7f32ec0b4410 2023-10-14T12:29:41.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.092+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec067010 con 0x7f32ec0b4410 2023-10-14T12:29:41.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.093+0000 7f32e2ffd640 1 -- 172.21.15.64:0/2256811151 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32e8013470 con 0x7f32ec0b4410 2023-10-14T12:29:41.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.094+0000 7f32e2ffd640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d006ae70 0x7f32d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.094+0000 7f32e2ffd640 1 -- 172.21.15.64:0/2256811151 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32e8089ad0 con 0x7f32ec0b4410 2023-10-14T12:29:41.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.095+0000 7f32f19ed640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d006ae70 0x7f32d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.096+0000 7f32f19ed640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d006ae70 0x7f32d006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0d2460 tx=0x7f32dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:41.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.098+0000 7f32e2ffd640 1 -- 172.21.15.64:0/2256811151 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32e8054880 con 0x7f32ec0b4410 2023-10-14T12:29:41.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.290+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32ec073ef0 con 0x7f32ec0b4410 2023-10-14T12:29:41.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.291+0000 7f32e2ffd640 1 -- 172.21.15.64:0/2256811151 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32e80170a0 con 0x7f32ec0b4410 2023-10-14T12:29:41.291 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:41.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.293+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d006ae70 msgr2=0x7f32d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.293+0000 7f32f4452640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d006ae70 0x7f32d006d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0d2460 tx=0x7f32dc009040 comp rx=0 tx=0).stop 2023-10-14T12:29:41.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.293+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ec0b4410 msgr2=0x7f32ec150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ec0b4410 0x7f32ec150090 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f32e800e870 tx=0x7f32e800ed30 comp rx=0 tx=0).stop 2023-10-14T12:29:41.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 shutdown_connections 2023-10-14T12:29:41.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d006ae70 0x7f32d006d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32ec15cbf0 0x7f32ec15dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32ec0b8400 0x7f32ec0cba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 --2- 172.21.15.64:0/2256811151 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32ec0b4410 0x7f32ec150090 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 >> 172.21.15.64:0/2256811151 conn(0x7f32ec071900 msgr2=0x7f32ec0ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:41.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 shutdown_connections 2023-10-14T12:29:41.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.294+0000 7f32f4452640 1 -- 172.21.15.64:0/2256811151 wait complete. 2023-10-14T12:29:41.314 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:41.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.543+0000 7f3cc759e640 1 Processor -- start 2023-10-14T12:29:41.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.543+0000 7f3cc759e640 1 -- start start 2023-10-14T12:29:41.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.544+0000 7f3cc759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80cf3f0 0x7f3cc80d1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.544+0000 7f3cc759e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3cc80af620 0x7f3cc80ad9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.544+0000 7f3cc759e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cc80ad510 con 0x7f3cc815a9a0 2023-10-14T12:29:41.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.544+0000 7f3cc759e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cc80cc620 con 0x7f3cc80af620 2023-10-14T12:29:41.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.544+0000 7f3cc759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80ce7a0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc6d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3cc80af620 0x7f3cc80ad9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc6d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3cc80af620 0x7f3cc80ad9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51476/0 (socket says 172.21.15.64:51476) 2023-10-14T12:29:41.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc6d9d640 1 -- 172.21.15.64:0/1073481873 learned_addr learned my addr 172.21.15.64:0/1073481873 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:41.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc5d9b640 1 --2- 172.21.15.64:0/1073481873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80cf3f0 0x7f3cc80d1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc6d9d640 1 -- 172.21.15.64:0/1073481873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80cf3f0 msgr2=0x7f3cc80d1220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc6d9d640 1 --2- 172.21.15.64:0/1073481873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80cf3f0 0x7f3cc80d1220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc6d9d640 1 -- 172.21.15.64:0/1073481873 >> v1:172.21.15.177:6789/0 conn(0x7f3cc815a9a0 legacy=0x7f3cc80cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.545+0000 7f3cc6d9d640 1 -- 172.21.15.64:0/1073481873 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc80cbdc0 con 0x7f3cc80af620 2023-10-14T12:29:41.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.547+0000 7f3cc6d9d640 1 --2- 172.21.15.64:0/1073481873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80af620 0x7f3cc80ad9a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c95d0766cfb44ba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:41.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.547+0000 7f3cc559a640 1 -- 172.21.15.64:0/1073481873 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0031640 con 0x7f3cc80af620 2023-10-14T12:29:41.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.547+0000 7f3cc559a640 1 -- 172.21.15.64:0/1073481873 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00317a0 con 0x7f3cc80af620 2023-10-14T12:29:41.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.547+0000 7f3cc559a640 1 -- 172.21.15.64:0/1073481873 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cc0031b30 con 0x7f3cc80af620 2023-10-14T12:29:41.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 -- 172.21.15.64:0/1073481873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80af620 msgr2=0x7f3cc80ad9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 --2- 172.21.15.64:0/1073481873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80af620 0x7f3cc80ad9a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009870 tx=0x7f3cc002b8f0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 -- 172.21.15.64:0/1073481873 shutdown_connections 2023-10-14T12:29:41.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 --2- 172.21.15.64:0/1073481873 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80af620 0x7f3cc80ad9a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 --2- 172.21.15.64:0/1073481873 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80cf3f0 0x7f3cc80d1220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 -- 172.21.15.64:0/1073481873 >> 172.21.15.64:0/1073481873 conn(0x7f3cc80d0700 msgr2=0x7f3cc80d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:41.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 -- 172.21.15.64:0/1073481873 shutdown_connections 2023-10-14T12:29:41.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.548+0000 7f3cc759e640 1 -- 172.21.15.64:0/1073481873 wait complete. 2023-10-14T12:29:41.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.550+0000 7f3cc759e640 1 Processor -- start 2023-10-14T12:29:41.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.550+0000 7f3cc759e640 1 -- start start 2023-10-14T12:29:41.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80af620 0x7f3cc80b4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80cf3f0 0x7f3cc80b56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cc815a9a0 0x7f3cc80c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80c6320 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80c5770 con 0x7f3cc815a9a0 2023-10-14T12:29:41.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cc80c59f0 con 0x7f3cc80af620 2023-10-14T12:29:41.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80cf3f0 0x7f3cc80b56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80cf3f0 0x7f3cc80b56e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51480/0 (socket says 172.21.15.64:51480) 2023-10-14T12:29:41.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.551+0000 7f3cc5d9b640 1 -- 172.21.15.64:0/2592086203 learned_addr learned my addr 172.21.15.64:0/2592086203 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:41.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc659c640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80af620 0x7f3cc80b4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc5d9b640 1 -- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80af620 msgr2=0x7f3cc80b4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc5d9b640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80af620 0x7f3cc80b4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc6d9d640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cc815a9a0 0x7f3cc80c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc5d9b640 1 -- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cc815a9a0 msgr2=0x7f3cc80c67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc5d9b640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cc815a9a0 0x7f3cc80c67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc5d9b640 1 -- 172.21.15.64:0/2592086203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc00094d0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc6d9d640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cc815a9a0 0x7f3cc80c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cc5d9b640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80cf3f0 0x7f3cc80b56e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000e8a0 tx=0x7f3cb000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:41.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.552+0000 7f3cbeffd640 1 -- 172.21.15.64:0/2592086203 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb00094f0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.553+0000 7f3cbeffd640 1 -- 172.21.15.64:0/2592086203 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cb000c940 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.553+0000 7f3cbeffd640 1 -- 172.21.15.64:0/2592086203 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cb000ccf0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.553+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cc80c5cd0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.553+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cc80b4a80 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.554+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cc804e9b0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.555+0000 7f3cbeffd640 1 -- 172.21.15.64:0/2592086203 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3cb0013470 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.556+0000 7f3cbeffd640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3ca806ae70 0x7f3ca806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:41.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.557+0000 7f3cbeffd640 1 -- 172.21.15.64:0/2592086203 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3cb0089ad0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.557+0000 7f3cc659c640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3ca806ae70 0x7f3ca806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:41.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.559+0000 7f3cc659c640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3ca806ae70 0x7f3ca806d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8007fd0 tx=0x7f3cb8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:41.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.561+0000 7f3cbeffd640 1 -- 172.21.15.64:0/2592086203 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3cb00547c0 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.753+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3cc80d0b80 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.754+0000 7f3cbeffd640 1 -- 172.21.15.64:0/2592086203 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3cb0021020 con 0x7f3cc80cf3f0 2023-10-14T12:29:41.756 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:41.759 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3ca806ae70 msgr2=0x7f3ca806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3ca806ae70 0x7f3ca806d330 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8007fd0 tx=0x7f3cb8009040 comp rx=0 tx=0).stop 2023-10-14T12:29:41.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80cf3f0 msgr2=0x7f3cc80b56e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:41.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80cf3f0 0x7f3cc80b56e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3cb000e8a0 tx=0x7f3cb000ed60 comp rx=0 tx=0).stop 2023-10-14T12:29:41.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 shutdown_connections 2023-10-14T12:29:41.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3ca806ae70 0x7f3ca806d330 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3cc815a9a0 0x7f3cc80c67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3cc80cf3f0 0x7f3cc80b56e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 --2- 172.21.15.64:0/2592086203 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3cc80af620 0x7f3cc80b4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:41.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 >> 172.21.15.64:0/2592086203 conn(0x7f3cc80d0700 msgr2=0x7f3cc80cb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:41.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 shutdown_connections 2023-10-14T12:29:41.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:41.757+0000 7f3cc759e640 1 -- 172.21.15.64:0/2592086203 wait complete. 2023-10-14T12:29:41.780 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:42.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.002+0000 7f19adefc640 1 Processor -- start 2023-10-14T12:29:42.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.003+0000 7f19adefc640 1 -- start start 2023-10-14T12:29:42.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.004+0000 7f19adefc640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f19a80cf030 0x7f19a806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.004+0000 7f19adefc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a806d360 0x7f19a80ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.004+0000 7f19adefc640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a81550f0 con 0x7f19a8154d10 2023-10-14T12:29:42.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.004+0000 7f19adefc640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a806db50 con 0x7f19a80cf030 2023-10-14T12:29:42.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.004+0000 7f19adefc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80b13f0 con 0x7f19a806d360 2023-10-14T12:29:42.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.005+0000 7f19ad6fb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a806d360 0x7f19a80ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.005+0000 7f19ad6fb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a806d360 0x7f19a80ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:35234/0 (socket says 172.21.15.64:35234) 2023-10-14T12:29:42.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.005+0000 7f19ad6fb640 1 -- 172.21.15.64:0/2505824831 learned_addr learned my addr 172.21.15.64:0/2505824831 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:42.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.005+0000 7f199ffff640 1 --2- 172.21.15.64:0/2505824831 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cf030 0x7f19a806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.006+0000 7f19ad6fb640 1 -- 172.21.15.64:0/2505824831 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cf030 msgr2=0x7f19a806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:42.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.006+0000 7f19ad6fb640 1 --2- 172.21.15.64:0/2505824831 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cf030 0x7f19a806ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.006+0000 7f19ad6fb640 1 -- 172.21.15.64:0/2505824831 >> v1:172.21.15.177:6789/0 conn(0x7f19a8154d10 legacy=0x7f19a80ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.006+0000 7f19ad6fb640 1 -- 172.21.15.64:0/2505824831 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a80b16d0 con 0x7f19a806d360 2023-10-14T12:29:42.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.007+0000 7f19ad6fb640 1 --2- 172.21.15.64:0/2505824831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a806d360 0x7f19a80ac1d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=962530786e9011e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f199f7fe640 1 -- 172.21.15.64:0/2505824831 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0030840 con 0x7f19a806d360 2023-10-14T12:29:42.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f199f7fe640 1 -- 172.21.15.64:0/2505824831 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a00309a0 con 0x7f19a806d360 2023-10-14T12:29:42.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f199f7fe640 1 -- 172.21.15.64:0/2505824831 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a0030d30 con 0x7f19a806d360 2023-10-14T12:29:42.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f19adefc640 1 -- 172.21.15.64:0/2505824831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a806d360 msgr2=0x7f19a80ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f19adefc640 1 --2- 172.21.15.64:0/2505824831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a806d360 0x7f19a80ac1d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f19a0009870 tx=0x7f19a002b980 comp rx=0 tx=0).stop 2023-10-14T12:29:42.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f19adefc640 1 -- 172.21.15.64:0/2505824831 shutdown_connections 2023-10-14T12:29:42.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f19adefc640 1 --2- 172.21.15.64:0/2505824831 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a806d360 0x7f19a80ac1d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f19adefc640 1 --2- 172.21.15.64:0/2505824831 >> v2:172.21.15.177:3300/0 conn(0x7f19a80cf030 0x7f19a806ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f19adefc640 1 -- 172.21.15.64:0/2505824831 >> 172.21.15.64:0/2505824831 conn(0x7f19a806a200 msgr2=0x7f19a806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:42.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.008+0000 7f19adefc640 1 -- 172.21.15.64:0/2505824831 shutdown_connections 2023-10-14T12:29:42.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.009+0000 7f19adefc640 1 -- 172.21.15.64:0/2505824831 wait complete. 2023-10-14T12:29:42.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.010+0000 7f19adefc640 1 Processor -- start 2023-10-14T12:29:42.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.011+0000 7f19adefc640 1 -- start start 2023-10-14T12:29:42.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19adefc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a806d360 0x7f19a81543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19adefc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19a80cf030 0x7f19a8159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19adefc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a8154d10 0x7f19a80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19adefc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a80c64f0 con 0x7f19a80cf030 2023-10-14T12:29:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19adefc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a815a460 con 0x7f19a806d360 2023-10-14T12:29:42.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19adefc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a815c390 con 0x7f19a8154d10 2023-10-14T12:29:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19a80cf030 0x7f19a8159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19a80cf030 0x7f19a8159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51484/0 (socket says 172.21.15.64:51484) 2023-10-14T12:29:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 -- 172.21.15.64:0/554990857 learned_addr learned my addr 172.21.15.64:0/554990857 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19acefa640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a806d360 0x7f19a81543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f19ad6fb640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a8154d10 0x7f19a80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 -- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a8154d10 msgr2=0x7f19a80cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a8154d10 0x7f19a80cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 -- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a806d360 msgr2=0x7f19a81543d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a806d360 0x7f19a81543d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.012+0000 7f199ffff640 1 -- 172.21.15.64:0/554990857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00094d0 con 0x7f19a80cf030 2023-10-14T12:29:42.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.013+0000 7f199ffff640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19a80cf030 0x7f19a8159f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19a400e9b0 tx=0x7f19a400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.013+0000 7f199d7fa640 1 -- 172.21.15.64:0/554990857 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a4009670 con 0x7f19a80cf030 2023-10-14T12:29:42.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.013+0000 7f199d7fa640 1 -- 172.21.15.64:0/554990857 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19a400c9a0 con 0x7f19a80cf030 2023-10-14T12:29:42.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.013+0000 7f199d7fa640 1 -- 172.21.15.64:0/554990857 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a400cd50 con 0x7f19a80cf030 2023-10-14T12:29:42.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.013+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a80c5970 con 0x7f19a80cf030 2023-10-14T12:29:42.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.013+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a80c5f30 con 0x7f19a80cf030 2023-10-14T12:29:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.014+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a804e9b0 con 0x7f19a80cf030 2023-10-14T12:29:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.015+0000 7f199d7fa640 1 -- 172.21.15.64:0/554990857 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f19a4013470 con 0x7f19a80cf030 2023-10-14T12:29:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.016+0000 7f199d7fa640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f199406ae70 0x7f199406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.017+0000 7f199d7fa640 1 -- 172.21.15.64:0/554990857 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f19a4089c90 con 0x7f19a80cf030 2023-10-14T12:29:42.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.017+0000 7f19acefa640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f199406ae70 0x7f199406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.018+0000 7f19acefa640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f199406ae70 0x7f199406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19a80ad360 tx=0x7f1998009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.021+0000 7f199d7fa640 1 -- 172.21.15.64:0/554990857 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19a4054970 con 0x7f19a80cf030 2023-10-14T12:29:42.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.220+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f19a806c9d0 con 0x7f19a80cf030 2023-10-14T12:29:42.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.221+0000 7f199d7fa640 1 -- 172.21.15.64:0/554990857 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f19a40170a0 con 0x7f19a80cf030 2023-10-14T12:29:42.223 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:42.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f199406ae70 msgr2=0x7f199406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f199406ae70 0x7f199406d330 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f19a80ad360 tx=0x7f1998009040 comp rx=0 tx=0).stop 2023-10-14T12:29:42.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19a80cf030 msgr2=0x7f19a8159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19a80cf030 0x7f19a8159f20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19a400e9b0 tx=0x7f19a400ee70 comp rx=0 tx=0).stop 2023-10-14T12:29:42.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 shutdown_connections 2023-10-14T12:29:42.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f199406ae70 0x7f199406d330 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f19a8154d10 0x7f19a80cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f19a80cf030 0x7f19a8159f20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 --2- 172.21.15.64:0/554990857 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f19a806d360 0x7f19a81543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 >> 172.21.15.64:0/554990857 conn(0x7f19a806a200 msgr2=0x7f19a80ca320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:42.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 shutdown_connections 2023-10-14T12:29:42.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.224+0000 7f19adefc640 1 -- 172.21.15.64:0/554990857 wait complete. 2023-10-14T12:29:42.245 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:42.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.466+0000 7fb1e2535640 1 Processor -- start 2023-10-14T12:29:42.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.466+0000 7fb1e2535640 1 -- start start 2023-10-14T12:29:42.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.467+0000 7fb1e2535640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc0cf030 0x7fb1dc06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.467+0000 7fb1e2535640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb1dc06d360 0x7fb1dc0ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.467+0000 7fb1e2535640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc1550f0 con 0x7fb1dc154d10 2023-10-14T12:29:42.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.467+0000 7fb1e2535640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc06db50 con 0x7fb1dc06d360 2023-10-14T12:29:42.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.467+0000 7fb1e2535640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc0b13f0 con 0x7fb1dc0cf030 2023-10-14T12:29:42.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.468+0000 7fb1e0d32640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc0cf030 0x7fb1dc06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.468+0000 7fb1e0d32640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc0cf030 0x7fb1dc06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:35258/0 (socket says 172.21.15.64:35258) 2023-10-14T12:29:42.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.468+0000 7fb1e0d32640 1 -- 172.21.15.64:0/3475396674 learned_addr learned my addr 172.21.15.64:0/3475396674 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:42.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.468+0000 7fb1e1d34640 1 --2- 172.21.15.64:0/3475396674 >> v2:172.21.15.177:3300/0 conn(0x7fb1dc06d360 0x7fb1dc0ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.469+0000 7fb1e0d32640 1 -- 172.21.15.64:0/3475396674 >> v2:172.21.15.177:3300/0 conn(0x7fb1dc06d360 msgr2=0x7fb1dc0ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:42.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.469+0000 7fb1e0d32640 1 --2- 172.21.15.64:0/3475396674 >> v2:172.21.15.177:3300/0 conn(0x7fb1dc06d360 0x7fb1dc0ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.469+0000 7fb1e0d32640 1 -- 172.21.15.64:0/3475396674 >> v1:172.21.15.177:6789/0 conn(0x7fb1dc154d10 legacy=0x7fb1dc0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.469+0000 7fb1e0d32640 1 -- 172.21.15.64:0/3475396674 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc0b16d0 con 0x7fb1dc0cf030 2023-10-14T12:29:42.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.470+0000 7fb1e0d32640 1 --2- 172.21.15.64:0/3475396674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc0cf030 0x7fb1dc06ce20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009870 tx=0x7fb1cc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b91824f6dbfbe01 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1d3fff640 1 -- 172.21.15.64:0/3475396674 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc030840 con 0x7fb1dc0cf030 2023-10-14T12:29:42.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1d3fff640 1 -- 172.21.15.64:0/3475396674 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1cc0309a0 con 0x7fb1dc0cf030 2023-10-14T12:29:42.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1d3fff640 1 -- 172.21.15.64:0/3475396674 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1cc030d30 con 0x7fb1dc0cf030 2023-10-14T12:29:42.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1e2535640 1 -- 172.21.15.64:0/3475396674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc0cf030 msgr2=0x7fb1dc06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1e2535640 1 --2- 172.21.15.64:0/3475396674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc0cf030 0x7fb1dc06ce20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb1cc009870 tx=0x7fb1cc02b980 comp rx=0 tx=0).stop 2023-10-14T12:29:42.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1e2535640 1 -- 172.21.15.64:0/3475396674 shutdown_connections 2023-10-14T12:29:42.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1e2535640 1 --2- 172.21.15.64:0/3475396674 >> v2:172.21.15.177:3300/0 conn(0x7fb1dc06d360 0x7fb1dc0ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1e2535640 1 --2- 172.21.15.64:0/3475396674 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc0cf030 0x7fb1dc06ce20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.471+0000 7fb1e2535640 1 -- 172.21.15.64:0/3475396674 >> 172.21.15.64:0/3475396674 conn(0x7fb1dc06a200 msgr2=0x7fb1dc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:42.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.472+0000 7fb1e2535640 1 -- 172.21.15.64:0/3475396674 shutdown_connections 2023-10-14T12:29:42.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.472+0000 7fb1e2535640 1 -- 172.21.15.64:0/3475396674 wait complete. 2023-10-14T12:29:42.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.473+0000 7fb1e2535640 1 Processor -- start 2023-10-14T12:29:42.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.474+0000 7fb1e2535640 1 -- start start 2023-10-14T12:29:42.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.474+0000 7fb1e2535640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc06d360 0x7fb1dc0cc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.474+0000 7fb1e2535640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0cf030 0x7fb1dc1f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.474+0000 7fb1e2535640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1dc154d10 0x7fb1dc1ef9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e2535640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc15cc40 con 0x7fb1dc154d10 2023-10-14T12:29:42.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e2535640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc15cee0 con 0x7fb1dc0cf030 2023-10-14T12:29:42.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e2535640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc1eff20 con 0x7fb1dc06d360 2023-10-14T12:29:42.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1dc154d10 0x7fb1dc1ef9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1dc154d10 0x7fb1dc1ef9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51490/0 (socket says 172.21.15.64:51490) 2023-10-14T12:29:42.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 -- 172.21.15.64:0/1127889404 learned_addr learned my addr 172.21.15.64:0/1127889404 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:42.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1533640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc06d360 0x7fb1dc0cc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e0d32640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0cf030 0x7fb1dc1f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 -- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc06d360 msgr2=0x7fb1dc0cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc06d360 0x7fb1dc0cc0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 -- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0cf030 msgr2=0x7fb1dc1f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0cf030 0x7fb1dc1f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.475+0000 7fb1e1d34640 1 -- 172.21.15.64:0/1127889404 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc0094d0 con 0x7fb1dc154d10 2023-10-14T12:29:42.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.476+0000 7fb1e1d34640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1dc154d10 0x7fb1dc1ef9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400efc0 tx=0x7fb1d400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.476+0000 7fb1d1ffb640 1 -- 172.21.15.64:0/1127889404 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4014480 con 0x7fb1dc154d10 2023-10-14T12:29:42.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.476+0000 7fb1d1ffb640 1 -- 172.21.15.64:0/1127889404 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d400f040 con 0x7fb1dc154d10 2023-10-14T12:29:42.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.476+0000 7fb1d1ffb640 1 -- 172.21.15.64:0/1127889404 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d4014820 con 0x7fb1dc154d10 2023-10-14T12:29:42.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.476+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1dc0cd000 con 0x7fb1dc154d10 2023-10-14T12:29:42.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.476+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc0cca40 con 0x7fb1dc154d10 2023-10-14T12:29:42.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.477+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc15d070 con 0x7fb1dc154d10 2023-10-14T12:29:42.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.479+0000 7fb1d1ffb640 1 -- 172.21.15.64:0/1127889404 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb1d4014980 con 0x7fb1dc154d10 2023-10-14T12:29:42.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.479+0000 7fb1d1ffb640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb1c006aea0 0x7fb1c006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.480+0000 7fb1d1ffb640 1 -- 172.21.15.64:0/1127889404 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb1d408a530 con 0x7fb1dc154d10 2023-10-14T12:29:42.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.480+0000 7fb1e1533640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb1c006aea0 0x7fb1c006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.481+0000 7fb1e1533640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb1c006aea0 0x7fb1c006d360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000f60 tx=0x7fb1d8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.484+0000 7fb1d1ffb640 1 -- 172.21.15.64:0/1127889404 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb1d4055220 con 0x7fb1dc154d10 2023-10-14T12:29:42.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.677+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb1dc04e9b0 con 0x7fb1dc154d10 2023-10-14T12:29:42.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.677+0000 7fb1d1ffb640 1 -- 172.21.15.64:0/1127889404 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb1d4058840 con 0x7fb1dc154d10 2023-10-14T12:29:42.680 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:42.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb1c006aea0 msgr2=0x7fb1c006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb1c006aea0 0x7fb1c006d360 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb1d8000f60 tx=0x7fb1d8009040 comp rx=0 tx=0).stop 2023-10-14T12:29:42.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1dc154d10 msgr2=0x7fb1dc1ef9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1dc154d10 0x7fb1dc1ef9e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fb1d400efc0 tx=0x7fb1d400c490 comp rx=0 tx=0).stop 2023-10-14T12:29:42.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 shutdown_connections 2023-10-14T12:29:42.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb1c006aea0 0x7fb1c006d360 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb1dc154d10 0x7fb1dc1ef9e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb1dc0cf030 0x7fb1dc1f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 --2- 172.21.15.64:0/1127889404 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb1dc06d360 0x7fb1dc0cc0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 >> 172.21.15.64:0/1127889404 conn(0x7fb1dc06a200 msgr2=0x7fb1dc0af830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:42.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 shutdown_connections 2023-10-14T12:29:42.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.680+0000 7fb1e2535640 1 -- 172.21.15.64:0/1127889404 wait complete. 2023-10-14T12:29:42.700 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:42.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.920+0000 7f070c9ed640 1 Processor -- start 2023-10-14T12:29:42.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.920+0000 7f070c9ed640 1 -- start start 2023-10-14T12:29:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070c9ed640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f070815a8d0 0x7f07080cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070c9ed640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f070806ff40 0x7f07080cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070c9ed640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070815acb0 con 0x7f07080ca660 2023-10-14T12:29:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070c9ed640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07080c1c60 con 0x7f070815a8d0 2023-10-14T12:29:42.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070c9ed640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f070815e350 con 0x7f070806ff40 2023-10-14T12:29:42.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f0706d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f070815a8d0 0x7f07080cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070659c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f07080ca660 0x7f070806bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:33778/0 (socket says 172.21.15.64:33778) 2023-10-14T12:29:42.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070659c640 1 -- 172.21.15.64:0/1089196806 learned_addr learned my addr 172.21.15.64:0/1089196806 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:42.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.922+0000 7f070759e640 1 --2- 172.21.15.64:0/1089196806 >> v2:172.21.15.177:3300/0 conn(0x7f070806ff40 0x7f07080cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.923+0000 7f0706d9d640 1 -- 172.21.15.64:0/1089196806 >> v2:172.21.15.177:3300/0 conn(0x7f070806ff40 msgr2=0x7f07080cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:42.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.923+0000 7f0706d9d640 1 --2- 172.21.15.64:0/1089196806 >> v2:172.21.15.177:3300/0 conn(0x7f070806ff40 0x7f07080cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.923+0000 7f0706d9d640 1 -- 172.21.15.64:0/1089196806 >> v1:172.21.15.64:6789/0 conn(0x7f07080ca660 legacy=0x7f070806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.923+0000 7f0705d9b640 1 -- 172.21.15.64:0/1089196806 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210797200 0 0) 0x7f06f0001110 con 0x7f07080ca660 2023-10-14T12:29:42.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.923+0000 7f0706d9d640 1 -- 172.21.15.64:0/1089196806 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070815e630 con 0x7f070815a8d0 2023-10-14T12:29:42.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.924+0000 7f0706d9d640 1 --2- 172.21.15.64:0/1089196806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070815a8d0 0x7f07080cab40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07080c1a30 tx=0x7f06f802bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bbfe54537cc3b4d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.924+0000 7f0705d9b640 1 -- 172.21.15.64:0/1089196806 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f802ccb0 con 0x7f070815a8d0 2023-10-14T12:29:42.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.924+0000 7f0705d9b640 1 -- 172.21.15.64:0/1089196806 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f802ce10 con 0x7f070815a8d0 2023-10-14T12:29:42.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.924+0000 7f0705d9b640 1 -- 172.21.15.64:0/1089196806 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8034660 con 0x7f070815a8d0 2023-10-14T12:29:42.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 -- 172.21.15.64:0/1089196806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070815a8d0 msgr2=0x7f07080cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1089196806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070815a8d0 0x7f07080cab40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f07080c1a30 tx=0x7f06f802bf00 comp rx=0 tx=0).stop 2023-10-14T12:29:42.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 -- 172.21.15.64:0/1089196806 shutdown_connections 2023-10-14T12:29:42.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1089196806 >> v2:172.21.15.177:3300/0 conn(0x7f070806ff40 0x7f07080cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1089196806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070815a8d0 0x7f07080cab40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 -- 172.21.15.64:0/1089196806 >> 172.21.15.64:0/1089196806 conn(0x7f070806a470 msgr2=0x7f07080afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:42.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 -- 172.21.15.64:0/1089196806 shutdown_connections 2023-10-14T12:29:42.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.925+0000 7f070c9ed640 1 -- 172.21.15.64:0/1089196806 wait complete. 2023-10-14T12:29:42.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.927+0000 7f070c9ed640 1 Processor -- start 2023-10-14T12:29:42.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.927+0000 7f070c9ed640 1 -- start start 2023-10-14T12:29:42.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.928+0000 7f070c9ed640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070806ff40 0x7f07080c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.928+0000 7f070c9ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07080ca660 0x7f070815b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.928+0000 7f070c9ed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f070815a8d0 0x7f07081f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.928+0000 7f070c9ed640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708157cf0 con 0x7f070806ff40 2023-10-14T12:29:42.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.928+0000 7f070c9ed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07081f60a0 con 0x7f070815a8d0 2023-10-14T12:29:42.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.928+0000 7f070c9ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07081f6380 con 0x7f07080ca660 2023-10-14T12:29:42.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070806ff40 0x7f07080c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070806ff40 0x7f07080c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51500/0 (socket says 172.21.15.64:51500) 2023-10-14T12:29:42.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 -- 172.21.15.64:0/1666073177 learned_addr learned my addr 172.21.15.64:0/1666073177 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:42.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f070659c640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07080ca660 0x7f070815b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 -- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07080ca660 msgr2=0x7f070815b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f070759e640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f070815a8d0 0x7f07081f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07080ca660 0x7f070815b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 -- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f070815a8d0 msgr2=0x7f07081f5870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:42.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f070815a8d0 0x7f07081f5870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:42.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f0706d9d640 1 -- 172.21.15.64:0/1666073177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f8009a70 con 0x7f070806ff40 2023-10-14T12:29:42.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f070659c640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07080ca660 0x7f070815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:42.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.929+0000 7f070759e640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f070815a8d0 0x7f07081f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:42.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.930+0000 7f0706d9d640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070806ff40 0x7f07080c5f80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f06f8037040 tx=0x7f06f8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.930+0000 7f06ff7fe640 1 -- 172.21.15.64:0/1666073177 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8040650 con 0x7f070806ff40 2023-10-14T12:29:42.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.930+0000 7f06ff7fe640 1 -- 172.21.15.64:0/1666073177 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f80407b0 con 0x7f070806ff40 2023-10-14T12:29:42.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.930+0000 7f06ff7fe640 1 -- 172.21.15.64:0/1666073177 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f8040b60 con 0x7f070806ff40 2023-10-14T12:29:42.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.930+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07081f6660 con 0x7f070806ff40 2023-10-14T12:29:42.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.930+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070815bdf0 con 0x7f070806ff40 2023-10-14T12:29:42.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.931+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07081581d0 con 0x7f070806ff40 2023-10-14T12:29:42.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.932+0000 7f06ff7fe640 1 -- 172.21.15.64:0/1666073177 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f06f8040cc0 con 0x7f070806ff40 2023-10-14T12:29:42.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.933+0000 7f06ff7fe640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f06e806ae70 0x7f06e806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:42.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.933+0000 7f06ff7fe640 1 -- 172.21.15.64:0/1666073177 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f06f80ac7d0 con 0x7f070806ff40 2023-10-14T12:29:42.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.934+0000 7f070659c640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f06e806ae70 0x7f06e806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:42.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.935+0000 7f070659c640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f06e806ae70 0x7f06e806d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07081f57d0 tx=0x7f06f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:42.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:42.937+0000 7f06ff7fe640 1 -- 172.21.15.64:0/1666073177 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f07081581d0 con 0x7f070806ff40 2023-10-14T12:29:43.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.132+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07081581d0 con 0x7f070806ff40 2023-10-14T12:29:43.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.134+0000 7f06ff7fe640 1 -- 172.21.15.64:0/1666073177 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f07081581d0 con 0x7f070806ff40 2023-10-14T12:29:43.136 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:43.136 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:43.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.136+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f06e806ae70 msgr2=0x7f06e806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.136+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f06e806ae70 0x7f06e806d330 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f07081f57d0 tx=0x7f06f0009040 comp rx=0 tx=0).stop 2023-10-14T12:29:43.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.136+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070806ff40 msgr2=0x7f07080c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.136+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070806ff40 0x7f07080c5f80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f06f8037040 tx=0x7f06f8004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:43.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 shutdown_connections 2023-10-14T12:29:43.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f06e806ae70 0x7f06e806d330 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f070815a8d0 0x7f07081f5870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f07080ca660 0x7f070815b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 --2- 172.21.15.64:0/1666073177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f070806ff40 0x7f07080c5f80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 >> 172.21.15.64:0/1666073177 conn(0x7f070806a470 msgr2=0x7f07080af6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:43.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 shutdown_connections 2023-10-14T12:29:43.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.137+0000 7f070c9ed640 1 -- 172.21.15.64:0/1666073177 wait complete. 2023-10-14T12:29:43.157 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:43.158 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:43.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.390+0000 7fd55556e640 1 Processor -- start 2023-10-14T12:29:43.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.390+0000 7fd55556e640 1 -- start start 2023-10-14T12:29:43.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd55556e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd55015a910 0x7fd5500cee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd55556e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd5500cd800 0x7fd5501645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd55556e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5500b37a0 con 0x7fd5500cf340 2023-10-14T12:29:43.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd55556e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500b3a40 con 0x7fd55015a910 2023-10-14T12:29:43.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd55556e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5500b3d20 con 0x7fd5500cd800 2023-10-14T12:29:43.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd54effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd55015a910 0x7fd5500cee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd54effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd55015a910 0x7fd5500cee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51516/0 (socket says 172.21.15.64:51516) 2023-10-14T12:29:43.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.392+0000 7fd54effd640 1 -- 172.21.15.64:0/3827204267 learned_addr learned my addr 172.21.15.64:0/3827204267 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.393+0000 7fd54effd640 1 -- 172.21.15.64:0/3827204267 >> v2:172.21.15.177:3300/0 conn(0x7fd5500cd800 msgr2=0x7fd5501645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.393+0000 7fd54effd640 1 --2- 172.21.15.64:0/3827204267 >> v2:172.21.15.177:3300/0 conn(0x7fd5500cd800 0x7fd5501645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.393+0000 7fd54effd640 1 -- 172.21.15.64:0/3827204267 >> v1:172.21.15.177:6789/0 conn(0x7fd5500cf340 legacy=0x7fd5500cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:43.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.393+0000 7fd54effd640 1 -- 172.21.15.64:0/3827204267 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5500b4000 con 0x7fd55015a910 2023-10-14T12:29:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.394+0000 7fd54effd640 1 --2- 172.21.15.64:0/3827204267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500cee00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd550071c20 tx=0x7fd54002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0fad08da13c07d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.394+0000 7fd54e7fc640 1 -- 172.21.15.64:0/3827204267 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400317e0 con 0x7fd55015a910 2023-10-14T12:29:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.394+0000 7fd54e7fc640 1 -- 172.21.15.64:0/3827204267 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd540031940 con 0x7fd55015a910 2023-10-14T12:29:43.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.394+0000 7fd54e7fc640 1 -- 172.21.15.64:0/3827204267 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd540031cd0 con 0x7fd55015a910 2023-10-14T12:29:43.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 -- 172.21.15.64:0/3827204267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 msgr2=0x7fd5500cee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 --2- 172.21.15.64:0/3827204267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500cee00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd550071c20 tx=0x7fd54002b880 comp rx=0 tx=0).stop 2023-10-14T12:29:43.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 -- 172.21.15.64:0/3827204267 shutdown_connections 2023-10-14T12:29:43.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 --2- 172.21.15.64:0/3827204267 >> v2:172.21.15.177:3300/0 conn(0x7fd5500cd800 0x7fd5501645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 --2- 172.21.15.64:0/3827204267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500cee00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 -- 172.21.15.64:0/3827204267 >> 172.21.15.64:0/3827204267 conn(0x7fd5500d0820 msgr2=0x7fd5500d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:43.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 -- 172.21.15.64:0/3827204267 shutdown_connections 2023-10-14T12:29:43.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.395+0000 7fd55556e640 1 -- 172.21.15.64:0/3827204267 wait complete. 2023-10-14T12:29:43.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.397+0000 7fd55556e640 1 Processor -- start 2023-10-14T12:29:43.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.397+0000 7fd55556e640 1 -- start start 2023-10-14T12:29:43.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd55556e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5500cd800 0x7fd5500ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd55556e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5500cf340 0x7fd5500c6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd55556e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd55556e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55014d510 con 0x7fd55015a910 2023-10-14T12:29:43.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd55556e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd55014d760 con 0x7fd5500cf340 2023-10-14T12:29:43.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd55556e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd55014da40 con 0x7fd5500cd800 2023-10-14T12:29:43.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd54f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd54f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500b46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51532/0 (socket says 172.21.15.64:51532) 2023-10-14T12:29:43.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd54f7fe640 1 -- 172.21.15.64:0/3638409538 learned_addr learned my addr 172.21.15.64:0/3638409538 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:43.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd547fff640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5500cf340 0x7fd5500c6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd54effd640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5500cd800 0x7fd5500ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.398+0000 7fd54f7fe640 1 -- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5500cd800 msgr2=0x7fd5500ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd54f7fe640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5500cd800 0x7fd5500ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd54f7fe640 1 -- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5500cf340 msgr2=0x7fd5500c6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd54f7fe640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5500cf340 0x7fd5500c6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd54f7fe640 1 -- 172.21.15.64:0/3638409538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5400094d0 con 0x7fd55015a910 2023-10-14T12:29:43.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd54f7fe640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500b46d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd54800b970 tx=0x7fd54800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:43.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd5477fe640 1 -- 172.21.15.64:0/3638409538 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54800cb40 con 0x7fd55015a910 2023-10-14T12:29:43.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd5477fe640 1 -- 172.21.15.64:0/3638409538 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54800ccc0 con 0x7fd55015a910 2023-10-14T12:29:43.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd5477fe640 1 -- 172.21.15.64:0/3638409538 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd548014680 con 0x7fd55015a910 2023-10-14T12:29:43.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd55014dd20 con 0x7fd55015a910 2023-10-14T12:29:43.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.399+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd550151820 con 0x7fd55015a910 2023-10-14T12:29:43.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.401+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd55014e240 con 0x7fd55015a910 2023-10-14T12:29:43.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.401+0000 7fd5477fe640 1 -- 172.21.15.64:0/3638409538 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd54801d3b0 con 0x7fd55015a910 2023-10-14T12:29:43.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.402+0000 7fd5477fe640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd53006aef0 0x7fd53006d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.402+0000 7fd5477fe640 1 -- 172.21.15.64:0/3638409538 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd548089960 con 0x7fd55015a910 2023-10-14T12:29:43.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.403+0000 7fd54effd640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd53006aef0 0x7fd53006d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.404+0000 7fd54effd640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd53006aef0 0x7fd53006d3b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd540036000 tx=0x7fd54003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:43.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.407+0000 7fd5477fe640 1 -- 172.21.15.64:0/3638409538 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd55014e240 con 0x7fd55015a910 2023-10-14T12:29:43.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.601+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd55014e240 con 0x7fd55015a910 2023-10-14T12:29:43.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.602+0000 7fd5477fe640 1 -- 172.21.15.64:0/3638409538 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd55014e240 con 0x7fd55015a910 2023-10-14T12:29:43.604 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:43.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.604+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd53006aef0 msgr2=0x7fd53006d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.604+0000 7fd55556e640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd53006aef0 0x7fd53006d3b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd540036000 tx=0x7fd54003d040 comp rx=0 tx=0).stop 2023-10-14T12:29:43.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 msgr2=0x7fd5500b46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500b46d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fd54800b970 tx=0x7fd54800be30 comp rx=0 tx=0).stop 2023-10-14T12:29:43.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 shutdown_connections 2023-10-14T12:29:43.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd53006aef0 0x7fd53006d3b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd55015a910 0x7fd5500b46d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd5500cf340 0x7fd5500c6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 --2- 172.21.15.64:0/3638409538 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd5500cd800 0x7fd5500ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 >> 172.21.15.64:0/3638409538 conn(0x7fd5500d0820 msgr2=0x7fd55015cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:43.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 shutdown_connections 2023-10-14T12:29:43.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.605+0000 7fd55556e640 1 -- 172.21.15.64:0/3638409538 wait complete. 2023-10-14T12:29:43.625 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:43.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.855+0000 7f18a5009640 1 Processor -- start 2023-10-14T12:29:43.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.855+0000 7f18a5009640 1 -- start start 2023-10-14T12:29:43.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f18a5009640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f18a00c9260 0x7f18a00cd5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f18a5009640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a00cdbb0 0x7f18a00cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f18a5009640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00cb180 con 0x7f18a015c580 2023-10-14T12:29:43.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f18a5009640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00cac40 con 0x7f18a00c9260 2023-10-14T12:29:43.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f18a5009640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00cf440 con 0x7f18a00cdbb0 2023-10-14T12:29:43.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f189e59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f18a00c9260 0x7f18a00cd5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f189e59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f18a00c9260 0x7f18a00cd5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51534/0 (socket says 172.21.15.64:51534) 2023-10-14T12:29:43.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.857+0000 7f189e59c640 1 -- 172.21.15.64:0/401532545 learned_addr learned my addr 172.21.15.64:0/401532545 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:43.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.858+0000 7f189f59e640 1 --2- 172.21.15.64:0/401532545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a00cdbb0 0x7f18a00cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.858+0000 7f189e59c640 1 -- 172.21.15.64:0/401532545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a00cdbb0 msgr2=0x7f18a00cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:43.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.858+0000 7f189e59c640 1 --2- 172.21.15.64:0/401532545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a00cdbb0 0x7f18a00cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.858+0000 7f189e59c640 1 -- 172.21.15.64:0/401532545 >> v1:172.21.15.177:6789/0 conn(0x7f18a015c580 legacy=0x7f18a00c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.858+0000 7f189e59c640 1 -- 172.21.15.64:0/401532545 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00ceec0 con 0x7f18a00c9260 2023-10-14T12:29:43.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.859+0000 7f189e59c640 1 --2- 172.21.15.64:0/401532545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00c9260 0x7f18a00cd5f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f188802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbde9341f3b4c919 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:43.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.859+0000 7f189dd9b640 1 -- 172.21.15.64:0/401532545 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888031870 con 0x7f18a00c9260 2023-10-14T12:29:43.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f189dd9b640 1 -- 172.21.15.64:0/401532545 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18880319d0 con 0x7f18a00c9260 2023-10-14T12:29:43.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f189dd9b640 1 -- 172.21.15.64:0/401532545 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888031d60 con 0x7f18a00c9260 2023-10-14T12:29:43.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 -- 172.21.15.64:0/401532545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00c9260 msgr2=0x7f18a00cd5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 --2- 172.21.15.64:0/401532545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00c9260 0x7f18a00cd5f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1888009870 tx=0x7f188802b910 comp rx=0 tx=0).stop 2023-10-14T12:29:43.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 -- 172.21.15.64:0/401532545 shutdown_connections 2023-10-14T12:29:43.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 --2- 172.21.15.64:0/401532545 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a00cdbb0 0x7f18a00cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 --2- 172.21.15.64:0/401532545 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00c9260 0x7f18a00cd5f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 -- 172.21.15.64:0/401532545 >> 172.21.15.64:0/401532545 conn(0x7f18a00b0030 msgr2=0x7f18a00b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:43.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 -- 172.21.15.64:0/401532545 shutdown_connections 2023-10-14T12:29:43.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.860+0000 7f18a5009640 1 -- 172.21.15.64:0/401532545 wait complete. 2023-10-14T12:29:43.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.862+0000 7f18a5009640 1 Processor -- start 2023-10-14T12:29:43.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.862+0000 7f18a5009640 1 -- start start 2023-10-14T12:29:43.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.863+0000 7f18a5009640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18a00c9260 0x7f18a01e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.863+0000 7f18a5009640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00cdbb0 0x7f18a014eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.863+0000 7f18a5009640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a015c580 0x7f18a00ab860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.863+0000 7f18a5009640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00c6e00 con 0x7f18a00cdbb0 2023-10-14T12:29:43.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.863+0000 7f18a5009640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a01e4f40 con 0x7f18a00c9260 2023-10-14T12:29:43.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.863+0000 7f18a5009640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a01e51c0 con 0x7f18a015c580 2023-10-14T12:29:43.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00cdbb0 0x7f18a014eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00cdbb0 0x7f18a014eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51538/0 (socket says 172.21.15.64:51538) 2023-10-14T12:29:43.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 -- 172.21.15.64:0/2654437491 learned_addr learned my addr 172.21.15.64:0/2654437491 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:43.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189ed9d640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18a00c9260 0x7f18a01e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189f59e640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a015c580 0x7f18a00ab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 -- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a015c580 msgr2=0x7f18a00ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a015c580 0x7f18a00ab860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 -- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18a00c9260 msgr2=0x7f18a01e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:43.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18a00c9260 0x7f18a01e4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:43.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189e59c640 1 -- 172.21.15.64:0/2654437491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18880094d0 con 0x7f18a00cdbb0 2023-10-14T12:29:43.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.864+0000 7f189f59e640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a015c580 0x7f18a00ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:43.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.865+0000 7f189e59c640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00cdbb0 0x7f18a014eaa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1888000c00 tx=0x7f18880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:43.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.865+0000 7f18977fe640 1 -- 172.21.15.64:0/2654437491 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188803abe0 con 0x7f18a00cdbb0 2023-10-14T12:29:43.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.865+0000 7f18977fe640 1 -- 172.21.15.64:0/2654437491 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188803ad40 con 0x7f18a00cdbb0 2023-10-14T12:29:43.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.865+0000 7f18977fe640 1 -- 172.21.15.64:0/2654437491 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1888044630 con 0x7f18a00cdbb0 2023-10-14T12:29:43.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.865+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00c64d0 con 0x7f18a00cdbb0 2023-10-14T12:29:43.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.865+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a00c6a90 con 0x7f18a00cdbb0 2023-10-14T12:29:43.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.867+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a00c6f70 con 0x7f18a00cdbb0 2023-10-14T12:29:43.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.867+0000 7f18977fe640 1 -- 172.21.15.64:0/2654437491 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f188804d450 con 0x7f18a00cdbb0 2023-10-14T12:29:43.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.868+0000 7f18977fe640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f188006ae70 0x7f188006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:43.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.868+0000 7f18977fe640 1 -- 172.21.15.64:0/2654437491 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f188802d040 con 0x7f18a00cdbb0 2023-10-14T12:29:43.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.869+0000 7f189ed9d640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f188006ae70 0x7f188006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:43.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.870+0000 7f189ed9d640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f188006ae70 0x7f188006d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1890000f60 tx=0x7f1890009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:43.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:43.873+0000 7f18977fe640 1 -- 172.21.15.64:0/2654437491 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1888076c90 con 0x7f18a00cdbb0 2023-10-14T12:29:44.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.069+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f18a0073ef0 con 0x7f18a00cdbb0 2023-10-14T12:29:44.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.070+0000 7f18977fe640 1 -- 172.21.15.64:0/2654437491 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1888035020 con 0x7f18a00cdbb0 2023-10-14T12:29:44.072 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:44.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f188006ae70 msgr2=0x7f188006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f188006ae70 0x7f188006d330 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f1890000f60 tx=0x7f1890009040 comp rx=0 tx=0).stop 2023-10-14T12:29:44.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00cdbb0 msgr2=0x7f18a014eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00cdbb0 0x7f18a014eaa0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1888000c00 tx=0x7f18880046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 shutdown_connections 2023-10-14T12:29:44.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f188006ae70 0x7f188006d330 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f18a015c580 0x7f18a00ab860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f18a00cdbb0 0x7f18a014eaa0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 --2- 172.21.15.64:0/2654437491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f18a00c9260 0x7f18a01e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 >> 172.21.15.64:0/2654437491 conn(0x7f18a00b0030 msgr2=0x7f18a00cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:44.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 shutdown_connections 2023-10-14T12:29:44.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.073+0000 7f18a5009640 1 -- 172.21.15.64:0/2654437491 wait complete. 2023-10-14T12:29:44.095 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:44.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.330+0000 7fd0f8e7c640 1 Processor -- start 2023-10-14T12:29:44.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.331+0000 7fd0f8e7c640 1 -- start start 2023-10-14T12:29:44.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.332+0000 7fd0f8e7c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd0f40b2ee0 0x7fd0f406d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.332+0000 7fd0f8e7c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f41550f0 con 0x7fd0f40cf030 2023-10-14T12:29:44.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.332+0000 7fd0f8e7c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0f406db50 con 0x7fd0f4154d10 2023-10-14T12:29:44.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.332+0000 7fd0f8e7c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0f40b13f0 con 0x7fd0f40b2ee0 2023-10-14T12:29:44.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.333+0000 7fd0f2ffd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd0f40cf030 0x7fd0f406ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:33784/0 (socket says 172.21.15.64:33784) 2023-10-14T12:29:44.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.333+0000 7fd0f2ffd640 1 -- 172.21.15.64:0/907411864 learned_addr learned my addr 172.21.15.64:0/907411864 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:44.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.333+0000 7fd0f3fff640 1 --2- 172.21.15.64:0/907411864 >> v2:172.21.15.177:3300/0 conn(0x7fd0f40b2ee0 0x7fd0f406d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.333+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3760156415 0 0) 0x7fd0f41550f0 con 0x7fd0f40cf030 2023-10-14T12:29:44.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.333+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0e0003520 con 0x7fd0f40cf030 2023-10-14T12:29:44.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3638280900 0 0) 0x7fd0e0003520 con 0x7fd0f40cf030 2023-10-14T12:29:44.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 >> v2:172.21.15.177:3300/0 conn(0x7fd0f40b2ee0 msgr2=0x7fd0f406d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:44.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 --2- 172.21.15.64:0/907411864 >> v2:172.21.15.177:3300/0 conn(0x7fd0f40b2ee0 0x7fd0f406d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 >> v1:172.21.15.177:6789/0 conn(0x7fd0f4154d10 legacy=0x7fd0f40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f40b16d0 con 0x7fd0f40cf030 2023-10-14T12:29:44.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fd0dc001670 con 0x7fd0f40cf030 2023-10-14T12:29:44.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 >> v1:172.21.15.64:6789/0 conn(0x7fd0f40cf030 legacy=0x7fd0f406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e00039e0 0x7fd0e0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00047c0 0x7fd0e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40b13f0 con 0x7fd0e0005180 2023-10-14T12:29:44.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e000c0b0 con 0x7fd0e00047c0 2023-10-14T12:29:44.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0e000c270 con 0x7fd0e00039e0 2023-10-14T12:29:44.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.334+0000 7fd0f3fff640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.335+0000 7fd0f3fff640 1 -- 172.21.15.64:0/907411864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e00039e0 msgr2=0x7fd0e0003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:44.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.335+0000 7fd0f3fff640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0e00039e0 0x7fd0e0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.335+0000 7fd0f3fff640 1 -- 172.21.15.64:0/907411864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00047c0 msgr2=0x7fd0e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:44.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.335+0000 7fd0f3fff640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0e00047c0 0x7fd0e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.335+0000 7fd0f3fff640 1 -- 172.21.15.64:0/907411864 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0e0003520 con 0x7fd0e0005180 2023-10-14T12:29:44.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.335+0000 7fd0f3fff640 1 -- 172.21.15.64:0/907411864 reap_dead start 2023-10-14T12:29:44.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.336+0000 7fd0f3fff640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0e000b980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009a90 tx=0x7fd0e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7417cc21bc582728 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:44.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.336+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec004020 con 0x7fd0e0005180 2023-10-14T12:29:44.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.336+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0ec004180 con 0x7fd0e0005180 2023-10-14T12:29:44.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.336+0000 7fd0f27fc640 1 -- 172.21.15.64:0/907411864 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec02c6d0 con 0x7fd0e0005180 2023-10-14T12:29:44.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.336+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/907411864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 msgr2=0x7fd0e000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.337+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0e000b980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec009a90 tx=0x7fd0e00057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.337+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/907411864 shutdown_connections 2023-10-14T12:29:44.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.337+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/907411864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0e000b980 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.337+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/907411864 >> 172.21.15.64:0/907411864 conn(0x7fd0f406a200 msgr2=0x7fd0f406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:44.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.337+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/907411864 shutdown_connections 2023-10-14T12:29:44.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.337+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/907411864 wait complete. 2023-10-14T12:29:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.339+0000 7fd0f8e7c640 1 Processor -- start 2023-10-14T12:29:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.339+0000 7fd0f8e7c640 1 -- start start 2023-10-14T12:29:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f8e7c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0f41f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f8e7c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0f40ad860 0x7fd0f4097920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f8e7c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0f40ac1a0 0x7fd0f40ac630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f8e7c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f40acb70 con 0x7fd0e0005180 2023-10-14T12:29:44.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f8e7c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f41f2060 con 0x7fd0f40ad860 2023-10-14T12:29:44.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f8e7c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4097e60 con 0x7fd0f40ac1a0 2023-10-14T12:29:44.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0f41f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0f41f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51558/0 (socket says 172.21.15.64:51558) 2023-10-14T12:29:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 -- 172.21.15.64:0/2374494906 learned_addr learned my addr 172.21.15.64:0/2374494906 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 -- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0f40ac1a0 msgr2=0x7fd0f40ac630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0f40ac1a0 0x7fd0f40ac630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 -- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0f40ad860 msgr2=0x7fd0f4097920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0f40ad860 0x7fd0f4097920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.341+0000 7fd0f37fe640 1 -- 172.21.15.64:0/2374494906 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0f40ccae0 con 0x7fd0e0005180 2023-10-14T12:29:44.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.342+0000 7fd0f37fe640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0f41f1b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c840 tx=0x7fd0e400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:44.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.342+0000 7fd0ebfff640 1 -- 172.21.15.64:0/2374494906 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4003b70 con 0x7fd0e0005180 2023-10-14T12:29:44.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.342+0000 7fd0ebfff640 1 -- 172.21.15.64:0/2374494906 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0e4003cf0 con 0x7fd0e0005180 2023-10-14T12:29:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.342+0000 7fd0ebfff640 1 -- 172.21.15.64:0/2374494906 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e400aa90 con 0x7fd0e0005180 2023-10-14T12:29:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.342+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f40ccd30 con 0x7fd0e0005180 2023-10-14T12:29:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.342+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f40cd2f0 con 0x7fd0e0005180 2023-10-14T12:29:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.344+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0f40afcb0 con 0x7fd0e0005180 2023-10-14T12:29:44.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.345+0000 7fd0ebfff640 1 -- 172.21.15.64:0/2374494906 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd0e400abf0 con 0x7fd0e0005180 2023-10-14T12:29:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.346+0000 7fd0ebfff640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0d406aea0 0x7fd0d406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.346+0000 7fd0ebfff640 1 -- 172.21.15.64:0/2374494906 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0e40898b0 con 0x7fd0e0005180 2023-10-14T12:29:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.347+0000 7fd0f2ffd640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0d406aea0 0x7fd0d406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.348+0000 7fd0f2ffd640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0d406aea0 0x7fd0d406d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40aec00 tx=0x7fd0dc001af0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:44.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.350+0000 7fd0ebfff640 1 -- 172.21.15.64:0/2374494906 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0e4054590 con 0x7fd0e0005180 2023-10-14T12:29:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.546+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0f404e9b0 con 0x7fd0e0005180 2023-10-14T12:29:44.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.547+0000 7fd0ebfff640 1 -- 172.21.15.64:0/2374494906 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0e4003e60 con 0x7fd0e0005180 2023-10-14T12:29:44.549 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0d406aea0 msgr2=0x7fd0d406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0d406aea0 0x7fd0d406d360 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd0f40aec00 tx=0x7fd0dc001af0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 msgr2=0x7fd0f41f1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0f41f1b20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd0e400c840 tx=0x7fd0e400cd00 comp rx=0 tx=0).stop 2023-10-14T12:29:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 shutdown_connections 2023-10-14T12:29:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0d406aea0 0x7fd0d406d360 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0f40ac1a0 0x7fd0f40ac630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0f40ad860 0x7fd0f4097920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 --2- 172.21.15.64:0/2374494906 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0e0005180 0x7fd0f41f1b20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 >> 172.21.15.64:0/2374494906 conn(0x7fd0f406a200 msgr2=0x7fd0f406a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:44.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 shutdown_connections 2023-10-14T12:29:44.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.550+0000 7fd0f8e7c640 1 -- 172.21.15.64:0/2374494906 wait complete. 2023-10-14T12:29:44.570 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:44.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.790+0000 7f4741d4e640 1 Processor -- start 2023-10-14T12:29:44.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.791+0000 7f4741d4e640 1 -- start start 2023-10-14T12:29:44.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.792+0000 7f4741d4e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f473c0cdf50 0x7f473c0ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.792+0000 7f4741d4e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.792+0000 7f4741d4e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473c0cf2b0 con 0x7f473c15c8e0 2023-10-14T12:29:44.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.792+0000 7f4741d4e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f473c06df90 con 0x7f473c0cdf50 2023-10-14T12:29:44.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.792+0000 7f4741d4e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c0cdac0 con 0x7f473c0cee60 2023-10-14T12:29:44.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.793+0000 7f474154d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.793+0000 7f474154d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:35324/0 (socket says 172.21.15.64:35324) 2023-10-14T12:29:44.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.793+0000 7f474154d640 1 -- 172.21.15.64:0/2279787949 learned_addr learned my addr 172.21.15.64:0/2279787949 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:44.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.793+0000 7f4740d4c640 1 --1- 172.21.15.64:0/2279787949 >> v1:172.21.15.177:6789/0 conn(0x7f473c15c8e0 0x7f473c06d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:48950/0 (socket says 172.21.15.64:48950) 2023-10-14T12:29:44.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.793+0000 7f473bfff640 1 --2- 172.21.15.64:0/2279787949 >> v2:172.21.15.177:3300/0 conn(0x7f473c0cdf50 0x7f473c0ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.794+0000 7f474154d640 1 -- 172.21.15.64:0/2279787949 >> v2:172.21.15.177:3300/0 conn(0x7f473c0cdf50 msgr2=0x7f473c0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:44.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.794+0000 7f474154d640 1 --2- 172.21.15.64:0/2279787949 >> v2:172.21.15.177:3300/0 conn(0x7f473c0cdf50 0x7f473c0ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.794+0000 7f474154d640 1 -- 172.21.15.64:0/2279787949 >> v1:172.21.15.177:6789/0 conn(0x7f473c15c8e0 legacy=0x7f473c06d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.794+0000 7f474154d640 1 -- 172.21.15.64:0/2279787949 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f473c0cd1f0 con 0x7f473c0cee60 2023-10-14T12:29:44.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.794+0000 7f473b7fe640 1 -- 172.21.15.64:0/2279787949 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 250245062 0 0) 0x7f4730001110 con 0x7f473c15c8e0 2023-10-14T12:29:44.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.795+0000 7f474154d640 1 --2- 172.21.15.64:0/2279787949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c070040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4734009e50 tx=0x7f473402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1411905ec9f4aeb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:44.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.796+0000 7f473b7fe640 1 -- 172.21.15.64:0/2279787949 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473402cb00 con 0x7f473c0cee60 2023-10-14T12:29:44.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.796+0000 7f473b7fe640 1 -- 172.21.15.64:0/2279787949 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473402cc60 con 0x7f473c0cee60 2023-10-14T12:29:44.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.796+0000 7f473b7fe640 1 -- 172.21.15.64:0/2279787949 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47340343f0 con 0x7f473c0cee60 2023-10-14T12:29:44.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.796+0000 7f4741d4e640 1 -- 172.21.15.64:0/2279787949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 msgr2=0x7f473c070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.796+0000 7f4741d4e640 1 --2- 172.21.15.64:0/2279787949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c070040 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4734009e50 tx=0x7f473402bf60 comp rx=0 tx=0).stop 2023-10-14T12:29:44.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.797+0000 7f4741d4e640 1 -- 172.21.15.64:0/2279787949 shutdown_connections 2023-10-14T12:29:44.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.797+0000 7f4741d4e640 1 --2- 172.21.15.64:0/2279787949 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c070040 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.797+0000 7f4741d4e640 1 --2- 172.21.15.64:0/2279787949 >> v2:172.21.15.177:3300/0 conn(0x7f473c0cdf50 0x7f473c0ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.797+0000 7f4741d4e640 1 -- 172.21.15.64:0/2279787949 >> 172.21.15.64:0/2279787949 conn(0x7f473c06a200 msgr2=0x7f473c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:44.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.797+0000 7f4741d4e640 1 -- 172.21.15.64:0/2279787949 shutdown_connections 2023-10-14T12:29:44.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.797+0000 7f4741d4e640 1 -- 172.21.15.64:0/2279787949 wait complete. 2023-10-14T12:29:44.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.799+0000 7f4741d4e640 1 Processor -- start 2023-10-14T12:29:44.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.799+0000 7f4741d4e640 1 -- start start 2023-10-14T12:29:44.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.800+0000 7f4741d4e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f473c0cdf50 0x7f473c097790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.800+0000 7f4741d4e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c15a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.800+0000 7f4741d4e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473c15c8e0 0x7f473c15acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.800+0000 7f4741d4e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c15c0a0 con 0x7f473c15c8e0 2023-10-14T12:29:44.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.800+0000 7f4741d4e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c097cd0 con 0x7f473c0cdf50 2023-10-14T12:29:44.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.800+0000 7f4741d4e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f473c15b520 con 0x7f473c0cee60 2023-10-14T12:29:44.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473c15c8e0 0x7f473c15acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473c15c8e0 0x7f473c15acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51574/0 (socket says 172.21.15.64:51574) 2023-10-14T12:29:44.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 -- 172.21.15.64:0/872778472 learned_addr learned my addr 172.21.15.64:0/872778472 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:44.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f473bfff640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c15a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f4740d4c640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f473c0cdf50 0x7f473c097790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 -- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 msgr2=0x7f473c15a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c15a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 -- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f473c0cdf50 msgr2=0x7f473c097790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:44.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f473c0cdf50 0x7f473c097790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:44.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f474154d640 1 -- 172.21.15.64:0/872778472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009b30 con 0x7f473c15c8e0 2023-10-14T12:29:44.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.801+0000 7f4740d4c640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f473c0cdf50 0x7f473c097790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:44.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.802+0000 7f474154d640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473c15c8e0 0x7f473c15acc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4734009e50 tx=0x7f4734004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:44.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.802+0000 7f47397fa640 1 -- 172.21.15.64:0/872778472 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734009510 con 0x7f473c15c8e0 2023-10-14T12:29:44.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.802+0000 7f47397fa640 1 -- 172.21.15.64:0/872778472 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473403e450 con 0x7f473c15c8e0 2023-10-14T12:29:44.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.802+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c15b800 con 0x7f473c15c8e0 2023-10-14T12:29:44.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.802+0000 7f47397fa640 1 -- 172.21.15.64:0/872778472 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473403e800 con 0x7f473c15c8e0 2023-10-14T12:29:44.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.802+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c15bdc0 con 0x7f473c15c8e0 2023-10-14T12:29:44.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.804+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c148e40 con 0x7f473c15c8e0 2023-10-14T12:29:44.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.805+0000 7f47397fa640 1 -- 172.21.15.64:0/872778472 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f473403e960 con 0x7f473c15c8e0 2023-10-14T12:29:44.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.806+0000 7f47397fa640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f472006ae70 0x7f472006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:44.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.806+0000 7f47397fa640 1 -- 172.21.15.64:0/872778472 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f47340ac6f0 con 0x7f473c15c8e0 2023-10-14T12:29:44.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.807+0000 7f4740d4c640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f472006ae70 0x7f472006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:44.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.808+0000 7f4740d4c640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f472006ae70 0x7f472006d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4730000f60 tx=0x7f4730007ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:44.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:44.811+0000 7f47397fa640 1 -- 172.21.15.64:0/872778472 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f47340773e0 con 0x7f473c15c8e0 2023-10-14T12:29:45.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.005+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f473c04e9b0 con 0x7f473c15c8e0 2023-10-14T12:29:45.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.007+0000 7f47397fa640 1 -- 172.21.15.64:0/872778472 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f473407aa00 con 0x7f473c15c8e0 2023-10-14T12:29:45.008 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:45.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f472006ae70 msgr2=0x7f472006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f472006ae70 0x7f472006d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4730000f60 tx=0x7f4730007ca0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473c15c8e0 msgr2=0x7f473c15acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473c15c8e0 0x7f473c15acc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f4734009e50 tx=0x7f4734004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:45.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 shutdown_connections 2023-10-14T12:29:45.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f472006ae70 0x7f472006d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f473c15c8e0 0x7f473c15acc0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f473c0cee60 0x7f473c15a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 --2- 172.21.15.64:0/872778472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f473c0cdf50 0x7f473c097790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.009+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 >> 172.21.15.64:0/872778472 conn(0x7f473c06a200 msgr2=0x7f473c156df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:45.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.010+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 shutdown_connections 2023-10-14T12:29:45.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.010+0000 7f4741d4e640 1 -- 172.21.15.64:0/872778472 wait complete. 2023-10-14T12:29:45.030 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:45.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.249+0000 7fe815f03640 1 Processor -- start 2023-10-14T12:29:45.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.249+0000 7fe815f03640 1 -- start start 2023-10-14T12:29:45.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe815f03640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe8100cd980 0x7fe8100cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe815f03640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe810159c00 0x7fe81015d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe815f03640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe81015def0 0x7fe81006bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe815f03640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe810154110 con 0x7fe8100cd980 2023-10-14T12:29:45.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe815f03640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81015d1f0 con 0x7fe810159c00 2023-10-14T12:29:45.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe815f03640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81015a4c0 con 0x7fe81015def0 2023-10-14T12:29:45.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe814f01640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe8100cd980 0x7fe8100cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe814f01640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe8100cd980 0x7fe8100cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51582/0 (socket says 172.21.15.64:51582) 2023-10-14T12:29:45.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.251+0000 7fe814f01640 1 -- 172.21.15.64:0/612772995 learned_addr learned my addr 172.21.15.64:0/612772995 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:45.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe815702640 1 --2- 172.21.15.64:0/612772995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe81015def0 0x7fe81006bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe80ffff640 1 --2- 172.21.15.64:0/612772995 >> v2:172.21.15.177:3300/0 conn(0x7fe810159c00 0x7fe81015d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe814f01640 1 -- 172.21.15.64:0/612772995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe81015def0 msgr2=0x7fe81006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:45.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe814f01640 1 --2- 172.21.15.64:0/612772995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe81015def0 0x7fe81006bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe814f01640 1 -- 172.21.15.64:0/612772995 >> v2:172.21.15.177:3300/0 conn(0x7fe810159c00 msgr2=0x7fe81015d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:45.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe814f01640 1 --2- 172.21.15.64:0/612772995 >> v2:172.21.15.177:3300/0 conn(0x7fe810159c00 0x7fe81015d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe814f01640 1 -- 172.21.15.64:0/612772995 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81015a7a0 con 0x7fe8100cd980 2023-10-14T12:29:45.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.252+0000 7fe80ffff640 1 --2- 172.21.15.64:0/612772995 >> v2:172.21.15.177:3300/0 conn(0x7fe810159c00 0x7fe81015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:45.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.253+0000 7fe814f01640 1 --2- 172.21.15.64:0/612772995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe8100cdd60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe8100b0680 tx=0x7fe80402b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70fe40ff44c34481 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:45.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.253+0000 7fe80f7fe640 1 -- 172.21.15.64:0/612772995 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804004030 con 0x7fe8100cd980 2023-10-14T12:29:45.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.253+0000 7fe80f7fe640 1 -- 172.21.15.64:0/612772995 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe804004190 con 0x7fe8100cd980 2023-10-14T12:29:45.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.253+0000 7fe80f7fe640 1 -- 172.21.15.64:0/612772995 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804031640 con 0x7fe8100cd980 2023-10-14T12:29:45.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 -- 172.21.15.64:0/612772995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 msgr2=0x7fe8100cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 --2- 172.21.15.64:0/612772995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe8100cdd60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe8100b0680 tx=0x7fe80402b8e0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 -- 172.21.15.64:0/612772995 shutdown_connections 2023-10-14T12:29:45.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 --2- 172.21.15.64:0/612772995 >> v2:172.21.15.177:3300/0 conn(0x7fe810159c00 0x7fe81015d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 --2- 172.21.15.64:0/612772995 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe81015def0 0x7fe81006bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 --2- 172.21.15.64:0/612772995 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe8100cdd60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 -- 172.21.15.64:0/612772995 >> 172.21.15.64:0/612772995 conn(0x7fe81006a470 msgr2=0x7fe8100afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:45.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 -- 172.21.15.64:0/612772995 shutdown_connections 2023-10-14T12:29:45.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.254+0000 7fe815f03640 1 -- 172.21.15.64:0/612772995 wait complete. 2023-10-14T12:29:45.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.256+0000 7fe815f03640 1 Processor -- start 2023-10-14T12:29:45.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.256+0000 7fe815f03640 1 -- start start 2023-10-14T12:29:45.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.257+0000 7fe815f03640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe810145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.257+0000 7fe815f03640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe810159c00 0x7fe8100c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.257+0000 7fe815f03640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe810148f30 0x7fe8100cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.257+0000 7fe815f03640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810145a60 con 0x7fe8100cd980 2023-10-14T12:29:45.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.257+0000 7fe815f03640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810154b60 con 0x7fe810148f30 2023-10-14T12:29:45.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.257+0000 7fe815f03640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe810145470 con 0x7fe810159c00 2023-10-14T12:29:45.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe810145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe810145e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51584/0 (socket says 172.21.15.64:51584) 2023-10-14T12:29:45.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 -- 172.21.15.64:0/1735553002 learned_addr learned my addr 172.21.15.64:0/1735553002 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:45.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe80ffff640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe810159c00 0x7fe8100c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 -- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe810159c00 msgr2=0x7fe8100c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe810159c00 0x7fe8100c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 -- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe810148f30 msgr2=0x7fe8100cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe810148f30 0x7fe8100cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 -- 172.21.15.64:0/1735553002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe804009460 con 0x7fe8100cd980 2023-10-14T12:29:45.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe80ffff640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe810159c00 0x7fe8100c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:45.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.258+0000 7fe814f01640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe810145e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe804000c00 tx=0x7fe8040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:45.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.259+0000 7fe80d7fa640 1 -- 172.21.15.64:0/1735553002 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804004030 con 0x7fe8100cd980 2023-10-14T12:29:45.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.259+0000 7fe80d7fa640 1 -- 172.21.15.64:0/1735553002 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80403f070 con 0x7fe8100cd980 2023-10-14T12:29:45.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.259+0000 7fe80d7fa640 1 -- 172.21.15.64:0/1735553002 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe804003e00 con 0x7fe8100cd980 2023-10-14T12:29:45.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.259+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8101463c0 con 0x7fe8100cd980 2023-10-14T12:29:45.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.259+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe810154880 con 0x7fe8100cd980 2023-10-14T12:29:45.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.260+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81004e9b0 con 0x7fe8100cd980 2023-10-14T12:29:45.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.261+0000 7fe80d7fa640 1 -- 172.21.15.64:0/1735553002 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe804041030 con 0x7fe8100cd980 2023-10-14T12:29:45.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.262+0000 7fe80d7fa640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe7f406ae70 0x7fe7f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.262+0000 7fe80d7fa640 1 -- 172.21.15.64:0/1735553002 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe8040abe70 con 0x7fe8100cd980 2023-10-14T12:29:45.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.262+0000 7fe80ffff640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe7f406ae70 0x7fe7f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.264+0000 7fe80ffff640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe7f406ae70 0x7fe7f406d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe810070b30 tx=0x7fe7fc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:45.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.266+0000 7fe80d7fa640 1 -- 172.21.15.64:0/1735553002 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe804076ac0 con 0x7fe8100cd980 2023-10-14T12:29:45.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.462+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe81004e9b0 con 0x7fe8100cd980 2023-10-14T12:29:45.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.465+0000 7fe80d7fa640 1 -- 172.21.15.64:0/1735553002 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fe8040a3e60 con 0x7fe8100cd980 2023-10-14T12:29:45.467 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:45.468 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:45.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe7f406ae70 msgr2=0x7fe7f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe7f406ae70 0x7fe7f406d330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe810070b30 tx=0x7fe7fc008040 comp rx=0 tx=0).stop 2023-10-14T12:29:45.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 msgr2=0x7fe810145e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe810145e80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe804000c00 tx=0x7fe8040046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 shutdown_connections 2023-10-14T12:29:45.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe7f406ae70 0x7fe7f406d330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe810148f30 0x7fe8100cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe810159c00 0x7fe8100c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 --2- 172.21.15.64:0/1735553002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe8100cd980 0x7fe810145e80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 >> 172.21.15.64:0/1735553002 conn(0x7fe81006a470 msgr2=0x7fe810152d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:45.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 shutdown_connections 2023-10-14T12:29:45.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.468+0000 7fe815f03640 1 -- 172.21.15.64:0/1735553002 wait complete. 2023-10-14T12:29:45.490 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:45.491 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:45.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.698+0000 7f39d64d1640 1 Processor -- start 2023-10-14T12:29:45.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.698+0000 7f39d64d1640 1 -- start start 2023-10-14T12:29:45.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d64d1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39d0071b50 0x7f39d0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d64d1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 0x7f39d0070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d64d1640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39d00c89d0 con 0x7f39d00cdc00 2023-10-14T12:29:45.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d64d1640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39d015a260 con 0x7f39d0071b50 2023-10-14T12:29:45.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d64d1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d015a540 con 0x7f39d0071f30 2023-10-14T12:29:45.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d5cd0640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f39d00cdc00 0x7f39d006bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:33794/0 (socket says 172.21.15.64:33794) 2023-10-14T12:29:45.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d5cd0640 1 -- 172.21.15.64:0/1950960657 learned_addr learned my addr 172.21.15.64:0/1950960657 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:45.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d4cce640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 0x7f39d0070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39d54cf640 1 --2- 172.21.15.64:0/1950960657 >> v2:172.21.15.177:3300/0 conn(0x7f39d0071b50 0x7f39d0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.700+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3967559807 0 0) 0x7f39d00c89d0 con 0x7f39d00cdc00 2023-10-14T12:29:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39bc005730 con 0x7f39d00cdc00 2023-10-14T12:29:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1613255546 0 0) 0x7f39bc005730 con 0x7f39d00cdc00 2023-10-14T12:29:45.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 msgr2=0x7f39d0070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 0x7f39d0070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 >> v2:172.21.15.177:3300/0 conn(0x7f39d0071b50 msgr2=0x7f39d0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 --2- 172.21.15.64:0/1950960657 >> v2:172.21.15.177:3300/0 conn(0x7f39d0071b50 0x7f39d0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d015a820 con 0x7f39d00cdc00 2023-10-14T12:29:45.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f39c80019f0 con 0x7f39d00cdc00 2023-10-14T12:29:45.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 >> v1:172.21.15.64:6789/0 conn(0x7f39d00cdc00 legacy=0x7f39d006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 0x7f39bc005b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006100 0x7f39bc0069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39bc006f10 0x7f39bc007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d015a260 con 0x7f39bc006f10 2023-10-14T12:29:45.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d015a540 con 0x7f39bc006100 2023-10-14T12:29:45.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc00db90 con 0x7f39d0071f30 2023-10-14T12:29:45.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.701+0000 7f39d5cd0640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39bc006f10 0x7f39bc007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.702+0000 7f39d54cf640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 0x7f39bc005b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.702+0000 7f39d4cce640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006100 0x7f39bc0069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.702+0000 7f39d5cd0640 1 -- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 msgr2=0x7f39bc005b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.702+0000 7f39d5cd0640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d0071f30 0x7f39bc005b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.702+0000 7f39d5cd0640 1 -- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006100 msgr2=0x7f39bc0069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.702+0000 7f39d5cd0640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006100 0x7f39bc0069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.702+0000 7f39d5cd0640 1 -- 172.21.15.64:0/1950960657 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc005730 con 0x7f39bc006f10 2023-10-14T12:29:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.703+0000 7f39d5cd0640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39bc006f10 0x7f39bc007390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39c800a830 tx=0x7f39bc007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111349524e18bc84 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.703+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8034630 con 0x7f39bc006f10 2023-10-14T12:29:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.703+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c802f070 con 0x7f39bc006f10 2023-10-14T12:29:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.703+0000 7f39c7fff640 1 -- 172.21.15.64:0/1950960657 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c8034a30 con 0x7f39bc006f10 2023-10-14T12:29:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.704+0000 7f39d64d1640 1 -- 172.21.15.64:0/1950960657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39bc006f10 msgr2=0x7f39bc007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.704+0000 7f39d64d1640 1 --2- 172.21.15.64:0/1950960657 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39bc006f10 0x7f39bc007390 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39c800a830 tx=0x7f39bc007a00 comp rx=0 tx=0).stop 2023-10-14T12:29:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.704+0000 7f39d5cd0640 1 -- 172.21.15.64:0/1950960657 reap_dead start 2023-10-14T12:29:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.704+0000 7f39d64d1640 1 -- 172.21.15.64:0/1950960657 shutdown_connections 2023-10-14T12:29:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.704+0000 7f39d64d1640 1 -- 172.21.15.64:0/1950960657 >> 172.21.15.64:0/1950960657 conn(0x7f39d006a470 msgr2=0x7f39d00afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.704+0000 7f39d64d1640 1 -- 172.21.15.64:0/1950960657 shutdown_connections 2023-10-14T12:29:45.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.704+0000 7f39d64d1640 1 -- 172.21.15.64:0/1950960657 wait complete. 2023-10-14T12:29:45.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.705+0000 7f39d64d1640 1 Processor -- start 2023-10-14T12:29:45.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.706+0000 7f39d64d1640 1 -- start start 2023-10-14T12:29:45.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.706+0000 7f39d64d1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006f10 0x7f39d00cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.706+0000 7f39d64d1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39d0147710 0x7f39d00c1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d64d1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d00ae4e0 0x7f39d00ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d64d1640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00c3910 con 0x7f39d0147710 2023-10-14T12:29:45.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d64d1640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00aeea0 con 0x7f39bc006f10 2023-10-14T12:29:45.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d64d1640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00cd100 con 0x7f39d00ae4e0 2023-10-14T12:29:45.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39d0147710 0x7f39d00c1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39d0147710 0x7f39d00c1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:51604/0 (socket says 172.21.15.64:51604) 2023-10-14T12:29:45.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 -- 172.21.15.64:0/3292267361 learned_addr learned my addr 172.21.15.64:0/3292267361 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:45.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 -- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d00ae4e0 msgr2=0x7f39d00ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d00ae4e0 0x7f39d00ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 -- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006f10 msgr2=0x7f39d00cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006f10 0x7f39d00cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 -- 172.21.15.64:0/3292267361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d00c2330 con 0x7f39d0147710 2023-10-14T12:29:45.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.707+0000 7f39d4cce640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39d0147710 0x7f39d00c1df0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39c0010860 tx=0x7f39c0010d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:45.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.708+0000 7f39c5ffb640 1 -- 172.21.15.64:0/3292267361 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c0009610 con 0x7f39d0147710 2023-10-14T12:29:45.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.708+0000 7f39c5ffb640 1 -- 172.21.15.64:0/3292267361 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39c000eae0 con 0x7f39d0147710 2023-10-14T12:29:45.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.708+0000 7f39c5ffb640 1 -- 172.21.15.64:0/3292267361 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39c000ee70 con 0x7f39d0147710 2023-10-14T12:29:45.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.708+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d0153bb0 con 0x7f39d0147710 2023-10-14T12:29:45.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.708+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d00cc7d0 con 0x7f39d0147710 2023-10-14T12:29:45.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.709+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d004e9b0 con 0x7f39d0147710 2023-10-14T12:29:45.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.710+0000 7f39c5ffb640 1 -- 172.21.15.64:0/3292267361 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f39c001c400 con 0x7f39d0147710 2023-10-14T12:29:45.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.711+0000 7f39c5ffb640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39b406ae70 0x7f39b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:45.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.711+0000 7f39c5ffb640 1 -- 172.21.15.64:0/3292267361 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39c0089fc0 con 0x7f39d0147710 2023-10-14T12:29:45.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.712+0000 7f39d54cf640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39b406ae70 0x7f39b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:45.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.713+0000 7f39d54cf640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39b406ae70 0x7f39b406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009990 tx=0x7f39cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:45.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.716+0000 7f39c5ffb640 1 -- 172.21.15.64:0/3292267361 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39c0054cc0 con 0x7f39d0147710 2023-10-14T12:29:45.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.908+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39d00c5a10 con 0x7f39d0147710 2023-10-14T12:29:45.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.909+0000 7f39c5ffb640 1 -- 172.21.15.64:0/3292267361 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39c00582e0 con 0x7f39d0147710 2023-10-14T12:29:45.911 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:45.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39b406ae70 msgr2=0x7f39b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39b406ae70 0x7f39b406d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f39cc009990 tx=0x7f39cc008040 comp rx=0 tx=0).stop 2023-10-14T12:29:45.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39d0147710 msgr2=0x7f39d00c1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:45.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39d0147710 0x7f39d00c1df0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f39c0010860 tx=0x7f39c0010d20 comp rx=0 tx=0).stop 2023-10-14T12:29:45.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 shutdown_connections 2023-10-14T12:29:45.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39b406ae70 0x7f39b406d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39d00ae4e0 0x7f39d00ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39d0147710 0x7f39d00c1df0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 --2- 172.21.15.64:0/3292267361 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39bc006f10 0x7f39d00cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:45.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 >> 172.21.15.64:0/3292267361 conn(0x7f39d006a470 msgr2=0x7f39d0158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:45.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.912+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 shutdown_connections 2023-10-14T12:29:45.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:45.913+0000 7f39d64d1640 1 -- 172.21.15.64:0/3292267361 wait complete. 2023-10-14T12:29:45.933 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:46.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.162+0000 7f587aebb640 1 Processor -- start 2023-10-14T12:29:46.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.162+0000 7f587aebb640 1 -- start start 2023-10-14T12:29:46.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.163+0000 7f587aebb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f58740d0d80 0x7f58740d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.163+0000 7f587aebb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f58740b5fd0 0x7f58740b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.163+0000 7f587aebb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58740ce810 con 0x7f587415c940 2023-10-14T12:29:46.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.163+0000 7f587aebb640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58740d1740 con 0x7f58740d0d80 2023-10-14T12:29:46.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.163+0000 7f587aebb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58740b5b40 con 0x7f58740b5fd0 2023-10-14T12:29:46.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f58796b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f58740d0d80 0x7f58740d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f58796b8640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f58740d0d80 0x7f58740d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52340/0 (socket says 172.21.15.64:52340) 2023-10-14T12:29:46.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f58796b8640 1 -- 172.21.15.64:0/2158297186 learned_addr learned my addr 172.21.15.64:0/2158297186 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:46.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f587a6ba640 1 --2- 172.21.15.64:0/2158297186 >> v2:172.21.15.177:3300/0 conn(0x7f58740b5fd0 0x7f58740b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f58796b8640 1 -- 172.21.15.64:0/2158297186 >> v2:172.21.15.177:3300/0 conn(0x7f58740b5fd0 msgr2=0x7f58740b6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:46.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f58796b8640 1 --2- 172.21.15.64:0/2158297186 >> v2:172.21.15.177:3300/0 conn(0x7f58740b5fd0 0x7f58740b6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f58796b8640 1 -- 172.21.15.64:0/2158297186 >> v1:172.21.15.177:6789/0 conn(0x7f587415c940 legacy=0x7f58740d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:46.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.164+0000 7f58796b8640 1 -- 172.21.15.64:0/2158297186 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58740d0b10 con 0x7f58740d0d80 2023-10-14T12:29:46.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.165+0000 7f58796b8640 1 --2- 172.21.15.64:0/2158297186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58740d1200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5874160460 tx=0x7f586802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dd5441421a4ffc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:46.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f5878eb7640 1 -- 172.21.15.64:0/2158297186 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586802c9f0 con 0x7f58740d0d80 2023-10-14T12:29:46.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f5878eb7640 1 -- 172.21.15.64:0/2158297186 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586802cb50 con 0x7f58740d0d80 2023-10-14T12:29:46.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f5878eb7640 1 -- 172.21.15.64:0/2158297186 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58680343f0 con 0x7f58740d0d80 2023-10-14T12:29:46.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f587aebb640 1 -- 172.21.15.64:0/2158297186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 msgr2=0x7f58740d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f587aebb640 1 --2- 172.21.15.64:0/2158297186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58740d1200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5874160460 tx=0x7f586802be50 comp rx=0 tx=0).stop 2023-10-14T12:29:46.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f587aebb640 1 -- 172.21.15.64:0/2158297186 shutdown_connections 2023-10-14T12:29:46.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f587aebb640 1 --2- 172.21.15.64:0/2158297186 >> v2:172.21.15.177:3300/0 conn(0x7f58740b5fd0 0x7f58740b6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f587aebb640 1 --2- 172.21.15.64:0/2158297186 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58740d1200 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.166+0000 7f587aebb640 1 -- 172.21.15.64:0/2158297186 >> 172.21.15.64:0/2158297186 conn(0x7f587409bb30 msgr2=0x7f58740d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:46.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.167+0000 7f587aebb640 1 -- 172.21.15.64:0/2158297186 shutdown_connections 2023-10-14T12:29:46.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.167+0000 7f587aebb640 1 -- 172.21.15.64:0/2158297186 wait complete. 2023-10-14T12:29:46.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.168+0000 7f587aebb640 1 Processor -- start 2023-10-14T12:29:46.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.168+0000 7f587aebb640 1 -- start start 2023-10-14T12:29:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.169+0000 7f587aebb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58740b5fd0 0x7f58740c8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.169+0000 7f587aebb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58741f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.169+0000 7f587aebb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f587415c940 0x7f58741f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.169+0000 7f587aebb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c8500 con 0x7f58740d0d80 2023-10-14T12:29:46.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.169+0000 7f587aebb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c78f0 con 0x7f58740b5fd0 2023-10-14T12:29:46.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.169+0000 7f587aebb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58740c7bd0 con 0x7f587415c940 2023-10-14T12:29:46.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58741f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58741f1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52342/0 (socket says 172.21.15.64:52342) 2023-10-14T12:29:46.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 -- 172.21.15.64:0/2809993124 learned_addr learned my addr 172.21.15.64:0/2809993124 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:46.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f5879eb9640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58740b5fd0 0x7f58740c8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 -- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f587415c940 msgr2=0x7f58741f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f587a6ba640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f587415c940 0x7f58741f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f587415c940 0x7f58741f1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 -- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58740b5fd0 msgr2=0x7f58740c8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58740b5fd0 0x7f58740c8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.170+0000 7f58796b8640 1 -- 172.21.15.64:0/2809993124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5868009b30 con 0x7f58740d0d80 2023-10-14T12:29:46.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.171+0000 7f58796b8640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58741f1540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5868000f80 tx=0x7f5868004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:46.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.171+0000 7f58667fc640 1 -- 172.21.15.64:0/2809993124 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5868009510 con 0x7f58740d0d80 2023-10-14T12:29:46.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.171+0000 7f58667fc640 1 -- 172.21.15.64:0/2809993124 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f586803e450 con 0x7f58740d0d80 2023-10-14T12:29:46.177 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.171+0000 7f58667fc640 1 -- 172.21.15.64:0/2809993124 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586803e800 con 0x7f58740d0d80 2023-10-14T12:29:46.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.171+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58740c7eb0 con 0x7f58740d0d80 2023-10-14T12:29:46.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.171+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58740c75a0 con 0x7f58740d0d80 2023-10-14T12:29:46.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.172+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58740c8670 con 0x7f58740d0d80 2023-10-14T12:29:46.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.173+0000 7f58667fc640 1 -- 172.21.15.64:0/2809993124 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f586803e960 con 0x7f58740d0d80 2023-10-14T12:29:46.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.175+0000 7f58667fc640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f585806aea0 0x7f585806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.175+0000 7f58667fc640 1 -- 172.21.15.64:0/2809993124 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f58680ac770 con 0x7f58740d0d80 2023-10-14T12:29:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.175+0000 7f5879eb9640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f585806aea0 0x7f585806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.176+0000 7f5879eb9640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f585806aea0 0x7f585806d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:46.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.179+0000 7f58667fc640 1 -- 172.21.15.64:0/2809993124 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5868077460 con 0x7f58740d0d80 2023-10-14T12:29:46.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.372+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f587404e9b0 con 0x7f58740d0d80 2023-10-14T12:29:46.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.373+0000 7f58667fc640 1 -- 172.21.15.64:0/2809993124 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f586807aa80 con 0x7f58740d0d80 2023-10-14T12:29:46.375 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:46.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f585806aea0 msgr2=0x7f585806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f585806aea0 0x7f585806d360 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f5870006fd0 tx=0x7f5870008040 comp rx=0 tx=0).stop 2023-10-14T12:29:46.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 msgr2=0x7f58741f1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58741f1540 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5868000f80 tx=0x7f5868004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:46.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 shutdown_connections 2023-10-14T12:29:46.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f585806aea0 0x7f585806d360 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f587415c940 0x7f58741f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58740d0d80 0x7f58741f1540 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 --2- 172.21.15.64:0/2809993124 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58740b5fd0 0x7f58740c8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 >> 172.21.15.64:0/2809993124 conn(0x7f587409bb30 msgr2=0x7f58740cf1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:46.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 shutdown_connections 2023-10-14T12:29:46.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.376+0000 7f587aebb640 1 -- 172.21.15.64:0/2809993124 wait complete. 2023-10-14T12:29:46.398 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:46.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.612+0000 7fb369472640 1 Processor -- start 2023-10-14T12:29:46.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.613+0000 7fb369472640 1 -- start start 2023-10-14T12:29:46.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.614+0000 7fb369472640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb3640c1be0 0x7fb3640b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.614+0000 7fb369472640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3640ccfa0 con 0x7fb364160d90 2023-10-14T12:29:46.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.614+0000 7fb369472640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3640cc6d0 con 0x7fb3640ad970 2023-10-14T12:29:46.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.614+0000 7fb369472640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3640adde0 con 0x7fb3640c1be0 2023-10-14T12:29:46.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.614+0000 7fb363fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fb364160d90 0x7fb3640cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47752/0 (socket says 172.21.15.64:47752) 2023-10-14T12:29:46.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.614+0000 7fb363fff640 1 -- 172.21.15.64:0/2288288076 learned_addr learned my addr 172.21.15.64:0/2288288076 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:46.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4218844521 0 0) 0x7fb3640ccfa0 con 0x7fb364160d90 2023-10-14T12:29:46.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb350003520 con 0x7fb364160d90 2023-10-14T12:29:46.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb368c71640 1 --2- 172.21.15.64:0/2288288076 >> v2:172.21.15.177:3300/0 conn(0x7fb3640c1be0 0x7fb3640b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3016299016 0 0) 0x7fb350003520 con 0x7fb364160d90 2023-10-14T12:29:46.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 >> v2:172.21.15.177:3300/0 conn(0x7fb3640c1be0 msgr2=0x7fb3640b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:46.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 --2- 172.21.15.64:0/2288288076 >> v2:172.21.15.177:3300/0 conn(0x7fb3640c1be0 0x7fb3640b1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 >> v1:172.21.15.177:6789/0 conn(0x7fb3640ad970 legacy=0x7fb3640c14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640b2770 con 0x7fb364160d90 2023-10-14T12:29:46.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fb354001670 con 0x7fb364160d90 2023-10-14T12:29:46.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 >> v1:172.21.15.64:6789/0 conn(0x7fb364160d90 legacy=0x7fb3640cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb350003a30 0x7fb350003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3500047c0 0x7fb350004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500052a0 0x7fb35000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35000c170 con 0x7fb3500047c0 2023-10-14T12:29:46.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35000c2e0 con 0x7fb3500052a0 2023-10-14T12:29:46.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.615+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35000c4a0 con 0x7fb350003a30 2023-10-14T12:29:46.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb35bfff640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3500047c0 0x7fb350004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb368c71640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500052a0 0x7fb35000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb35bfff640 1 -- 172.21.15.64:0/2288288076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb350003a30 msgr2=0x7fb350003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb35bfff640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb350003a30 0x7fb350003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb35bfff640 1 -- 172.21.15.64:0/2288288076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500052a0 msgr2=0x7fb35000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb35bfff640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500052a0 0x7fb35000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb35bfff640 1 -- 172.21.15.64:0/2288288076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb350003520 con 0x7fb3500047c0 2023-10-14T12:29:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.616+0000 7fb368c71640 1 -- 172.21.15.64:0/2288288076 reap_dead start 2023-10-14T12:29:46.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.617+0000 7fb35bfff640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3500047c0 0x7fb350004c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb34c001720 tx=0x7fb3500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d8606217e06272 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:46.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.617+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0052d0 con 0x7fb3500047c0 2023-10-14T12:29:46.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.617+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c02e050 con 0x7fb3500047c0 2023-10-14T12:29:46.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.617+0000 7fb3637fe640 1 -- 172.21.15.64:0/2288288076 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c003830 con 0x7fb3500047c0 2023-10-14T12:29:46.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.618+0000 7fb369472640 1 -- 172.21.15.64:0/2288288076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3500047c0 msgr2=0x7fb350004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.618+0000 7fb369472640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3500047c0 0x7fb350004c40 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb34c001720 tx=0x7fb3500057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.618+0000 7fb369472640 1 -- 172.21.15.64:0/2288288076 shutdown_connections 2023-10-14T12:29:46.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.618+0000 7fb369472640 1 --2- 172.21.15.64:0/2288288076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3500047c0 0x7fb350004c40 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.618+0000 7fb369472640 1 -- 172.21.15.64:0/2288288076 >> 172.21.15.64:0/2288288076 conn(0x7fb36406a200 msgr2=0x7fb36406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:46.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.618+0000 7fb369472640 1 -- 172.21.15.64:0/2288288076 shutdown_connections 2023-10-14T12:29:46.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.618+0000 7fb369472640 1 -- 172.21.15.64:0/2288288076 wait complete. 2023-10-14T12:29:46.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.620+0000 7fb369472640 1 Processor -- start 2023-10-14T12:29:46.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.620+0000 7fb369472640 1 -- start start 2023-10-14T12:29:46.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb369472640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500047c0 0x7fb3640c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb369472640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3641f71e0 0x7fb3641f5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb369472640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb36415eb40 0x7fb36415efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb369472640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36415f500 con 0x7fb3641f71e0 2023-10-14T12:29:46.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb369472640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3640c7820 con 0x7fb3500047c0 2023-10-14T12:29:46.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb369472640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3640c7b00 con 0x7fb36415eb40 2023-10-14T12:29:46.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3641f71e0 0x7fb3641f5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3641f71e0 0x7fb3641f5d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52358/0 (socket says 172.21.15.64:52358) 2023-10-14T12:29:46.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 -- 172.21.15.64:0/3129151046 learned_addr learned my addr 172.21.15.64:0/3129151046 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:46.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 -- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb36415eb40 msgr2=0x7fb36415efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb36415eb40 0x7fb36415efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 -- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500047c0 msgr2=0x7fb3640c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500047c0 0x7fb3640c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.621+0000 7fb35bfff640 1 -- 172.21.15.64:0/3129151046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3640c7de0 con 0x7fb3641f71e0 2023-10-14T12:29:46.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.622+0000 7fb35bfff640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3641f71e0 0x7fb3641f5d20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb34c02bbc0 tx=0x7fb34c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:46.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.622+0000 7fb3617fa640 1 -- 172.21.15.64:0/3129151046 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c0076c0 con 0x7fb3641f71e0 2023-10-14T12:29:46.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.622+0000 7fb3617fa640 1 -- 172.21.15.64:0/3129151046 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb34c0069e0 con 0x7fb3641f71e0 2023-10-14T12:29:46.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.622+0000 7fb3617fa640 1 -- 172.21.15.64:0/3129151046 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb34c006d50 con 0x7fb3641f71e0 2023-10-14T12:29:46.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.622+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3640c80c0 con 0x7fb3641f71e0 2023-10-14T12:29:46.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.622+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3640c7480 con 0x7fb3641f71e0 2023-10-14T12:29:46.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.623+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36404e9b0 con 0x7fb3641f71e0 2023-10-14T12:29:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.624+0000 7fb3617fa640 1 -- 172.21.15.64:0/3129151046 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb34c0035f0 con 0x7fb3641f71e0 2023-10-14T12:29:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.625+0000 7fb3617fa640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb34406ae70 0x7fb34406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:46.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.625+0000 7fb3617fa640 1 -- 172.21.15.64:0/3129151046 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb34c0ab690 con 0x7fb3641f71e0 2023-10-14T12:29:46.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.626+0000 7fb363fff640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb34406ae70 0x7fb34406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:46.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.627+0000 7fb363fff640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb34406ae70 0x7fb34406d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb364068c20 tx=0x7fb3540014c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:46.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.629+0000 7fb3617fa640 1 -- 172.21.15.64:0/3129151046 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb34c076370 con 0x7fb3641f71e0 2023-10-14T12:29:46.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.818+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb3640c87e0 con 0x7fb3641f71e0 2023-10-14T12:29:46.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.819+0000 7fb3617fa640 1 -- 172.21.15.64:0/3129151046 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb34c079990 con 0x7fb3641f71e0 2023-10-14T12:29:46.821 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb34406ae70 msgr2=0x7fb34406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb34406ae70 0x7fb34406d330 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb364068c20 tx=0x7fb3540014c0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3641f71e0 msgr2=0x7fb3641f5d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3641f71e0 0x7fb3641f5d20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fb34c02bbc0 tx=0x7fb34c001120 comp rx=0 tx=0).stop 2023-10-14T12:29:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 shutdown_connections 2023-10-14T12:29:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb34406ae70 0x7fb34406d330 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb36415eb40 0x7fb36415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb3641f71e0 0x7fb3641f5d20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 --2- 172.21.15.64:0/3129151046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb3500047c0 0x7fb3640c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 >> 172.21.15.64:0/3129151046 conn(0x7fb36406a200 msgr2=0x7fb3640703d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.822+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 shutdown_connections 2023-10-14T12:29:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:46.823+0000 7fb369472640 1 -- 172.21.15.64:0/3129151046 wait complete. 2023-10-14T12:29:46.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:47.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.056+0000 7f309759e640 1 Processor -- start 2023-10-14T12:29:47.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.056+0000 7f309759e640 1 -- start start 2023-10-14T12:29:47.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f309759e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f30980ad970 0x7f30980b1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f309759e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980ccfa0 con 0x7f3098160d90 2023-10-14T12:29:47.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f309659c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f3098160d90 0x7f30980cd430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47760/0 (socket says 172.21.15.64:47760) 2023-10-14T12:29:47.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f309759e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30980cc6d0 con 0x7f30980c14d0 2023-10-14T12:29:47.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f309659c640 1 -- 172.21.15.64:0/3289498577 learned_addr learned my addr 172.21.15.64:0/3289498577 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:47.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f309759e640 1 -- 172.21.15.64:0/3289498577 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30980adde0 con 0x7f30980ad970 2023-10-14T12:29:47.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 525282575 0 0) 0x7f30980ccfa0 con 0x7f3098160d90 2023-10-14T12:29:47.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.058+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3084003520 con 0x7f3098160d90 2023-10-14T12:29:47.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f308ffff640 1 --2- 172.21.15.64:0/3289498577 >> v2:172.21.15.177:3300/0 conn(0x7f30980ad970 0x7f30980b1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 490111213 0 0) 0x7f3084003520 con 0x7f3098160d90 2023-10-14T12:29:47.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 >> v2:172.21.15.177:3300/0 conn(0x7f30980ad970 msgr2=0x7f30980b1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:47.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 --2- 172.21.15.64:0/3289498577 >> v2:172.21.15.177:3300/0 conn(0x7f30980ad970 0x7f30980b1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 >> v1:172.21.15.177:6789/0 conn(0x7f30980c14d0 legacy=0x7f309806bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:47.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980b2770 con 0x7f3098160d90 2023-10-14T12:29:47.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f3088001670 con 0x7f3098160d90 2023-10-14T12:29:47.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 >> v1:172.21.15.64:6789/0 conn(0x7f3098160d90 legacy=0x7f30980cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840039e0 0x7f3084003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30840047c0 0x7f3084004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3084005380 0x7f308400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308400c1c0 con 0x7f30840047c0 2023-10-14T12:29:47.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308400c330 con 0x7f30840039e0 2023-10-14T12:29:47.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308400c4f0 con 0x7f3084005380 2023-10-14T12:29:47.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f308ffff640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30840047c0 0x7f3084004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.059+0000 7f309659c640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840039e0 0x7f3084003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.060+0000 7f308ffff640 1 -- 172.21.15.64:0/3289498577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3084005380 msgr2=0x7f308400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.060+0000 7f308ffff640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3084005380 0x7f308400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.060+0000 7f308ffff640 1 -- 172.21.15.64:0/3289498577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840039e0 msgr2=0x7f3084003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.060+0000 7f308ffff640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840039e0 0x7f3084003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.060+0000 7f308ffff640 1 -- 172.21.15.64:0/3289498577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3084003520 con 0x7f30840047c0 2023-10-14T12:29:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.060+0000 7f3096d9d640 1 -- 172.21.15.64:0/3289498577 reap_dead start 2023-10-14T12:29:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.061+0000 7f308ffff640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30840047c0 0x7f3084004c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f308000a9a0 tx=0x7f30840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c095f8fc69c5bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.061+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080030620 con 0x7f30840047c0 2023-10-14T12:29:47.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.061+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3080030780 con 0x7f30840047c0 2023-10-14T12:29:47.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.061+0000 7f3095d9b640 1 -- 172.21.15.64:0/3289498577 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3080030b70 con 0x7f30840047c0 2023-10-14T12:29:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.062+0000 7f309759e640 1 -- 172.21.15.64:0/3289498577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30840047c0 msgr2=0x7f3084004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.062+0000 7f309759e640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30840047c0 0x7f3084004c40 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f308000a9a0 tx=0x7f30840057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.062+0000 7f309759e640 1 -- 172.21.15.64:0/3289498577 shutdown_connections 2023-10-14T12:29:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.062+0000 7f309759e640 1 --2- 172.21.15.64:0/3289498577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30840047c0 0x7f3084004c40 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.062+0000 7f309759e640 1 -- 172.21.15.64:0/3289498577 >> 172.21.15.64:0/3289498577 conn(0x7f309806a200 msgr2=0x7f309806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.062+0000 7f309759e640 1 -- 172.21.15.64:0/3289498577 shutdown_connections 2023-10-14T12:29:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.062+0000 7f309759e640 1 -- 172.21.15.64:0/3289498577 wait complete. 2023-10-14T12:29:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.064+0000 7f309759e640 1 Processor -- start 2023-10-14T12:29:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.064+0000 7f309759e640 1 -- start start 2023-10-14T12:29:47.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f309759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840047c0 0x7f30980c1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f309759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f309815fe40 0x7f30980c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f309759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30980ca300 0x7f3098161d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f309759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c76b0 con 0x7f30980ca300 2023-10-14T12:29:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f309759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30980c6820 con 0x7f30840047c0 2023-10-14T12:29:47.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f309759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30980ca780 con 0x7f309815fe40 2023-10-14T12:29:47.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f3096d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30980ca300 0x7f3098161d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f3096d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30980ca300 0x7f3098161d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52382/0 (socket says 172.21.15.64:52382) 2023-10-14T12:29:47.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f3096d9d640 1 -- 172.21.15.64:0/1766369247 learned_addr learned my addr 172.21.15.64:0/1766369247 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:47.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f309659c640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840047c0 0x7f30980c1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.065+0000 7f308ffff640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f309815fe40 0x7f30980c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f3096d9d640 1 -- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f309815fe40 msgr2=0x7f30980c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f3096d9d640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f309815fe40 0x7f30980c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f3096d9d640 1 -- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840047c0 msgr2=0x7f30980c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f3096d9d640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840047c0 0x7f30980c1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f3096d9d640 1 -- 172.21.15.64:0/1766369247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980c6a30 con 0x7f30980ca300 2023-10-14T12:29:47.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f308ffff640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f309815fe40 0x7f30980c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f3096d9d640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30980ca300 0x7f3098161d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f309806e0a0 tx=0x7f309000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f308effd640 1 -- 172.21.15.64:0/1766369247 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30900070d0 con 0x7f30980ca300 2023-10-14T12:29:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f308effd640 1 -- 172.21.15.64:0/1766369247 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3090007250 con 0x7f30980ca300 2023-10-14T12:29:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f308effd640 1 -- 172.21.15.64:0/1766369247 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090007600 con 0x7f30980ca300 2023-10-14T12:29:47.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.066+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30980c6d10 con 0x7f30980ca300 2023-10-14T12:29:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.067+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30980c72d0 con 0x7f30980ca300 2023-10-14T12:29:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.068+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30980c77f0 con 0x7f30980ca300 2023-10-14T12:29:47.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.069+0000 7f308effd640 1 -- 172.21.15.64:0/1766369247 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3090007760 con 0x7f30980ca300 2023-10-14T12:29:47.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.070+0000 7f308effd640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f307806aea0 0x7f307806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.070+0000 7f308effd640 1 -- 172.21.15.64:0/1766369247 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3090088f20 con 0x7f30980ca300 2023-10-14T12:29:47.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.071+0000 7f309659c640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f307806aea0 0x7f307806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.072+0000 7f309659c640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f307806aea0 0x7f307806d360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3088001eb0 tx=0x7f3088009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:47.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.075+0000 7f308effd640 1 -- 172.21.15.64:0/1766369247 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f30980c77f0 con 0x7f30980ca300 2023-10-14T12:29:47.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.267+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f30980c77f0 con 0x7f30980ca300 2023-10-14T12:29:47.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.268+0000 7f308effd640 1 -- 172.21.15.64:0/1766369247 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f30980c77f0 con 0x7f30980ca300 2023-10-14T12:29:47.269 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:47.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.270+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f307806aea0 msgr2=0x7f307806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.270+0000 7f309759e640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f307806aea0 0x7f307806d360 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3088001eb0 tx=0x7f3088009040 comp rx=0 tx=0).stop 2023-10-14T12:29:47.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.270+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30980ca300 msgr2=0x7f3098161d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.270+0000 7f309759e640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30980ca300 0x7f3098161d30 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f309806e0a0 tx=0x7f309000c960 comp rx=0 tx=0).stop 2023-10-14T12:29:47.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 shutdown_connections 2023-10-14T12:29:47.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f307806aea0 0x7f307806d360 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f30980ca300 0x7f3098161d30 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f309815fe40 0x7f30980c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 --2- 172.21.15.64:0/1766369247 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f30840047c0 0x7f30980c1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 >> 172.21.15.64:0/1766369247 conn(0x7f309806a200 msgr2=0x7f30980add80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:47.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 shutdown_connections 2023-10-14T12:29:47.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.271+0000 7f309759e640 1 -- 172.21.15.64:0/1766369247 wait complete. 2023-10-14T12:29:47.339 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-14T12:29:47.340 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:47.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.571+0000 7f17ca1ed640 1 Processor -- start 2023-10-14T12:29:47.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.572+0000 7f17ca1ed640 1 -- start start 2023-10-14T12:29:47.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.573+0000 7f17ca1ed640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f17c415ca60 0x7f17c406b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.573+0000 7f17ca1ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.573+0000 7f17ca1ed640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c406c2c0 con 0x7f17c40d1220 2023-10-14T12:29:47.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.573+0000 7f17ca1ed640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c40cfce0 con 0x7f17c415ca60 2023-10-14T12:29:47.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.573+0000 7f17ca1ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40cf440 con 0x7f17c415ce40 2023-10-14T12:29:47.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.574+0000 7f17c89ea640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.574+0000 7f17c89ea640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:51352/0 (socket says 172.21.15.64:51352) 2023-10-14T12:29:47.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.574+0000 7f17c89ea640 1 -- 172.21.15.64:0/1287832480 learned_addr learned my addr 172.21.15.64:0/1287832480 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:47.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.574+0000 7f17c91eb640 1 --2- 172.21.15.64:0/1287832480 >> v2:172.21.15.177:3300/0 conn(0x7f17c415ca60 0x7f17c406b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.575+0000 7f17c89ea640 1 -- 172.21.15.64:0/1287832480 >> v2:172.21.15.177:3300/0 conn(0x7f17c415ca60 msgr2=0x7f17c406b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:47.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.575+0000 7f17c89ea640 1 --2- 172.21.15.64:0/1287832480 >> v2:172.21.15.177:3300/0 conn(0x7f17c415ca60 0x7f17c406b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.575+0000 7f17c89ea640 1 -- 172.21.15.64:0/1287832480 >> v1:172.21.15.177:6789/0 conn(0x7f17c40d1220 legacy=0x7f17c40ccfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.575+0000 7f17c89ea640 1 -- 172.21.15.64:0/1287832480 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c40cf720 con 0x7f17c415ce40 2023-10-14T12:29:47.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.575+0000 7f17c91eb640 1 --2- 172.21.15.64:0/1287832480 >> v2:172.21.15.177:3300/0 conn(0x7f17c415ca60 0x7f17c406b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:47.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.576+0000 7f17c89ea640 1 --2- 172.21.15.64:0/1287832480 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406b640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009870 tx=0x7f17b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97fbdf8bd26c491 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:47.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.576+0000 7f17bbfff640 1 -- 172.21.15.64:0/1287832480 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4030840 con 0x7f17c415ce40 2023-10-14T12:29:47.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17bbfff640 1 -- 172.21.15.64:0/1287832480 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b40309a0 con 0x7f17c415ce40 2023-10-14T12:29:47.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17bbfff640 1 -- 172.21.15.64:0/1287832480 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b4030d30 con 0x7f17c415ce40 2023-10-14T12:29:47.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 -- 172.21.15.64:0/1287832480 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 msgr2=0x7f17c406b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/1287832480 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406b640 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f17b4009870 tx=0x7f17b402b980 comp rx=0 tx=0).stop 2023-10-14T12:29:47.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 -- 172.21.15.64:0/1287832480 shutdown_connections 2023-10-14T12:29:47.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/1287832480 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406b640 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/1287832480 >> v2:172.21.15.177:3300/0 conn(0x7f17c415ca60 0x7f17c406b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 -- 172.21.15.64:0/1287832480 >> 172.21.15.64:0/1287832480 conn(0x7f17c40d0730 msgr2=0x7f17c40d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:47.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 -- 172.21.15.64:0/1287832480 shutdown_connections 2023-10-14T12:29:47.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.577+0000 7f17ca1ed640 1 -- 172.21.15.64:0/1287832480 wait complete. 2023-10-14T12:29:47.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.579+0000 7f17ca1ed640 1 Processor -- start 2023-10-14T12:29:47.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.579+0000 7f17ca1ed640 1 -- start start 2023-10-14T12:29:47.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.580+0000 7f17ca1ed640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17c40d1220 0x7f17c4150550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.580+0000 7f17ca1ed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c415ca60 0x7f17c40c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.580+0000 7f17ca1ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.580+0000 7f17ca1ed640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40c6ca0 con 0x7f17c40d1220 2023-10-14T12:29:47.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.580+0000 7f17ca1ed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c415e1c0 con 0x7f17c415ca60 2023-10-14T12:29:47.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.580+0000 7f17ca1ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c40c8a20 con 0x7f17c415ce40 2023-10-14T12:29:47.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.580+0000 7f17c91eb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17c40d1220 0x7f17c4150550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17c40d1220 0x7f17c4150550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52396/0 (socket says 172.21.15.64:52396) 2023-10-14T12:29:47.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 -- 172.21.15.64:0/3638677901 learned_addr learned my addr 172.21.15.64:0/3638677901 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:47.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c99ec640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c89ea640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c415ca60 0x7f17c40c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 -- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 msgr2=0x7f17c406ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 -- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c415ca60 msgr2=0x7f17c40c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c415ca60 0x7f17c40c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 -- 172.21.15.64:0/3638677901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40094d0 con 0x7f17c40d1220 2023-10-14T12:29:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.581+0000 7f17c91eb640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17c40d1220 0x7f17c4150550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f17c000e7e0 tx=0x7f17c000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:47.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.582+0000 7f17b9ffb640 1 -- 172.21.15.64:0/3638677901 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0004030 con 0x7f17c40d1220 2023-10-14T12:29:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.582+0000 7f17b9ffb640 1 -- 172.21.15.64:0/3638677901 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17c0004190 con 0x7f17c40d1220 2023-10-14T12:29:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.582+0000 7f17b9ffb640 1 -- 172.21.15.64:0/3638677901 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0004520 con 0x7f17c40d1220 2023-10-14T12:29:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.582+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c40ca6e0 con 0x7f17c40d1220 2023-10-14T12:29:47.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.582+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c40ca400 con 0x7f17c40d1220 2023-10-14T12:29:47.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.583+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c404e9b0 con 0x7f17c40d1220 2023-10-14T12:29:47.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.584+0000 7f17b9ffb640 1 -- 172.21.15.64:0/3638677901 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f17c000c6d0 con 0x7f17c40d1220 2023-10-14T12:29:47.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.585+0000 7f17b9ffb640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f17a806ae70 0x7f17a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:47.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.585+0000 7f17b9ffb640 1 -- 172.21.15.64:0/3638677901 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17c0089630 con 0x7f17c40d1220 2023-10-14T12:29:47.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.586+0000 7f17c89ea640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f17a806ae70 0x7f17a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:47.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.587+0000 7f17c89ea640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f17a806ae70 0x7f17a806d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f17b4036000 tx=0x7f17b403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:47.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.590+0000 7f17b9ffb640 1 -- 172.21.15.64:0/3638677901 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f17c00543b0 con 0x7f17c40d1220 2023-10-14T12:29:47.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.784+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17c40cef10 con 0x7f17c40d1220 2023-10-14T12:29:47.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.786+0000 7f17b9ffb640 1 -- 172.21.15.64:0/3638677901 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f17c00579d0 con 0x7f17c40d1220 2023-10-14T12:29:47.789 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:47.789 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:47.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f17a806ae70 msgr2=0x7f17a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f17a806ae70 0x7f17a806d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f17b4036000 tx=0x7f17b403b040 comp rx=0 tx=0).stop 2023-10-14T12:29:47.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17c40d1220 msgr2=0x7f17c4150550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:47.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17c40d1220 0x7f17c4150550 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f17c000e7e0 tx=0x7f17c000eca0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 shutdown_connections 2023-10-14T12:29:47.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f17a806ae70 0x7f17a806d330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17c415ce40 0x7f17c406ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17c415ca60 0x7f17c40c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 --2- 172.21.15.64:0/3638677901 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17c40d1220 0x7f17c4150550 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:47.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.789+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 >> 172.21.15.64:0/3638677901 conn(0x7f17c40d0730 msgr2=0x7f17c415bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:47.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.790+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 shutdown_connections 2023-10-14T12:29:47.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:47.790+0000 7f17ca1ed640 1 -- 172.21.15.64:0/3638677901 wait complete. 2023-10-14T12:29:47.812 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:47.813 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:48.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.037+0000 7fcf2759e640 1 Processor -- start 2023-10-14T12:29:48.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.037+0000 7fcf2759e640 1 -- start start 2023-10-14T12:29:48.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2759e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcf280b1a30 0x7fcf280cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2759e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fcf280d0cd0 0x7fcf280d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf2806ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2759e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2806bf40 con 0x7fcf280b1a30 2023-10-14T12:29:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2759e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf280d1620 con 0x7fcf280d0cd0 2023-10-14T12:29:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280cfc20 con 0x7fcf2806b570 2023-10-14T12:29:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2659c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcf280b1a30 0x7fcf280cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2659c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fcf280b1a30 0x7fcf280cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52410/0 (socket says 172.21.15.64:52410) 2023-10-14T12:29:48.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.038+0000 7fcf2659c640 1 -- 172.21.15.64:0/1055087616 learned_addr learned my addr 172.21.15.64:0/1055087616 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:48.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf2659c640 1 -- 172.21.15.64:0/1055087616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 msgr2=0x7fcf2806ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:48.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf26d9d640 1 --2- 172.21.15.64:0/1055087616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf2806ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf25d9b640 1 --2- 172.21.15.64:0/1055087616 >> v2:172.21.15.177:3300/0 conn(0x7fcf280d0cd0 0x7fcf280d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf2659c640 1 --2- 172.21.15.64:0/1055087616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf2806ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf2659c640 1 -- 172.21.15.64:0/1055087616 >> v2:172.21.15.177:3300/0 conn(0x7fcf280d0cd0 msgr2=0x7fcf280d10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf2659c640 1 --2- 172.21.15.64:0/1055087616 >> v2:172.21.15.177:3300/0 conn(0x7fcf280d0cd0 0x7fcf280d10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf2659c640 1 -- 172.21.15.64:0/1055087616 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280cd4a0 con 0x7fcf280b1a30 2023-10-14T12:29:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf26d9d640 1 --2- 172.21.15.64:0/1055087616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf2806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.039+0000 7fcf25d9b640 1 --2- 172.21.15.64:0/1055087616 >> v2:172.21.15.177:3300/0 conn(0x7fcf280d0cd0 0x7fcf280d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.040+0000 7fcf2659c640 1 --2- 172.21.15.64:0/1055087616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf280cdf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf2808cdf0 tx=0x7fcf1802b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53c977c4d087ca7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.040+0000 7fcf2559a640 1 -- 172.21.15.64:0/1055087616 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18031880 con 0x7fcf280b1a30 2023-10-14T12:29:48.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2559a640 1 -- 172.21.15.64:0/1055087616 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf180319e0 con 0x7fcf280b1a30 2023-10-14T12:29:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2559a640 1 -- 172.21.15.64:0/1055087616 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18031d70 con 0x7fcf280b1a30 2023-10-14T12:29:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 -- 172.21.15.64:0/1055087616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 msgr2=0x7fcf280cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1055087616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf280cdf80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fcf2808cdf0 tx=0x7fcf1802b920 comp rx=0 tx=0).stop 2023-10-14T12:29:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 -- 172.21.15.64:0/1055087616 shutdown_connections 2023-10-14T12:29:48.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1055087616 >> v2:172.21.15.177:3300/0 conn(0x7fcf280d0cd0 0x7fcf280d10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1055087616 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf2806ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1055087616 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf280cdf80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 -- 172.21.15.64:0/1055087616 >> 172.21.15.64:0/1055087616 conn(0x7fcf2808c140 msgr2=0x7fcf2809ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.041+0000 7fcf2759e640 1 -- 172.21.15.64:0/1055087616 shutdown_connections 2023-10-14T12:29:48.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.042+0000 7fcf2759e640 1 -- 172.21.15.64:0/1055087616 wait complete. 2023-10-14T12:29:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.044+0000 7fcf2759e640 1 Processor -- start 2023-10-14T12:29:48.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.044+0000 7fcf2759e640 1 -- start start 2023-10-14T12:29:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.045+0000 7fcf2759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf280b5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.045+0000 7fcf2759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf281ef410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.045+0000 7fcf2759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf280d0cd0 0x7fcf280ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.045+0000 7fcf2759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280b6240 con 0x7fcf280b1a30 2023-10-14T12:29:48.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.045+0000 7fcf2759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280b79f0 con 0x7fcf280d0cd0 2023-10-14T12:29:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.045+0000 7fcf2759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281f3170 con 0x7fcf2806b570 2023-10-14T12:29:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf281ef410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf281ef410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52424/0 (socket says 172.21.15.64:52424) 2023-10-14T12:29:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 -- 172.21.15.64:0/1546211753 learned_addr learned my addr 172.21.15.64:0/1546211753 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:48.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf2659c640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf280b5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf26d9d640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf280d0cd0 0x7fcf280ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 -- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 msgr2=0x7fcf280b5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf280b5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 -- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf280d0cd0 msgr2=0x7fcf280ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf280d0cd0 0x7fcf280ceed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf25d9b640 1 -- 172.21.15.64:0/1546211753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180094d0 con 0x7fcf280b1a30 2023-10-14T12:29:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.046+0000 7fcf2659c640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf280b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.047+0000 7fcf25d9b640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf281ef410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000ce00 tx=0x7fcf1000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.047+0000 7fcf1effd640 1 -- 172.21.15.64:0/1546211753 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000f890 con 0x7fcf280b1a30 2023-10-14T12:29:48.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.047+0000 7fcf1effd640 1 -- 172.21.15.64:0/1546211753 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1000f9f0 con 0x7fcf280b1a30 2023-10-14T12:29:48.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.047+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf281f2590 con 0x7fcf280b1a30 2023-10-14T12:29:48.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.047+0000 7fcf1effd640 1 -- 172.21.15.64:0/1546211753 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1000fdc0 con 0x7fcf280b1a30 2023-10-14T12:29:48.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.047+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf281f2b50 con 0x7fcf280b1a30 2023-10-14T12:29:48.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.048+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2804e9b0 con 0x7fcf280b1a30 2023-10-14T12:29:48.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.049+0000 7fcf1effd640 1 -- 172.21.15.64:0/1546211753 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fcf1000b040 con 0x7fcf280b1a30 2023-10-14T12:29:48.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.050+0000 7fcf1effd640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf0806aea0 0x7fcf0806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.050+0000 7fcf1effd640 1 -- 172.21.15.64:0/1546211753 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf1008a3f0 con 0x7fcf280b1a30 2023-10-14T12:29:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.051+0000 7fcf2659c640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf0806aea0 0x7fcf0806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.052+0000 7fcf2659c640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf0806aea0 0x7fcf0806d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf1803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.054+0000 7fcf1effd640 1 -- 172.21.15.64:0/1546211753 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fcf10055040 con 0x7fcf280b1a30 2023-10-14T12:29:48.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.245+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf280d3120 con 0x7fcf280b1a30 2023-10-14T12:29:48.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.246+0000 7fcf1effd640 1 -- 172.21.15.64:0/1546211753 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf10058660 con 0x7fcf280b1a30 2023-10-14T12:29:48.248 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:48.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf0806aea0 msgr2=0x7fcf0806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf0806aea0 0x7fcf0806d360 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf18036000 tx=0x7fcf1803c040 comp rx=0 tx=0).stop 2023-10-14T12:29:48.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 msgr2=0x7fcf281ef410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf281ef410 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000ce00 tx=0x7fcf1000a650 comp rx=0 tx=0).stop 2023-10-14T12:29:48.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 shutdown_connections 2023-10-14T12:29:48.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fcf0806aea0 0x7fcf0806d360 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fcf280d0cd0 0x7fcf280ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fcf280b1a30 0x7fcf281ef410 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 --2- 172.21.15.64:0/1546211753 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fcf2806b570 0x7fcf280b5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 >> 172.21.15.64:0/1546211753 conn(0x7fcf2808c140 msgr2=0x7fcf280b3a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:48.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 shutdown_connections 2023-10-14T12:29:48.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.249+0000 7fcf2759e640 1 -- 172.21.15.64:0/1546211753 wait complete. 2023-10-14T12:29:48.270 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:48.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.499+0000 7f139f48a640 1 Processor -- start 2023-10-14T12:29:48.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.499+0000 7f139f48a640 1 -- start start 2023-10-14T12:29:48.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.500+0000 7f139f48a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f13980cf030 0x7f139806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.500+0000 7f139f48a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f139806d360 0x7f13980ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.500+0000 7f139f48a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13981550f0 con 0x7f1398154d10 2023-10-14T12:29:48.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.500+0000 7f139f48a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f139806db50 con 0x7f13980cf030 2023-10-14T12:29:48.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.500+0000 7f139f48a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13980b13f0 con 0x7f139806d360 2023-10-14T12:29:48.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139e488640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1398154d10 0x7f13980ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47772/0 (socket says 172.21.15.64:47772) 2023-10-14T12:29:48.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139e488640 1 -- 172.21.15.64:0/2544690993 learned_addr learned my addr 172.21.15.64:0/2544690993 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:48.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139dc87640 1 --2- 172.21.15.64:0/2544690993 >> v2:172.21.15.64:3300/0 conn(0x7f13980cf030 0x7f139806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139ec89640 1 --2- 172.21.15.64:0/2544690993 >> v2:172.21.15.177:3300/0 conn(0x7f139806d360 0x7f13980ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139dc87640 1 -- 172.21.15.64:0/2544690993 >> v2:172.21.15.177:3300/0 conn(0x7f139806d360 msgr2=0x7f13980ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:48.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139dc87640 1 --2- 172.21.15.64:0/2544690993 >> v2:172.21.15.177:3300/0 conn(0x7f139806d360 0x7f13980ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139dc87640 1 -- 172.21.15.64:0/2544690993 >> v1:172.21.15.64:6789/0 conn(0x7f1398154d10 legacy=0x7f13980ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.501+0000 7f139dc87640 1 -- 172.21.15.64:0/2544690993 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980b16d0 con 0x7f13980cf030 2023-10-14T12:29:48.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.502+0000 7f139dc87640 1 --2- 172.21.15.64:0/2544690993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13980cf030 0x7f139806ce20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f139806c090 tx=0x7f138802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eae3765c4b5f914 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139d486640 1 -- 172.21.15.64:0/2544690993 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388031830 con 0x7f13980cf030 2023-10-14T12:29:48.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139d486640 1 -- 172.21.15.64:0/2544690993 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1388031990 con 0x7f13980cf030 2023-10-14T12:29:48.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139d486640 1 -- 172.21.15.64:0/2544690993 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1388031d20 con 0x7f13980cf030 2023-10-14T12:29:48.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139f48a640 1 -- 172.21.15.64:0/2544690993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13980cf030 msgr2=0x7f139806ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139f48a640 1 --2- 172.21.15.64:0/2544690993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13980cf030 0x7f139806ce20 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f139806c090 tx=0x7f138802b8d0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139f48a640 1 -- 172.21.15.64:0/2544690993 shutdown_connections 2023-10-14T12:29:48.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139f48a640 1 --2- 172.21.15.64:0/2544690993 >> v2:172.21.15.177:3300/0 conn(0x7f139806d360 0x7f13980ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139f48a640 1 --2- 172.21.15.64:0/2544690993 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f13980cf030 0x7f139806ce20 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.503+0000 7f139f48a640 1 -- 172.21.15.64:0/2544690993 >> 172.21.15.64:0/2544690993 conn(0x7f139806a200 msgr2=0x7f139806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:48.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.504+0000 7f139f48a640 1 -- 172.21.15.64:0/2544690993 shutdown_connections 2023-10-14T12:29:48.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.504+0000 7f139f48a640 1 -- 172.21.15.64:0/2544690993 wait complete. 2023-10-14T12:29:48.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.505+0000 7f139f48a640 1 Processor -- start 2023-10-14T12:29:48.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.506+0000 7f139f48a640 1 -- start start 2023-10-14T12:29:48.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.506+0000 7f139f48a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139806d360 0x7f1398071660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.506+0000 7f139f48a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13980cf030 0x7f13981f17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.506+0000 7f139f48a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1398154d10 0x7f13980ae600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.506+0000 7f139f48a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1398071ba0 con 0x7f139806d360 2023-10-14T12:29:48.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139f48a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13980700e0 con 0x7f13980cf030 2023-10-14T12:29:48.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139f48a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13980703c0 con 0x7f1398154d10 2023-10-14T12:29:48.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139806d360 0x7f1398071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139806d360 0x7f1398071660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52436/0 (socket says 172.21.15.64:52436) 2023-10-14T12:29:48.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 -- 172.21.15.64:0/303554118 learned_addr learned my addr 172.21.15.64:0/303554118 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:48.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139ec89640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1398154d10 0x7f13980ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 -- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1398154d10 msgr2=0x7f13980ae600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139dc87640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13980cf030 0x7f13981f17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1398154d10 0x7f13980ae600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 -- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13980cf030 msgr2=0x7f13981f17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13980cf030 0x7f13981f17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139e488640 1 -- 172.21.15.64:0/303554118 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388009400 con 0x7f139806d360 2023-10-14T12:29:48.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.507+0000 7f139ec89640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1398154d10 0x7f13980ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:48.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.508+0000 7f139e488640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139806d360 0x7f1398071660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f139400c4a0 tx=0x7f139400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.508+0000 7f138effd640 1 -- 172.21.15.64:0/303554118 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394005ce0 con 0x7f139806d360 2023-10-14T12:29:48.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.508+0000 7f138effd640 1 -- 172.21.15.64:0/303554118 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394005e40 con 0x7f139806d360 2023-10-14T12:29:48.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.508+0000 7f138effd640 1 -- 172.21.15.64:0/303554118 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394007270 con 0x7f139806d360 2023-10-14T12:29:48.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.508+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13980706a0 con 0x7f139806d360 2023-10-14T12:29:48.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.508+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1398070c60 con 0x7f139806d360 2023-10-14T12:29:48.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.510+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1398070e50 con 0x7f139806d360 2023-10-14T12:29:48.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.510+0000 7f138effd640 1 -- 172.21.15.64:0/303554118 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1394007490 con 0x7f139806d360 2023-10-14T12:29:48.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.511+0000 7f138effd640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f137c06ae70 0x7f137c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.511+0000 7f138effd640 1 -- 172.21.15.64:0/303554118 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1394088d80 con 0x7f139806d360 2023-10-14T12:29:48.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.512+0000 7f139dc87640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f137c06ae70 0x7f137c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.513+0000 7f139dc87640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f137c06ae70 0x7f137c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1388036000 tx=0x7f1388008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.516+0000 7f138effd640 1 -- 172.21.15.64:0/303554118 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1394053bb0 con 0x7f139806d360 2023-10-14T12:29:48.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.707+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f139804e9b0 con 0x7f139806d360 2023-10-14T12:29:48.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.708+0000 7f138effd640 1 -- 172.21.15.64:0/303554118 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f13940170a0 con 0x7f139806d360 2023-10-14T12:29:48.710 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:48.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f137c06ae70 msgr2=0x7f137c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f137c06ae70 0x7f137c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1388036000 tx=0x7f1388008030 comp rx=0 tx=0).stop 2023-10-14T12:29:48.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139806d360 msgr2=0x7f1398071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.714 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139806d360 0x7f1398071660 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f139400c4a0 tx=0x7f139400c960 comp rx=0 tx=0).stop 2023-10-14T12:29:48.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 shutdown_connections 2023-10-14T12:29:48.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f137c06ae70 0x7f137c06d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1398154d10 0x7f13980ae600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f13980cf030 0x7f13981f17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.715 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 --2- 172.21.15.64:0/303554118 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f139806d360 0x7f1398071660 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 >> 172.21.15.64:0/303554118 conn(0x7f139806a200 msgr2=0x7f1398152e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 shutdown_connections 2023-10-14T12:29:48.716 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.712+0000 7f139f48a640 1 -- 172.21.15.64:0/303554118 wait complete. 2023-10-14T12:29:48.732 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:48.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.949+0000 7f58e08c3640 1 Processor -- start 2023-10-14T12:29:48.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.950+0000 7f58e08c3640 1 -- start start 2023-10-14T12:29:48.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.951+0000 7f58e08c3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 0x7f58dc06d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.951+0000 7f58e08c3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc1550f0 con 0x7f58dc0cf030 2023-10-14T12:29:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.951+0000 7f58e08c3640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58dc06db50 con 0x7f58dc154d10 2023-10-14T12:29:48.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.951+0000 7f58e08c3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0b13f0 con 0x7f58dc0b2ee0 2023-10-14T12:29:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.951+0000 7f58d3fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f58dc0cf030 0x7f58dc06ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47788/0 (socket says 172.21.15.64:47788) 2023-10-14T12:29:48.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.951+0000 7f58d3fff640 1 -- 172.21.15.64:0/2342822183 learned_addr learned my addr 172.21.15.64:0/2342822183 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:48.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58dbfff640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 0x7f58dc06d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2392133478 0 0) 0x7f58dc1550f0 con 0x7f58dc0cf030 2023-10-14T12:29:48.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58c8003520 con 0x7f58dc0cf030 2023-10-14T12:29:48.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1002543234 0 0) 0x7f58c8003520 con 0x7f58dc0cf030 2023-10-14T12:29:48.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 msgr2=0x7f58dc06d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:48.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 0x7f58dc06d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 >> v1:172.21.15.177:6789/0 conn(0x7f58dc154d10 legacy=0x7f58dc0ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc0b16d0 con 0x7f58dc0cf030 2023-10-14T12:29:48.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f58c4001670 con 0x7f58dc0cf030 2023-10-14T12:29:48.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.952+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 >> v1:172.21.15.64:6789/0 conn(0x7f58dc0cf030 legacy=0x7f58dc06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58daffd640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58c8003a10 0x7f58c8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58daffd640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58daffd640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 0x7f58c80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0b13f0 con 0x7f58c80047c0 2023-10-14T12:29:48.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c800bb40 con 0x7f58c8003a10 2023-10-14T12:29:48.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c800bd00 con 0x7f58dc0b2ee0 2023-10-14T12:29:48.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58d3fff640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58db7fe640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58c8003a10 0x7f58c8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58dbfff640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 0x7f58c80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58d3fff640 1 -- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 msgr2=0x7f58c80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:48.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.953+0000 7f58d3fff640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0b2ee0 0x7f58c80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.954+0000 7f58d3fff640 1 -- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58c8003a10 msgr2=0x7f58c8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:48.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.954+0000 7f58d3fff640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58c8003a10 0x7f58c8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.954+0000 7f58d3fff640 1 -- 172.21.15.64:0/2342822183 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c8003520 con 0x7f58c80047c0 2023-10-14T12:29:48.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.955+0000 7f58d3fff640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58c8004c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c0e0 tx=0x7f58c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e99f9a9636eb96 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.955+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4005ad0 con 0x7f58c80047c0 2023-10-14T12:29:48.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.955+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c4005c30 con 0x7f58c80047c0 2023-10-14T12:29:48.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.955+0000 7f58daffd640 1 -- 172.21.15.64:0/2342822183 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c402c810 con 0x7f58c80047c0 2023-10-14T12:29:48.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.956+0000 7f58e08c3640 1 -- 172.21.15.64:0/2342822183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 msgr2=0x7f58c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.956+0000 7f58e08c3640 1 --2- 172.21.15.64:0/2342822183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58c8004c40 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c0e0 tx=0x7f58c80057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.956+0000 7f58dbfff640 1 -- 172.21.15.64:0/2342822183 reap_dead start 2023-10-14T12:29:48.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.956+0000 7f58e08c3640 1 -- 172.21.15.64:0/2342822183 shutdown_connections 2023-10-14T12:29:48.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.956+0000 7f58e08c3640 1 -- 172.21.15.64:0/2342822183 >> 172.21.15.64:0/2342822183 conn(0x7f58dc06a200 msgr2=0x7f58dc06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:48.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.956+0000 7f58e08c3640 1 -- 172.21.15.64:0/2342822183 shutdown_connections 2023-10-14T12:29:48.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.956+0000 7f58e08c3640 1 -- 172.21.15.64:0/2342822183 wait complete. 2023-10-14T12:29:48.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.958+0000 7f58e08c3640 1 Processor -- start 2023-10-14T12:29:48.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.958+0000 7f58e08c3640 1 -- start start 2023-10-14T12:29:48.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58e08c3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58dc1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58e08c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58dc071360 0x7f58dc0717e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58e08c3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0bcc00 0x7f58dc0bd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58e08c3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc071d20 con 0x7f58c80047c0 2023-10-14T12:29:48.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58e08c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0ae210 con 0x7f58dc071360 2023-10-14T12:29:48.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58e08c3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58dc0ae4f0 con 0x7f58dc0bcc00 2023-10-14T12:29:48.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58dc1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58db7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58dc1550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52464/0 (socket says 172.21.15.64:52464) 2023-10-14T12:29:48.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58db7fe640 1 -- 172.21.15.64:0/1831613698 learned_addr learned my addr 172.21.15.64:0/1831613698 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:48.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58db7fe640 1 -- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0bcc00 msgr2=0x7f58dc0bd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.959+0000 7f58db7fe640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0bcc00 0x7f58dc0bd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58db7fe640 1 -- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58dc071360 msgr2=0x7f58dc0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:48.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58db7fe640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58dc071360 0x7f58dc0717e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:48.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58db7fe640 1 -- 172.21.15.64:0/1831613698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58dc1579a0 con 0x7f58c80047c0 2023-10-14T12:29:48.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58db7fe640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58dc1550f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00e4d0 tx=0x7f58cc00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58d8ff9640 1 -- 172.21.15.64:0/1831613698 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc0052e0 con 0x7f58c80047c0 2023-10-14T12:29:48.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58d8ff9640 1 -- 172.21.15.64:0/1831613698 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58cc005440 con 0x7f58c80047c0 2023-10-14T12:29:48.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58dc157c80 con 0x7f58c80047c0 2023-10-14T12:29:48.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58d8ff9640 1 -- 172.21.15.64:0/1831613698 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58cc003810 con 0x7f58c80047c0 2023-10-14T12:29:48.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.960+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58dc0ba920 con 0x7f58c80047c0 2023-10-14T12:29:48.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.961+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58dc04e9b0 con 0x7f58c80047c0 2023-10-14T12:29:48.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.962+0000 7f58d8ff9640 1 -- 172.21.15.64:0/1831613698 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f58cc003970 con 0x7f58c80047c0 2023-10-14T12:29:48.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.963+0000 7f58d8ff9640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f58bc06aea0 0x7f58bc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:48.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.963+0000 7f58d8ff9640 1 -- 172.21.15.64:0/1831613698 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f58cc0896b0 con 0x7f58c80047c0 2023-10-14T12:29:48.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.964+0000 7f58d3fff640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f58bc06aea0 0x7f58bc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:48.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.965+0000 7f58d3fff640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f58bc06aea0 0x7f58bc06d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f58c4034000 tx=0x7f58c4007000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:48.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:48.967+0000 7f58d8ff9640 1 -- 172.21.15.64:0/1831613698 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f58cc054390 con 0x7f58c80047c0 2023-10-14T12:29:49.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.158+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58dc0b09a0 con 0x7f58c80047c0 2023-10-14T12:29:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.159+0000 7f58d8ff9640 1 -- 172.21.15.64:0/1831613698 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58cc0579b0 con 0x7f58c80047c0 2023-10-14T12:29:49.162 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:49.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.162+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f58bc06aea0 msgr2=0x7f58bc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.162+0000 7f58e08c3640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f58bc06aea0 0x7f58bc06d360 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f58c4034000 tx=0x7f58c4007000 comp rx=0 tx=0).stop 2023-10-14T12:29:49.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.162+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 msgr2=0x7f58dc1550f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.162+0000 7f58e08c3640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58dc1550f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f58cc00e4d0 tx=0x7f58cc00e990 comp rx=0 tx=0).stop 2023-10-14T12:29:49.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.162+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 shutdown_connections 2023-10-14T12:29:49.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.162+0000 7f58e08c3640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f58bc06aea0 0x7f58bc06d360 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.163+0000 7f58e08c3640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f58dc0bcc00 0x7f58dc0bd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.163+0000 7f58e08c3640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f58dc071360 0x7f58dc0717e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.163+0000 7f58e08c3640 1 --2- 172.21.15.64:0/1831613698 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f58c80047c0 0x7f58dc1550f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.163+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 >> 172.21.15.64:0/1831613698 conn(0x7f58dc06a200 msgr2=0x7f58dc0ce8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:49.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.163+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 shutdown_connections 2023-10-14T12:29:49.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.163+0000 7f58e08c3640 1 -- 172.21.15.64:0/1831613698 wait complete. 2023-10-14T12:29:49.183 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:49.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.406+0000 7fd79ffff640 1 Processor -- start 2023-10-14T12:29:49.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.406+0000 7fd79ffff640 1 -- start start 2023-10-14T12:29:49.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.408+0000 7fd79ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7a00d0d80 0x7fd7a00d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.408+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 0x7fd7a00b6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.408+0000 7fd79ffff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a00ce810 con 0x7fd7a015c940 2023-10-14T12:29:49.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.408+0000 7fd79ffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a00d1740 con 0x7fd7a00d0d80 2023-10-14T12:29:49.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.408+0000 7fd79ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00b5b40 con 0x7fd7a00b5fd0 2023-10-14T12:29:49.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79effd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd7a015c940 0x7fd7a00d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47802/0 (socket says 172.21.15.64:47802) 2023-10-14T12:29:49.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79effd640 1 -- 172.21.15.64:0/2708397282 learned_addr learned my addr 172.21.15.64:0/2708397282 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:49.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79f7fe640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 0x7fd7a00b6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79e7fc640 1 --2- 172.21.15.64:0/2708397282 >> v2:172.21.15.177:3300/0 conn(0x7fd7a00d0d80 0x7fd7a00d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3707226491 0 0) 0x7fd7a00ce810 con 0x7fd7a015c940 2023-10-14T12:29:49.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd78c003520 con 0x7fd7a015c940 2023-10-14T12:29:49.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238862258 0 0) 0x7fd78c003520 con 0x7fd7a015c940 2023-10-14T12:29:49.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 msgr2=0x7fd7a00b6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:49.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79dffb640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 0x7fd7a00b6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 >> v2:172.21.15.177:3300/0 conn(0x7fd7a00d0d80 msgr2=0x7fd7a00d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:49.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.409+0000 7fd79dffb640 1 --2- 172.21.15.64:0/2708397282 >> v2:172.21.15.177:3300/0 conn(0x7fd7a00d0d80 0x7fd7a00d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00d0b10 con 0x7fd7a015c940 2023-10-14T12:29:49.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fd790001670 con 0x7fd7a015c940 2023-10-14T12:29:49.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 >> v1:172.21.15.64:6789/0 conn(0x7fd7a015c940 legacy=0x7fd7a00d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 0x7fd78c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd78c003f60 0x7fd78c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd78c004d00 0x7fd78c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00d1740 con 0x7fd78c004d00 2023-10-14T12:29:49.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00b5b40 con 0x7fd78c003f60 2023-10-14T12:29:49.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd78c00ba30 con 0x7fd7a00b5fd0 2023-10-14T12:29:49.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79f7fe640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd78c004d00 0x7fd78c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79effd640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 0x7fd78c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79f7fe640 1 -- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 msgr2=0x7fd78c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:49.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79f7fe640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a00b5fd0 0x7fd78c0039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79e7fc640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd78c003f60 0x7fd78c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.410+0000 7fd79f7fe640 1 -- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd78c003f60 msgr2=0x7fd78c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.411+0000 7fd79f7fe640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd78c003f60 0x7fd78c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.411+0000 7fd79f7fe640 1 -- 172.21.15.64:0/2708397282 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c003520 con 0x7fd78c004d00 2023-10-14T12:29:49.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.411+0000 7fd79e7fc640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd78c003f60 0x7fd78c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:49.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.412+0000 7fd79f7fe640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd78c004d00 0x7fd78c005180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd798009ac0 tx=0x7fd78c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7107cf19ad3966 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:49.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.412+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79802c6b0 con 0x7fd78c004d00 2023-10-14T12:29:49.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.412+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd79802c810 con 0x7fd78c004d00 2023-10-14T12:29:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.412+0000 7fd79dffb640 1 -- 172.21.15.64:0/2708397282 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79802cba0 con 0x7fd78c004d00 2023-10-14T12:29:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.413+0000 7fd79ffff640 1 -- 172.21.15.64:0/2708397282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd78c004d00 msgr2=0x7fd78c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.413+0000 7fd79ffff640 1 --2- 172.21.15.64:0/2708397282 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd78c004d00 0x7fd78c005180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd798009ac0 tx=0x7fd78c0057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.413+0000 7fd79f7fe640 1 -- 172.21.15.64:0/2708397282 reap_dead start 2023-10-14T12:29:49.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.413+0000 7fd79ffff640 1 -- 172.21.15.64:0/2708397282 shutdown_connections 2023-10-14T12:29:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.413+0000 7fd79ffff640 1 -- 172.21.15.64:0/2708397282 >> 172.21.15.64:0/2708397282 conn(0x7fd7a009bb30 msgr2=0x7fd7a00d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.413+0000 7fd79ffff640 1 -- 172.21.15.64:0/2708397282 shutdown_connections 2023-10-14T12:29:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.413+0000 7fd79ffff640 1 -- 172.21.15.64:0/2708397282 wait complete. 2023-10-14T12:29:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.415+0000 7fd79ffff640 1 Processor -- start 2023-10-14T12:29:49.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.415+0000 7fd79ffff640 1 -- start start 2023-10-14T12:29:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a00cb690 0x7fd7a0156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a00cba70 0x7fd7a0158cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a009c4a0 0x7fd7a00c8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79ffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a0159200 con 0x7fd7a00cba70 2023-10-14T12:29:49.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79ffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00c7be0 con 0x7fd7a00cb690 2023-10-14T12:29:49.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a00c7ec0 con 0x7fd7a009c4a0 2023-10-14T12:29:49.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79e7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a00cba70 0x7fd7a0158cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79e7fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a00cba70 0x7fd7a0158cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52482/0 (socket says 172.21.15.64:52482) 2023-10-14T12:29:49.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.416+0000 7fd79e7fc640 1 -- 172.21.15.64:0/781963950 learned_addr learned my addr 172.21.15.64:0/781963950 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:49.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd79e7fc640 1 -- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a009c4a0 msgr2=0x7fd7a00c8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd79e7fc640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a009c4a0 0x7fd7a00c8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd79e7fc640 1 -- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a00cb690 msgr2=0x7fd7a0156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd79e7fc640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a00cb690 0x7fd7a0156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd79e7fc640 1 -- 172.21.15.64:0/781963950 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a00c81a0 con 0x7fd7a00cba70 2023-10-14T12:29:49.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd79e7fc640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a00cba70 0x7fd7a0158cc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd78800f3d0 tx=0x7fd78800f890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:49.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd7977fe640 1 -- 172.21.15.64:0/781963950 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78801a070 con 0x7fd7a00cba70 2023-10-14T12:29:49.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd7977fe640 1 -- 172.21.15.64:0/781963950 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd788003990 con 0x7fd7a00cba70 2023-10-14T12:29:49.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a00c8480 con 0x7fd7a00cba70 2023-10-14T12:29:49.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.417+0000 7fd7977fe640 1 -- 172.21.15.64:0/781963950 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd788003d00 con 0x7fd7a00cba70 2023-10-14T12:29:49.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.418+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a009c920 con 0x7fd7a00cba70 2023-10-14T12:29:49.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.419+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a004e9b0 con 0x7fd7a00cba70 2023-10-14T12:29:49.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.420+0000 7fd7977fe640 1 -- 172.21.15.64:0/781963950 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd788004020 con 0x7fd7a00cba70 2023-10-14T12:29:49.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.421+0000 7fd7977fe640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd78006aea0 0x7fd78006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.421+0000 7fd7977fe640 1 -- 172.21.15.64:0/781963950 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd78808a4f0 con 0x7fd7a00cba70 2023-10-14T12:29:49.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.421+0000 7fd79effd640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd78006aea0 0x7fd78006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.422+0000 7fd79effd640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd78006aea0 0x7fd78006d360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd790001eb0 tx=0x7fd790001dc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:49.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.425+0000 7fd7977fe640 1 -- 172.21.15.64:0/781963950 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd788055270 con 0x7fd7a00cba70 2023-10-14T12:29:49.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.618+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd7a00a04e0 con 0x7fd7a00cba70 2023-10-14T12:29:49.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.618+0000 7fd7977fe640 1 -- 172.21.15.64:0/781963950 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd788003e60 con 0x7fd7a00cba70 2023-10-14T12:29:49.620 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:49.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd78006aea0 msgr2=0x7fd78006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd78006aea0 0x7fd78006d360 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd790001eb0 tx=0x7fd790001dc0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a00cba70 msgr2=0x7fd7a0158cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a00cba70 0x7fd7a0158cc0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd78800f3d0 tx=0x7fd78800f890 comp rx=0 tx=0).stop 2023-10-14T12:29:49.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 shutdown_connections 2023-10-14T12:29:49.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd78006aea0 0x7fd78006d360 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7a009c4a0 0x7fd7a00c8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7a00cba70 0x7fd7a0158cc0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 --2- 172.21.15.64:0/781963950 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7a00cb690 0x7fd7a0156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.621+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 >> 172.21.15.64:0/781963950 conn(0x7fd7a009bb30 msgr2=0x7fd7a006c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:49.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.622+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 shutdown_connections 2023-10-14T12:29:49.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.622+0000 7fd79ffff640 1 -- 172.21.15.64:0/781963950 wait complete. 2023-10-14T12:29:49.644 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-14T12:29:49.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.876+0000 7fd0c676e640 1 Processor -- start 2023-10-14T12:29:49.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.876+0000 7fd0c676e640 1 -- start start 2023-10-14T12:29:49.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.878+0000 7fd0c676e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd0c015c9d0 0x7fd0c00cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.878+0000 7fd0c676e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0c00d16a0 0x7fd0c00cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.878+0000 7fd0c676e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c00b2f90 con 0x7fd0c00ce4d0 2023-10-14T12:29:49.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.878+0000 7fd0c676e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00d0320 con 0x7fd0c00d16a0 2023-10-14T12:29:49.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.878+0000 7fd0c676e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c00d0600 con 0x7fd0c015c9d0 2023-10-14T12:29:49.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c4f6b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0c00d16a0 0x7fd0c00cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c4f6b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd0c00d16a0 0x7fd0c00cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52486/0 (socket says 172.21.15.64:52486) 2023-10-14T12:29:49.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c4f6b640 1 -- 172.21.15.64:0/1506551550 learned_addr learned my addr 172.21.15.64:0/1506551550 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:49.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c576c640 1 --2- 172.21.15.64:0/1506551550 >> v2:172.21.15.177:3300/0 conn(0x7fd0c015c9d0 0x7fd0c00cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c4f6b640 1 -- 172.21.15.64:0/1506551550 >> v2:172.21.15.177:3300/0 conn(0x7fd0c015c9d0 msgr2=0x7fd0c00cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:49.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c4f6b640 1 --2- 172.21.15.64:0/1506551550 >> v2:172.21.15.177:3300/0 conn(0x7fd0c015c9d0 0x7fd0c00cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c4f6b640 1 -- 172.21.15.64:0/1506551550 >> v1:172.21.15.177:6789/0 conn(0x7fd0c00ce4d0 legacy=0x7fd0c0160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:49.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c4f6b640 1 -- 172.21.15.64:0/1506551550 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c00d08e0 con 0x7fd0c00d16a0 2023-10-14T12:29:49.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.879+0000 7fd0c576c640 1 --2- 172.21.15.64:0/1506551550 >> v2:172.21.15.177:3300/0 conn(0x7fd0c015c9d0 0x7fd0c00cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:49.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.880+0000 7fd0c4f6b640 1 --2- 172.21.15.64:0/1506551550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c00d16a0 0x7fd0c00cf140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00d26b0 tx=0x7fd0b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98d8bb1996668a32 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:49.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0b7fff640 1 -- 172.21.15.64:0/1506551550 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0031870 con 0x7fd0c00d16a0 2023-10-14T12:29:49.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0b7fff640 1 -- 172.21.15.64:0/1506551550 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b00319d0 con 0x7fd0c00d16a0 2023-10-14T12:29:49.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0b7fff640 1 -- 172.21.15.64:0/1506551550 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0031d60 con 0x7fd0c00d16a0 2023-10-14T12:29:49.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 -- 172.21.15.64:0/1506551550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c00d16a0 msgr2=0x7fd0c00cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 --2- 172.21.15.64:0/1506551550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c00d16a0 0x7fd0c00cf140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd0c00d26b0 tx=0x7fd0b002b910 comp rx=0 tx=0).stop 2023-10-14T12:29:49.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 -- 172.21.15.64:0/1506551550 shutdown_connections 2023-10-14T12:29:49.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 --2- 172.21.15.64:0/1506551550 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c00d16a0 0x7fd0c00cf140 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 --2- 172.21.15.64:0/1506551550 >> v2:172.21.15.177:3300/0 conn(0x7fd0c015c9d0 0x7fd0c00cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 -- 172.21.15.64:0/1506551550 >> 172.21.15.64:0/1506551550 conn(0x7fd0c009bad0 msgr2=0x7fd0c00d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:49.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 -- 172.21.15.64:0/1506551550 shutdown_connections 2023-10-14T12:29:49.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.881+0000 7fd0c676e640 1 -- 172.21.15.64:0/1506551550 wait complete. 2023-10-14T12:29:49.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.883+0000 7fd0c676e640 1 Processor -- start 2023-10-14T12:29:49.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.883+0000 7fd0c676e640 1 -- start start 2023-10-14T12:29:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.884+0000 7fd0c676e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c00ce4d0 0x7fd0c00cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.884+0000 7fd0c676e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0c00d16a0 0x7fd0c0156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.884+0000 7fd0c676e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c015c9d0 0x7fd0c00b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.884+0000 7fd0c676e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0156a60 con 0x7fd0c015c9d0 2023-10-14T12:29:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.884+0000 7fd0c676e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00cc270 con 0x7fd0c00ce4d0 2023-10-14T12:29:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.884+0000 7fd0c676e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c00cb660 con 0x7fd0c00d16a0 2023-10-14T12:29:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c015c9d0 0x7fd0c00b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c015c9d0 0x7fd0c00b7eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52492/0 (socket says 172.21.15.64:52492) 2023-10-14T12:29:49.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 -- 172.21.15.64:0/2210873429 learned_addr learned my addr 172.21.15.64:0/2210873429 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:49.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c4f6b640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0c00d16a0 0x7fd0c0156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c576c640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c00ce4d0 0x7fd0c00cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 -- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0c00d16a0 msgr2=0x7fd0c0156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0c00d16a0 0x7fd0c0156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 -- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c00ce4d0 msgr2=0x7fd0c00cc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c00ce4d0 0x7fd0c00cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.885+0000 7fd0c5f6d640 1 -- 172.21.15.64:0/2210873429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00094d0 con 0x7fd0c015c9d0 2023-10-14T12:29:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.886+0000 7fd0c5f6d640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c015c9d0 0x7fd0c00b7eb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c780 tx=0x7fd0b800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.886+0000 7fd0b5ffb640 1 -- 172.21.15.64:0/2210873429 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8004b60 con 0x7fd0c015c9d0 2023-10-14T12:29:49.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.886+0000 7fd0b5ffb640 1 -- 172.21.15.64:0/2210873429 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b800ce90 con 0x7fd0c015c9d0 2023-10-14T12:29:49.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.886+0000 7fd0b5ffb640 1 -- 172.21.15.64:0/2210873429 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b800a7f0 con 0x7fd0c015c9d0 2023-10-14T12:29:49.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.886+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c00cb940 con 0x7fd0c015c9d0 2023-10-14T12:29:49.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.886+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c00cbf00 con 0x7fd0c015c9d0 2023-10-14T12:29:49.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.887+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0c004e9b0 con 0x7fd0c015c9d0 2023-10-14T12:29:49.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.888+0000 7fd0b5ffb640 1 -- 172.21.15.64:0/2210873429 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd0b800a950 con 0x7fd0c015c9d0 2023-10-14T12:29:49.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.889+0000 7fd0b5ffb640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0a406aea0 0x7fd0a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:49.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.889+0000 7fd0b5ffb640 1 -- 172.21.15.64:0/2210873429 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd0b8089ba0 con 0x7fd0c015c9d0 2023-10-14T12:29:49.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.890+0000 7fd0c576c640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0a406aea0 0x7fd0a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:49.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.891+0000 7fd0c576c640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0a406aea0 0x7fd0a406d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00b840 tx=0x7fd0bc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:49.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:49.894+0000 7fd0b5ffb640 1 -- 172.21.15.64:0/2210873429 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd0b80547f0 con 0x7fd0c015c9d0 2023-10-14T12:29:50.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.162+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fd0c006c950 con 0x7fd0c015c9d0 2023-10-14T12:29:50.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.851+0000 7fd0b5ffb640 1 -- 172.21.15.64:0/2210873429 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v77) v1 ==== 147+0+0 (secure 0 0 0) 0x7fd0b8057e10 con 0x7fd0c015c9d0 2023-10-14T12:29:50.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0a406aea0 msgr2=0x7fd0a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:50.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0a406aea0 0x7fd0a406d360 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00b840 tx=0x7fd0bc008040 comp rx=0 tx=0).stop 2023-10-14T12:29:50.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c015c9d0 msgr2=0x7fd0c00b7eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:50.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c015c9d0 0x7fd0c00b7eb0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd0b800c780 tx=0x7fd0b800cc40 comp rx=0 tx=0).stop 2023-10-14T12:29:50.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 shutdown_connections 2023-10-14T12:29:50.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd0a406aea0 0x7fd0a406d360 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:50.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd0c015c9d0 0x7fd0c00b7eb0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:50.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd0c00d16a0 0x7fd0c0156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:50.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 --2- 172.21.15.64:0/2210873429 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd0c00ce4d0 0x7fd0c00cc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:50.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 >> 172.21.15.64:0/2210873429 conn(0x7fd0c009bad0 msgr2=0x7fd0c01604c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:50.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 shutdown_connections 2023-10-14T12:29:50.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:50.855+0000 7fd0c676e640 1 -- 172.21.15.64:0/2210873429 wait complete. 2023-10-14T12:29:50.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-14T12:29:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.102+0000 7f63acf3c640 1 Processor -- start 2023-10-14T12:29:51.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.102+0000 7f63acf3c640 1 -- start start 2023-10-14T12:29:51.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f63acf3c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f63a80cdf50 0x7f63a80ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f63acf3c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a80cee60 0x7f63a8070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f63acf3c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63a80cf2b0 con 0x7f63a815c8e0 2023-10-14T12:29:51.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f63acf3c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63a806df90 con 0x7f63a80cdf50 2023-10-14T12:29:51.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f63acf3c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a80cdac0 con 0x7f63a80cee60 2023-10-14T12:29:51.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f63a77fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f63a815c8e0 0x7f63a806d230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47812/0 (socket says 172.21.15.64:47812) 2023-10-14T12:29:51.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f63a77fe640 1 -- 172.21.15.64:0/2314734846 learned_addr learned my addr 172.21.15.64:0/2314734846 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.104+0000 7f639ffff640 1 --2- 172.21.15.64:0/2314734846 >> v2:172.21.15.64:3300/0 conn(0x7f63a80cdf50 0x7f63a80ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f63a7fff640 1 --2- 172.21.15.64:0/2314734846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a80cee60 0x7f63a8070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f63a6ffd640 1 -- 172.21.15.64:0/2314734846 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574689365 0 0) 0x7f6398001110 con 0x7f63a815c8e0 2023-10-14T12:29:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f63a6ffd640 1 -- 172.21.15.64:0/2314734846 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6394003520 con 0x7f63a815c8e0 2023-10-14T12:29:51.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f639ffff640 1 -- 172.21.15.64:0/2314734846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a80cee60 msgr2=0x7f63a8070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f639ffff640 1 --2- 172.21.15.64:0/2314734846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a80cee60 0x7f63a8070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f63a6ffd640 1 -- 172.21.15.64:0/2314734846 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1554851545 0 0) 0x7f6394003520 con 0x7f63a815c8e0 2023-10-14T12:29:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f639ffff640 1 -- 172.21.15.64:0/2314734846 >> v1:172.21.15.64:6789/0 conn(0x7f63a815c8e0 legacy=0x7f63a806d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.105+0000 7f639ffff640 1 -- 172.21.15.64:0/2314734846 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a80cd1f0 con 0x7f63a80cdf50 2023-10-14T12:29:51.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.107+0000 7f639ffff640 1 --2- 172.21.15.64:0/2314734846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cdf50 0x7f63a80ce920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63900097a0 tx=0x7f639002b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5534473d61926e46 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63a6ffd640 1 -- 172.21.15.64:0/2314734846 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6398001800 con 0x7f63a80cdf50 2023-10-14T12:29:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63a6ffd640 1 -- 172.21.15.64:0/2314734846 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639002e050 con 0x7f63a80cdf50 2023-10-14T12:29:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63a6ffd640 1 -- 172.21.15.64:0/2314734846 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6390030730 con 0x7f63a80cdf50 2023-10-14T12:29:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 -- 172.21.15.64:0/2314734846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cdf50 msgr2=0x7f63a80ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 --2- 172.21.15.64:0/2314734846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cdf50 0x7f63a80ce920 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f63900097a0 tx=0x7f639002b790 comp rx=0 tx=0).stop 2023-10-14T12:29:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 -- 172.21.15.64:0/2314734846 shutdown_connections 2023-10-14T12:29:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 --2- 172.21.15.64:0/2314734846 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a80cee60 0x7f63a8070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 --2- 172.21.15.64:0/2314734846 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cdf50 0x7f63a80ce920 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 -- 172.21.15.64:0/2314734846 >> 172.21.15.64:0/2314734846 conn(0x7f63a806a200 msgr2=0x7f63a806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:51.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 -- 172.21.15.64:0/2314734846 shutdown_connections 2023-10-14T12:29:51.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.108+0000 7f63acf3c640 1 -- 172.21.15.64:0/2314734846 wait complete. 2023-10-14T12:29:51.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.110+0000 7f63acf3c640 1 Processor -- start 2023-10-14T12:29:51.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.110+0000 7f63acf3c640 1 -- start start 2023-10-14T12:29:51.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.111+0000 7f63acf3c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a80cdf50 0x7f63a8153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.111+0000 7f63acf3c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cee60 0x7f63a8160760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.111+0000 7f63acf3c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a815c8e0 0x7f63a81f52b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.111+0000 7f63acf3c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a815e710 con 0x7f63a80cee60 2023-10-14T12:29:51.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.111+0000 7f63acf3c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63a815e100 con 0x7f63a80cdf50 2023-10-14T12:29:51.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.111+0000 7f63acf3c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63a81f57f0 con 0x7f63a815c8e0 2023-10-14T12:29:51.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cee60 0x7f63a8160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cee60 0x7f63a8160760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52524/0 (socket says 172.21.15.64:52524) 2023-10-14T12:29:51.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 -- 172.21.15.64:0/1758066189 learned_addr learned my addr 172.21.15.64:0/1758066189 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:51.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f63a77fe640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a80cdf50 0x7f63a8153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 -- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a815c8e0 msgr2=0x7f63a81f52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a815c8e0 0x7f63a81f52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 -- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a80cdf50 msgr2=0x7f63a8153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a80cdf50 0x7f63a8153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f639ffff640 1 -- 172.21.15.64:0/1758066189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6390009400 con 0x7f63a80cee60 2023-10-14T12:29:51.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.112+0000 7f63a77fe640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a80cdf50 0x7f63a8153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:51.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.113+0000 7f639ffff640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cee60 0x7f63a8160760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6390000c00 tx=0x7f63900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:51.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.113+0000 7f63a4ff9640 1 -- 172.21.15.64:0/1758066189 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639003b8d0 con 0x7f63a80cee60 2023-10-14T12:29:51.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.113+0000 7f63a4ff9640 1 -- 172.21.15.64:0/1758066189 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f639003ba70 con 0x7f63a80cee60 2023-10-14T12:29:51.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.113+0000 7f63a4ff9640 1 -- 172.21.15.64:0/1758066189 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f639003be20 con 0x7f63a80cee60 2023-10-14T12:29:51.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.113+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63a815db00 con 0x7f63a80cee60 2023-10-14T12:29:51.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.113+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63a815dde0 con 0x7f63a80cee60 2023-10-14T12:29:51.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.114+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63a815e8c0 con 0x7f63a80cee60 2023-10-14T12:29:51.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.115+0000 7f63a4ff9640 1 -- 172.21.15.64:0/1758066189 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6390039040 con 0x7f63a80cee60 2023-10-14T12:29:51.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.116+0000 7f63a4ff9640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f638806aea0 0x7f638806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.116+0000 7f63a4ff9640 1 -- 172.21.15.64:0/1758066189 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f63900ab0f0 con 0x7f63a80cee60 2023-10-14T12:29:51.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.117+0000 7f63a77fe640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f638806aea0 0x7f638806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.118+0000 7f63a77fe640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f638806aea0 0x7f638806d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6398001eb0 tx=0x7f6398009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:51.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.120+0000 7f63a4ff9640 1 -- 172.21.15.64:0/1758066189 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f63a815e8c0 con 0x7f63a80cee60 2023-10-14T12:29:51.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.313+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f63a804e9b0 con 0x7f63a80cee60 2023-10-14T12:29:51.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.321+0000 7f63a4ff9640 1 -- 172.21.15.64:0/1758066189 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6390075de0 con 0x7f63a80cee60 2023-10-14T12:29:51.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.323+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f638806aea0 msgr2=0x7f638806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.323+0000 7f63acf3c640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f638806aea0 0x7f638806d360 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6398001eb0 tx=0x7f6398009040 comp rx=0 tx=0).stop 2023-10-14T12:29:51.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.323+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cee60 msgr2=0x7f63a8160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.323+0000 7f63acf3c640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cee60 0x7f63a8160760 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f6390000c00 tx=0x7f63900046c0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 shutdown_connections 2023-10-14T12:29:51.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f638806aea0 0x7f638806d360 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f63a815c8e0 0x7f63a81f52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f63a80cee60 0x7f63a8160760 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 --2- 172.21.15.64:0/1758066189 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f63a80cdf50 0x7f63a8153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 >> 172.21.15.64:0/1758066189 conn(0x7f63a806a200 msgr2=0x7f63a80acb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:51.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 shutdown_connections 2023-10-14T12:29:51.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.324+0000 7f63acf3c640 1 -- 172.21.15.64:0/1758066189 wait complete. 2023-10-14T12:29:51.346 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T12:29:51.346 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T12:29:51.467 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T12:29:51.598 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T12:29:51.599 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:29:51.599 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:29:51.663 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:29:51.663 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:29:51.715 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:51.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.926+0000 7f148ed6e640 1 Processor -- start 2023-10-14T12:29:51.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.926+0000 7f148ed6e640 1 -- start start 2023-10-14T12:29:51.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148ed6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14880b0010 0x7f14880701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148ed6e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f148815f040 0x7f148815b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148ed6e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14880707f0 con 0x7f148815ad00 2023-10-14T12:29:51.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148ed6e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1488070ad0 con 0x7f148815f040 2023-10-14T12:29:51.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148ed6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148815b1d0 con 0x7f14880b0010 2023-10-14T12:29:51.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148d30b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f148815f040 0x7f148815b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148d30b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f148815f040 0x7f148815b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52536/0 (socket says 172.21.15.64:52536) 2023-10-14T12:29:51.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148d30b640 1 -- 172.21.15.64:0/3707170866 learned_addr learned my addr 172.21.15.64:0/3707170866 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:51.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.928+0000 7f148cb0a640 1 --2- 172.21.15.64:0/3707170866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14880b0010 0x7f14880701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.929+0000 7f148d30b640 1 -- 172.21.15.64:0/3707170866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14880b0010 msgr2=0x7f14880701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:51.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.929+0000 7f148d30b640 1 --2- 172.21.15.64:0/3707170866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14880b0010 0x7f14880701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.929+0000 7f148d30b640 1 -- 172.21.15.64:0/3707170866 >> v1:172.21.15.177:6789/0 conn(0x7f148815ad00 legacy=0x7f14880b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.929+0000 7f148d30b640 1 -- 172.21.15.64:0/3707170866 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148815b4b0 con 0x7f148815f040 2023-10-14T12:29:51.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.930+0000 7f148d30b640 1 --2- 172.21.15.64:0/3707170866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f148815b9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1480009e50 tx=0x7f148002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25cabbad2aa47112 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:51.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.930+0000 7f14877fe640 1 -- 172.21.15.64:0/3707170866 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148002cb00 con 0x7f148815f040 2023-10-14T12:29:51.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.930+0000 7f14877fe640 1 -- 172.21.15.64:0/3707170866 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148002cc60 con 0x7f148815f040 2023-10-14T12:29:51.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.930+0000 7f14877fe640 1 -- 172.21.15.64:0/3707170866 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14800343f0 con 0x7f148815f040 2023-10-14T12:29:51.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 -- 172.21.15.64:0/3707170866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 msgr2=0x7f148815b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3707170866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f148815b9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1480009e50 tx=0x7f148002bf60 comp rx=0 tx=0).stop 2023-10-14T12:29:51.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 -- 172.21.15.64:0/3707170866 shutdown_connections 2023-10-14T12:29:51.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3707170866 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f148815b9d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3707170866 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f14880b0010 0x7f14880701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 -- 172.21.15.64:0/3707170866 >> 172.21.15.64:0/3707170866 conn(0x7f148806c1c0 msgr2=0x7f148806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:51.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 -- 172.21.15.64:0/3707170866 shutdown_connections 2023-10-14T12:29:51.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.931+0000 7f148ed6e640 1 -- 172.21.15.64:0/3707170866 wait complete. 2023-10-14T12:29:51.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.933+0000 7f148ed6e640 1 Processor -- start 2023-10-14T12:29:51.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.933+0000 7f148ed6e640 1 -- start start 2023-10-14T12:29:51.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.934+0000 7f148ed6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14880b0010 0x7f14880b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.934+0000 7f148ed6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f148815ad00 0x7f14880c2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.934+0000 7f148ed6e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f14880aca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.934+0000 7f148ed6e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14880c2ff0 con 0x7f148815f040 2023-10-14T12:29:51.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.934+0000 7f148ed6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14880c4980 con 0x7f14880b0010 2023-10-14T12:29:51.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.934+0000 7f148ed6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14880c4c60 con 0x7f148815ad00 2023-10-14T12:29:51.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f14880aca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f14880aca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52546/0 (socket says 172.21.15.64:52546) 2023-10-14T12:29:51.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 -- 172.21.15.64:0/3416920878 learned_addr learned my addr 172.21.15.64:0/3416920878 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:51.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148cb0a640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14880b0010 0x7f14880b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f1487fff640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f148815ad00 0x7f14880c2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 -- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f148815ad00 msgr2=0x7f14880c2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f148815ad00 0x7f14880c2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 -- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14880b0010 msgr2=0x7f14880b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:51.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14880b0010 0x7f14880b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:51.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148d30b640 1 -- 172.21.15.64:0/3416920878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1480009b30 con 0x7f148815f040 2023-10-14T12:29:51.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.935+0000 7f148cb0a640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14880b0010 0x7f14880b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:51.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.936+0000 7f148d30b640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f14880aca90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1480009e50 tx=0x7f1480004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:51.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.936+0000 7f14857fa640 1 -- 172.21.15.64:0/3416920878 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1480009510 con 0x7f148815f040 2023-10-14T12:29:51.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.936+0000 7f14857fa640 1 -- 172.21.15.64:0/3416920878 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148003e450 con 0x7f148815f040 2023-10-14T12:29:51.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.936+0000 7f14857fa640 1 -- 172.21.15.64:0/3416920878 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148003e800 con 0x7f148815f040 2023-10-14T12:29:51.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.936+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14880c7200 con 0x7f148815f040 2023-10-14T12:29:51.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.936+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14880acfd0 con 0x7f148815f040 2023-10-14T12:29:51.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.937+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14880c7440 con 0x7f148815f040 2023-10-14T12:29:51.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.938+0000 7f14857fa640 1 -- 172.21.15.64:0/3416920878 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f148003e960 con 0x7f148815f040 2023-10-14T12:29:51.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.939+0000 7f14857fa640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f146c06ae70 0x7f146c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:51.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.939+0000 7f14857fa640 1 -- 172.21.15.64:0/3416920878 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f14800ac700 con 0x7f148815f040 2023-10-14T12:29:51.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.940+0000 7f148cb0a640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f146c06ae70 0x7f146c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:51.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.941+0000 7f148cb0a640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f146c06ae70 0x7f146c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f147c006fd0 tx=0x7f147c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:51.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:51.944+0000 7f14857fa640 1 -- 172.21.15.64:0/3416920878 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f14880c7440 con 0x7f148815f040 2023-10-14T12:29:52.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.144+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14880c7440 con 0x7f148815f040 2023-10-14T12:29:52.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.147+0000 7f14857fa640 1 -- 172.21.15.64:0/3416920878 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f14880c7440 con 0x7f148815f040 2023-10-14T12:29:52.149 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:52.149 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:52.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.149+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f146c06ae70 msgr2=0x7f146c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.149+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f146c06ae70 0x7f146c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f147c006fd0 tx=0x7f147c008040 comp rx=0 tx=0).stop 2023-10-14T12:29:52.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.149+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 msgr2=0x7f14880aca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.149+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f14880aca90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1480009e50 tx=0x7f1480004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:52.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.150+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 shutdown_connections 2023-10-14T12:29:52.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.150+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f146c06ae70 0x7f146c06d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.150+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f148815f040 0x7f14880aca90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.150+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f148815ad00 0x7f14880c2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.150+0000 7f148ed6e640 1 --2- 172.21.15.64:0/3416920878 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f14880b0010 0x7f14880b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.150+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 >> 172.21.15.64:0/3416920878 conn(0x7f148806c1c0 msgr2=0x7f14880ca100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:52.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.150+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 shutdown_connections 2023-10-14T12:29:52.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.151+0000 7f148ed6e640 1 -- 172.21.15.64:0/3416920878 wait complete. 2023-10-14T12:29:52.170 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:52.171 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:52.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.398+0000 7f95ce89e640 1 Processor -- start 2023-10-14T12:29:52.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.398+0000 7f95ce89e640 1 -- start start 2023-10-14T12:29:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.399+0000 7f95ce89e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071f30 0x7f95c8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.399+0000 7f95ce89e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f95c80cdc00 0x7f95c806bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.399+0000 7f95ce89e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95c80c89d0 con 0x7f95c8071b50 2023-10-14T12:29:52.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.399+0000 7f95ce89e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95c8071600 con 0x7f95c80cdc00 2023-10-14T12:29:52.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.399+0000 7f95ce89e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c815a260 con 0x7f95c8071f30 2023-10-14T12:29:52.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95ce09d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f95c80cdc00 0x7f95c806bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95ce09d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f95c80cdc00 0x7f95c806bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52552/0 (socket says 172.21.15.64:52552) 2023-10-14T12:29:52.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95ce09d640 1 -- 172.21.15.64:0/628923615 learned_addr learned my addr 172.21.15.64:0/628923615 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:52.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95cd09b640 1 --2- 172.21.15.64:0/628923615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071f30 0x7f95c8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95ce09d640 1 -- 172.21.15.64:0/628923615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071f30 msgr2=0x7f95c8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:52.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95ce09d640 1 --2- 172.21.15.64:0/628923615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071f30 0x7f95c8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95ce09d640 1 -- 172.21.15.64:0/628923615 >> v1:172.21.15.177:6789/0 conn(0x7f95c8071b50 legacy=0x7f95c8070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:52.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95ce09d640 1 -- 172.21.15.64:0/628923615 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c815a540 con 0x7f95c80cdc00 2023-10-14T12:29:52.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.400+0000 7f95cd09b640 1 --2- 172.21.15.64:0/628923615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071f30 0x7f95c8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:52.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.401+0000 7f95ce09d640 1 --2- 172.21.15.64:0/628923615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c80cdc00 0x7f95c806bf20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009e50 tx=0x7f95c002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbda4b37219a447d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:52.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95cc89a640 1 -- 172.21.15.64:0/628923615 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c002ca80 con 0x7f95c80cdc00 2023-10-14T12:29:52.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95cc89a640 1 -- 172.21.15.64:0/628923615 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95c002cbe0 con 0x7f95c80cdc00 2023-10-14T12:29:52.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95cc89a640 1 -- 172.21.15.64:0/628923615 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95c00343f0 con 0x7f95c80cdc00 2023-10-14T12:29:52.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95ce89e640 1 -- 172.21.15.64:0/628923615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c80cdc00 msgr2=0x7f95c806bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95ce89e640 1 --2- 172.21.15.64:0/628923615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c80cdc00 0x7f95c806bf20 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009e50 tx=0x7f95c002bee0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95ce89e640 1 -- 172.21.15.64:0/628923615 shutdown_connections 2023-10-14T12:29:52.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95ce89e640 1 --2- 172.21.15.64:0/628923615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c80cdc00 0x7f95c806bf20 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95ce89e640 1 --2- 172.21.15.64:0/628923615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071f30 0x7f95c8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95ce89e640 1 -- 172.21.15.64:0/628923615 >> 172.21.15.64:0/628923615 conn(0x7f95c806a470 msgr2=0x7f95c80afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:52.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.402+0000 7f95ce89e640 1 -- 172.21.15.64:0/628923615 shutdown_connections 2023-10-14T12:29:52.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.403+0000 7f95ce89e640 1 -- 172.21.15.64:0/628923615 wait complete. 2023-10-14T12:29:52.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.404+0000 7f95ce89e640 1 Processor -- start 2023-10-14T12:29:52.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.404+0000 7f95ce89e640 1 -- start start 2023-10-14T12:29:52.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.405+0000 7f95ce89e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071b50 0x7f95c80c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.405+0000 7f95ce89e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c8071f30 0x7f95c80c7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.405+0000 7f95ce89e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c80cdc00 0x7f95c81537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.405+0000 7f95ce89e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80c78e0 con 0x7f95c8071f30 2023-10-14T12:29:52.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.405+0000 7f95ce89e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c80c8240 con 0x7f95c80cdc00 2023-10-14T12:29:52.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.405+0000 7f95ce89e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95c8153d10 con 0x7f95c8071b50 2023-10-14T12:29:52.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c8071f30 0x7f95c80c7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c8071f30 0x7f95c80c7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52560/0 (socket says 172.21.15.64:52560) 2023-10-14T12:29:52.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 -- 172.21.15.64:0/2083302723 learned_addr learned my addr 172.21.15.64:0/2083302723 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:52.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd89c640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071b50 0x7f95c80c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95ce09d640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c80cdc00 0x7f95c81537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 -- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071b50 msgr2=0x7f95c80c2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071b50 0x7f95c80c2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 -- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c80cdc00 msgr2=0x7f95c81537d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c80cdc00 0x7f95c81537d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.406+0000 7f95cd09b640 1 -- 172.21.15.64:0/2083302723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95c0009b30 con 0x7f95c8071f30 2023-10-14T12:29:52.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.407+0000 7f95cd09b640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c8071f30 0x7f95c80c7d00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c7f0 tx=0x7f95b800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:52.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.407+0000 7f95be7fc640 1 -- 172.21.15.64:0/2083302723 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80079d0 con 0x7f95c8071f30 2023-10-14T12:29:52.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.407+0000 7f95be7fc640 1 -- 172.21.15.64:0/2083302723 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b8007b30 con 0x7f95c8071f30 2023-10-14T12:29:52.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.407+0000 7f95be7fc640 1 -- 172.21.15.64:0/2083302723 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b800ce40 con 0x7f95c8071f30 2023-10-14T12:29:52.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.407+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c80c6c60 con 0x7f95c8071f30 2023-10-14T12:29:52.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.407+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c80c7220 con 0x7f95c8071f30 2023-10-14T12:29:52.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.408+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95c80c9c30 con 0x7f95c8071f30 2023-10-14T12:29:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.409+0000 7f95be7fc640 1 -- 172.21.15.64:0/2083302723 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f95b80113f0 con 0x7f95c8071f30 2023-10-14T12:29:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.410+0000 7f95be7fc640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f95ac06ae70 0x7f95ac06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.410+0000 7f95be7fc640 1 -- 172.21.15.64:0/2083302723 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95b8089b20 con 0x7f95c8071f30 2023-10-14T12:29:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.411+0000 7f95cd89c640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f95ac06ae70 0x7f95ac06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.412+0000 7f95cd89c640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f95ac06ae70 0x7f95ac06d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95c815c6a0 tx=0x7f95c4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:52.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.414+0000 7f95be7fc640 1 -- 172.21.15.64:0/2083302723 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f95b8054800 con 0x7f95c8071f30 2023-10-14T12:29:52.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.606+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95c804e9b0 con 0x7f95c8071f30 2023-10-14T12:29:52.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.607+0000 7f95be7fc640 1 -- 172.21.15.64:0/2083302723 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95b801f0a0 con 0x7f95c8071f30 2023-10-14T12:29:52.609 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:52.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f95ac06ae70 msgr2=0x7f95ac06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f95ac06ae70 0x7f95ac06d330 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f95c815c6a0 tx=0x7f95c4009040 comp rx=0 tx=0).stop 2023-10-14T12:29:52.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c8071f30 msgr2=0x7f95c80c7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c8071f30 0x7f95c80c7d00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f95b800c7f0 tx=0x7f95b800cbf0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 shutdown_connections 2023-10-14T12:29:52.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f95ac06ae70 0x7f95ac06d330 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f95c80cdc00 0x7f95c81537d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f95c8071f30 0x7f95c80c7d00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 --2- 172.21.15.64:0/2083302723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f95c8071b50 0x7f95c80c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.609+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 >> 172.21.15.64:0/2083302723 conn(0x7f95c806a470 msgr2=0x7f95c806bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:52.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.610+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 shutdown_connections 2023-10-14T12:29:52.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.610+0000 7f95ce89e640 1 -- 172.21.15.64:0/2083302723 wait complete. 2023-10-14T12:29:52.632 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:52.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.857+0000 7f3c4221a640 1 Processor -- start 2023-10-14T12:29:52.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.857+0000 7f3c4221a640 1 -- start start 2023-10-14T12:29:52.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.859+0000 7f3c4221a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3c3c0d1200 0x7f3c3c0b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.859+0000 7f3c4221a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c0ce810 con 0x7f3c3c15c940 2023-10-14T12:29:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.859+0000 7f3c4221a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c3c0b5b40 con 0x7f3c3c0d0d80 2023-10-14T12:29:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.859+0000 7f3c4221a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c3c0d0b10 con 0x7f3c3c0d1200 2023-10-14T12:29:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.859+0000 7f3c41218640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f3c3c15c940 0x7f3c3c0d0400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47826/0 (socket says 172.21.15.64:47826) 2023-10-14T12:29:52.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.859+0000 7f3c41218640 1 -- 172.21.15.64:0/1857050492 learned_addr learned my addr 172.21.15.64:0/1857050492 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:52.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1067602853 0 0) 0x7f3c3c0ce810 con 0x7f3c3c15c940 2023-10-14T12:29:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c28003520 con 0x7f3c3c15c940 2023-10-14T12:29:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c41a19640 1 --2- 172.21.15.64:0/1857050492 >> v2:172.21.15.177:3300/0 conn(0x7f3c3c0d1200 0x7f3c3c0b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2467910190 0 0) 0x7f3c28003520 con 0x7f3c3c15c940 2023-10-14T12:29:52.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 >> v2:172.21.15.177:3300/0 conn(0x7f3c3c0d1200 msgr2=0x7f3c3c0b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 --2- 172.21.15.64:0/1857050492 >> v2:172.21.15.177:3300/0 conn(0x7f3c3c0d1200 0x7f3c3c0b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 >> v1:172.21.15.177:6789/0 conn(0x7f3c3c0d0d80 legacy=0x7f3c3c0b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c0ce250 con 0x7f3c3c15c940 2023-10-14T12:29:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f3c380019f0 con 0x7f3c3c15c940 2023-10-14T12:29:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 >> v1:172.21.15.64:6789/0 conn(0x7f3c3c15c940 legacy=0x7f3c3c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c280039e0 0x7f3c28003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c280052a0 0x7f3c2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c0d0b10 con 0x7f3c280047c0 2023-10-14T12:29:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.860+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2800c1f0 con 0x7f3c280039e0 2023-10-14T12:29:52.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2800c3b0 con 0x7f3c280052a0 2023-10-14T12:29:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c40a17640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c41a19640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c280052a0 0x7f3c2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c41218640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c280039e0 0x7f3c28003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c40a17640 1 -- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c280052a0 msgr2=0x7f3c2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c40a17640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c280052a0 0x7f3c2800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c40a17640 1 -- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c280039e0 msgr2=0x7f3c28003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c40a17640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c280039e0 0x7f3c28003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c40a17640 1 -- 172.21.15.64:0/1857050492 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c28003520 con 0x7f3c280047c0 2023-10-14T12:29:52.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c41218640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c280039e0 0x7f3c28003e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:52.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.861+0000 7f3c41a19640 1 -- 172.21.15.64:0/1857050492 reap_dead start 2023-10-14T12:29:52.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.863+0000 7f3c40a17640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c28004c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c001720 tx=0x7f3c280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d92ca3289fadbf server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:52.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.863+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c0052d0 con 0x7f3c280047c0 2023-10-14T12:29:52.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.863+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c02e050 con 0x7f3c280047c0 2023-10-14T12:29:52.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.863+0000 7f3c33fff640 1 -- 172.21.15.64:0/1857050492 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c003830 con 0x7f3c280047c0 2023-10-14T12:29:52.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.863+0000 7f3c4221a640 1 -- 172.21.15.64:0/1857050492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 msgr2=0x7f3c28004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.863+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c28004c40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c001720 tx=0x7f3c280057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.864+0000 7f3c4221a640 1 -- 172.21.15.64:0/1857050492 shutdown_connections 2023-10-14T12:29:52.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.864+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1857050492 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c28004c40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.864+0000 7f3c4221a640 1 -- 172.21.15.64:0/1857050492 >> 172.21.15.64:0/1857050492 conn(0x7f3c3c09bb30 msgr2=0x7f3c3c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:52.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.864+0000 7f3c4221a640 1 -- 172.21.15.64:0/1857050492 shutdown_connections 2023-10-14T12:29:52.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.864+0000 7f3c4221a640 1 -- 172.21.15.64:0/1857050492 wait complete. 2023-10-14T12:29:52.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.866+0000 7f3c4221a640 1 Processor -- start 2023-10-14T12:29:52.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.866+0000 7f3c4221a640 1 -- start start 2023-10-14T12:29:52.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c4221a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c3c158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c4221a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c3c0c8030 0x7f3c3c1f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c4221a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c3c1580d0 0x7f3c3c0b7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c4221a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c09c8b0 con 0x7f3c280047c0 2023-10-14T12:29:52.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c4221a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c1f27d0 con 0x7f3c3c1580d0 2023-10-14T12:29:52.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c4221a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3c09c540 con 0x7f3c3c0c8030 2023-10-14T12:29:52.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c3c158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c3c158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52576/0 (socket says 172.21.15.64:52576) 2023-10-14T12:29:52.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 -- 172.21.15.64:0/1067965198 learned_addr learned my addr 172.21.15.64:0/1067965198 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:52.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41a19640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c3c1580d0 0x7f3c3c0b7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c40a17640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c3c0c8030 0x7f3c3c1f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 -- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c3c0c8030 msgr2=0x7f3c3c1f2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c3c0c8030 0x7f3c3c1f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 -- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c3c1580d0 msgr2=0x7f3c3c0b7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:52.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c3c1580d0 0x7f3c3c0b7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:52.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41218640 1 -- 172.21.15.64:0/1067965198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c09fc60 con 0x7f3c280047c0 2023-10-14T12:29:52.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.867+0000 7f3c41a19640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c3c1580d0 0x7f3c3c0b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:52.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.868+0000 7f3c41218640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c3c158970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c38002010 tx=0x7f3c3800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:52.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.868+0000 7f3c31ffb640 1 -- 172.21.15.64:0/1067965198 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800bb50 con 0x7f3c280047c0 2023-10-14T12:29:52.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.868+0000 7f3c31ffb640 1 -- 172.21.15.64:0/1067965198 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800bcb0 con 0x7f3c280047c0 2023-10-14T12:29:52.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.868+0000 7f3c31ffb640 1 -- 172.21.15.64:0/1067965198 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38007310 con 0x7f3c280047c0 2023-10-14T12:29:52.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.868+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3c09ff20 con 0x7f3c280047c0 2023-10-14T12:29:52.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.868+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3c0a0200 con 0x7f3c280047c0 2023-10-14T12:29:52.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.869+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3c04e9b0 con 0x7f3c280047c0 2023-10-14T12:29:52.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.870+0000 7f3c31ffb640 1 -- 172.21.15.64:0/1067965198 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3c38007470 con 0x7f3c280047c0 2023-10-14T12:29:52.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.871+0000 7f3c31ffb640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3c2006ae70 0x7f3c2006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:52.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.872+0000 7f3c31ffb640 1 -- 172.21.15.64:0/1067965198 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3c38089bd0 con 0x7f3c280047c0 2023-10-14T12:29:52.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.872+0000 7f3c40a17640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3c2006ae70 0x7f3c2006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:52.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.873+0000 7f3c40a17640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3c2006ae70 0x7f3c2006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c033000 tx=0x7f3c2c009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:52.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:52.876+0000 7f3c31ffb640 1 -- 172.21.15.64:0/1067965198 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3c380548d0 con 0x7f3c280047c0 2023-10-14T12:29:53.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.071+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c3c0a04e0 con 0x7f3c280047c0 2023-10-14T12:29:53.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.072+0000 7f3c31ffb640 1 -- 172.21.15.64:0/1067965198 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c380190a0 con 0x7f3c280047c0 2023-10-14T12:29:53.074 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:53.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3c2006ae70 msgr2=0x7f3c2006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3c2006ae70 0x7f3c2006d330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c033000 tx=0x7f3c2c009030 comp rx=0 tx=0).stop 2023-10-14T12:29:53.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 msgr2=0x7f3c3c158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c3c158970 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3c38002010 tx=0x7f3c3800b4a0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 shutdown_connections 2023-10-14T12:29:53.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3c2006ae70 0x7f3c2006d330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3c3c1580d0 0x7f3c3c0b7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3c3c0c8030 0x7f3c3c1f2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 --2- 172.21.15.64:0/1067965198 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3c280047c0 0x7f3c3c158970 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.075+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 >> 172.21.15.64:0/1067965198 conn(0x7f3c3c09bb30 msgr2=0x7f3c3c15b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:53.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.076+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 shutdown_connections 2023-10-14T12:29:53.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.076+0000 7f3c4221a640 1 -- 172.21.15.64:0/1067965198 wait complete. 2023-10-14T12:29:53.095 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.321+0000 7f6ed1539640 1 Processor -- start 2023-10-14T12:29:53.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.322+0000 7f6ed1539640 1 -- start start 2023-10-14T12:29:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.323+0000 7f6ed1539640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 0x7f6ecc1654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.323+0000 7f6ed1539640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6ecc0cb3b0 0x7f6ecc0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6ed1539640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ecc0cc8b0 con 0x7f6ecc0c9060 2023-10-14T12:29:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6ed1539640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ecc165a20 con 0x7f6ecc0cb3b0 2023-10-14T12:29:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6ed1539640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c9cc0 con 0x7f6ecc160ee0 2023-10-14T12:29:53.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6ec3fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f6ecc0c9060 0x7f6ecc0caca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47830/0 (socket says 172.21.15.64:47830) 2023-10-14T12:29:53.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6ec3fff640 1 -- 172.21.15.64:0/1077416428 learned_addr learned my addr 172.21.15.64:0/1077416428 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:53.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6ecaffd640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 0x7f6ecc1654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6ecb7fe640 1 --2- 172.21.15.64:0/1077416428 >> v2:172.21.15.177:3300/0 conn(0x7f6ecc0cb3b0 0x7f6ecc0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3898761136 0 0) 0x7f6ecc0cc8b0 con 0x7f6ecc0c9060 2023-10-14T12:29:53.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.324+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6eb8003520 con 0x7f6ecc0c9060 2023-10-14T12:29:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4132899301 0 0) 0x7f6eb8003520 con 0x7f6ecc0c9060 2023-10-14T12:29:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 msgr2=0x7f6ecc1654e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 0x7f6ecc1654e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 >> v2:172.21.15.177:3300/0 conn(0x7f6ecc0cb3b0 msgr2=0x7f6ecc0cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:53.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 --2- 172.21.15.64:0/1077416428 >> v2:172.21.15.177:3300/0 conn(0x7f6ecc0cb3b0 0x7f6ecc0cd070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0c9700 con 0x7f6ecc0c9060 2023-10-14T12:29:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f6eb4001670 con 0x7f6ecc0c9060 2023-10-14T12:29:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 >> v1:172.21.15.64:6789/0 conn(0x7f6ecc0c9060 legacy=0x7f6ecc0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6eb8003970 0x7f6eb8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 0x7f6eb80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb8004d00 0x7f6eb8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc165a20 con 0x7f6eb8003970 2023-10-14T12:29:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c9cc0 con 0x7f6eb8004d00 2023-10-14T12:29:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb800b980 con 0x7f6ecc160ee0 2023-10-14T12:29:53.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.325+0000 7f6ecaffd640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6eb8003970 0x7f6eb8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.326+0000 7f6ec3fff640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 0x7f6eb80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.326+0000 7f6ecaffd640 1 -- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 msgr2=0x7f6eb80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:53.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.326+0000 7f6ecaffd640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc160ee0 0x7f6eb80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.326+0000 7f6ecaffd640 1 -- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb8004d00 msgr2=0x7f6eb8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:53.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.326+0000 7f6ecaffd640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb8004d00 0x7f6eb8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.326+0000 7f6ecaffd640 1 -- 172.21.15.64:0/1077416428 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb8003520 con 0x7f6eb8003970 2023-10-14T12:29:53.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.327+0000 7f6ecaffd640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6eb8003970 0x7f6eb8003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009ac0 tx=0x7f6eb80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4687e2d3ec5b5c3a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:53.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.327+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc02c6b0 con 0x7f6eb8003970 2023-10-14T12:29:53.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.327+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ebc02c810 con 0x7f6eb8003970 2023-10-14T12:29:53.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.327+0000 7f6eca7fc640 1 -- 172.21.15.64:0/1077416428 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ebc02cba0 con 0x7f6eb8003970 2023-10-14T12:29:53.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.328+0000 7f6ed1539640 1 -- 172.21.15.64:0/1077416428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6eb8003970 msgr2=0x7f6eb8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.328+0000 7f6ed1539640 1 --2- 172.21.15.64:0/1077416428 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6eb8003970 0x7f6eb8003d90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc009ac0 tx=0x7f6eb80057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.328+0000 7f6ecb7fe640 1 -- 172.21.15.64:0/1077416428 reap_dead start 2023-10-14T12:29:53.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.328+0000 7f6ed1539640 1 -- 172.21.15.64:0/1077416428 shutdown_connections 2023-10-14T12:29:53.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.328+0000 7f6ed1539640 1 -- 172.21.15.64:0/1077416428 >> 172.21.15.64:0/1077416428 conn(0x7f6ecc0b0030 msgr2=0x7f6ecc0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:53.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.328+0000 7f6ed1539640 1 -- 172.21.15.64:0/1077416428 shutdown_connections 2023-10-14T12:29:53.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.328+0000 7f6ed1539640 1 -- 172.21.15.64:0/1077416428 wait complete. 2023-10-14T12:29:53.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.330+0000 7f6ed1539640 1 Processor -- start 2023-10-14T12:29:53.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.330+0000 7f6ed1539640 1 -- start start 2023-10-14T12:29:53.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ed1539640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb8003970 0x7f6ecc159ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ed1539640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc0b43f0 0x7f6ecc160100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ed1539640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ecc15b5a0 0x7f6ecc15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ed1539640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc15bf60 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ed1539640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c2dd0 con 0x7f6eb8003970 2023-10-14T12:29:53.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ed1539640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ecc0c83b0 con 0x7f6ecc0b43f0 2023-10-14T12:29:53.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ecc15b5a0 0x7f6ecc15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ecc15b5a0 0x7f6ecc15ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52590/0 (socket says 172.21.15.64:52590) 2023-10-14T12:29:53.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 -- 172.21.15.64:0/3090519333 learned_addr learned my addr 172.21.15.64:0/3090519333 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:53.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 -- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc0b43f0 msgr2=0x7f6ecc160100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc0b43f0 0x7f6ecc160100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 -- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb8003970 msgr2=0x7f6ecc159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb8003970 0x7f6ecc159ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.331+0000 7f6ecb7fe640 1 -- 172.21.15.64:0/3090519333 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ecc0c7df0 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.332+0000 7f6ecb7fe640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ecc15b5a0 0x7f6ecc15ba20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0c1f80 tx=0x7f6ec400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:53.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.332+0000 7f6ec37fe640 1 -- 172.21.15.64:0/3090519333 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4010040 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.332+0000 7f6ec37fe640 1 -- 172.21.15.64:0/3090519333 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec400bcb0 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.332+0000 7f6ec37fe640 1 -- 172.21.15.64:0/3090519333 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec4014640 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.332+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ecc0c80d0 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.332+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ecc160640 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.334+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ecc073ef0 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.334+0000 7f6ec37fe640 1 -- 172.21.15.64:0/3090519333 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6ec40147a0 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.335+0000 7f6ec37fe640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6eac06aea0 0x7f6eac06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.335+0000 7f6ec37fe640 1 -- 172.21.15.64:0/3090519333 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6ec4089d70 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.336+0000 7f6ecaffd640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6eac06aea0 0x7f6eac06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.337+0000 7f6ecaffd640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6eac06aea0 0x7f6eac06d360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc036000 tx=0x7f6ebc02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:53.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.339+0000 7f6ec37fe640 1 -- 172.21.15.64:0/3090519333 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6ec40549c0 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.534+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6ecc0c2f10 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.535+0000 7f6ec37fe640 1 -- 172.21.15.64:0/3090519333 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6ec4057fe0 con 0x7f6ecc15b5a0 2023-10-14T12:29:53.537 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:53.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6eac06aea0 msgr2=0x7f6eac06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6eac06aea0 0x7f6eac06d360 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc036000 tx=0x7f6ebc02e000 comp rx=0 tx=0).stop 2023-10-14T12:29:53.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ecc15b5a0 msgr2=0x7f6ecc15ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ecc15b5a0 0x7f6ecc15ba20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0c1f80 tx=0x7f6ec400b480 comp rx=0 tx=0).stop 2023-10-14T12:29:53.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 shutdown_connections 2023-10-14T12:29:53.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6eac06aea0 0x7f6eac06d360 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6ecc15b5a0 0x7f6ecc15ba20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6ecc0b43f0 0x7f6ecc160100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 --2- 172.21.15.64:0/3090519333 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6eb8003970 0x7f6ecc159ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 >> 172.21.15.64:0/3090519333 conn(0x7f6ecc0b0030 msgr2=0x7f6ecc15db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:53.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 shutdown_connections 2023-10-14T12:29:53.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.539+0000 7f6ed1539640 1 -- 172.21.15.64:0/3090519333 wait complete. 2023-10-14T12:29:53.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:53.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.792+0000 7f4d0f575640 1 Processor -- start 2023-10-14T12:29:53.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.793+0000 7f4d0f575640 1 -- start start 2023-10-14T12:29:53.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.794+0000 7f4d0f575640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d08154d10 0x7f4d080ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.794+0000 7f4d0f575640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d0806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.794+0000 7f4d0f575640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d081550f0 con 0x7f4d0806d360 2023-10-14T12:29:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.794+0000 7f4d0f575640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080cf310 con 0x7f4d08154d10 2023-10-14T12:29:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.794+0000 7f4d0f575640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0806db50 con 0x7f4d080cee60 2023-10-14T12:29:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0e573640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d08154d10 0x7f4d080ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0e573640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d08154d10 0x7f4d080ce920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52592/0 (socket says 172.21.15.64:52592) 2023-10-14T12:29:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0e573640 1 -- 172.21.15.64:0/581608650 learned_addr learned my addr 172.21.15.64:0/581608650 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:53.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0dd72640 1 --2- 172.21.15.64:0/581608650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d0806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0e573640 1 -- 172.21.15.64:0/581608650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 msgr2=0x7f4d0806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0e573640 1 --2- 172.21.15.64:0/581608650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d0806ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0e573640 1 -- 172.21.15.64:0/581608650 >> v1:172.21.15.177:6789/0 conn(0x7f4d0806d360 legacy=0x7f4d080ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.795+0000 7f4d0e573640 1 -- 172.21.15.64:0/581608650 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080b13f0 con 0x7f4d08154d10 2023-10-14T12:29:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.796+0000 7f4d0e573640 1 --2- 172.21.15.64:0/581608650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d080ce920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009870 tx=0x7f4d0402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=883cc8fe7c71c03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:53.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.797+0000 7f4d0d571640 1 -- 172.21.15.64:0/581608650 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04030840 con 0x7f4d08154d10 2023-10-14T12:29:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.797+0000 7f4d0d571640 1 -- 172.21.15.64:0/581608650 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d040309a0 con 0x7f4d08154d10 2023-10-14T12:29:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.797+0000 7f4d0d571640 1 -- 172.21.15.64:0/581608650 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d04030d30 con 0x7f4d08154d10 2023-10-14T12:29:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.797+0000 7f4d0f575640 1 -- 172.21.15.64:0/581608650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 msgr2=0x7f4d080ce920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.797+0000 7f4d0f575640 1 --2- 172.21.15.64:0/581608650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d080ce920 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009870 tx=0x7f4d0402b980 comp rx=0 tx=0).stop 2023-10-14T12:29:53.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.798+0000 7f4d0f575640 1 -- 172.21.15.64:0/581608650 shutdown_connections 2023-10-14T12:29:53.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.798+0000 7f4d0f575640 1 --2- 172.21.15.64:0/581608650 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d0806ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.798+0000 7f4d0f575640 1 --2- 172.21.15.64:0/581608650 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d080ce920 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.798+0000 7f4d0f575640 1 -- 172.21.15.64:0/581608650 >> 172.21.15.64:0/581608650 conn(0x7f4d0806a200 msgr2=0x7f4d0806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:53.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.798+0000 7f4d0f575640 1 -- 172.21.15.64:0/581608650 shutdown_connections 2023-10-14T12:29:53.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.798+0000 7f4d0f575640 1 -- 172.21.15.64:0/581608650 wait complete. 2023-10-14T12:29:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.799+0000 7f4d0f575640 1 Processor -- start 2023-10-14T12:29:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.800+0000 7f4d0f575640 1 -- start start 2023-10-14T12:29:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0f575640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0806d360 0x7f4d080c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0f575640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d08155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0f575640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d08156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0f575640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d080c4750 con 0x7f4d08154d10 2023-10-14T12:29:53.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0f575640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08071530 con 0x7f4d0806d360 2023-10-14T12:29:53.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0f575640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d08159c00 con 0x7f4d080cee60 2023-10-14T12:29:53.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d08156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d08156470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52606/0 (socket says 172.21.15.64:52606) 2023-10-14T12:29:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 -- 172.21.15.64:0/1757962521 learned_addr learned my addr 172.21.15.64:0/1757962521 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0dd72640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d08155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0e573640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0806d360 0x7f4d080c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 -- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 msgr2=0x7f4d08155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d08155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 -- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0806d360 msgr2=0x7f4d080c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0806d360 0x7f4d080c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.801+0000 7f4d0ed74640 1 -- 172.21.15.64:0/1757962521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040094d0 con 0x7f4d08154d10 2023-10-14T12:29:53.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.802+0000 7f4d0ed74640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d08156470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c7d0 tx=0x7f4d0000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.802+0000 7f4cfeffd640 1 -- 172.21.15.64:0/1757962521 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00003b70 con 0x7f4d08154d10 2023-10-14T12:29:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.802+0000 7f4cfeffd640 1 -- 172.21.15.64:0/1757962521 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d00003cf0 con 0x7f4d08154d10 2023-10-14T12:29:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.802+0000 7f4cfeffd640 1 -- 172.21.15.64:0/1757962521 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0000aa90 con 0x7f4d08154d10 2023-10-14T12:29:53.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.802+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d08071d40 con 0x7f4d08154d10 2023-10-14T12:29:53.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.802+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d08071a60 con 0x7f4d08154d10 2023-10-14T12:29:53.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.804+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0804e9b0 con 0x7f4d08154d10 2023-10-14T12:29:53.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.804+0000 7f4cfeffd640 1 -- 172.21.15.64:0/1757962521 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d0000abf0 con 0x7f4d08154d10 2023-10-14T12:29:53.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.805+0000 7f4cfeffd640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06aea0 0x7f4cec06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:53.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.805+0000 7f4cfeffd640 1 -- 172.21.15.64:0/1757962521 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d00089810 con 0x7f4d08154d10 2023-10-14T12:29:53.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.806+0000 7f4d0e573640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06aea0 0x7f4cec06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:53.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.807+0000 7f4d0e573640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06aea0 0x7f4cec06d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d04036000 tx=0x7f4d0403b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:53.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:53.810+0000 7f4cfeffd640 1 -- 172.21.15.64:0/1757962521 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d00054500 con 0x7f4d08154d10 2023-10-14T12:29:54.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.011+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4d08159d40 con 0x7f4d08154d10 2023-10-14T12:29:54.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.012+0000 7f4cfeffd640 1 -- 172.21.15.64:0/1757962521 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4d00003e60 con 0x7f4d08154d10 2023-10-14T12:29:54.014 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:54.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06aea0 msgr2=0x7f4cec06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06aea0 0x7f4cec06d360 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4d04036000 tx=0x7f4d0403b040 comp rx=0 tx=0).stop 2023-10-14T12:29:54.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 msgr2=0x7f4d08156470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d08156470 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4d0000c7d0 tx=0x7f4d0000cc90 comp rx=0 tx=0).stop 2023-10-14T12:29:54.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 shutdown_connections 2023-10-14T12:29:54.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06aea0 0x7f4cec06d360 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d08154d10 0x7f4d08156470 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cee60 0x7f4d08155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.015+0000 7f4d0f575640 1 --2- 172.21.15.64:0/1757962521 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d0806d360 0x7f4d080c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.016+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 >> 172.21.15.64:0/1757962521 conn(0x7f4d0806a200 msgr2=0x7f4d080c9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.016+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 shutdown_connections 2023-10-14T12:29:54.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.016+0000 7f4d0f575640 1 -- 172.21.15.64:0/1757962521 wait complete. 2023-10-14T12:29:54.038 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:29:54.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.264+0000 7f72fb59e640 1 Processor -- start 2023-10-14T12:29:54.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.264+0000 7f72fb59e640 1 -- start start 2023-10-14T12:29:54.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.265+0000 7f72fb59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 0x7f72fc0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.265+0000 7f72fb59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc0c8a10 con 0x7f72fc0ad970 2023-10-14T12:29:54.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.265+0000 7f72fb59e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc15d1a0 con 0x7f72fc0b2e90 2023-10-14T12:29:54.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.265+0000 7f72fb59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc159b40 con 0x7f72fc0ced10 2023-10-14T12:29:54.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.266+0000 7f72fa59c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f72fc0ad970 0x7f72fc0ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:47836/0 (socket says 172.21.15.64:47836) 2023-10-14T12:29:54.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.266+0000 7f72fa59c640 1 -- 172.21.15.64:0/1124409633 learned_addr learned my addr 172.21.15.64:0/1124409633 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:54.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.266+0000 7f72f3fff640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 0x7f72fc0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.266+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 815934411 0 0) 0x7f72fc0c8a10 con 0x7f72fc0ad970 2023-10-14T12:29:54.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.266+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72e8005730 con 0x7f72fc0ad970 2023-10-14T12:29:54.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3563886635 0 0) 0x7f72e8005730 con 0x7f72fc0ad970 2023-10-14T12:29:54.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 msgr2=0x7f72fc0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:54.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 0x7f72fc0b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 >> v1:172.21.15.177:6789/0 conn(0x7f72fc0b2e90 legacy=0x7f72fc06c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc15d3f0 con 0x7f72fc0ad970 2023-10-14T12:29:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f72ec0017f0 con 0x7f72fc0ad970 2023-10-14T12:29:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 >> v1:172.21.15.64:6789/0 conn(0x7f72fc0ad970 legacy=0x7f72fc0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72e8005bb0 0x7f72e8005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 0x7f72e80069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72e8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc159b40 con 0x7f72e8006f10 2023-10-14T12:29:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800bb80 con 0x7f72e8005bb0 2023-10-14T12:29:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72e800bcc0 con 0x7f72fc0ced10 2023-10-14T12:29:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72fad9d640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72e8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72f3fff640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 0x7f72e80069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.267+0000 7f72fa59c640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72e8005bb0 0x7f72e8005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.268+0000 7f72fad9d640 1 -- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 msgr2=0x7f72e80069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:54.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.268+0000 7f72fad9d640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0ced10 0x7f72e80069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.268+0000 7f72fad9d640 1 -- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72e8005bb0 msgr2=0x7f72e8005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:54.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.268+0000 7f72fad9d640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72e8005bb0 0x7f72e8005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.268+0000 7f72fad9d640 1 -- 172.21.15.64:0/1124409633 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8005730 con 0x7f72e8006f10 2023-10-14T12:29:54.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.269+0000 7f72fad9d640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72e8007390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f72f4001e50 tx=0x7f72e8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b78479b7d8d06d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:54.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.269+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4003b70 con 0x7f72e8006f10 2023-10-14T12:29:54.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.269+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4003cd0 con 0x7f72e8006f10 2023-10-14T12:29:54.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.269+0000 7f72f9d9b640 1 -- 172.21.15.64:0/1124409633 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4005310 con 0x7f72e8006f10 2023-10-14T12:29:54.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.270+0000 7f72fb59e640 1 -- 172.21.15.64:0/1124409633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 msgr2=0x7f72e8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.270+0000 7f72fb59e640 1 --2- 172.21.15.64:0/1124409633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72e8007390 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f72f4001e50 tx=0x7f72e8007a00 comp rx=0 tx=0).stop 2023-10-14T12:29:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.270+0000 7f72fad9d640 1 -- 172.21.15.64:0/1124409633 reap_dead start 2023-10-14T12:29:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.270+0000 7f72fb59e640 1 -- 172.21.15.64:0/1124409633 shutdown_connections 2023-10-14T12:29:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.270+0000 7f72fb59e640 1 -- 172.21.15.64:0/1124409633 >> 172.21.15.64:0/1124409633 conn(0x7f72fc069fc0 msgr2=0x7f72fc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.270+0000 7f72fb59e640 1 -- 172.21.15.64:0/1124409633 shutdown_connections 2023-10-14T12:29:54.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.270+0000 7f72fb59e640 1 -- 172.21.15.64:0/1124409633 wait complete. 2023-10-14T12:29:54.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.272+0000 7f72fb59e640 1 Processor -- start 2023-10-14T12:29:54.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.272+0000 7f72fb59e640 1 -- start start 2023-10-14T12:29:54.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fb59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72fc097320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fb59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72fc0af980 0x7f72fc0c1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fb59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0af4d0 0x7f72fc071070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fb59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0c1650 con 0x7f72e8006f10 2023-10-14T12:29:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fb59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0ca8d0 con 0x7f72fc0af980 2023-10-14T12:29:54.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fb59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc096e90 con 0x7f72fc0af4d0 2023-10-14T12:29:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fa59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72fc097320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fa59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72fc097320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52618/0 (socket says 172.21.15.64:52618) 2023-10-14T12:29:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.273+0000 7f72fa59c640 1 -- 172.21.15.64:0/3148449076 learned_addr learned my addr 172.21.15.64:0/3148449076 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fad9d640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0af4d0 0x7f72fc071070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72f3fff640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72fc0af980 0x7f72fc0c1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fa59c640 1 -- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0af4d0 msgr2=0x7f72fc071070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fa59c640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0af4d0 0x7f72fc071070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fa59c640 1 -- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72fc0af980 msgr2=0x7f72fc0c1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fa59c640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72fc0af980 0x7f72fc0c1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fa59c640 1 -- 172.21.15.64:0/3148449076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc15cad0 con 0x7f72e8006f10 2023-10-14T12:29:54.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fad9d640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0af4d0 0x7f72fc071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fa59c640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72fc097320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00e730 tx=0x7f72ec00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72f2ffd640 1 -- 172.21.15.64:0/3148449076 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec00ee40 con 0x7f72e8006f10 2023-10-14T12:29:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72f2ffd640 1 -- 172.21.15.64:0/3148449076 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ec0072e0 con 0x7f72e8006f10 2023-10-14T12:29:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72f2ffd640 1 -- 172.21.15.64:0/3148449076 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ec0057a0 con 0x7f72e8006f10 2023-10-14T12:29:54.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.274+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc15c510 con 0x7f72e8006f10 2023-10-14T12:29:54.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.275+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc097a70 con 0x7f72e8006f10 2023-10-14T12:29:54.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.276+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc04e9b0 con 0x7f72e8006f10 2023-10-14T12:29:54.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.277+0000 7f72f2ffd640 1 -- 172.21.15.64:0/3148449076 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f72ec005900 con 0x7f72e8006f10 2023-10-14T12:29:54.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.278+0000 7f72f2ffd640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f72dc06ae70 0x7f72dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.278+0000 7f72f2ffd640 1 -- 172.21.15.64:0/3148449076 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f72ec089a00 con 0x7f72e8006f10 2023-10-14T12:29:54.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.279+0000 7f72f3fff640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f72dc06ae70 0x7f72dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.280+0000 7f72f3fff640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f72dc06ae70 0x7f72dc06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0b2b90 tx=0x7f72e4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:54.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.283+0000 7f72f2ffd640 1 -- 172.21.15.64:0/3148449076 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f72ec0546f0 con 0x7f72e8006f10 2023-10-14T12:29:54.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.496+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f72fc06dc00 con 0x7f72e8006f10 2023-10-14T12:29:54.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.497+0000 7f72f2ffd640 1 -- 172.21.15.64:0/3148449076 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f72ec057d10 con 0x7f72e8006f10 2023-10-14T12:29:54.498 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:29:54.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.499+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f72dc06ae70 msgr2=0x7f72dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.499+0000 7f72fb59e640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f72dc06ae70 0x7f72dc06d330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0b2b90 tx=0x7f72e4008040 comp rx=0 tx=0).stop 2023-10-14T12:29:54.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.499+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 msgr2=0x7f72fc097320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.499+0000 7f72fb59e640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72fc097320 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f72ec00e730 tx=0x7f72ec00ebf0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 shutdown_connections 2023-10-14T12:29:54.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f72dc06ae70 0x7f72dc06d330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f72fc0af4d0 0x7f72fc071070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f72fc0af980 0x7f72fc0c1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 --2- 172.21.15.64:0/3148449076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f72e8006f10 0x7f72fc097320 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 >> 172.21.15.64:0/3148449076 conn(0x7f72fc069fc0 msgr2=0x7f72fc0cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:54.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 shutdown_connections 2023-10-14T12:29:54.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.500+0000 7f72fb59e640 1 -- 172.21.15.64:0/3148449076 wait complete. 2023-10-14T12:29:54.519 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:29:54.519 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:29:54.573 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:54.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.797+0000 7faa8bfff640 1 Processor -- start 2023-10-14T12:29:54.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.797+0000 7faa8bfff640 1 -- start start 2023-10-14T12:29:54.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faa8c15a8d0 0x7faa8c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7faa8c0ca660 0x7faa8c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c06bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8bfff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c15acb0 con 0x7faa8c15a8d0 2023-10-14T12:29:54.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8bfff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa8c0c1c60 con 0x7faa8c0ca660 2023-10-14T12:29:54.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c15e350 con 0x7faa8c06ff40 2023-10-14T12:29:54.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8affd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faa8c15a8d0 0x7faa8c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8affd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7faa8c15a8d0 0x7faa8c0cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52632/0 (socket says 172.21.15.64:52632) 2023-10-14T12:29:54.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8affd640 1 -- 172.21.15.64:0/3352567065 learned_addr learned my addr 172.21.15.64:0/3352567065 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:54.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8b7fe640 1 --2- 172.21.15.64:0/3352567065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c06bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8affd640 1 -- 172.21.15.64:0/3352567065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 msgr2=0x7faa8c06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:54.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8affd640 1 --2- 172.21.15.64:0/3352567065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c06bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8affd640 1 -- 172.21.15.64:0/3352567065 >> v2:172.21.15.177:3300/0 conn(0x7faa8c0ca660 msgr2=0x7faa8c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:54.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa827fc640 1 --2- 172.21.15.64:0/3352567065 >> v2:172.21.15.177:3300/0 conn(0x7faa8c0ca660 0x7faa8c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.799+0000 7faa8affd640 1 --2- 172.21.15.64:0/3352567065 >> v2:172.21.15.177:3300/0 conn(0x7faa8c0ca660 0x7faa8c0cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.800+0000 7faa8affd640 1 -- 172.21.15.64:0/3352567065 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa8c15e630 con 0x7faa8c15a8d0 2023-10-14T12:29:54.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.801+0000 7faa8affd640 1 --2- 172.21.15.64:0/3352567065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c15a8d0 0x7faa8c0cab40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0b0aa0 tx=0x7faa7c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426a7cd2b0a91712 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:54.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.801+0000 7faa8a7fc640 1 -- 172.21.15.64:0/3352567065 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c004230 con 0x7faa8c15a8d0 2023-10-14T12:29:54.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.801+0000 7faa8a7fc640 1 -- 172.21.15.64:0/3352567065 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7c004390 con 0x7faa8c15a8d0 2023-10-14T12:29:54.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.801+0000 7faa8a7fc640 1 -- 172.21.15.64:0/3352567065 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c003810 con 0x7faa8c15a8d0 2023-10-14T12:29:54.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 -- 172.21.15.64:0/3352567065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c15a8d0 msgr2=0x7faa8c0cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 --2- 172.21.15.64:0/3352567065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c15a8d0 0x7faa8c0cab40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faa8c0b0aa0 tx=0x7faa7c02b8f0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 -- 172.21.15.64:0/3352567065 shutdown_connections 2023-10-14T12:29:54.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 --2- 172.21.15.64:0/3352567065 >> v2:172.21.15.177:3300/0 conn(0x7faa8c0ca660 0x7faa8c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 --2- 172.21.15.64:0/3352567065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c06bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 --2- 172.21.15.64:0/3352567065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c15a8d0 0x7faa8c0cab40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 -- 172.21.15.64:0/3352567065 >> 172.21.15.64:0/3352567065 conn(0x7faa8c06a470 msgr2=0x7faa8c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:54.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 -- 172.21.15.64:0/3352567065 shutdown_connections 2023-10-14T12:29:54.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.802+0000 7faa8bfff640 1 -- 172.21.15.64:0/3352567065 wait complete. 2023-10-14T12:29:54.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.804+0000 7faa8bfff640 1 Processor -- start 2023-10-14T12:29:54.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.804+0000 7faa8bfff640 1 -- start start 2023-10-14T12:29:54.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c14d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c0ca660 0x7faa8c1f2280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa8bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa8c15a8d0 0x7faa8c0c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa8bfff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c14ddd0 con 0x7faa8c0ca660 2023-10-14T12:29:54.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa8bfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c1f27c0 con 0x7faa8c15a8d0 2023-10-14T12:29:54.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa8bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c0c8530 con 0x7faa8c06ff40 2023-10-14T12:29:54.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa827fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c0ca660 0x7faa8c1f2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa827fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c0ca660 0x7faa8c1f2280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52648/0 (socket says 172.21.15.64:52648) 2023-10-14T12:29:54.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.805+0000 7faa827fc640 1 -- 172.21.15.64:0/704386254 learned_addr learned my addr 172.21.15.64:0/704386254 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:54.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa8affd640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c14d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa8b7fe640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa8c15a8d0 0x7faa8c0c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa827fc640 1 -- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 msgr2=0x7faa8c14d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa827fc640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c14d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa827fc640 1 -- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa8c15a8d0 msgr2=0x7faa8c0c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa827fc640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa8c15a8d0 0x7faa8c0c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa827fc640 1 -- 172.21.15.64:0/704386254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa7c009460 con 0x7faa8c0ca660 2023-10-14T12:29:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa827fc640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c0ca660 0x7faa8c1f2280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c7f0 tx=0x7faa7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.806+0000 7faa83fff640 1 -- 172.21.15.64:0/704386254 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74004220 con 0x7faa8c0ca660 2023-10-14T12:29:54.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.807+0000 7faa83fff640 1 -- 172.21.15.64:0/704386254 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa74004380 con 0x7faa8c0ca660 2023-10-14T12:29:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.807+0000 7faa83fff640 1 -- 172.21.15.64:0/704386254 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa74007860 con 0x7faa8c0ca660 2023-10-14T12:29:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.807+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c1f3270 con 0x7faa8c0ca660 2023-10-14T12:29:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.807+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c1f2cb0 con 0x7faa8c0ca660 2023-10-14T12:29:54.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.808+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa8c04e9b0 con 0x7faa8c0ca660 2023-10-14T12:29:54.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.809+0000 7faa83fff640 1 -- 172.21.15.64:0/704386254 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7faa74007bd0 con 0x7faa8c0ca660 2023-10-14T12:29:54.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.810+0000 7faa83fff640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faa6c06ae70 0x7faa6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:54.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.810+0000 7faa83fff640 1 -- 172.21.15.64:0/704386254 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faa74089c80 con 0x7faa8c0ca660 2023-10-14T12:29:54.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.810+0000 7faa8affd640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faa6c06ae70 0x7faa6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:54.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.812+0000 7faa8affd640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faa6c06ae70 0x7faa6c06d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa7c035000 tx=0x7faa7c008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:54.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:54.814+0000 7faa83fff640 1 -- 172.21.15.64:0/704386254 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7faa74054960 con 0x7faa8c0ca660 2023-10-14T12:29:55.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.011+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa8c0cdd20 con 0x7faa8c0ca660 2023-10-14T12:29:55.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.015+0000 7faa83fff640 1 -- 172.21.15.64:0/704386254 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7faa7401e020 con 0x7faa8c0ca660 2023-10-14T12:29:55.017 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:55.017 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:55.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.017+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faa6c06ae70 msgr2=0x7faa6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.017+0000 7faa8bfff640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faa6c06ae70 0x7faa6c06d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faa7c035000 tx=0x7faa7c008030 comp rx=0 tx=0).stop 2023-10-14T12:29:55.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.017+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c0ca660 msgr2=0x7faa8c1f2280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.017+0000 7faa8bfff640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c0ca660 0x7faa8c1f2280 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c7f0 tx=0x7faa7400ccb0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 shutdown_connections 2023-10-14T12:29:55.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7faa6c06ae70 0x7faa6c06d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7faa8c15a8d0 0x7faa8c0c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7faa8c0ca660 0x7faa8c1f2280 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 --2- 172.21.15.64:0/704386254 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7faa8c06ff40 0x7faa8c14d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 >> 172.21.15.64:0/704386254 conn(0x7faa8c06a470 msgr2=0x7faa8c0cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:55.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 shutdown_connections 2023-10-14T12:29:55.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.018+0000 7faa8bfff640 1 -- 172.21.15.64:0/704386254 wait complete. 2023-10-14T12:29:55.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:55.041 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:55.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.266+0000 7f4160df4640 1 Processor -- start 2023-10-14T12:29:55.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.266+0000 7f4160df4640 1 -- start start 2023-10-14T12:29:55.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.268+0000 7f4160df4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c0d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.268+0000 7f4160df4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f415c06b570 0x7f415c06ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.268+0000 7f4160df4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f415c0ce690 con 0x7f415c0b1a30 2023-10-14T12:29:55.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.268+0000 7f4160df4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f415c06bf40 con 0x7f415c06b570 2023-10-14T12:29:55.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.268+0000 7f4160df4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0cfc20 con 0x7f415c0d0cd0 2023-10-14T12:29:55.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f4153fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c0d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f4153fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c0d10b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:51618/0 (socket says 172.21.15.64:51618) 2023-10-14T12:29:55.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f4153fff640 1 -- 172.21.15.64:0/3925329372 learned_addr learned my addr 172.21.15.64:0/3925329372 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:55.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f415bfff640 1 --2- 172.21.15.64:0/3925329372 >> v2:172.21.15.177:3300/0 conn(0x7f415c06b570 0x7f415c06ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f415affd640 1 -- 172.21.15.64:0/3925329372 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2414244460 0 0) 0x7f415c0ce690 con 0x7f415c0b1a30 2023-10-14T12:29:55.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f4153fff640 1 -- 172.21.15.64:0/3925329372 >> v2:172.21.15.177:3300/0 conn(0x7f415c06b570 msgr2=0x7f415c06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:55.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f4153fff640 1 --2- 172.21.15.64:0/3925329372 >> v2:172.21.15.177:3300/0 conn(0x7f415c06b570 0x7f415c06ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f4153fff640 1 -- 172.21.15.64:0/3925329372 >> v1:172.21.15.177:6789/0 conn(0x7f415c0b1a30 legacy=0x7f415c0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.269+0000 7f4153fff640 1 -- 172.21.15.64:0/3925329372 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415c0d15f0 con 0x7f415c0d0cd0 2023-10-14T12:29:55.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.271+0000 7f4153fff640 1 --2- 172.21.15.64:0/3925329372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c0d10b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35cd27dc08b3d414 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:55.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.272+0000 7f415affd640 1 -- 172.21.15.64:0/3925329372 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144030840 con 0x7f415c0d0cd0 2023-10-14T12:29:55.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.272+0000 7f415affd640 1 -- 172.21.15.64:0/3925329372 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41440309a0 con 0x7f415c0d0cd0 2023-10-14T12:29:55.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.272+0000 7f415affd640 1 -- 172.21.15.64:0/3925329372 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144030d30 con 0x7f415c0d0cd0 2023-10-14T12:29:55.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 -- 172.21.15.64:0/3925329372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 msgr2=0x7f415c0d10b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 --2- 172.21.15.64:0/3925329372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c0d10b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4144009870 tx=0x7f414402b980 comp rx=0 tx=0).stop 2023-10-14T12:29:55.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 -- 172.21.15.64:0/3925329372 shutdown_connections 2023-10-14T12:29:55.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 --2- 172.21.15.64:0/3925329372 >> v2:172.21.15.177:3300/0 conn(0x7f415c06b570 0x7f415c06ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 --2- 172.21.15.64:0/3925329372 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c0d10b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 -- 172.21.15.64:0/3925329372 >> 172.21.15.64:0/3925329372 conn(0x7f415c08c140 msgr2=0x7f415c09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:55.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 -- 172.21.15.64:0/3925329372 shutdown_connections 2023-10-14T12:29:55.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.273+0000 7f4160df4640 1 -- 172.21.15.64:0/3925329372 wait complete. 2023-10-14T12:29:55.276 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.275+0000 7f4160df4640 1 Processor -- start 2023-10-14T12:29:55.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.275+0000 7f4160df4640 1 -- start start 2023-10-14T12:29:55.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4160df4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f415c06b570 0x7f415c155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4160df4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f415c0b1a30 0x7f415c156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4160df4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4160df4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0b71f0 con 0x7f415c0b1a30 2023-10-14T12:29:55.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4160df4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0b6920 con 0x7f415c06b570 2023-10-14T12:29:55.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4160df4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415c0b6c00 con 0x7f415c0d0cd0 2023-10-14T12:29:55.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4153fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f415c0b1a30 0x7f415c156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4153fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f415c0b1a30 0x7f415c156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52650/0 (socket says 172.21.15.64:52650) 2023-10-14T12:29:55.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.276+0000 7f4153fff640 1 -- 172.21.15.64:0/3355336235 learned_addr learned my addr 172.21.15.64:0/3355336235 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:55.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f415bfff640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f415b7fe640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f415c06b570 0x7f415c155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4153fff640 1 -- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 msgr2=0x7f415c156cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4153fff640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4153fff640 1 -- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f415c06b570 msgr2=0x7f415c155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4153fff640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f415c06b570 0x7f415c155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4153fff640 1 -- 172.21.15.64:0/3355336235 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41440094d0 con 0x7f415c0b1a30 2023-10-14T12:29:55.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f415b7fe640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f415c06b570 0x7f415c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:55.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4153fff640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f415c0b1a30 0x7f415c156780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f4144004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:55.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4158ff9640 1 -- 172.21.15.64:0/3355336235 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144039a90 con 0x7f415c0b1a30 2023-10-14T12:29:55.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4158ff9640 1 -- 172.21.15.64:0/3355336235 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4144039bf0 con 0x7f415c0b1a30 2023-10-14T12:29:55.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4158ff9640 1 -- 172.21.15.64:0/3355336235 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4144043410 con 0x7f415c0b1a30 2023-10-14T12:29:55.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.277+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415c0b6ee0 con 0x7f415c0b1a30 2023-10-14T12:29:55.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.278+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415c156490 con 0x7f415c0b1a30 2023-10-14T12:29:55.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.279+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415c04e9b0 con 0x7f415c0b1a30 2023-10-14T12:29:55.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.280+0000 7f4158ff9640 1 -- 172.21.15.64:0/3355336235 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f414402f390 con 0x7f415c0b1a30 2023-10-14T12:29:55.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.280+0000 7f4158ff9640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f413c06ae70 0x7f413c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.281+0000 7f4158ff9640 1 -- 172.21.15.64:0/3355336235 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f41440abae0 con 0x7f415c0b1a30 2023-10-14T12:29:55.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.281+0000 7f415b7fe640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f413c06ae70 0x7f413c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.282+0000 7f415b7fe640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f413c06ae70 0x7f413c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f414c000f60 tx=0x7f414c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:55.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.285+0000 7f4158ff9640 1 -- 172.21.15.64:0/3355336235 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f41440768f0 con 0x7f415c0b1a30 2023-10-14T12:29:55.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.476+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f415c0d3120 con 0x7f415c0b1a30 2023-10-14T12:29:55.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.477+0000 7f4158ff9640 1 -- 172.21.15.64:0/3355336235 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4144048020 con 0x7f415c0b1a30 2023-10-14T12:29:55.479 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:55.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f413c06ae70 msgr2=0x7f413c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f413c06ae70 0x7f413c06d330 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f414c000f60 tx=0x7f414c009040 comp rx=0 tx=0).stop 2023-10-14T12:29:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f415c0b1a30 msgr2=0x7f415c156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f415c0b1a30 0x7f415c156780 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4144000c00 tx=0x7f4144004730 comp rx=0 tx=0).stop 2023-10-14T12:29:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 shutdown_connections 2023-10-14T12:29:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f413c06ae70 0x7f413c06d330 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f415c0d0cd0 0x7f415c156cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f415c0b1a30 0x7f415c156780 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 --2- 172.21.15.64:0/3355336235 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f415c06b570 0x7f415c155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.479+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 >> 172.21.15.64:0/3355336235 conn(0x7f415c08c140 msgr2=0x7f415c0d2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:55.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.480+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 shutdown_connections 2023-10-14T12:29:55.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.480+0000 7f4160df4640 1 -- 172.21.15.64:0/3355336235 wait complete. 2023-10-14T12:29:55.499 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:55.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.725+0000 7f3e55613640 1 Processor -- start 2023-10-14T12:29:55.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.725+0000 7f3e55613640 1 -- start start 2023-10-14T12:29:55.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.726+0000 7f3e55613640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e5015c940 0x7f3e500d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.726+0000 7f3e55613640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f3e500d0d80 0x7f3e500d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.727+0000 7f3e55613640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e500ce810 con 0x7f3e50160520 2023-10-14T12:29:55.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.727+0000 7f3e55613640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e500d1740 con 0x7f3e500d0d80 2023-10-14T12:29:55.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.727+0000 7f3e55613640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500b5b40 con 0x7f3e5015c940 2023-10-14T12:29:55.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.727+0000 7f3e4ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e5015c940 0x7f3e500d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.727+0000 7f3e4ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e5015c940 0x7f3e500d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:51632/0 (socket says 172.21.15.64:51632) 2023-10-14T12:29:55.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.727+0000 7f3e4ffff640 1 -- 172.21.15.64:0/350094314 learned_addr learned my addr 172.21.15.64:0/350094314 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:55.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.727+0000 7f3e4f7fe640 1 --2- 172.21.15.64:0/350094314 >> v2:172.21.15.177:3300/0 conn(0x7f3e500d0d80 0x7f3e500d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.728+0000 7f3e4effd640 1 -- 172.21.15.64:0/350094314 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 170941302 0 0) 0x7f3e500ce810 con 0x7f3e50160520 2023-10-14T12:29:55.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.728+0000 7f3e4effd640 1 -- 172.21.15.64:0/350094314 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e38003520 con 0x7f3e50160520 2023-10-14T12:29:55.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.728+0000 7f3e4ffff640 1 -- 172.21.15.64:0/350094314 >> v2:172.21.15.177:3300/0 conn(0x7f3e500d0d80 msgr2=0x7f3e500d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:55.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.728+0000 7f3e4ffff640 1 --2- 172.21.15.64:0/350094314 >> v2:172.21.15.177:3300/0 conn(0x7f3e500d0d80 0x7f3e500d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.728+0000 7f3e4ffff640 1 -- 172.21.15.64:0/350094314 >> v1:172.21.15.177:6789/0 conn(0x7f3e50160520 legacy=0x7f3e501609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.728+0000 7f3e4ffff640 1 -- 172.21.15.64:0/350094314 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e500ce250 con 0x7f3e5015c940 2023-10-14T12:29:55.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.730+0000 7f3e4ffff640 1 --2- 172.21.15.64:0/350094314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e5015c940 0x7f3e500d0400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4002bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bf0f6106191f095 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:55.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.730+0000 7f3e4effd640 1 -- 172.21.15.64:0/350094314 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4002ca60 con 0x7f3e5015c940 2023-10-14T12:29:55.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.730+0000 7f3e4effd640 1 -- 172.21.15.64:0/350094314 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4002cbc0 con 0x7f3e5015c940 2023-10-14T12:29:55.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.730+0000 7f3e4effd640 1 -- 172.21.15.64:0/350094314 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e400343f0 con 0x7f3e5015c940 2023-10-14T12:29:55.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 -- 172.21.15.64:0/350094314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e5015c940 msgr2=0x7f3e500d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 --2- 172.21.15.64:0/350094314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e5015c940 0x7f3e500d0400 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e40009e50 tx=0x7f3e4002bec0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 -- 172.21.15.64:0/350094314 shutdown_connections 2023-10-14T12:29:55.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 --2- 172.21.15.64:0/350094314 >> v2:172.21.15.177:3300/0 conn(0x7f3e500d0d80 0x7f3e500d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 --2- 172.21.15.64:0/350094314 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e5015c940 0x7f3e500d0400 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 -- 172.21.15.64:0/350094314 >> 172.21.15.64:0/350094314 conn(0x7f3e5009bb30 msgr2=0x7f3e500d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:55.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 -- 172.21.15.64:0/350094314 shutdown_connections 2023-10-14T12:29:55.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.731+0000 7f3e55613640 1 -- 172.21.15.64:0/350094314 wait complete. 2023-10-14T12:29:55.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.733+0000 7f3e55613640 1 Processor -- start 2023-10-14T12:29:55.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.733+0000 7f3e55613640 1 -- start start 2023-10-14T12:29:55.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e55613640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e500d0d80 0x7f3e500caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e55613640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5015c940 0x7f3e5006bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e55613640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e50160520 0x7f3e5006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e55613640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5015b8e0 con 0x7f3e5015c940 2023-10-14T12:29:55.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e55613640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500cc440 con 0x7f3e50160520 2023-10-14T12:29:55.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e55613640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e500cb830 con 0x7f3e500d0d80 2023-10-14T12:29:55.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e4f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5015c940 0x7f3e5006bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e4f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5015c940 0x7f3e5006bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52662/0 (socket says 172.21.15.64:52662) 2023-10-14T12:29:55.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.734+0000 7f3e4f7fe640 1 -- 172.21.15.64:0/2947562854 learned_addr learned my addr 172.21.15.64:0/2947562854 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:55.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4ffff640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e500d0d80 0x7f3e500caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4f7fe640 1 -- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e500d0d80 msgr2=0x7f3e500caf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4f7fe640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e500d0d80 0x7f3e500caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4f7fe640 1 -- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e50160520 msgr2=0x7f3e5006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4f7fe640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e50160520 0x7f3e5006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4f7fe640 1 -- 172.21.15.64:0/2947562854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e40009b30 con 0x7f3e5015c940 2023-10-14T12:29:55.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4f7fe640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5015c940 0x7f3e5006bfb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e870 tx=0x7f3e4400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:55.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4cff9640 1 -- 172.21.15.64:0/2947562854 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e440094f0 con 0x7f3e5015c940 2023-10-14T12:29:55.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.735+0000 7f3e4cff9640 1 -- 172.21.15.64:0/2947562854 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e4400c940 con 0x7f3e5015c940 2023-10-14T12:29:55.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.736+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e500cbb10 con 0x7f3e5015c940 2023-10-14T12:29:55.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.736+0000 7f3e4cff9640 1 -- 172.21.15.64:0/2947562854 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4400ccf0 con 0x7f3e5015c940 2023-10-14T12:29:55.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.736+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e500cc0d0 con 0x7f3e5015c940 2023-10-14T12:29:55.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.737+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e5004e9b0 con 0x7f3e5015c940 2023-10-14T12:29:55.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.738+0000 7f3e4cff9640 1 -- 172.21.15.64:0/2947562854 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3e44013470 con 0x7f3e5015c940 2023-10-14T12:29:55.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.739+0000 7f3e4cff9640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3e3c06ae70 0x7f3e3c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:55.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.739+0000 7f3e4cff9640 1 -- 172.21.15.64:0/2947562854 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3e44089b20 con 0x7f3e5015c940 2023-10-14T12:29:55.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.739+0000 7f3e4ffff640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3e3c06ae70 0x7f3e3c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:55.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.740+0000 7f3e4ffff640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3e3c06ae70 0x7f3e3c06d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e40035000 tx=0x7f3e40030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:55.746 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.743+0000 7f3e4cff9640 1 -- 172.21.15.64:0/2947562854 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3e44054780 con 0x7f3e5015c940 2023-10-14T12:29:55.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.945+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3e500cc580 con 0x7f3e5015c940 2023-10-14T12:29:55.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.946+0000 7f3e4cff9640 1 -- 172.21.15.64:0/2947562854 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3e44057da0 con 0x7f3e5015c940 2023-10-14T12:29:55.948 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:55.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.948+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3e3c06ae70 msgr2=0x7f3e3c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.948+0000 7f3e55613640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3e3c06ae70 0x7f3e3c06d330 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3e40035000 tx=0x7f3e40030000 comp rx=0 tx=0).stop 2023-10-14T12:29:55.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5015c940 msgr2=0x7f3e5006bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:55.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5015c940 0x7f3e5006bfb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3e4400e870 tx=0x7f3e4400ed30 comp rx=0 tx=0).stop 2023-10-14T12:29:55.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 shutdown_connections 2023-10-14T12:29:55.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f3e3c06ae70 0x7f3e3c06d330 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f3e50160520 0x7f3e5006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3e5015c940 0x7f3e5006bfb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 --2- 172.21.15.64:0/2947562854 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f3e500d0d80 0x7f3e500caf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:55.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 >> 172.21.15.64:0/2947562854 conn(0x7f3e5009bb30 msgr2=0x7f3e500b7360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:55.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 shutdown_connections 2023-10-14T12:29:55.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:55.949+0000 7f3e55613640 1 -- 172.21.15.64:0/2947562854 wait complete. 2023-10-14T12:29:55.970 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:56.196 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.195+0000 7f38f1380640 1 Processor -- start 2023-10-14T12:29:56.197 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.195+0000 7f38f1380640 1 -- start start 2023-10-14T12:29:56.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.196+0000 7f38f1380640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 0x7f38ec0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.197+0000 7f38f1380640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0ce4c0 con 0x7f38ec160da0 2023-10-14T12:29:56.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.197+0000 7f38f1380640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38ec0cd8b0 con 0x7f38ec15cc40 2023-10-14T12:29:56.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.197+0000 7f38f1380640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec15d0d0 con 0x7f38ec1609c0 2023-10-14T12:29:56.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.197+0000 7f38eb7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f38ec160da0 0x7f38ec15c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41890/0 (socket says 172.21.15.64:41890) 2023-10-14T12:29:56.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.197+0000 7f38eb7fe640 1 -- 172.21.15.64:0/340937234 learned_addr learned my addr 172.21.15.64:0/340937234 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:56.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.197+0000 7f38ebfff640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 0x7f38ec0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1892891138 0 0) 0x7f38ec0ce4c0 con 0x7f38ec160da0 2023-10-14T12:29:56.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38d4003520 con 0x7f38ec160da0 2023-10-14T12:29:56.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 996025442 0 0) 0x7f38d4003520 con 0x7f38ec160da0 2023-10-14T12:29:56.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 msgr2=0x7f38ec0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:56.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 0x7f38ec0d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 >> v1:172.21.15.177:6789/0 conn(0x7f38ec15cc40 legacy=0x7f38ec0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec0cdb90 con 0x7f38ec160da0 2023-10-14T12:29:56.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f38e0001670 con 0x7f38ec160da0 2023-10-14T12:29:56.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 >> v1:172.21.15.64:6789/0 conn(0x7f38ec160da0 legacy=0x7f38ec15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4003a10 0x7f38d4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 0x7f38d40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec15d0d0 con 0x7f38d4004d00 2023-10-14T12:29:56.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38d400ba30 con 0x7f38d4003a10 2023-10-14T12:29:56.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.198+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38d400bbf0 con 0x7f38ec1609c0 2023-10-14T12:29:56.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38f0b7f640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38eb7fe640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 0x7f38d40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38ebfff640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4003a10 0x7f38d4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38f0b7f640 1 -- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 msgr2=0x7f38d40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:56.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38f0b7f640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec1609c0 0x7f38d40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38f0b7f640 1 -- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4003a10 msgr2=0x7f38d4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:56.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38f0b7f640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4003a10 0x7f38d4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.199+0000 7f38f0b7f640 1 -- 172.21.15.64:0/340937234 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38d4003520 con 0x7f38d4004d00 2023-10-14T12:29:56.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.200+0000 7f38f0b7f640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38e4001860 tx=0x7f38d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459c3db812c04d30 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:56.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.200+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4033410 con 0x7f38d4004d00 2023-10-14T12:29:56.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.200+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e4033590 con 0x7f38d4004d00 2023-10-14T12:29:56.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.200+0000 7f38eaffd640 1 -- 172.21.15.64:0/340937234 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4033940 con 0x7f38d4004d00 2023-10-14T12:29:56.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.201+0000 7f38f1380640 1 -- 172.21.15.64:0/340937234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38d4004d00 msgr2=0x7f38d4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.201+0000 7f38f1380640 1 --2- 172.21.15.64:0/340937234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38d4004d00 0x7f38d4005180 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f38e4001860 tx=0x7f38d40057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.201+0000 7f38f0b7f640 1 -- 172.21.15.64:0/340937234 reap_dead start 2023-10-14T12:29:56.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.201+0000 7f38f1380640 1 -- 172.21.15.64:0/340937234 shutdown_connections 2023-10-14T12:29:56.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.201+0000 7f38f1380640 1 -- 172.21.15.64:0/340937234 >> 172.21.15.64:0/340937234 conn(0x7f38ec09bbf0 msgr2=0x7f38ec0d28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:56.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.201+0000 7f38f1380640 1 -- 172.21.15.64:0/340937234 shutdown_connections 2023-10-14T12:29:56.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.201+0000 7f38f1380640 1 -- 172.21.15.64:0/340937234 wait complete. 2023-10-14T12:29:56.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.203+0000 7f38f1380640 1 Processor -- start 2023-10-14T12:29:56.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.203+0000 7f38f1380640 1 -- start start 2023-10-14T12:29:56.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.204+0000 7f38f1380640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4004d00 0x7f38ec15fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.204+0000 7f38f1380640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec0cc6b0 0x7f38ec1f5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.204+0000 7f38f1380640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38ec15ef70 0x7f38ec15f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.204+0000 7f38f1380640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec0b4b70 con 0x7f38ec15ef70 2023-10-14T12:29:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.204+0000 7f38f1380640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec15f960 con 0x7f38d4004d00 2023-10-14T12:29:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.204+0000 7f38f1380640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38ec1600b0 con 0x7f38ec0cc6b0 2023-10-14T12:29:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.204+0000 7f38f0b7f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38ec15ef70 0x7f38ec15f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38ec15ef70 0x7f38ec15f420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45716/0 (socket says 172.21.15.64:45716) 2023-10-14T12:29:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 -- 172.21.15.64:0/1342800286 learned_addr learned my addr 172.21.15.64:0/1342800286 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:56.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38ebfff640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4004d00 0x7f38ec15fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38eb7fe640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec0cc6b0 0x7f38ec1f5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 -- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec0cc6b0 msgr2=0x7f38ec1f5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec0cc6b0 0x7f38ec1f5980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 -- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4004d00 msgr2=0x7f38ec15fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4004d00 0x7f38ec15fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 -- 172.21.15.64:0/1342800286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec0b4dc0 con 0x7f38ec15ef70 2023-10-14T12:29:56.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.205+0000 7f38f0b7f640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38ec15ef70 0x7f38ec15f420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f38e4008fd0 tx=0x7f38e4001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:56.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.206+0000 7f38e8ff9640 1 -- 172.21.15.64:0/1342800286 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e4033410 con 0x7f38ec15ef70 2023-10-14T12:29:56.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.206+0000 7f38e8ff9640 1 -- 172.21.15.64:0/1342800286 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38e4005070 con 0x7f38ec15ef70 2023-10-14T12:29:56.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.206+0000 7f38e8ff9640 1 -- 172.21.15.64:0/1342800286 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38e40053e0 con 0x7f38ec15ef70 2023-10-14T12:29:56.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.206+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ec0b50a0 con 0x7f38ec15ef70 2023-10-14T12:29:56.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.206+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ec15d680 con 0x7f38ec15ef70 2023-10-14T12:29:56.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.207+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38ec04e9b0 con 0x7f38ec15ef70 2023-10-14T12:29:56.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.208+0000 7f38e8ff9640 1 -- 172.21.15.64:0/1342800286 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f38e403a050 con 0x7f38ec15ef70 2023-10-14T12:29:56.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.209+0000 7f38e8ff9640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f38d806ae70 0x7f38d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.209+0000 7f38e8ff9640 1 -- 172.21.15.64:0/1342800286 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f38e40aa210 con 0x7f38ec15ef70 2023-10-14T12:29:56.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.210+0000 7f38ebfff640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f38d806ae70 0x7f38d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.211+0000 7f38ebfff640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f38d806ae70 0x7f38d806d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f38ec15d330 tx=0x7f38dc00b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:56.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.213+0000 7f38e8ff9640 1 -- 172.21.15.64:0/1342800286 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f38e4074ea0 con 0x7f38ec15ef70 2023-10-14T12:29:56.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.408+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f38ec0b8860 con 0x7f38ec15ef70 2023-10-14T12:29:56.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.409+0000 7f38e8ff9640 1 -- 172.21.15.64:0/1342800286 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f38e40784c0 con 0x7f38ec15ef70 2023-10-14T12:29:56.411 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:56.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f38d806ae70 msgr2=0x7f38d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f38d806ae70 0x7f38d806d330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f38ec15d330 tx=0x7f38dc00b040 comp rx=0 tx=0).stop 2023-10-14T12:29:56.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38ec15ef70 msgr2=0x7f38ec15f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38ec15ef70 0x7f38ec15f420 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f38e4008fd0 tx=0x7f38e4001230 comp rx=0 tx=0).stop 2023-10-14T12:29:56.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 shutdown_connections 2023-10-14T12:29:56.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f38d806ae70 0x7f38d806d330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f38ec15ef70 0x7f38ec15f420 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f38ec0cc6b0 0x7f38ec1f5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 --2- 172.21.15.64:0/1342800286 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f38d4004d00 0x7f38ec15fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.412+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 >> 172.21.15.64:0/1342800286 conn(0x7f38ec09bbf0 msgr2=0x7f38ec06c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.413+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 shutdown_connections 2023-10-14T12:29:56.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.413+0000 7f38f1380640 1 -- 172.21.15.64:0/1342800286 wait complete. 2023-10-14T12:29:56.433 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:56.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.665+0000 7f17a359e640 1 Processor -- start 2023-10-14T12:29:56.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.666+0000 7f17a359e640 1 -- start start 2023-10-14T12:29:56.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.667+0000 7f17a359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 0x7f17a40d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.667+0000 7f17a359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40ce810 con 0x7f17a40b6fe0 2023-10-14T12:29:56.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.668+0000 7f17a359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17a40b5b40 con 0x7f17a40d0d80 2023-10-14T12:29:56.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.668+0000 7f17a359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4161340 con 0x7f17a415c940 2023-10-14T12:29:56.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.668+0000 7f17a2d9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f17a40b6fe0 0x7f17a4160c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41898/0 (socket says 172.21.15.64:41898) 2023-10-14T12:29:56.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.668+0000 7f17a2d9d640 1 -- 172.21.15.64:0/2373725512 learned_addr learned my addr 172.21.15.64:0/2373725512 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:56.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.668+0000 7f17a259c640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 0x7f17a40d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.668+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 796736842 0 0) 0x7f17a40ce810 con 0x7f17a40b6fe0 2023-10-14T12:29:56.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.668+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f178c003520 con 0x7f17a40b6fe0 2023-10-14T12:29:56.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2552060953 0 0) 0x7f17a40b5b40 con 0x7f17a40d0d80 2023-10-14T12:29:56.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a40ce810 con 0x7f17a40d0d80 2023-10-14T12:29:56.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4031262313 0 0) 0x7f178c003520 con 0x7f17a40b6fe0 2023-10-14T12:29:56.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 msgr2=0x7f17a40d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:56.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 0x7f17a40d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 >> v1:172.21.15.177:6789/0 conn(0x7f17a40d0d80 legacy=0x7f17a4160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a40ce250 con 0x7f17a40b6fe0 2023-10-14T12:29:56.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f179c0019f0 con 0x7f17a40b6fe0 2023-10-14T12:29:56.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 >> v1:172.21.15.64:6789/0 conn(0x7f17a40b6fe0 legacy=0x7f17a4160c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 0x7f178c003ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178c004150 0x7f178c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f178c004d00 0x7f178c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a4161340 con 0x7f178c004150 2023-10-14T12:29:56.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c00bbc0 con 0x7f178c004d00 2023-10-14T12:29:56.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c00bd80 con 0x7f17a415c940 2023-10-14T12:29:56.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.669+0000 7f17a1d9b640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178c004150 0x7f178c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.670+0000 7f17a259c640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 0x7f178c003ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.670+0000 7f17a2d9d640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f178c004d00 0x7f178c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.670+0000 7f17a1d9b640 1 -- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 msgr2=0x7f178c003ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:56.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.670+0000 7f17a1d9b640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f17a415c940 0x7f178c003ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.670+0000 7f17a1d9b640 1 -- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f178c004d00 msgr2=0x7f178c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:56.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.670+0000 7f17a1d9b640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f178c004d00 0x7f178c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.670+0000 7f17a1d9b640 1 -- 172.21.15.64:0/2373725512 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c003520 con 0x7f178c004150 2023-10-14T12:29:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.671+0000 7f17a1d9b640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178c004150 0x7f178c0047c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f17980018d0 tx=0x7f178c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b0fdda9f1046e8d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.671+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17980052d0 con 0x7f178c004150 2023-10-14T12:29:56.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.671+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798005430 con 0x7f178c004150 2023-10-14T12:29:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.671+0000 7f17a159a640 1 -- 172.21.15.64:0/2373725512 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798003810 con 0x7f178c004150 2023-10-14T12:29:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.672+0000 7f17a359e640 1 -- 172.21.15.64:0/2373725512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178c004150 msgr2=0x7f178c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.672+0000 7f17a359e640 1 --2- 172.21.15.64:0/2373725512 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f178c004150 0x7f178c0047c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f17980018d0 tx=0x7f178c0057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.672+0000 7f17a2d9d640 1 -- 172.21.15.64:0/2373725512 reap_dead start 2023-10-14T12:29:56.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.672+0000 7f17a359e640 1 -- 172.21.15.64:0/2373725512 shutdown_connections 2023-10-14T12:29:56.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.672+0000 7f17a359e640 1 -- 172.21.15.64:0/2373725512 >> 172.21.15.64:0/2373725512 conn(0x7f17a409bb30 msgr2=0x7f17a40d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:56.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.672+0000 7f17a359e640 1 -- 172.21.15.64:0/2373725512 shutdown_connections 2023-10-14T12:29:56.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.672+0000 7f17a359e640 1 -- 172.21.15.64:0/2373725512 wait complete. 2023-10-14T12:29:56.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.674+0000 7f17a359e640 1 Processor -- start 2023-10-14T12:29:56.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.674+0000 7f17a359e640 1 -- start start 2023-10-14T12:29:56.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f178c004150 0x7f17a41f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17a40c6290 0x7f17a41ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a415b000 0x7f17a415b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c72d0 con 0x7f17a40c6290 2023-10-14T12:29:56.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a415b9f0 con 0x7f17a415b000 2023-10-14T12:29:56.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a40c8110 con 0x7f178c004150 2023-10-14T12:29:56.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17a40c6290 0x7f17a41ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17a40c6290 0x7f17a41ef6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45730/0 (socket says 172.21.15.64:45730) 2023-10-14T12:29:56.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.675+0000 7f17a1d9b640 1 -- 172.21.15.64:0/65528847 learned_addr learned my addr 172.21.15.64:0/65528847 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:56.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a259c640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f178c004150 0x7f17a41f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a2d9d640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a415b000 0x7f17a415b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a1d9b640 1 -- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f178c004150 msgr2=0x7f17a41f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a1d9b640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f178c004150 0x7f17a41f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a1d9b640 1 -- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a415b000 msgr2=0x7f17a415b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a1d9b640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a415b000 0x7f17a415b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a1d9b640 1 -- 172.21.15.64:0/65528847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a41f3240 con 0x7f17a40c6290 2023-10-14T12:29:56.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a2d9d640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a415b000 0x7f17a415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:56.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.676+0000 7f17a1d9b640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17a40c6290 0x7f17a41ef6c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1798035040 tx=0x7f17980012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:56.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.677+0000 7f1792ffd640 1 -- 172.21.15.64:0/65528847 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798007450 con 0x7f17a40c6290 2023-10-14T12:29:56.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.677+0000 7f1792ffd640 1 -- 172.21.15.64:0/65528847 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17980075b0 con 0x7f17a40c6290 2023-10-14T12:29:56.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.677+0000 7f1792ffd640 1 -- 172.21.15.64:0/65528847 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798007720 con 0x7f17a40c6290 2023-10-14T12:29:56.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.677+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17a40c6750 con 0x7f17a40c6290 2023-10-14T12:29:56.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.677+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17a40c6d10 con 0x7f17a40c6290 2023-10-14T12:29:56.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.678+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17a404e9b0 con 0x7f17a40c6290 2023-10-14T12:29:56.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.679+0000 7f1792ffd640 1 -- 172.21.15.64:0/65528847 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f17980037f0 con 0x7f17a40c6290 2023-10-14T12:29:56.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.680+0000 7f1792ffd640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f178406ae70 0x7f178406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:56.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.680+0000 7f1792ffd640 1 -- 172.21.15.64:0/65528847 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f17980ab920 con 0x7f17a40c6290 2023-10-14T12:29:56.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.681+0000 7f17a259c640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f178406ae70 0x7f178406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:56.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.682+0000 7f17a259c640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f178406ae70 0x7f178406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17a40c74e0 tx=0x7f1794008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:56.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.684+0000 7f1792ffd640 1 -- 172.21.15.64:0/65528847 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1798076620 con 0x7f17a40c6290 2023-10-14T12:29:56.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.884+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f17a40c9890 con 0x7f17a40c6290 2023-10-14T12:29:56.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.890+0000 7f1792ffd640 1 -- 172.21.15.64:0/65528847 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f179804b020 con 0x7f17a40c6290 2023-10-14T12:29:56.892 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:56.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.892+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f178406ae70 msgr2=0x7f178406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.892+0000 7f17a359e640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f178406ae70 0x7f178406d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17a40c74e0 tx=0x7f1794008040 comp rx=0 tx=0).stop 2023-10-14T12:29:56.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.892+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17a40c6290 msgr2=0x7f17a41ef6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:56.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.892+0000 7f17a359e640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17a40c6290 0x7f17a41ef6c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1798035040 tx=0x7f17980012d0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 shutdown_connections 2023-10-14T12:29:56.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f178406ae70 0x7f178406d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f17a415b000 0x7f17a415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f17a40c6290 0x7f17a41ef6c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 --2- 172.21.15.64:0/65528847 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f178c004150 0x7f17a41f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:56.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 >> 172.21.15.64:0/65528847 conn(0x7f17a409bb30 msgr2=0x7f17a40b74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:56.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 shutdown_connections 2023-10-14T12:29:56.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:56.893+0000 7f17a359e640 1 -- 172.21.15.64:0/65528847 wait complete. 2023-10-14T12:29:56.913 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:29:57.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.136+0000 7f371759e640 1 Processor -- start 2023-10-14T12:29:57.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.136+0000 7f371759e640 1 -- start start 2023-10-14T12:29:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371759e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3718157040 0x7f371806d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180cd950 0x7f37180cea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371759e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f371806d4c0 con 0x7f37180ce600 2023-10-14T12:29:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371759e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37180cdde0 con 0x7f3718157040 2023-10-14T12:29:57.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180cefc0 con 0x7f37180cd950 2023-10-14T12:29:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371659c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3718157040 0x7f371806d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371659c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f3718157040 0x7f371806d950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45744/0 (socket says 172.21.15.64:45744) 2023-10-14T12:29:57.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.137+0000 7f371659c640 1 -- 172.21.15.64:0/2317631988 learned_addr learned my addr 172.21.15.64:0/2317631988 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.138+0000 7f3716d9d640 1 --2- 172.21.15.64:0/2317631988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180cd950 0x7f37180cea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.138+0000 7f371659c640 1 -- 172.21.15.64:0/2317631988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180cd950 msgr2=0x7f37180cea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.138+0000 7f371659c640 1 --2- 172.21.15.64:0/2317631988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180cd950 0x7f37180cea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.138+0000 7f3715d9b640 1 -- 172.21.15.64:0/2317631988 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1442511288 0 0) 0x7f371806d4c0 con 0x7f37180ce600 2023-10-14T12:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.138+0000 7f371659c640 1 -- 172.21.15.64:0/2317631988 >> v1:172.21.15.64:6789/0 conn(0x7f37180ce600 legacy=0x7f37180cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.138+0000 7f371659c640 1 -- 172.21.15.64:0/2317631988 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371806de90 con 0x7f3718157040 2023-10-14T12:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.139+0000 7f371659c640 1 --2- 172.21.15.64:0/2317631988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f371806d950 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3708009850 tx=0x7f370802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3445f23ae72ceef9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:57.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.139+0000 7f3715d9b640 1 -- 172.21.15.64:0/2317631988 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708004230 con 0x7f3718157040 2023-10-14T12:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.139+0000 7f3715d9b640 1 -- 172.21.15.64:0/2317631988 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3708004390 con 0x7f3718157040 2023-10-14T12:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.139+0000 7f3715d9b640 1 -- 172.21.15.64:0/2317631988 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3708003810 con 0x7f3718157040 2023-10-14T12:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 -- 172.21.15.64:0/2317631988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 msgr2=0x7f371806d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 --2- 172.21.15.64:0/2317631988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f371806d950 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3708009850 tx=0x7f370802b960 comp rx=0 tx=0).stop 2023-10-14T12:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 -- 172.21.15.64:0/2317631988 shutdown_connections 2023-10-14T12:29:57.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 --2- 172.21.15.64:0/2317631988 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180cd950 0x7f37180cea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 --2- 172.21.15.64:0/2317631988 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f371806d950 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 -- 172.21.15.64:0/2317631988 >> 172.21.15.64:0/2317631988 conn(0x7f3718069fc0 msgr2=0x7f371806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:57.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 -- 172.21.15.64:0/2317631988 shutdown_connections 2023-10-14T12:29:57.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.140+0000 7f371759e640 1 -- 172.21.15.64:0/2317631988 wait complete. 2023-10-14T12:29:57.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.142+0000 7f371759e640 1 Processor -- start 2023-10-14T12:29:57.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.142+0000 7f371759e640 1 -- start start 2023-10-14T12:29:57.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.143+0000 7f371759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37180cd950 0x7f37180c9850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.143+0000 7f371759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180ce600 0x7f37181f1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.143+0000 7f371759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f37181f61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.143+0000 7f371759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37180c93c0 con 0x7f3718157040 2023-10-14T12:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.143+0000 7f371759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37181f6710 con 0x7f37180cd950 2023-10-14T12:29:57.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.143+0000 7f371759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37180acb00 con 0x7f37180ce600 2023-10-14T12:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f37181f61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f37181f61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45758/0 (socket says 172.21.15.64:45758) 2023-10-14T12:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 -- 172.21.15.64:0/1574144443 learned_addr learned my addr 172.21.15.64:0/1574144443 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f370ffff640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180ce600 0x7f37181f1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f371659c640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37180cd950 0x7f37180c9850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 -- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180ce600 msgr2=0x7f37181f1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180ce600 0x7f37181f1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 -- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37180cd950 msgr2=0x7f37180c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37180cd950 0x7f37180c9850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.144+0000 7f3716d9d640 1 -- 172.21.15.64:0/1574144443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3708009460 con 0x7f3718157040 2023-10-14T12:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.145+0000 7f3716d9d640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f37181f61d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f371000cd20 tx=0x7f371000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.145+0000 7f370effd640 1 -- 172.21.15.64:0/1574144443 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710003b90 con 0x7f3718157040 2023-10-14T12:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.145+0000 7f370effd640 1 -- 172.21.15.64:0/1574144443 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3710003cf0 con 0x7f3718157040 2023-10-14T12:29:57.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.145+0000 7f370effd640 1 -- 172.21.15.64:0/1574144443 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3710004240 con 0x7f3718157040 2023-10-14T12:29:57.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.145+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37180c8a90 con 0x7f3718157040 2023-10-14T12:29:57.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.145+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37180c9050 con 0x7f3718157040 2023-10-14T12:29:57.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.146+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37180c9210 con 0x7f3718157040 2023-10-14T12:29:57.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.147+0000 7f370effd640 1 -- 172.21.15.64:0/1574144443 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f37100043a0 con 0x7f3718157040 2023-10-14T12:29:57.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.148+0000 7f370effd640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f806aec0 0x7f36f806d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.148+0000 7f370effd640 1 -- 172.21.15.64:0/1574144443 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3710012070 con 0x7f3718157040 2023-10-14T12:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.149+0000 7f371659c640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f806aec0 0x7f36f806d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.150+0000 7f371659c640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f806aec0 0x7f36f806d380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3708035000 tx=0x7f3708008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:57.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.153+0000 7f370effd640 1 -- 172.21.15.64:0/1574144443 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3710055000 con 0x7f3718157040 2023-10-14T12:29:57.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.362+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f371806c260 con 0x7f3718157040 2023-10-14T12:29:57.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.363+0000 7f370effd640 1 -- 172.21.15.64:0/1574144443 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3710058620 con 0x7f3718157040 2023-10-14T12:29:57.365 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:29:57.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.365+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f806aec0 msgr2=0x7f36f806d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.365+0000 7f371759e640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f806aec0 0x7f36f806d380 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f3708035000 tx=0x7f3708008030 comp rx=0 tx=0).stop 2023-10-14T12:29:57.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 msgr2=0x7f37181f61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f37181f61d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f371000cd20 tx=0x7f371000a660 comp rx=0 tx=0).stop 2023-10-14T12:29:57.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 shutdown_connections 2023-10-14T12:29:57.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f806aec0 0x7f36f806d380 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f3718157040 0x7f37181f61d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f37180ce600 0x7f37181f1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 --2- 172.21.15.64:0/1574144443 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f37180cd950 0x7f37180c9850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 >> 172.21.15.64:0/1574144443 conn(0x7f3718069fc0 msgr2=0x7f3718154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:57.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 shutdown_connections 2023-10-14T12:29:57.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.366+0000 7f371759e640 1 -- 172.21.15.64:0/1574144443 wait complete. 2023-10-14T12:29:57.386 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi064.front.sepia.ceph.com... 2023-10-14T12:29:57.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:57.386 DEBUG:teuthology.orchestra.run.smithi064:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-10-14T12:29:57.488 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:29:57.488 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:29:57.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:29:57.489 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T12:29:57.543 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:29:57.543 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:29:57.603 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:29:57.604 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:29:57.659 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:29:57.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.893+0000 7fce2f585640 1 Processor -- start 2023-10-14T12:29:57.896 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.894+0000 7fce2f585640 1 -- start start 2023-10-14T12:29:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.895+0000 7fce2f585640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fce280d16a0 0x7fce280cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.895+0000 7fce2f585640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280cfa90 con 0x7fce280cf680 2023-10-14T12:29:57.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.895+0000 7fce2f585640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce280d0320 con 0x7fce2815c9d0 2023-10-14T12:29:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.895+0000 7fce2f585640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce280d0600 con 0x7fce280d16a0 2023-10-14T12:29:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.896+0000 7fce2ed84640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fce280cf680 0x7fce280b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41910/0 (socket says 172.21.15.64:41910) 2023-10-14T12:29:57.898 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.896+0000 7fce2ed84640 1 -- 172.21.15.64:0/256938076 learned_addr learned my addr 172.21.15.64:0/256938076 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.896+0000 7fce2dd82640 1 --2- 172.21.15.64:0/256938076 >> v2:172.21.15.177:3300/0 conn(0x7fce280d16a0 0x7fce280cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.897+0000 7fce2dd82640 1 -- 172.21.15.64:0/256938076 >> v1:172.21.15.177:6789/0 conn(0x7fce2815c9d0 legacy=0x7fce280cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.897+0000 7fce2dd82640 1 -- 172.21.15.64:0/256938076 >> v1:172.21.15.64:6789/0 conn(0x7fce280cf680 legacy=0x7fce280b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.897+0000 7fce2dd82640 1 -- 172.21.15.64:0/256938076 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce280d08e0 con 0x7fce280d16a0 2023-10-14T12:29:57.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.898+0000 7fce2dd82640 1 --2- 172.21.15.64:0/256938076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce280d16a0 0x7fce280cf140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce180097a0 tx=0x7fce1802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=181cd5c3b9b9710b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:57.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.899+0000 7fce2d581640 1 -- 172.21.15.64:0/256938076 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18030610 con 0x7fce280d16a0 2023-10-14T12:29:57.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.899+0000 7fce2d581640 1 -- 172.21.15.64:0/256938076 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18030770 con 0x7fce280d16a0 2023-10-14T12:29:57.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.899+0000 7fce2d581640 1 -- 172.21.15.64:0/256938076 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18030b00 con 0x7fce280d16a0 2023-10-14T12:29:57.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.900+0000 7fce2f585640 1 -- 172.21.15.64:0/256938076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce280d16a0 msgr2=0x7fce280cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.900+0000 7fce2f585640 1 --2- 172.21.15.64:0/256938076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce280d16a0 0x7fce280cf140 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fce180097a0 tx=0x7fce1802b960 comp rx=0 tx=0).stop 2023-10-14T12:29:57.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.900+0000 7fce2f585640 1 -- 172.21.15.64:0/256938076 shutdown_connections 2023-10-14T12:29:57.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.900+0000 7fce2f585640 1 --2- 172.21.15.64:0/256938076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce280d16a0 0x7fce280cf140 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.900+0000 7fce2f585640 1 -- 172.21.15.64:0/256938076 >> 172.21.15.64:0/256938076 conn(0x7fce2809bad0 msgr2=0x7fce280d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:57.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.900+0000 7fce2f585640 1 -- 172.21.15.64:0/256938076 shutdown_connections 2023-10-14T12:29:57.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.900+0000 7fce2f585640 1 -- 172.21.15.64:0/256938076 wait complete. 2023-10-14T12:29:57.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.902+0000 7fce2f585640 1 Processor -- start 2023-10-14T12:29:57.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.902+0000 7fce2f585640 1 -- start start 2023-10-14T12:29:57.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2f585640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce280cf680 0x7fce28156dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2f585640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce280d16a0 0x7fce281e7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2f585640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce2815c9d0 0x7fce280c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2f585640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b73d0 con 0x7fce280d16a0 2023-10-14T12:29:57.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2f585640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce28157300 con 0x7fce2815c9d0 2023-10-14T12:29:57.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2f585640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce280b67c0 con 0x7fce280cf680 2023-10-14T12:29:57.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2dd82640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce280d16a0 0x7fce281e7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2dd82640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce280d16a0 0x7fce281e7480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45774/0 (socket says 172.21.15.64:45774) 2023-10-14T12:29:57.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2dd82640 1 -- 172.21.15.64:0/3173501215 learned_addr learned my addr 172.21.15.64:0/3173501215 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2e583640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce280cf680 0x7fce28156dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2ed84640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce2815c9d0 0x7fce280c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2dd82640 1 -- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce280cf680 msgr2=0x7fce28156dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.910 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2dd82640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce280cf680 0x7fce28156dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2dd82640 1 -- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce2815c9d0 msgr2=0x7fce280c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.904+0000 7fce2dd82640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce2815c9d0 0x7fce280c6280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.905+0000 7fce2dd82640 1 -- 172.21.15.64:0/3173501215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce18009400 con 0x7fce280d16a0 2023-10-14T12:29:57.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.905+0000 7fce2dd82640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce280d16a0 0x7fce281e7480 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fce180098c0 tx=0x7fce18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:57.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.905+0000 7fce1effd640 1 -- 172.21.15.64:0/3173501215 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce1803e040 con 0x7fce280d16a0 2023-10-14T12:29:57.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.905+0000 7fce1effd640 1 -- 172.21.15.64:0/3173501215 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce18039cb0 con 0x7fce280d16a0 2023-10-14T12:29:57.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.905+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce280b6aa0 con 0x7fce280d16a0 2023-10-14T12:29:57.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.905+0000 7fce1effd640 1 -- 172.21.15.64:0/3173501215 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce18044630 con 0x7fce280d16a0 2023-10-14T12:29:57.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.906+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce280b7060 con 0x7fce280d16a0 2023-10-14T12:29:57.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.907+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce280b7540 con 0x7fce280d16a0 2023-10-14T12:29:57.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.908+0000 7fce1effd640 1 -- 172.21.15.64:0/3173501215 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fce18043390 con 0x7fce280d16a0 2023-10-14T12:29:57.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.909+0000 7fce1effd640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0c06ae70 0x7fce0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:57.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.909+0000 7fce1effd640 1 -- 172.21.15.64:0/3173501215 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce180abe40 con 0x7fce280d16a0 2023-10-14T12:29:57.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.909+0000 7fce2e583640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0c06ae70 0x7fce0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:57.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.910+0000 7fce2e583640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0c06ae70 0x7fce0c06d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce2806cc20 tx=0x7fce24009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:57.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:57.914+0000 7fce1effd640 1 -- 172.21.15.64:0/3173501215 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce18076a10 con 0x7fce280d16a0 2023-10-14T12:29:58.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.113+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce2804e9b0 con 0x7fce280d16a0 2023-10-14T12:29:58.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.114+0000 7fce1effd640 1 -- 172.21.15.64:0/3173501215 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fce1807a030 con 0x7fce280d16a0 2023-10-14T12:29:58.116 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:29:58.117 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:29:58.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0c06ae70 msgr2=0x7fce0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0c06ae70 0x7fce0c06d330 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fce2806cc20 tx=0x7fce24009040 comp rx=0 tx=0).stop 2023-10-14T12:29:58.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce280d16a0 msgr2=0x7fce281e7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce280d16a0 0x7fce281e7480 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fce180098c0 tx=0x7fce18004730 comp rx=0 tx=0).stop 2023-10-14T12:29:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 shutdown_connections 2023-10-14T12:29:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0c06ae70 0x7fce0c06d330 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce2815c9d0 0x7fce280c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce280d16a0 0x7fce281e7480 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 --2- 172.21.15.64:0/3173501215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce280cf680 0x7fce28156dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 >> 172.21.15.64:0/3173501215 conn(0x7fce2809bad0 msgr2=0x7fce280cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:58.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.117+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 shutdown_connections 2023-10-14T12:29:58.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.118+0000 7fce2f585640 1 -- 172.21.15.64:0/3173501215 wait complete. 2023-10-14T12:29:58.139 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:29:58.140 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:29:58.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.374+0000 7f0a328aa640 1 Processor -- start 2023-10-14T12:29:58.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.374+0000 7f0a328aa640 1 -- start start 2023-10-14T12:29:58.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a328aa640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0a2c071f30 0x7f0a2c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.378 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a328aa640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0a2c0cdc00 0x7f0a2c06bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a328aa640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c0c89d0 con 0x7f0a2c071b50 2023-10-14T12:29:58.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a328aa640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c071600 con 0x7f0a2c0cdc00 2023-10-14T12:29:58.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a328aa640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c15a260 con 0x7f0a2c071f30 2023-10-14T12:29:58.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a320a9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0a2c0cdc00 0x7f0a2c06bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a320a9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0a2c0cdc00 0x7f0a2c06bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45790/0 (socket says 172.21.15.64:45790) 2023-10-14T12:29:58.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a320a9640 1 -- 172.21.15.64:0/3605597094 learned_addr learned my addr 172.21.15.64:0/3605597094 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:58.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.376+0000 7f0a310a7640 1 --2- 172.21.15.64:0/3605597094 >> v2:172.21.15.177:3300/0 conn(0x7f0a2c071f30 0x7f0a2c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.377+0000 7f0a320a9640 1 -- 172.21.15.64:0/3605597094 >> v2:172.21.15.177:3300/0 conn(0x7f0a2c071f30 msgr2=0x7f0a2c159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:58.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.377+0000 7f0a320a9640 1 --2- 172.21.15.64:0/3605597094 >> v2:172.21.15.177:3300/0 conn(0x7f0a2c071f30 0x7f0a2c159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.377+0000 7f0a320a9640 1 -- 172.21.15.64:0/3605597094 >> v1:172.21.15.177:6789/0 conn(0x7f0a2c071b50 legacy=0x7f0a2c070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.377+0000 7f0a320a9640 1 -- 172.21.15.64:0/3605597094 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c15a540 con 0x7f0a2c0cdc00 2023-10-14T12:29:58.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.378+0000 7f0a320a9640 1 --2- 172.21.15.64:0/3605597094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c0cdc00 0x7f0a2c06bf20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0b4420 tx=0x7f0a2402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e78efc331a7c084 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:58.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.378+0000 7f0a308a6640 1 -- 172.21.15.64:0/3605597094 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24030860 con 0x7f0a2c0cdc00 2023-10-14T12:29:58.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.378+0000 7f0a308a6640 1 -- 172.21.15.64:0/3605597094 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a240309c0 con 0x7f0a2c0cdc00 2023-10-14T12:29:58.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.378+0000 7f0a308a6640 1 -- 172.21.15.64:0/3605597094 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a24030d50 con 0x7f0a2c0cdc00 2023-10-14T12:29:58.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 -- 172.21.15.64:0/3605597094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c0cdc00 msgr2=0x7f0a2c06bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 --2- 172.21.15.64:0/3605597094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c0cdc00 0x7f0a2c06bf20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0b4420 tx=0x7f0a2402b9a0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 -- 172.21.15.64:0/3605597094 shutdown_connections 2023-10-14T12:29:58.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 --2- 172.21.15.64:0/3605597094 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c0cdc00 0x7f0a2c06bf20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 --2- 172.21.15.64:0/3605597094 >> v2:172.21.15.177:3300/0 conn(0x7f0a2c071f30 0x7f0a2c159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 -- 172.21.15.64:0/3605597094 >> 172.21.15.64:0/3605597094 conn(0x7f0a2c06a470 msgr2=0x7f0a2c0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:58.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 -- 172.21.15.64:0/3605597094 shutdown_connections 2023-10-14T12:29:58.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.379+0000 7f0a328aa640 1 -- 172.21.15.64:0/3605597094 wait complete. 2023-10-14T12:29:58.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.381+0000 7f0a328aa640 1 Processor -- start 2023-10-14T12:29:58.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.381+0000 7f0a328aa640 1 -- start start 2023-10-14T12:29:58.387 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a328aa640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c071b50 0x7f0a2c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a328aa640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a2c071f30 0x7f0a2c0af000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a328aa640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a2c0cdc00 0x7f0a2c150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a328aa640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b1380 con 0x7f0a2c071b50 2023-10-14T12:29:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a328aa640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0c7580 con 0x7f0a2c071f30 2023-10-14T12:29:58.388 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a328aa640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0c77d0 con 0x7f0a2c0cdc00 2023-10-14T12:29:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a318a8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c071b50 0x7f0a2c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a318a8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c071b50 0x7f0a2c0b0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45806/0 (socket says 172.21.15.64:45806) 2023-10-14T12:29:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a318a8640 1 -- 172.21.15.64:0/1629043724 learned_addr learned my addr 172.21.15.64:0/1629043724 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.382+0000 7f0a310a7640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a2c071f30 0x7f0a2c0af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a320a9640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a2c0cdc00 0x7f0a2c150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a318a8640 1 -- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a2c0cdc00 msgr2=0x7f0a2c150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a318a8640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a2c0cdc00 0x7f0a2c150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a318a8640 1 -- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a2c071f30 msgr2=0x7f0a2c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a318a8640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a2c071f30 0x7f0a2c0af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a318a8640 1 -- 172.21.15.64:0/1629043724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a240094d0 con 0x7f0a2c071b50 2023-10-14T12:29:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a320a9640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a2c0cdc00 0x7f0a2c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a318a8640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c071b50 0x7f0a2c0b0e40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c870 tx=0x7f0a2800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a227fc640 1 -- 172.21.15.64:0/1629043724 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a28003b70 con 0x7f0a2c071b50 2023-10-14T12:29:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a227fc640 1 -- 172.21.15.64:0/1629043724 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a28003cf0 con 0x7f0a2c071b50 2023-10-14T12:29:58.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a227fc640 1 -- 172.21.15.64:0/1629043724 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2800aa90 con 0x7f0a2c071b50 2023-10-14T12:29:58.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c0c7ab0 con 0x7f0a2c071b50 2023-10-14T12:29:58.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.383+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c0c8070 con 0x7f0a2c071b50 2023-10-14T12:29:58.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.385+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c0c8230 con 0x7f0a2c071b50 2023-10-14T12:29:58.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.385+0000 7f0a227fc640 1 -- 172.21.15.64:0/1629043724 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0a2800abf0 con 0x7f0a2c071b50 2023-10-14T12:29:58.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.386+0000 7f0a227fc640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0a1006ae70 0x7f0a1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.386+0000 7f0a227fc640 1 -- 172.21.15.64:0/1629043724 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0a28089810 con 0x7f0a2c071b50 2023-10-14T12:29:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.387+0000 7f0a310a7640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0a1006ae70 0x7f0a1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.388+0000 7f0a310a7640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0a1006ae70 0x7f0a1006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0ae840 tx=0x7f0a1c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:58.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.391+0000 7f0a227fc640 1 -- 172.21.15.64:0/1629043724 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0a28054590 con 0x7f0a2c071b50 2023-10-14T12:29:58.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.583+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a2c04e9b0 con 0x7f0a2c071b50 2023-10-14T12:29:58.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.584+0000 7f0a227fc640 1 -- 172.21.15.64:0/1629043724 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a28003e60 con 0x7f0a2c071b50 2023-10-14T12:29:58.586 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:29:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0a1006ae70 msgr2=0x7f0a1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0a1006ae70 0x7f0a1006d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c0ae840 tx=0x7f0a1c008040 comp rx=0 tx=0).stop 2023-10-14T12:29:58.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c071b50 msgr2=0x7f0a2c0b0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c071b50 0x7f0a2c0b0e40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0a2800c870 tx=0x7f0a2800cd30 comp rx=0 tx=0).stop 2023-10-14T12:29:58.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 shutdown_connections 2023-10-14T12:29:58.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0a1006ae70 0x7f0a1006d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0a2c0cdc00 0x7f0a2c150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0a2c071f30 0x7f0a2c0af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 --2- 172.21.15.64:0/1629043724 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0a2c071b50 0x7f0a2c0b0e40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.586+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 >> 172.21.15.64:0/1629043724 conn(0x7f0a2c06a470 msgr2=0x7f0a2c0cca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:58.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.587+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 shutdown_connections 2023-10-14T12:29:58.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.587+0000 7f0a328aa640 1 -- 172.21.15.64:0/1629043724 wait complete. 2023-10-14T12:29:58.608 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:29:58.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.841+0000 7f930c9ed640 1 Processor -- start 2023-10-14T12:29:58.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.841+0000 7f930c9ed640 1 -- start start 2023-10-14T12:29:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.843+0000 7f930c9ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080b2ee0 0x7f930806d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.843+0000 7f930c9ed640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93081550f0 con 0x7f93080cf030 2023-10-14T12:29:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.843+0000 7f930c9ed640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f930806db50 con 0x7f9308154d10 2023-10-14T12:29:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.843+0000 7f930c9ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93080b13f0 con 0x7f93080b2ee0 2023-10-14T12:29:58.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.843+0000 7f9306ffd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f93080cf030 0x7f930806ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41914/0 (socket says 172.21.15.64:41914) 2023-10-14T12:29:58.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.843+0000 7f9306ffd640 1 -- 172.21.15.64:0/532225471 learned_addr learned my addr 172.21.15.64:0/532225471 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f9307fff640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080b2ee0 0x7f930806d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 27721252 0 0) 0x7f93081550f0 con 0x7f93080cf030 2023-10-14T12:29:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92f0003520 con 0x7f93080cf030 2023-10-14T12:29:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055610382 0 0) 0x7f930806db50 con 0x7f9308154d10 2023-10-14T12:29:58.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93081550f0 con 0x7f9308154d10 2023-10-14T12:29:58.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2053936382 0 0) 0x7f92f0003520 con 0x7f93080cf030 2023-10-14T12:29:58.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080b2ee0 msgr2=0x7f930806d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:58.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080b2ee0 0x7f930806d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 >> v1:172.21.15.177:6789/0 conn(0x7f9308154d10 legacy=0x7f93080ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080b16d0 con 0x7f93080cf030 2023-10-14T12:29:58.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.844+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f92fc001670 con 0x7f93080cf030 2023-10-14T12:29:58.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 >> v1:172.21.15.64:6789/0 conn(0x7f93080cf030 legacy=0x7f930806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93067fc640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92f0003ba0 0x7f92f0003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93067fc640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f00047c0 0x7f92f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93067fc640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005180 0x7f92f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080b13f0 con 0x7f92f0005180 2023-10-14T12:29:58.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92f000c050 con 0x7f92f00047c0 2023-10-14T12:29:58.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92f000c210 con 0x7f92f0003ba0 2023-10-14T12:29:58.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f9307fff640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005180 0x7f92f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f9306ffd640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f00047c0 0x7f92f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f93077fe640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92f0003ba0 0x7f92f0003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f9307fff640 1 -- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92f0003ba0 msgr2=0x7f92f0003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f9307fff640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f92f0003ba0 0x7f92f0003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f9307fff640 1 -- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f00047c0 msgr2=0x7f92f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f9307fff640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f00047c0 0x7f92f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.845+0000 7f9307fff640 1 -- 172.21.15.64:0/532225471 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f0003520 con 0x7f92f0005180 2023-10-14T12:29:58.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.847+0000 7f9307fff640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005180 0x7f92f000b980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f93080b32c0 tx=0x7f92f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d961a9704ff2fb7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:58.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.847+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f930002cb70 con 0x7f92f0005180 2023-10-14T12:29:58.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.847+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f930000f040 con 0x7f92f0005180 2023-10-14T12:29:58.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.847+0000 7f93067fc640 1 -- 172.21.15.64:0/532225471 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9300034440 con 0x7f92f0005180 2023-10-14T12:29:58.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.848+0000 7f930c9ed640 1 -- 172.21.15.64:0/532225471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005180 msgr2=0x7f92f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.848+0000 7f930c9ed640 1 --2- 172.21.15.64:0/532225471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f92f0005180 0x7f92f000b980 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f93080b32c0 tx=0x7f92f00057f0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.848+0000 7f9307fff640 1 -- 172.21.15.64:0/532225471 reap_dead start 2023-10-14T12:29:58.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.848+0000 7f930c9ed640 1 -- 172.21.15.64:0/532225471 shutdown_connections 2023-10-14T12:29:58.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.848+0000 7f930c9ed640 1 -- 172.21.15.64:0/532225471 >> 172.21.15.64:0/532225471 conn(0x7f930806a200 msgr2=0x7f930806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:58.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.848+0000 7f930c9ed640 1 -- 172.21.15.64:0/532225471 shutdown_connections 2023-10-14T12:29:58.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.848+0000 7f930c9ed640 1 -- 172.21.15.64:0/532225471 wait complete. 2023-10-14T12:29:58.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.850+0000 7f930c9ed640 1 Processor -- start 2023-10-14T12:29:58.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.850+0000 7f930c9ed640 1 -- start start 2023-10-14T12:29:58.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f930c9ed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f0005180 0x7f9308153b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f930c9ed640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93080c2030 0x7f930815bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f930c9ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080c24b0 0x7f930815c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f930c9ed640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080c2a10 con 0x7f93080c2030 2023-10-14T12:29:58.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f930c9ed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93080c2cf0 con 0x7f92f0005180 2023-10-14T12:29:58.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f930c9ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93080c2fd0 con 0x7f93080c24b0 2023-10-14T12:29:58.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f9306ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93080c2030 0x7f930815bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f9306ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93080c2030 0x7f930815bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45832/0 (socket says 172.21.15.64:45832) 2023-10-14T12:29:58.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f9306ffd640 1 -- 172.21.15.64:0/2017142330 learned_addr learned my addr 172.21.15.64:0/2017142330 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:58.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f93077fe640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f0005180 0x7f9308153b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.851+0000 7f9307fff640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080c24b0 0x7f930815c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f9306ffd640 1 -- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080c24b0 msgr2=0x7f930815c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f9306ffd640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080c24b0 0x7f930815c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f9306ffd640 1 -- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f0005180 msgr2=0x7f9308153b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:58.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f9306ffd640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f0005180 0x7f9308153b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f9306ffd640 1 -- 172.21.15.64:0/2017142330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93080c32b0 con 0x7f93080c2030 2023-10-14T12:29:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f9306ffd640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93080c2030 0x7f930815bdf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e730 tx=0x7f92fc00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f92effff640 1 -- 172.21.15.64:0/2017142330 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00ee40 con 0x7f93080c2030 2023-10-14T12:29:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.852+0000 7f92effff640 1 -- 172.21.15.64:0/2017142330 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92fc00c850 con 0x7f93080c2030 2023-10-14T12:29:58.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.853+0000 7f92effff640 1 -- 172.21.15.64:0/2017142330 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92fc00cc00 con 0x7f93080c2030 2023-10-14T12:29:58.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.853+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93080c3590 con 0x7f93080c2030 2023-10-14T12:29:58.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.853+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9308154330 con 0x7f93080c2030 2023-10-14T12:29:58.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.854+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9308154520 con 0x7f93080c2030 2023-10-14T12:29:58.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.855+0000 7f92effff640 1 -- 172.21.15.64:0/2017142330 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f92fc01d460 con 0x7f93080c2030 2023-10-14T12:29:58.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.856+0000 7f92effff640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f92f406aef0 0x7f92f406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:58.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.856+0000 7f92effff640 1 -- 172.21.15.64:0/2017142330 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f92fc0898b0 con 0x7f93080c2030 2023-10-14T12:29:58.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.856+0000 7f93077fe640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f92f406aef0 0x7f92f406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.857+0000 7f93077fe640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f92f406aef0 0x7f92f406d3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000f60 tx=0x7f92f8000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:58.864 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:58.860+0000 7f92effff640 1 -- 172.21.15.64:0/2017142330 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9308154520 con 0x7f93080c2030 2023-10-14T12:29:59.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.053+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9308154520 con 0x7f93080c2030 2023-10-14T12:29:59.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.053+0000 7f92effff640 1 -- 172.21.15.64:0/2017142330 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9308154520 con 0x7f93080c2030 2023-10-14T12:29:59.055 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:59.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.056+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f92f406aef0 msgr2=0x7f92f406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.056+0000 7f930c9ed640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f92f406aef0 0x7f92f406d3b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f92f8000f60 tx=0x7f92f8000ed0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.056+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93080c2030 msgr2=0x7f930815bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.056+0000 7f930c9ed640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93080c2030 0x7f930815bdf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f92fc00e730 tx=0x7f92fc00ebf0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 shutdown_connections 2023-10-14T12:29:59.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f92f406aef0 0x7f92f406d3b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93080c24b0 0x7f930815c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f93080c2030 0x7f930815bdf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 --2- 172.21.15.64:0/2017142330 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f92f0005180 0x7f9308153b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 >> 172.21.15.64:0/2017142330 conn(0x7f930806a200 msgr2=0x7f9308070220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:59.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 shutdown_connections 2023-10-14T12:29:59.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.057+0000 7f930c9ed640 1 -- 172.21.15.64:0/2017142330 wait complete. 2023-10-14T12:29:59.076 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:29:59.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.303+0000 7f007b59e640 1 Processor -- start 2023-10-14T12:29:59.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.303+0000 7f007b59e640 1 -- start start 2023-10-14T12:29:59.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.304+0000 7f007b59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f007c0ad940 0x7f007c06c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.304+0000 7f007b59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c06cbf0 0x7f007c0ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.304+0000 7f007b59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007c159ca0 con 0x7f007c0ca3a0 2023-10-14T12:29:59.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.304+0000 7f007b59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f007c0b34c0 con 0x7f007c0ad940 2023-10-14T12:29:59.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.304+0000 7f007b59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c0b2fd0 con 0x7f007c06cbf0 2023-10-14T12:29:59.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.305+0000 7f007ad9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f007c0ca3a0 0x7f007c15d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41928/0 (socket says 172.21.15.64:41928) 2023-10-14T12:29:59.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.305+0000 7f007ad9d640 1 -- 172.21.15.64:0/251516537 learned_addr learned my addr 172.21.15.64:0/251516537 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:29:59.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.305+0000 7f0079d9b640 1 --2- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c06cbf0 0x7f007c0ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.305+0000 7f007a59c640 1 --2- 172.21.15.64:0/251516537 >> v2:172.21.15.177:3300/0 conn(0x7f007c0ad940 0x7f007c06c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.305+0000 7f007959a640 1 -- 172.21.15.64:0/251516537 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885342598 0 0) 0x7f007c159ca0 con 0x7f007c0ca3a0 2023-10-14T12:29:59.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.305+0000 7f007959a640 1 -- 172.21.15.64:0/251516537 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0068003520 con 0x7f007c0ca3a0 2023-10-14T12:29:59.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.306+0000 7f007a59c640 1 -- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c06cbf0 msgr2=0x7f007c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:59.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.306+0000 7f007a59c640 1 --2- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c06cbf0 0x7f007c0ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.306+0000 7f007a59c640 1 -- 172.21.15.64:0/251516537 >> v1:172.21.15.64:6789/0 conn(0x7f007c0ca3a0 legacy=0x7f007c15d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.306+0000 7f007a59c640 1 -- 172.21.15.64:0/251516537 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007c0cac20 con 0x7f007c0ad940 2023-10-14T12:29:59.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.307+0000 7f007a59c640 1 --2- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ad940 0x7f007c06c6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f006c0097a0 tx=0x7f006c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9f7b1ee01a663d87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:59.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007959a640 1 -- 172.21.15.64:0/251516537 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c02d040 con 0x7f007c0ad940 2023-10-14T12:29:59.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007959a640 1 -- 172.21.15.64:0/251516537 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c031810 con 0x7f007c0ad940 2023-10-14T12:29:59.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007959a640 1 -- 172.21.15.64:0/251516537 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c031b80 con 0x7f007c0ad940 2023-10-14T12:29:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007b59e640 1 -- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ad940 msgr2=0x7f007c06c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007b59e640 1 --2- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ad940 0x7f007c06c6b0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f006c0097a0 tx=0x7f006c02b8b0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007b59e640 1 -- 172.21.15.64:0/251516537 shutdown_connections 2023-10-14T12:29:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007b59e640 1 --2- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c06cbf0 0x7f007c0ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007b59e640 1 --2- 172.21.15.64:0/251516537 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ad940 0x7f007c06c6b0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007b59e640 1 -- 172.21.15.64:0/251516537 >> 172.21.15.64:0/251516537 conn(0x7f007c06a200 msgr2=0x7f007c06a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:59.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.308+0000 7f007b59e640 1 -- 172.21.15.64:0/251516537 shutdown_connections 2023-10-14T12:29:59.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.309+0000 7f007b59e640 1 -- 172.21.15.64:0/251516537 wait complete. 2023-10-14T12:29:59.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.311+0000 7f007b59e640 1 Processor -- start 2023-10-14T12:29:59.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.311+0000 7f007b59e640 1 -- start start 2023-10-14T12:29:59.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.312+0000 7f007b59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c0ad940 0x7f007c0ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.312+0000 7f007b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ca3a0 0x7f007c070d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.312+0000 7f007b59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f007c0977f0 0x7f007c0b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.312+0000 7f007b59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c15c710 con 0x7f007c0977f0 2023-10-14T12:29:59.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.312+0000 7f007b59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f007c15c9f0 con 0x7f007c0ca3a0 2023-10-14T12:29:59.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.312+0000 7f007b59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007c15ccd0 con 0x7f007c0ad940 2023-10-14T12:29:59.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.312+0000 7f007ad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f007c0977f0 0x7f007c0b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f007c0977f0 0x7f007c0b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45848/0 (socket says 172.21.15.64:45848) 2023-10-14T12:29:59.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 -- 172.21.15.64:0/3554067316 learned_addr learned my addr 172.21.15.64:0/3554067316 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:59.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007a59c640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c0ad940 0x7f007c0ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f0079d9b640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ca3a0 0x7f007c070d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 -- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c0ad940 msgr2=0x7f007c0ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c0ad940 0x7f007c0ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 -- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ca3a0 msgr2=0x7f007c070d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ca3a0 0x7f007c070d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 -- 172.21.15.64:0/3554067316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f006c009400 con 0x7f007c0977f0 2023-10-14T12:29:59.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007a59c640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c0ad940 0x7f007c0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:29:59.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.313+0000 7f007ad9d640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f007c0977f0 0x7f007c0b0850 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f007400c390 tx=0x7f007400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:59.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.314+0000 7f0072ffd640 1 -- 172.21.15.64:0/3554067316 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074005ce0 con 0x7f007c0977f0 2023-10-14T12:29:59.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.314+0000 7f0072ffd640 1 -- 172.21.15.64:0/3554067316 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0074005e40 con 0x7f007c0977f0 2023-10-14T12:29:59.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.314+0000 7f0072ffd640 1 -- 172.21.15.64:0/3554067316 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0074007310 con 0x7f007c0977f0 2023-10-14T12:29:59.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.314+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f007c0adfd0 con 0x7f007c0977f0 2023-10-14T12:29:59.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.314+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f007c071280 con 0x7f007c0977f0 2023-10-14T12:29:59.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.315+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f007c0ae4f0 con 0x7f007c0977f0 2023-10-14T12:29:59.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.316+0000 7f0072ffd640 1 -- 172.21.15.64:0/3554067316 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0074007470 con 0x7f007c0977f0 2023-10-14T12:29:59.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.317+0000 7f0072ffd640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f005c06aec0 0x7f005c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.317+0000 7f0072ffd640 1 -- 172.21.15.64:0/3554067316 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0074089090 con 0x7f007c0977f0 2023-10-14T12:29:59.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.317+0000 7f007a59c640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f005c06aec0 0x7f005c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.318+0000 7f007a59c640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f005c06aec0 0x7f005c06d380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f006c036000 tx=0x7f006c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:59.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.321+0000 7f0072ffd640 1 -- 172.21.15.64:0/3554067316 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f007c0ae4f0 con 0x7f007c0977f0 2023-10-14T12:29:59.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.519+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f007c0ae4f0 con 0x7f007c0977f0 2023-10-14T12:29:59.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.520+0000 7f0072ffd640 1 -- 172.21.15.64:0/3554067316 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f007c0ae4f0 con 0x7f007c0977f0 2023-10-14T12:29:59.522 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:29:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f005c06aec0 msgr2=0x7f005c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f005c06aec0 0x7f005c06d380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f006c036000 tx=0x7f006c03c040 comp rx=0 tx=0).stop 2023-10-14T12:29:59.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f007c0977f0 msgr2=0x7f007c0b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f007c0977f0 0x7f007c0b0850 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f007400c390 tx=0x7f007400c850 comp rx=0 tx=0).stop 2023-10-14T12:29:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 shutdown_connections 2023-10-14T12:29:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f005c06aec0 0x7f005c06d380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f007c0977f0 0x7f007c0b0850 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f007c0ca3a0 0x7f007c070d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 --2- 172.21.15.64:0/3554067316 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f007c0ad940 0x7f007c0ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 >> 172.21.15.64:0/3554067316 conn(0x7f007c06a200 msgr2=0x7f007c071900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:59.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 shutdown_connections 2023-10-14T12:29:59.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.523+0000 7f007b59e640 1 -- 172.21.15.64:0/3554067316 wait complete. 2023-10-14T12:29:59.545 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:29:59.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.773+0000 7ffac4abb640 1 Processor -- start 2023-10-14T12:29:59.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.773+0000 7ffac4abb640 1 -- start start 2023-10-14T12:29:59.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffac4abb640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ffac015c8e0 0x7ffac00cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffac4abb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffac00cf030 0x7ffac006d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffac4abb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac00cdac0 con 0x7ffac006d230 2023-10-14T12:29:59.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffac4abb640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac006df90 con 0x7ffac00cf030 2023-10-14T12:29:59.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffac4abb640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac00cd1f0 con 0x7ffac015c8e0 2023-10-14T12:29:59.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffabffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffac00cf030 0x7ffac006d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffabffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffac00cf030 0x7ffac006d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45850/0 (socket says 172.21.15.64:45850) 2023-10-14T12:29:59.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.775+0000 7ffabffff640 1 -- 172.21.15.64:0/3259990348 learned_addr learned my addr 172.21.15.64:0/3259990348 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:59.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.776+0000 7ffabf7fe640 1 --2- 172.21.15.64:0/3259990348 >> v2:172.21.15.177:3300/0 conn(0x7ffac015c8e0 0x7ffac00cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.776+0000 7ffabffff640 1 -- 172.21.15.64:0/3259990348 >> v2:172.21.15.177:3300/0 conn(0x7ffac015c8e0 msgr2=0x7ffac00cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:59.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.776+0000 7ffabffff640 1 --2- 172.21.15.64:0/3259990348 >> v2:172.21.15.177:3300/0 conn(0x7ffac015c8e0 0x7ffac00cdf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.776+0000 7ffabffff640 1 -- 172.21.15.64:0/3259990348 >> v1:172.21.15.177:6789/0 conn(0x7ffac006d230 legacy=0x7ffac00ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:29:59.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.776+0000 7ffabffff640 1 -- 172.21.15.64:0/3259990348 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac006dcb0 con 0x7ffac00cf030 2023-10-14T12:29:59.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.777+0000 7ffabffff640 1 --2- 172.21.15.64:0/3259990348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac00cf030 0x7ffac006d6c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffac006c180 tx=0x7ffab802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3659fc4f42205888 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:59.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.777+0000 7ffabeffd640 1 -- 172.21.15.64:0/3259990348 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab802ca80 con 0x7ffac00cf030 2023-10-14T12:29:59.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.777+0000 7ffabeffd640 1 -- 172.21.15.64:0/3259990348 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab802cbe0 con 0x7ffac00cf030 2023-10-14T12:29:59.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.777+0000 7ffabeffd640 1 -- 172.21.15.64:0/3259990348 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab80343f0 con 0x7ffac00cf030 2023-10-14T12:29:59.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 -- 172.21.15.64:0/3259990348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac00cf030 msgr2=0x7ffac006d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3259990348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac00cf030 0x7ffac006d6c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ffac006c180 tx=0x7ffab802bee0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 -- 172.21.15.64:0/3259990348 shutdown_connections 2023-10-14T12:29:59.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3259990348 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac00cf030 0x7ffac006d6c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3259990348 >> v2:172.21.15.177:3300/0 conn(0x7ffac015c8e0 0x7ffac00cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 -- 172.21.15.64:0/3259990348 >> 172.21.15.64:0/3259990348 conn(0x7ffac006a200 msgr2=0x7ffac006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:59.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 -- 172.21.15.64:0/3259990348 shutdown_connections 2023-10-14T12:29:59.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.778+0000 7ffac4abb640 1 -- 172.21.15.64:0/3259990348 wait complete. 2023-10-14T12:29:59.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.780+0000 7ffac4abb640 1 Processor -- start 2023-10-14T12:29:59.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.780+0000 7ffac4abb640 1 -- start start 2023-10-14T12:29:59.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffac4abb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac006d230 0x7ffac0097810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffac4abb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac00cf030 0x7ffac0159d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffac4abb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac015c8e0 0x7ffac01573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffac4abb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac015b400 con 0x7ffac015c8e0 2023-10-14T12:29:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffac4abb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac015a7f0 con 0x7ffac006d230 2023-10-14T12:29:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffac4abb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac015aad0 con 0x7ffac00cf030 2023-10-14T12:29:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffabffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac015c8e0 0x7ffac01573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.781+0000 7ffabffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac015c8e0 0x7ffac01573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45862/0 (socket says 172.21.15.64:45862) 2023-10-14T12:29:59.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabffff640 1 -- 172.21.15.64:0/3644677626 learned_addr learned my addr 172.21.15.64:0/3644677626 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:29:59.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabf7fe640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac006d230 0x7ffac0097810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffab7fff640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac00cf030 0x7ffac0159d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabffff640 1 -- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac00cf030 msgr2=0x7ffac0159d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabffff640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac00cf030 0x7ffac0159d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabffff640 1 -- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac006d230 msgr2=0x7ffac0097810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabffff640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac006d230 0x7ffac0097810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabffff640 1 -- 172.21.15.64:0/3644677626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8009b30 con 0x7ffac015c8e0 2023-10-14T12:29:59.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffab7fff640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac00cf030 0x7ffac0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:29:59.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.782+0000 7ffabffff640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac015c8e0 0x7ffac01573a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffab8036040 tx=0x7ffab8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:59.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.783+0000 7ffabcff9640 1 -- 172.21.15.64:0/3644677626 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab803e450 con 0x7ffac015c8e0 2023-10-14T12:29:59.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.783+0000 7ffabcff9640 1 -- 172.21.15.64:0/3644677626 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab803e5d0 con 0x7ffac015c8e0 2023-10-14T12:29:59.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.783+0000 7ffabcff9640 1 -- 172.21.15.64:0/3644677626 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab803e980 con 0x7ffac015c8e0 2023-10-14T12:29:59.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.783+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac015adb0 con 0x7ffac015c8e0 2023-10-14T12:29:59.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.783+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac0160ed0 con 0x7ffac015c8e0 2023-10-14T12:29:59.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.784+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac015b5b0 con 0x7ffac015c8e0 2023-10-14T12:29:59.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.785+0000 7ffabcff9640 1 -- 172.21.15.64:0/3644677626 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffab802cd50 con 0x7ffac015c8e0 2023-10-14T12:29:59.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.786+0000 7ffabcff9640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffaa006ae70 0x7ffaa006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:29:59.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.786+0000 7ffabcff9640 1 -- 172.21.15.64:0/3644677626 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffab80ac580 con 0x7ffac015c8e0 2023-10-14T12:29:59.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.787+0000 7ffabf7fe640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffaa006ae70 0x7ffaa006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:29:59.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.788+0000 7ffabf7fe640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffaa006ae70 0x7ffaa006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffab0006fd0 tx=0x7ffab0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:29:59.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.791+0000 7ffabcff9640 1 -- 172.21.15.64:0/3644677626 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffac015b5b0 con 0x7ffac015c8e0 2023-10-14T12:29:59.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.985+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ffac006da30 con 0x7ffac015c8e0 2023-10-14T12:29:59.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.986+0000 7ffabcff9640 1 -- 172.21.15.64:0/3644677626 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ffab8077440 con 0x7ffac015c8e0 2023-10-14T12:29:59.988 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:29:59.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.988+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffaa006ae70 msgr2=0x7ffaa006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.988+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffaa006ae70 0x7ffaa006d330 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7ffab0006fd0 tx=0x7ffab0008040 comp rx=0 tx=0).stop 2023-10-14T12:29:59.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.988+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac015c8e0 msgr2=0x7ffac01573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:29:59.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.988+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac015c8e0 0x7ffac01573a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ffab8036040 tx=0x7ffab8004a40 comp rx=0 tx=0).stop 2023-10-14T12:29:59.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 shutdown_connections 2023-10-14T12:29:59.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffaa006ae70 0x7ffaa006d330 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffac015c8e0 0x7ffac01573a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffac00cf030 0x7ffac0159d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 --2- 172.21.15.64:0/3644677626 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffac006d230 0x7ffac0097810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:29:59.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 >> 172.21.15.64:0/3644677626 conn(0x7ffac006a200 msgr2=0x7ffac0070000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:29:59.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 shutdown_connections 2023-10-14T12:29:59.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:29:59.989+0000 7ffac4abb640 1 -- 172.21.15.64:0/3644677626 wait complete. 2023-10-14T12:30:00.010 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:30:00.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.231+0000 7f54eca47640 1 Processor -- start 2023-10-14T12:30:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.232+0000 7f54eca47640 1 -- start start 2023-10-14T12:30:00.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.233+0000 7f54eca47640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 0x7f54e806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.233+0000 7f54eca47640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e815f0d0 con 0x7f54e80ced10 2023-10-14T12:30:00.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.233+0000 7f54eca47640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54e815ab50 con 0x7f54e806dc20 2023-10-14T12:30:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.233+0000 7f54eca47640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e815e2b0 con 0x7f54e80b2dd0 2023-10-14T12:30:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.234+0000 7f54e7fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f54e80ced10 0x7f54e80ab180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41938/0 (socket says 172.21.15.64:41938) 2023-10-14T12:30:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.234+0000 7f54e7fff640 1 -- 172.21.15.64:0/1138700660 learned_addr learned my addr 172.21.15.64:0/1138700660 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:00.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.234+0000 7f54e77fe640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 0x7f54e806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.234+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 129000422 0 0) 0x7f54e815f0d0 con 0x7f54e80ced10 2023-10-14T12:30:00.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.234+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d4003520 con 0x7f54e80ced10 2023-10-14T12:30:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3171782368 0 0) 0x7f54d4003520 con 0x7f54e80ced10 2023-10-14T12:30:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 msgr2=0x7f54e806d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 0x7f54e806d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 >> v1:172.21.15.177:6789/0 conn(0x7f54e806dc20 legacy=0x7f54e80ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e806d3a0 con 0x7f54e80ced10 2023-10-14T12:30:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f54e00019f0 con 0x7f54e80ced10 2023-10-14T12:30:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 >> v1:172.21.15.64:6789/0 conn(0x7f54e80ced10 legacy=0x7f54e80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54d40039a0 0x7f54d4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 0x7f54d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e815e2b0 con 0x7f54d40047c0 2023-10-14T12:30:00.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d400ba30 con 0x7f54d40039a0 2023-10-14T12:30:00.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54d400bba0 con 0x7f54e80b2dd0 2023-10-14T12:30:00.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.235+0000 7f54dffff640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54e77fe640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54d40039a0 0x7f54d4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54e7fff640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 0x7f54d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54dffff640 1 -- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 msgr2=0x7f54d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54dffff640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 0x7f54d4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54dffff640 1 -- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54d40039a0 msgr2=0x7f54d4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:00.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54dffff640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54d40039a0 0x7f54d4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54dffff640 1 -- 172.21.15.64:0/1138700660 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d4003520 con 0x7f54d40047c0 2023-10-14T12:30:00.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.236+0000 7f54e7fff640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80b2dd0 0x7f54d4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:00.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.237+0000 7f54dffff640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54d4004c40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f54e806e080 tx=0x7f54d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195c0bfaeebd4338 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:00.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.237+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d0032600 con 0x7f54d40047c0 2023-10-14T12:30:00.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.237+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d002e050 con 0x7f54d40047c0 2023-10-14T12:30:00.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.237+0000 7f54e6ffd640 1 -- 172.21.15.64:0/1138700660 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d00329c0 con 0x7f54d40047c0 2023-10-14T12:30:00.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.238+0000 7f54eca47640 1 -- 172.21.15.64:0/1138700660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 msgr2=0x7f54d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.238+0000 7f54eca47640 1 --2- 172.21.15.64:0/1138700660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54d4004c40 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f54e806e080 tx=0x7f54d40057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.238+0000 7f54e7fff640 1 -- 172.21.15.64:0/1138700660 reap_dead start 2023-10-14T12:30:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.238+0000 7f54eca47640 1 -- 172.21.15.64:0/1138700660 shutdown_connections 2023-10-14T12:30:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.238+0000 7f54eca47640 1 -- 172.21.15.64:0/1138700660 >> 172.21.15.64:0/1138700660 conn(0x7f54e8069fc0 msgr2=0x7f54e806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.238+0000 7f54eca47640 1 -- 172.21.15.64:0/1138700660 shutdown_connections 2023-10-14T12:30:00.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.238+0000 7f54eca47640 1 -- 172.21.15.64:0/1138700660 wait complete. 2023-10-14T12:30:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.240+0000 7f54eca47640 1 Processor -- start 2023-10-14T12:30:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.240+0000 7f54eca47640 1 -- start start 2023-10-14T12:30:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54eca47640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54e8150fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54eca47640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80c6ef0 0x7f54e815b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54eca47640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e8097410 0x7f54e80978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54eca47640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80c73f0 con 0x7f54d40047c0 2023-10-14T12:30:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54eca47640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80c76d0 con 0x7f54e8097410 2023-10-14T12:30:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54eca47640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54e80c79b0 con 0x7f54e80c6ef0 2023-10-14T12:30:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54e8150fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54e77fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54e8150fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45876/0 (socket says 172.21.15.64:45876) 2023-10-14T12:30:00.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.241+0000 7f54e77fe640 1 -- 172.21.15.64:0/703068252 learned_addr learned my addr 172.21.15.64:0/703068252 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:00.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e77fe640 1 -- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80c6ef0 msgr2=0x7f54e815b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e77fe640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80c6ef0 0x7f54e815b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e77fe640 1 -- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e8097410 msgr2=0x7f54e80978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e77fe640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e8097410 0x7f54e80978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e77fe640 1 -- 172.21.15.64:0/703068252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54e80c7c90 con 0x7f54d40047c0 2023-10-14T12:30:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e77fe640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54e8150fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f54d80115b0 tx=0x7f54d8011a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e4ff9640 1 -- 172.21.15.64:0/703068252 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d8005da0 con 0x7f54d40047c0 2023-10-14T12:30:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e4ff9640 1 -- 172.21.15.64:0/703068252 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d8006050 con 0x7f54d40047c0 2023-10-14T12:30:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54e4ff9640 1 -- 172.21.15.64:0/703068252 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54d80063c0 con 0x7f54d40047c0 2023-10-14T12:30:00.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.242+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54e8097e00 con 0x7f54d40047c0 2023-10-14T12:30:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.243+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54e815b7b0 con 0x7f54d40047c0 2023-10-14T12:30:00.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.244+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54e815b9a0 con 0x7f54d40047c0 2023-10-14T12:30:00.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.245+0000 7f54e4ff9640 1 -- 172.21.15.64:0/703068252 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f54d8006520 con 0x7f54d40047c0 2023-10-14T12:30:00.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.245+0000 7f54e4ff9640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f54c806aea0 0x7f54c806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.246+0000 7f54e4ff9640 1 -- 172.21.15.64:0/703068252 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f54d808a140 con 0x7f54d40047c0 2023-10-14T12:30:00.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.246+0000 7f54dffff640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f54c806aea0 0x7f54c806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.247+0000 7f54dffff640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f54c806aea0 0x7f54c806d360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f54d0035000 tx=0x7f54d0009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:00.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.250+0000 7f54e4ff9640 1 -- 172.21.15.64:0/703068252 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f54d8054d90 con 0x7f54d40047c0 2023-10-14T12:30:00.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.462+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f54e804e9b0 con 0x7f54d40047c0 2023-10-14T12:30:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.463+0000 7f54e4ff9640 1 -- 172.21.15.64:0/703068252 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f54d80583b0 con 0x7f54d40047c0 2023-10-14T12:30:00.464 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:30:00.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f54c806aea0 msgr2=0x7f54c806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f54c806aea0 0x7f54c806d360 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f54d0035000 tx=0x7f54d0009030 comp rx=0 tx=0).stop 2023-10-14T12:30:00.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 msgr2=0x7f54e8150fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54e8150fb0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f54d80115b0 tx=0x7f54d8011a70 comp rx=0 tx=0).stop 2023-10-14T12:30:00.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 shutdown_connections 2023-10-14T12:30:00.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f54c806aea0 0x7f54c806d360 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f54e8097410 0x7f54e80978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f54e80c6ef0 0x7f54e815b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 --2- 172.21.15.64:0/703068252 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f54d40047c0 0x7f54e8150fb0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 >> 172.21.15.64:0/703068252 conn(0x7f54e8069fc0 msgr2=0x7f54e8070970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:00.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 shutdown_connections 2023-10-14T12:30:00.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.466+0000 7f54eca47640 1 -- 172.21.15.64:0/703068252 wait complete. 2023-10-14T12:30:00.487 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:30:00.488 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:30:00.551 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:00.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.771+0000 7f6e4fef2640 1 Processor -- start 2023-10-14T12:30:00.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.771+0000 7f6e4fef2640 1 -- start start 2023-10-14T12:30:00.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4fef2640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6e480b8600 0x7f6e480cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4fef2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480cf6a0 0x7f6e480d0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4fef2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6e480d1270 0x7f6e4806ad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4fef2640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e480cd740 con 0x7f6e480b8600 2023-10-14T12:30:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4fef2640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e480b6240 con 0x7f6e480d1270 2023-10-14T12:30:00.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4fef2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480cfb20 con 0x7f6e480cf6a0 2023-10-14T12:30:00.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4dc8e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6e480b8600 0x7f6e480cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4dc8e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6e480b8600 0x7f6e480cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45892/0 (socket says 172.21.15.64:45892) 2023-10-14T12:30:00.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.773+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/983794887 learned_addr learned my addr 172.21.15.64:0/983794887 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:00.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.774+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/983794887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480cf6a0 msgr2=0x7f6e480d0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:00.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.774+0000 7f6e4dc8e640 1 --2- 172.21.15.64:0/983794887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480cf6a0 0x7f6e480d0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.774+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/983794887 >> v2:172.21.15.177:3300/0 conn(0x7f6e480d1270 msgr2=0x7f6e4806ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.774+0000 7f6e4e48f640 1 --2- 172.21.15.64:0/983794887 >> v2:172.21.15.177:3300/0 conn(0x7f6e480d1270 0x7f6e4806ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.774+0000 7f6e4dc8e640 1 --2- 172.21.15.64:0/983794887 >> v2:172.21.15.177:3300/0 conn(0x7f6e480d1270 0x7f6e4806ad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.774+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/983794887 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e480d16e0 con 0x7f6e480b8600 2023-10-14T12:30:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.775+0000 7f6e4dc8e640 1 --2- 172.21.15.64:0/983794887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e480cf160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e480d24d0 tx=0x7f6e4402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f573c35f33eaeb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:00.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.775+0000 7f6e4cc8c640 1 -- 172.21.15.64:0/983794887 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44004230 con 0x7f6e480b8600 2023-10-14T12:30:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.775+0000 7f6e4cc8c640 1 -- 172.21.15.64:0/983794887 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e44004390 con 0x7f6e480b8600 2023-10-14T12:30:00.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.775+0000 7f6e4cc8c640 1 -- 172.21.15.64:0/983794887 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44003810 con 0x7f6e480b8600 2023-10-14T12:30:00.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 -- 172.21.15.64:0/983794887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 msgr2=0x7f6e480cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/983794887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e480cf160 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6e480d24d0 tx=0x7f6e4402b8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 -- 172.21.15.64:0/983794887 shutdown_connections 2023-10-14T12:30:00.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/983794887 >> v2:172.21.15.177:3300/0 conn(0x7f6e480d1270 0x7f6e4806ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/983794887 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480cf6a0 0x7f6e480d0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/983794887 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e480cf160 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 -- 172.21.15.64:0/983794887 >> 172.21.15.64:0/983794887 conn(0x7f6e480b44a0 msgr2=0x7f6e480b4880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 -- 172.21.15.64:0/983794887 shutdown_connections 2023-10-14T12:30:00.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.776+0000 7f6e4fef2640 1 -- 172.21.15.64:0/983794887 wait complete. 2023-10-14T12:30:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.778+0000 7f6e4fef2640 1 Processor -- start 2023-10-14T12:30:00.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.778+0000 7f6e4fef2640 1 -- start start 2023-10-14T12:30:00.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4fef2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e48153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4fef2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480cf6a0 0x7f6e480aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4fef2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480d1270 0x7f6e480cd890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4fef2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e48154380 con 0x7f6e480b8600 2023-10-14T12:30:00.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4fef2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480a9300 con 0x7f6e480cf6a0 2023-10-14T12:30:00.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4fef2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e480a95e0 con 0x7f6e480d1270 2023-10-14T12:30:00.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4dc8e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e48153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4dc8e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e48153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45904/0 (socket says 172.21.15.64:45904) 2023-10-14T12:30:00.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.779+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/1739152491 learned_addr learned my addr 172.21.15.64:0/1739152491 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:00.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4d48d640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480cf6a0 0x7f6e480aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4e48f640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480d1270 0x7f6e480cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480d1270 msgr2=0x7f6e480cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4dc8e640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480d1270 0x7f6e480cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480cf6a0 msgr2=0x7f6e480aa3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4dc8e640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480cf6a0 0x7f6e480aa3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4dc8e640 1 -- 172.21.15.64:0/1739152491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44009460 con 0x7f6e480b8600 2023-10-14T12:30:00.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4d48d640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480cf6a0 0x7f6e480aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:00.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e4dc8e640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e48153e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e4402b930 tx=0x7f6e440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:00.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.780+0000 7f6e3e7fc640 1 -- 172.21.15.64:0/1739152491 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44003c40 con 0x7f6e480b8600 2023-10-14T12:30:00.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.781+0000 7f6e3e7fc640 1 -- 172.21.15.64:0/1739152491 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4403f070 con 0x7f6e480b8600 2023-10-14T12:30:00.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.781+0000 7f6e3e7fc640 1 -- 172.21.15.64:0/1739152491 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44004500 con 0x7f6e480b8600 2023-10-14T12:30:00.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.781+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e480a98c0 con 0x7f6e480b8600 2023-10-14T12:30:00.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.781+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e480a9e80 con 0x7f6e480b8600 2023-10-14T12:30:00.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.782+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e48073ef0 con 0x7f6e480b8600 2023-10-14T12:30:00.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.783+0000 7f6e3e7fc640 1 -- 172.21.15.64:0/1739152491 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e44041030 con 0x7f6e480b8600 2023-10-14T12:30:00.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.784+0000 7f6e3e7fc640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e2c06ae70 0x7f6e2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:00.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.784+0000 7f6e3e7fc640 1 -- 172.21.15.64:0/1739152491 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6e440abd90 con 0x7f6e480b8600 2023-10-14T12:30:00.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.784+0000 7f6e4d48d640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e2c06ae70 0x7f6e2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:00.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.785+0000 7f6e4d48d640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e2c06ae70 0x7f6e2c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e38006fd0 tx=0x7f6e38008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:00.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.792+0000 7f6e3e7fc640 1 -- 172.21.15.64:0/1739152491 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e44076950 con 0x7f6e480b8600 2023-10-14T12:30:00.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.985+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e480d26a0 con 0x7f6e480b8600 2023-10-14T12:30:00.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.988+0000 7f6e3e7fc640 1 -- 172.21.15.64:0/1739152491 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f6e44049070 con 0x7f6e480b8600 2023-10-14T12:30:00.990 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:00.990 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:00.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e2c06ae70 msgr2=0x7f6e2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e2c06ae70 0x7f6e2c06d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6e38006fd0 tx=0x7f6e38008040 comp rx=0 tx=0).stop 2023-10-14T12:30:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 msgr2=0x7f6e48153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e48153e40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f6e4402b930 tx=0x7f6e440046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 shutdown_connections 2023-10-14T12:30:00.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e2c06ae70 0x7f6e2c06d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480d1270 0x7f6e480cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480cf6a0 0x7f6e480aa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 --2- 172.21.15.64:0/1739152491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480b8600 0x7f6e48153e40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:00.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 >> 172.21.15.64:0/1739152491 conn(0x7f6e480b44a0 msgr2=0x7f6e480b2dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:00.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 shutdown_connections 2023-10-14T12:30:00.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:00.990+0000 7f6e4fef2640 1 -- 172.21.15.64:0/1739152491 wait complete. 2023-10-14T12:30:01.009 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:30:01.010 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:30:01.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.210+0000 7f1a0f53c640 1 Processor -- start 2023-10-14T12:30:01.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.210+0000 7f1a0f53c640 1 -- start start 2023-10-14T12:30:01.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.212+0000 7f1a0f53c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0815cf90 0x7f1a0815d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.212+0000 7f1a0f53c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1a0806a4f0 0x7f1a08160e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.212+0000 7f1a0f53c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a08160990 con 0x7f1a0815d8b0 2023-10-14T12:30:01.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.212+0000 7f1a0f53c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a080ccff0 con 0x7f1a0806a4f0 2023-10-14T12:30:01.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.212+0000 7f1a0f53c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080ce1b0 con 0x7f1a0815cf90 2023-10-14T12:30:01.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.212+0000 7f1a0dad9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1a0806a4f0 0x7f1a08160e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.212+0000 7f1a0d2d8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0815cf90 0x7f1a0815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0dad9640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1a0806a4f0 0x7f1a08160e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:43632/0 (socket says 172.21.15.64:43632) 2023-10-14T12:30:01.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0dad9640 1 -- 172.21.15.64:0/1417799063 learned_addr learned my addr 172.21.15.64:0/1417799063 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:01.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0d2d8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0815cf90 0x7f1a0815d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:43052/0 (socket says 172.21.15.64:43052) 2023-10-14T12:30:01.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0cad7640 1 --1- 172.21.15.64:0/1417799063 >> v1:172.21.15.177:6789/0 conn(0x7f1a0815d8b0 0x7f1a08069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:54220/0 (socket says 172.21.15.64:54220) 2023-10-14T12:30:01.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0d2d8640 1 -- 172.21.15.64:0/1417799063 >> v2:172.21.15.177:3300/0 conn(0x7f1a0806a4f0 msgr2=0x7f1a08160e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:01.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0d2d8640 1 --2- 172.21.15.64:0/1417799063 >> v2:172.21.15.177:3300/0 conn(0x7f1a0806a4f0 0x7f1a08160e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0d2d8640 1 -- 172.21.15.64:0/1417799063 >> v1:172.21.15.177:6789/0 conn(0x7f1a0815d8b0 legacy=0x7f1a08069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.213+0000 7f1a0d2d8640 1 -- 172.21.15.64:0/1417799063 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a080ccd10 con 0x7f1a0815cf90 2023-10-14T12:30:01.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.215+0000 7f1a0d2d8640 1 --2- 172.21.15.64:0/1417799063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0815cf90 0x7f1a0815d370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a040097a0 tx=0x7f1a0402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=378f4e02e458d228 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:01.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.215+0000 7f19fffff640 1 -- 172.21.15.64:0/1417799063 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04031780 con 0x7f1a0815cf90 2023-10-14T12:30:01.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.215+0000 7f19fffff640 1 -- 172.21.15.64:0/1417799063 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a040318e0 con 0x7f1a0815cf90 2023-10-14T12:30:01.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.215+0000 7f19fffff640 1 -- 172.21.15.64:0/1417799063 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a04031c70 con 0x7f1a0815cf90 2023-10-14T12:30:01.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 -- 172.21.15.64:0/1417799063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0815cf90 msgr2=0x7f1a0815d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/1417799063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0815cf90 0x7f1a0815d370 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1a040097a0 tx=0x7f1a0402b820 comp rx=0 tx=0).stop 2023-10-14T12:30:01.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 -- 172.21.15.64:0/1417799063 shutdown_connections 2023-10-14T12:30:01.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/1417799063 >> v2:172.21.15.177:3300/0 conn(0x7f1a0806a4f0 0x7f1a08160e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/1417799063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0815cf90 0x7f1a0815d370 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 -- 172.21.15.64:0/1417799063 >> 172.21.15.64:0/1417799063 conn(0x7f1a080cc080 msgr2=0x7f1a080cc460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:01.220 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 -- 172.21.15.64:0/1417799063 shutdown_connections 2023-10-14T12:30:01.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.216+0000 7f1a0f53c640 1 -- 172.21.15.64:0/1417799063 wait complete. 2023-10-14T12:30:01.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.218+0000 7f1a0f53c640 1 Processor -- start 2023-10-14T12:30:01.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.218+0000 7f1a0f53c640 1 -- start start 2023-10-14T12:30:01.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0f53c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0806a4f0 0x7f1a0814aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0f53c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a0815cf90 0x7f1a080aef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0f53c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0815d8b0 0x7f1a0815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0f53c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0814af90 con 0x7f1a0815cf90 2023-10-14T12:30:01.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0f53c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080afa20 con 0x7f1a0815d8b0 2023-10-14T12:30:01.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0f53c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a080ab9e0 con 0x7f1a0806a4f0 2023-10-14T12:30:01.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0cad7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a0815cf90 0x7f1a080aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0cad7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a0815cf90 0x7f1a080aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45908/0 (socket says 172.21.15.64:45908) 2023-10-14T12:30:01.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0cad7640 1 -- 172.21.15.64:0/2684092561 learned_addr learned my addr 172.21.15.64:0/2684092561 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:01.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0d2d8640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0806a4f0 0x7f1a0814aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.219+0000 7f1a0dad9640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0815d8b0 0x7f1a0815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f1a0cad7640 1 -- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0806a4f0 msgr2=0x7f1a0814aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f1a0cad7640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0806a4f0 0x7f1a0814aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f1a0cad7640 1 -- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0815d8b0 msgr2=0x7f1a0815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f1a0cad7640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0815d8b0 0x7f1a0815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f1a0cad7640 1 -- 172.21.15.64:0/2684092561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04009400 con 0x7f1a0815cf90 2023-10-14T12:30:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f1a0cad7640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a0815cf90 0x7f1a080aef60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c3c0 tx=0x7f19f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f19fdffb640 1 -- 172.21.15.64:0/2684092561 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80074e0 con 0x7f1a0815cf90 2023-10-14T12:30:01.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f19fdffb640 1 -- 172.21.15.64:0/2684092561 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f8007640 con 0x7f1a0815cf90 2023-10-14T12:30:01.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a080abcc0 con 0x7f1a0815cf90 2023-10-14T12:30:01.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.220+0000 7f19fdffb640 1 -- 172.21.15.64:0/2684092561 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f8004a00 con 0x7f1a0815cf90 2023-10-14T12:30:01.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.221+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a080ac280 con 0x7f1a0815cf90 2023-10-14T12:30:01.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.222+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a08073ef0 con 0x7f1a0815cf90 2023-10-14T12:30:01.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.223+0000 7f19fdffb640 1 -- 172.21.15.64:0/2684092561 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f19f8004b60 con 0x7f1a0815cf90 2023-10-14T12:30:01.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.224+0000 7f19fdffb640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f19ec06ae70 0x7f19ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.224+0000 7f19fdffb640 1 -- 172.21.15.64:0/2684092561 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f19f8089360 con 0x7f1a0815cf90 2023-10-14T12:30:01.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.225+0000 7f1a0d2d8640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f19ec06ae70 0x7f19ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.226+0000 7f1a0d2d8640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f19ec06ae70 0x7f19ec06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1a04036000 tx=0x7f1a0403d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:01.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.229+0000 7f19fdffb640 1 -- 172.21.15.64:0/2684092561 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f19f8054050 con 0x7f1a0815cf90 2023-10-14T12:30:01.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.418+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1a080b5580 con 0x7f1a0815cf90 2023-10-14T12:30:01.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.419+0000 7f19fdffb640 1 -- 172.21.15.64:0/2684092561 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f19f8057670 con 0x7f1a0815cf90 2023-10-14T12:30:01.421 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:30:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.421+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f19ec06ae70 msgr2=0x7f19ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.421+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f19ec06ae70 0x7f19ec06d330 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1a04036000 tx=0x7f1a0403d040 comp rx=0 tx=0).stop 2023-10-14T12:30:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.421+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a0815cf90 msgr2=0x7f1a080aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.421+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a0815cf90 0x7f1a080aef60 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f19f800c3c0 tx=0x7f19f800c880 comp rx=0 tx=0).stop 2023-10-14T12:30:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 shutdown_connections 2023-10-14T12:30:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f19ec06ae70 0x7f19ec06d330 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1a0815d8b0 0x7f1a0815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1a0815cf90 0x7f1a080aef60 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 --2- 172.21.15.64:0/2684092561 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1a0806a4f0 0x7f1a0814aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 >> 172.21.15.64:0/2684092561 conn(0x7f1a080cc080 msgr2=0x7f1a08158b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 shutdown_connections 2023-10-14T12:30:01.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.422+0000 7f1a0f53c640 1 -- 172.21.15.64:0/2684092561 wait complete. 2023-10-14T12:30:01.440 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:30:01.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.643+0000 7fdb7a30a640 1 Processor -- start 2023-10-14T12:30:01.645 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.643+0000 7fdb7a30a640 1 -- start start 2023-10-14T12:30:01.646 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.645+0000 7fdb7a30a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 0x7fdb740b66e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.645+0000 7fdb7a30a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740ce810 con 0x7fdb740d0d80 2023-10-14T12:30:01.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.645+0000 7fdb7a30a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb740b5b40 con 0x7fdb7415c940 2023-10-14T12:30:01.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.645+0000 7fdb7a30a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740d0b10 con 0x7fdb740d1200 2023-10-14T12:30:01.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.645+0000 7fdb78b07640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdb740d0d80 0x7fdb740b5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41946/0 (socket says 172.21.15.64:41946) 2023-10-14T12:30:01.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.645+0000 7fdb78b07640 1 -- 172.21.15.64:0/2352120926 learned_addr learned my addr 172.21.15.64:0/2352120926 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:01.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb79b09640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 0x7fdb740b66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2504851178 0 0) 0x7fdb740ce810 con 0x7fdb740d0d80 2023-10-14T12:30:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdb60003520 con 0x7fdb740d0d80 2023-10-14T12:30:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3351855240 0 0) 0x7fdb60003520 con 0x7fdb740d0d80 2023-10-14T12:30:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 msgr2=0x7fdb740b66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 0x7fdb740b66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 >> v1:172.21.15.177:6789/0 conn(0x7fdb7415c940 legacy=0x7fdb740d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740d1690 con 0x7fdb740d0d80 2023-10-14T12:30:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fdb64001670 con 0x7fdb740d0d80 2023-10-14T12:30:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 >> v1:172.21.15.64:6789/0 conn(0x7fdb740d0d80 legacy=0x7fdb740b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 0x7fdb60003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb60003f90 0x7fdb600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb60004d00 0x7fdb60005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740d0b10 con 0x7fdb60003f90 2023-10-14T12:30:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6000bb70 con 0x7fdb60004d00 2023-10-14T12:30:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.646+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6000bd30 con 0x7fdb740d1200 2023-10-14T12:30:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb78b07640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb60003f90 0x7fdb600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb79308640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 0x7fdb60003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb79b09640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb60004d00 0x7fdb60005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb78b07640 1 -- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 msgr2=0x7fdb60003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb78b07640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 0x7fdb60003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb78b07640 1 -- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb60004d00 msgr2=0x7fdb60005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:01.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb78b07640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb60004d00 0x7fdb60005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb78b07640 1 -- 172.21.15.64:0/2352120926 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb60003520 con 0x7fdb60003f90 2023-10-14T12:30:01.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.647+0000 7fdb79308640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb740d1200 0x7fdb60003a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:01.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.648+0000 7fdb78b07640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb60003f90 0x7fdb600047c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c240 tx=0x7fdb600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234f979d6f97d1e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:01.657 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.648+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb64005ad0 con 0x7fdb60003f90 2023-10-14T12:30:01.657 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.648+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb64005c30 con 0x7fdb60003f90 2023-10-14T12:30:01.657 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.648+0000 7fdb6bfff640 1 -- 172.21.15.64:0/2352120926 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6402caf0 con 0x7fdb60003f90 2023-10-14T12:30:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.649+0000 7fdb7a30a640 1 -- 172.21.15.64:0/2352120926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb60003f90 msgr2=0x7fdb600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.649+0000 7fdb7a30a640 1 --2- 172.21.15.64:0/2352120926 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb60003f90 0x7fdb600047c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdb6400c240 tx=0x7fdb600057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.649+0000 7fdb79b09640 1 -- 172.21.15.64:0/2352120926 reap_dead start 2023-10-14T12:30:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.649+0000 7fdb7a30a640 1 -- 172.21.15.64:0/2352120926 shutdown_connections 2023-10-14T12:30:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.649+0000 7fdb7a30a640 1 -- 172.21.15.64:0/2352120926 >> 172.21.15.64:0/2352120926 conn(0x7fdb7409bb30 msgr2=0x7fdb740d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.649+0000 7fdb7a30a640 1 -- 172.21.15.64:0/2352120926 shutdown_connections 2023-10-14T12:30:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.649+0000 7fdb7a30a640 1 -- 172.21.15.64:0/2352120926 wait complete. 2023-10-14T12:30:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.651+0000 7fdb7a30a640 1 Processor -- start 2023-10-14T12:30:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.651+0000 7fdb7a30a640 1 -- start start 2023-10-14T12:30:01.659 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb7a30a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb60003f90 0x7fdb7409c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb7a30a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb74151330 0x7fdb7414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb7a30a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb7409c9e0 0x7fdb7414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb7a30a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740cc250 con 0x7fdb7409c9e0 2023-10-14T12:30:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb7a30a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740cb6d0 con 0x7fdb74151330 2023-10-14T12:30:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb7a30a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb740cb9b0 con 0x7fdb60003f90 2023-10-14T12:30:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb79b09640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb7409c9e0 0x7fdb7414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb79b09640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb7409c9e0 0x7fdb7414dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45932/0 (socket says 172.21.15.64:45932) 2023-10-14T12:30:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.652+0000 7fdb79b09640 1 -- 172.21.15.64:0/1713327048 learned_addr learned my addr 172.21.15.64:0/1713327048 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb79308640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb60003f90 0x7fdb7409c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb78b07640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb74151330 0x7fdb7414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb79b09640 1 -- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb60003f90 msgr2=0x7fdb7409c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb79b09640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb60003f90 0x7fdb7409c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb79b09640 1 -- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb74151330 msgr2=0x7fdb7414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb79b09640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb74151330 0x7fdb7414d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb79b09640 1 -- 172.21.15.64:0/1713327048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb740cbc90 con 0x7fdb7409c9e0 2023-10-14T12:30:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb79b09640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb7409c9e0 0x7fdb7414dd20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb7408a600 tx=0x7fdb6c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb69ffb640 1 -- 172.21.15.64:0/1713327048 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c017400 con 0x7fdb7409c9e0 2023-10-14T12:30:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb69ffb640 1 -- 172.21.15.64:0/1713327048 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6c011040 con 0x7fdb7409c9e0 2023-10-14T12:30:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb69ffb640 1 -- 172.21.15.64:0/1713327048 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6c0177c0 con 0x7fdb7409c9e0 2023-10-14T12:30:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.653+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb740cbf70 con 0x7fdb7409c9e0 2023-10-14T12:30:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.654+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb741f1280 con 0x7fdb7409c9e0 2023-10-14T12:30:01.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.655+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb740ccbd0 con 0x7fdb7409c9e0 2023-10-14T12:30:01.664 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.656+0000 7fdb69ffb640 1 -- 172.21.15.64:0/1713327048 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdb6c017920 con 0x7fdb7409c9e0 2023-10-14T12:30:01.665 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.656+0000 7fdb69ffb640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdb5806ae70 0x7fdb5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:01.665 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.657+0000 7fdb69ffb640 1 -- 172.21.15.64:0/1713327048 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdb6c089ea0 con 0x7fdb7409c9e0 2023-10-14T12:30:01.665 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.657+0000 7fdb79308640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdb5806ae70 0x7fdb5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:01.665 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.658+0000 7fdb79308640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdb5806ae70 0x7fdb5806d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb70001630 tx=0x7fdb70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:01.665 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.661+0000 7fdb69ffb640 1 -- 172.21.15.64:0/1713327048 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdb6c054b90 con 0x7fdb7409c9e0 2023-10-14T12:30:01.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.851+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdb7404e9b0 con 0x7fdb7409c9e0 2023-10-14T12:30:01.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.852+0000 7fdb69ffb640 1 -- 172.21.15.64:0/1713327048 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdb6c0581b0 con 0x7fdb7409c9e0 2023-10-14T12:30:01.854 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:01.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdb5806ae70 msgr2=0x7fdb5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdb5806ae70 0x7fdb5806d330 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb70001630 tx=0x7fdb70009040 comp rx=0 tx=0).stop 2023-10-14T12:30:01.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb7409c9e0 msgr2=0x7fdb7414dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:01.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb7409c9e0 0x7fdb7414dd20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fdb7408a600 tx=0x7fdb6c00f4a0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 shutdown_connections 2023-10-14T12:30:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdb5806ae70 0x7fdb5806d330 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdb7409c9e0 0x7fdb7414dd20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdb74151330 0x7fdb7414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 --2- 172.21.15.64:0/1713327048 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdb60003f90 0x7fdb7409c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 >> 172.21.15.64:0/1713327048 conn(0x7fdb7409bb30 msgr2=0x7fdb7415bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 shutdown_connections 2023-10-14T12:30:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:01.855+0000 7fdb7a30a640 1 -- 172.21.15.64:0/1713327048 wait complete. 2023-10-14T12:30:01.875 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:30:02.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.076+0000 7f6b92ff5640 1 Processor -- start 2023-10-14T12:30:02.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.076+0000 7f6b92ff5640 1 -- start start 2023-10-14T12:30:02.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.077+0000 7f6b92ff5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6b8c160ee0 0x7f6b8c1654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.077+0000 7f6b92ff5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6b8c0c9060 0x7f6b8c0caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.077+0000 7f6b92ff5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c0cc8b0 con 0x7f6b8c0cb1e0 2023-10-14T12:30:02.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.077+0000 7f6b92ff5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8c165a20 con 0x7f6b8c160ee0 2023-10-14T12:30:02.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.077+0000 7f6b92ff5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8c0c9cc0 con 0x7f6b8c0c9060 2023-10-14T12:30:02.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b90d91640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6b8c160ee0 0x7f6b8c1654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b90d91640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6b8c160ee0 0x7f6b8c1654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45940/0 (socket says 172.21.15.64:45940) 2023-10-14T12:30:02.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b91592640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f6b8c0cb1e0 0x7f6b8c0ce490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41954/0 (socket says 172.21.15.64:41954) 2023-10-14T12:30:02.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b90d91640 1 -- 172.21.15.64:0/1101636168 learned_addr learned my addr 172.21.15.64:0/1101636168 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:02.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b8bfff640 1 --2- 172.21.15.64:0/1101636168 >> v2:172.21.15.177:3300/0 conn(0x7f6b8c0c9060 0x7f6b8c0caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b90d91640 1 -- 172.21.15.64:0/1101636168 >> v2:172.21.15.177:3300/0 conn(0x7f6b8c0c9060 msgr2=0x7f6b8c0caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b90d91640 1 --2- 172.21.15.64:0/1101636168 >> v2:172.21.15.177:3300/0 conn(0x7f6b8c0c9060 0x7f6b8c0caca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b90d91640 1 -- 172.21.15.64:0/1101636168 >> v1:172.21.15.64:6789/0 conn(0x7f6b8c0cb1e0 legacy=0x7f6b8c0ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b90d91640 1 -- 172.21.15.64:0/1101636168 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c0c9700 con 0x7f6b8c160ee0 2023-10-14T12:30:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.078+0000 7f6b8b7fe640 1 -- 172.21.15.64:0/1101636168 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2256954820 0 0) 0x7f6b8c0cc8b0 con 0x7f6b8c0cb1e0 2023-10-14T12:30:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.079+0000 7f6b90d91640 1 --2- 172.21.15.64:0/1101636168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c1654e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0adb20 tx=0x7f6b8002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39670ecbd45d6926 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b8b7fe640 1 -- 172.21.15.64:0/1101636168 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80030860 con 0x7f6b8c160ee0 2023-10-14T12:30:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b8b7fe640 1 -- 172.21.15.64:0/1101636168 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b800309c0 con 0x7f6b8c160ee0 2023-10-14T12:30:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b8b7fe640 1 -- 172.21.15.64:0/1101636168 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b80030d50 con 0x7f6b8c160ee0 2023-10-14T12:30:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b92ff5640 1 -- 172.21.15.64:0/1101636168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 msgr2=0x7f6b8c1654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/1101636168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c1654e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c0adb20 tx=0x7f6b8002b9a0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b92ff5640 1 -- 172.21.15.64:0/1101636168 shutdown_connections 2023-10-14T12:30:02.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/1101636168 >> v2:172.21.15.177:3300/0 conn(0x7f6b8c0c9060 0x7f6b8c0caca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/1101636168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c1654e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b92ff5640 1 -- 172.21.15.64:0/1101636168 >> 172.21.15.64:0/1101636168 conn(0x7f6b8c0b0030 msgr2=0x7f6b8c0b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:02.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.080+0000 7f6b92ff5640 1 -- 172.21.15.64:0/1101636168 shutdown_connections 2023-10-14T12:30:02.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.081+0000 7f6b92ff5640 1 -- 172.21.15.64:0/1101636168 wait complete. 2023-10-14T12:30:02.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.082+0000 7f6b92ff5640 1 Processor -- start 2023-10-14T12:30:02.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.082+0000 7f6b92ff5640 1 -- start start 2023-10-14T12:30:02.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.083+0000 7f6b92ff5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0c9060 0x7f6b8c1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.083+0000 7f6b92ff5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b8c0cb1e0 0x7f6b8c0c3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.083+0000 7f6b92ff5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b92ff5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c15ad40 con 0x7f6b8c160ee0 2023-10-14T12:30:02.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b92ff5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0c2fa0 con 0x7f6b8c0cb1e0 2023-10-14T12:30:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b92ff5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0c3430 con 0x7f6b8c0c9060 2023-10-14T12:30:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c0c3d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45954/0 (socket says 172.21.15.64:45954) 2023-10-14T12:30:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 -- 172.21.15.64:0/230400376 learned_addr learned my addr 172.21.15.64:0/230400376 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:02.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b90d91640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0c9060 0x7f6b8c1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b8bfff640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b8c0cb1e0 0x7f6b8c0c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 -- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0c9060 msgr2=0x7f6b8c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0c9060 0x7f6b8c1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 -- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b8c0cb1e0 msgr2=0x7f6b8c0c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b8c0cb1e0 0x7f6b8c0c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.084+0000 7f6b91592640 1 -- 172.21.15.64:0/230400376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b800094d0 con 0x7f6b8c160ee0 2023-10-14T12:30:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.085+0000 7f6b91592640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c0c3d60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c810 tx=0x7f6b8400ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.085+0000 7f6b897fa640 1 -- 172.21.15.64:0/230400376 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400a640 con 0x7f6b8c160ee0 2023-10-14T12:30:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.085+0000 7f6b897fa640 1 -- 172.21.15.64:0/230400376 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8400a7c0 con 0x7f6b8c160ee0 2023-10-14T12:30:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.085+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8c0c2390 con 0x7f6b8c160ee0 2023-10-14T12:30:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.085+0000 7f6b897fa640 1 -- 172.21.15.64:0/230400376 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8400ab70 con 0x7f6b8c160ee0 2023-10-14T12:30:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.085+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8c0c2950 con 0x7f6b8c160ee0 2023-10-14T12:30:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.086+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8c0c5420 con 0x7f6b8c160ee0 2023-10-14T12:30:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.087+0000 7f6b897fa640 1 -- 172.21.15.64:0/230400376 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b8400acd0 con 0x7f6b8c160ee0 2023-10-14T12:30:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.088+0000 7f6b897fa640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b7806ae70 0x7f6b7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.088+0000 7f6b897fa640 1 -- 172.21.15.64:0/230400376 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6b84089270 con 0x7f6b8c160ee0 2023-10-14T12:30:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.089+0000 7f6b90d91640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b7806ae70 0x7f6b7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.090+0000 7f6b90d91640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b7806ae70 0x7f6b7806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b80036000 tx=0x7f6b80008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:02.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.093+0000 7f6b897fa640 1 -- 172.21.15.64:0/230400376 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b84053f50 con 0x7f6b8c160ee0 2023-10-14T12:30:02.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.286+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6b8c0c3150 con 0x7f6b8c160ee0 2023-10-14T12:30:02.288 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.286+0000 7f6b897fa640 1 -- 172.21.15.64:0/230400376 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6b8c0c3150 con 0x7f6b8c160ee0 2023-10-14T12:30:02.288 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:30:02.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b7806ae70 msgr2=0x7f6b7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b7806ae70 0x7f6b7806d330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b80036000 tx=0x7f6b80008030 comp rx=0 tx=0).stop 2023-10-14T12:30:02.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 msgr2=0x7f6b8c0c3d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c0c3d60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6b8400c810 tx=0x7f6b8400ccd0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 shutdown_connections 2023-10-14T12:30:02.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b7806ae70 0x7f6b7806d330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b8c160ee0 0x7f6b8c0c3d60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b8c0cb1e0 0x7f6b8c0c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 --2- 172.21.15.64:0/230400376 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b8c0c9060 0x7f6b8c1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 >> 172.21.15.64:0/230400376 conn(0x7f6b8c0b0030 msgr2=0x7f6b8c15be40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 shutdown_connections 2023-10-14T12:30:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.289+0000 7f6b92ff5640 1 -- 172.21.15.64:0/230400376 wait complete. 2023-10-14T12:30:02.310 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:30:02.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.536+0000 7f35a759e640 1 Processor -- start 2023-10-14T12:30:02.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.537+0000 7f35a759e640 1 -- start start 2023-10-14T12:30:02.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.538+0000 7f35a759e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f35a815c940 0x7f35a80d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.538+0000 7f35a759e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f35a80b6fe0 0x7f35a80d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.538+0000 7f35a759e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35a80ce810 con 0x7f35a80d0d80 2023-10-14T12:30:02.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.538+0000 7f35a759e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a80d1740 con 0x7f35a80b6fe0 2023-10-14T12:30:02.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.538+0000 7f35a759e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35a80b5b40 con 0x7f35a815c940 2023-10-14T12:30:02.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a6d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f35a80b6fe0 0x7f35a80d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a5d9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f35a80d0d80 0x7f35a8160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41958/0 (socket says 172.21.15.64:41958) 2023-10-14T12:30:02.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a6d9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f35a80b6fe0 0x7f35a80d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45956/0 (socket says 172.21.15.64:45956) 2023-10-14T12:30:02.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a5d9b640 1 -- 172.21.15.64:0/858239355 learned_addr learned my addr 172.21.15.64:0/858239355 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:02.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a659c640 1 --2- 172.21.15.64:0/858239355 >> v2:172.21.15.177:3300/0 conn(0x7f35a815c940 0x7f35a80d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a559a640 1 -- 172.21.15.64:0/858239355 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2192443416 0 0) 0x7f35a80ce810 con 0x7f35a80d0d80 2023-10-14T12:30:02.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a6d9d640 1 -- 172.21.15.64:0/858239355 >> v2:172.21.15.177:3300/0 conn(0x7f35a815c940 msgr2=0x7f35a80d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:02.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a6d9d640 1 --2- 172.21.15.64:0/858239355 >> v2:172.21.15.177:3300/0 conn(0x7f35a815c940 0x7f35a80d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a6d9d640 1 -- 172.21.15.64:0/858239355 >> v1:172.21.15.64:6789/0 conn(0x7f35a80d0d80 legacy=0x7f35a8160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.539+0000 7f35a6d9d640 1 -- 172.21.15.64:0/858239355 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a80ce250 con 0x7f35a80b6fe0 2023-10-14T12:30:02.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.541+0000 7f35a6d9d640 1 --2- 172.21.15.64:0/858239355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80b6fe0 0x7f35a80d1200 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f35a80671a0 tx=0x7f35a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66e5d764dbaa6257 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:02.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.541+0000 7f35a559a640 1 -- 172.21.15.64:0/858239355 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a002e070 con 0x7f35a80b6fe0 2023-10-14T12:30:02.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.541+0000 7f35a559a640 1 -- 172.21.15.64:0/858239355 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a00315a0 con 0x7f35a80b6fe0 2023-10-14T12:30:02.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.541+0000 7f35a559a640 1 -- 172.21.15.64:0/858239355 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a0031930 con 0x7f35a80b6fe0 2023-10-14T12:30:02.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 -- 172.21.15.64:0/858239355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80b6fe0 msgr2=0x7f35a80d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 --2- 172.21.15.64:0/858239355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80b6fe0 0x7f35a80d1200 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f35a80671a0 tx=0x7f35a002b840 comp rx=0 tx=0).stop 2023-10-14T12:30:02.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 -- 172.21.15.64:0/858239355 shutdown_connections 2023-10-14T12:30:02.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 --2- 172.21.15.64:0/858239355 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80b6fe0 0x7f35a80d1200 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 --2- 172.21.15.64:0/858239355 >> v2:172.21.15.177:3300/0 conn(0x7f35a815c940 0x7f35a80d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 -- 172.21.15.64:0/858239355 >> 172.21.15.64:0/858239355 conn(0x7f35a809bb30 msgr2=0x7f35a80d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:02.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 -- 172.21.15.64:0/858239355 shutdown_connections 2023-10-14T12:30:02.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.542+0000 7f35a759e640 1 -- 172.21.15.64:0/858239355 wait complete. 2023-10-14T12:30:02.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.544+0000 7f35a759e640 1 Processor -- start 2023-10-14T12:30:02.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.544+0000 7f35a759e640 1 -- start start 2023-10-14T12:30:02.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80b6fe0 0x7f35a8157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80d0d80 0x7f35a80cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a815c940 0x7f35a81f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a8157990 con 0x7f35a80d0d80 2023-10-14T12:30:02.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80cb080 con 0x7f35a80b6fe0 2023-10-14T12:30:02.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35a80cb360 con 0x7f35a815c940 2023-10-14T12:30:02.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80d0d80 0x7f35a80cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a5d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80d0d80 0x7f35a80cc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45972/0 (socket says 172.21.15.64:45972) 2023-10-14T12:30:02.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a5d9b640 1 -- 172.21.15.64:0/1668075088 learned_addr learned my addr 172.21.15.64:0/1668075088 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:02.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a659c640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80b6fe0 0x7f35a8157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a6d9d640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a815c940 0x7f35a81f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a5d9b640 1 -- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a815c940 msgr2=0x7f35a81f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a5d9b640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a815c940 0x7f35a81f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a5d9b640 1 -- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80b6fe0 msgr2=0x7f35a8157db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.546+0000 7f35a5d9b640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80b6fe0 0x7f35a8157db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.547+0000 7f35a5d9b640 1 -- 172.21.15.64:0/1668075088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a0009400 con 0x7f35a80d0d80 2023-10-14T12:30:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.547+0000 7f35a5d9b640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80d0d80 0x7f35a80cc4d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f359000c430 tx=0x7f359000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.547+0000 7f359effd640 1 -- 172.21.15.64:0/1668075088 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35900074e0 con 0x7f35a80d0d80 2023-10-14T12:30:02.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.547+0000 7f359effd640 1 -- 172.21.15.64:0/1668075088 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3590007660 con 0x7f35a80d0d80 2023-10-14T12:30:02.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.547+0000 7f359effd640 1 -- 172.21.15.64:0/1668075088 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3590004a20 con 0x7f35a80d0d80 2023-10-14T12:30:02.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.547+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35a81575b0 con 0x7f35a80d0d80 2023-10-14T12:30:02.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.547+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35a8156ae0 con 0x7f35a80d0d80 2023-10-14T12:30:02.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.549+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35a80cb580 con 0x7f35a80d0d80 2023-10-14T12:30:02.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.550+0000 7f359effd640 1 -- 172.21.15.64:0/1668075088 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f3590004b80 con 0x7f35a80d0d80 2023-10-14T12:30:02.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.550+0000 7f359effd640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f358806ae70 0x7f358806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:02.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.550+0000 7f359effd640 1 -- 172.21.15.64:0/1668075088 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f35900897b0 con 0x7f35a80d0d80 2023-10-14T12:30:02.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.551+0000 7f35a659c640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f358806ae70 0x7f358806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:02.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.552+0000 7f35a659c640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f358806ae70 0x7f358806d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3598009a60 tx=0x7f3598003990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:02.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.555+0000 7f359effd640 1 -- 172.21.15.64:0/1668075088 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3590054530 con 0x7f35a80d0d80 2023-10-14T12:30:02.749 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.747+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f35a804e9b0 con 0x7f35a80d0d80 2023-10-14T12:30:02.749 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.748+0000 7f359effd640 1 -- 172.21.15.64:0/1668075088 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3590057b50 con 0x7f35a80d0d80 2023-10-14T12:30:02.750 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:02.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f358806ae70 msgr2=0x7f358806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.752 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f358806ae70 0x7f358806d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3598009a60 tx=0x7f3598003990 comp rx=0 tx=0).stop 2023-10-14T12:30:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80d0d80 msgr2=0x7f35a80cc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80d0d80 0x7f35a80cc4d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f359000c430 tx=0x7f359000c8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 shutdown_connections 2023-10-14T12:30:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f358806ae70 0x7f358806d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f35a815c940 0x7f35a81f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f35a80d0d80 0x7f35a80cc4d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 --2- 172.21.15.64:0/1668075088 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f35a80b6fe0 0x7f35a8157db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:02.754 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.750+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 >> 172.21.15.64:0/1668075088 conn(0x7f35a809bb30 msgr2=0x7f35a80b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:02.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.751+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 shutdown_connections 2023-10-14T12:30:02.755 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:02.751+0000 7f35a759e640 1 -- 172.21.15.64:0/1668075088 wait complete. 2023-10-14T12:30:02.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:30:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.001+0000 7ffa6359e640 1 Processor -- start 2023-10-14T12:30:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.001+0000 7ffa6359e640 1 -- start start 2023-10-14T12:30:03.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.003+0000 7ffa6359e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ffa640cd950 0x7ffa640cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.003+0000 7ffa6359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa640cefa0 con 0x7ffa64157040 2023-10-14T12:30:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.003+0000 7ffa6359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6406d4c0 con 0x7ffa640ce600 2023-10-14T12:30:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.003+0000 7ffa6359e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa640cdde0 con 0x7ffa640cd950 2023-10-14T12:30:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.003+0000 7ffa6259c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ffa64157040 0x7ffa6406d950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41962/0 (socket says 172.21.15.64:41962) 2023-10-14T12:30:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.003+0000 7ffa6259c640 1 -- 172.21.15.64:0/4272937690 learned_addr learned my addr 172.21.15.64:0/4272937690 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:03.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.003+0000 7ffa62d9d640 1 --2- 172.21.15.64:0/4272937690 >> v2:172.21.15.64:3300/0 conn(0x7ffa640cd950 0x7ffa640cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.004+0000 7ffa62d9d640 1 -- 172.21.15.64:0/4272937690 >> v1:172.21.15.177:6789/0 conn(0x7ffa640ce600 legacy=0x7ffa640cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:03.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.004+0000 7ffa62d9d640 1 -- 172.21.15.64:0/4272937690 >> v1:172.21.15.64:6789/0 conn(0x7ffa64157040 legacy=0x7ffa6406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.004+0000 7ffa62d9d640 1 -- 172.21.15.64:0/4272937690 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa640cdfc0 con 0x7ffa640cd950 2023-10-14T12:30:03.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.004+0000 7ffa6159a640 1 -- 172.21.15.64:0/4272937690 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1836920861 0 0) 0x7ffa640cefa0 con 0x7ffa64157040 2023-10-14T12:30:03.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.005+0000 7ffa62d9d640 1 --2- 172.21.15.64:0/4272937690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640cea60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0097a0 tx=0x7ffa5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e128966e5ab97ee3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:03.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6159a640 1 -- 172.21.15.64:0/4272937690 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c031830 con 0x7ffa640cd950 2023-10-14T12:30:03.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6159a640 1 -- 172.21.15.64:0/4272937690 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5c031990 con 0x7ffa640cd950 2023-10-14T12:30:03.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6159a640 1 -- 172.21.15.64:0/4272937690 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5c031d20 con 0x7ffa640cd950 2023-10-14T12:30:03.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6359e640 1 -- 172.21.15.64:0/4272937690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 msgr2=0x7ffa640cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4272937690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640cea60 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c0097a0 tx=0x7ffa5c02b8d0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6359e640 1 -- 172.21.15.64:0/4272937690 shutdown_connections 2023-10-14T12:30:03.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4272937690 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640cea60 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6359e640 1 -- 172.21.15.64:0/4272937690 >> 172.21.15.64:0/4272937690 conn(0x7ffa64069fc0 msgr2=0x7ffa6406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:03.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.006+0000 7ffa6359e640 1 -- 172.21.15.64:0/4272937690 shutdown_connections 2023-10-14T12:30:03.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.007+0000 7ffa6359e640 1 -- 172.21.15.64:0/4272937690 wait complete. 2023-10-14T12:30:03.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.008+0000 7ffa6359e640 1 Processor -- start 2023-10-14T12:30:03.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.008+0000 7ffa6359e640 1 -- start start 2023-10-14T12:30:03.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.009+0000 7ffa6359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640c2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.009+0000 7ffa6359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa640ce600 0x7ffa640c4510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.009+0000 7ffa6359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa64157040 0x7ffa640c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.009+0000 7ffa6359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa641552c0 con 0x7ffa640cd950 2023-10-14T12:30:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.009+0000 7ffa6359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640acac0 con 0x7ffa64157040 2023-10-14T12:30:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.009+0000 7ffa6359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa640ac500 con 0x7ffa640ce600 2023-10-14T12:30:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:45990/0 (socket says 172.21.15.64:45990) 2023-10-14T12:30:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 -- 172.21.15.64:0/4138004358 learned_addr learned my addr 172.21.15.64:0/4138004358 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:03.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa62d9d640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa64157040 0x7ffa640c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa61d9b640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa640ce600 0x7ffa640c4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 -- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa640ce600 msgr2=0x7ffa640c4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa640ce600 0x7ffa640c4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 -- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa64157040 msgr2=0x7ffa640c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa64157040 0x7ffa640c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa6259c640 1 -- 172.21.15.64:0/4138004358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa5c009400 con 0x7ffa640cd950 2023-10-14T12:30:03.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.010+0000 7ffa61d9b640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa640ce600 0x7ffa640c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:03.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.011+0000 7ffa6259c640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640c2910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c750 tx=0x7ffa5400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:03.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.011+0000 7ffa5affd640 1 -- 172.21.15.64:0/4138004358 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400ce60 con 0x7ffa640cd950 2023-10-14T12:30:03.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.011+0000 7ffa5affd640 1 -- 172.21.15.64:0/4138004358 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5400a640 con 0x7ffa640cd950 2023-10-14T12:30:03.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.011+0000 7ffa5affd640 1 -- 172.21.15.64:0/4138004358 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5400a9f0 con 0x7ffa640cd950 2023-10-14T12:30:03.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.011+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa640ac7e0 con 0x7ffa640cd950 2023-10-14T12:30:03.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.011+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa640c2e50 con 0x7ffa640cd950 2023-10-14T12:30:03.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.012+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6404e9b0 con 0x7ffa640cd950 2023-10-14T12:30:03.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.013+0000 7ffa5affd640 1 -- 172.21.15.64:0/4138004358 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ffa5400ab50 con 0x7ffa640cd950 2023-10-14T12:30:03.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.014+0000 7ffa5affd640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffa4406ae70 0x7ffa4406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.014+0000 7ffa5affd640 1 -- 172.21.15.64:0/4138004358 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ffa540898b0 con 0x7ffa640cd950 2023-10-14T12:30:03.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.015+0000 7ffa61d9b640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffa4406ae70 0x7ffa4406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.016+0000 7ffa61d9b640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffa4406ae70 0x7ffa4406d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffa6406dd10 tx=0x7ffa4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:03.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.018+0000 7ffa5affd640 1 -- 172.21.15.64:0/4138004358 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ffa54054500 con 0x7ffa640cd950 2023-10-14T12:30:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.233+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffa6406cad0 con 0x7ffa640cd950 2023-10-14T12:30:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.234+0000 7ffa5affd640 1 -- 172.21.15.64:0/4138004358 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffa54057b20 con 0x7ffa640cd950 2023-10-14T12:30:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:30:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffa4406ae70 msgr2=0x7ffa4406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffa4406ae70 0x7ffa4406d330 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ffa6406dd10 tx=0x7ffa4c009040 comp rx=0 tx=0).stop 2023-10-14T12:30:03.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 msgr2=0x7ffa640c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640c2910 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c750 tx=0x7ffa5400cc10 comp rx=0 tx=0).stop 2023-10-14T12:30:03.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 shutdown_connections 2023-10-14T12:30:03.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ffa4406ae70 0x7ffa4406d330 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ffa64157040 0x7ffa640c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ffa640ce600 0x7ffa640c4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 --2- 172.21.15.64:0/4138004358 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ffa640cd950 0x7ffa640c2910 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 >> 172.21.15.64:0/4138004358 conn(0x7ffa64069fc0 msgr2=0x7ffa6415d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:03.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 shutdown_connections 2023-10-14T12:30:03.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.237+0000 7ffa6359e640 1 -- 172.21.15.64:0/4138004358 wait complete. 2023-10-14T12:30:03.256 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-14T12:30:03.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:03.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-10-14T12:30:03.368 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:30:03.368 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:30:03.369 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:03.369 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T12:30:03.438 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:30:03.438 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:30:03.500 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:30:03.500 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:30:03.558 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.776+0000 7f03621bf640 1 Processor -- start 2023-10-14T12:30:03.778 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.776+0000 7f03621bf640 1 -- start start 2023-10-14T12:30:03.779 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.778+0000 7f03621bf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 0x7f035c0c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.778+0000 7f03621bf640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c15acb0 con 0x7f035c0ca660 2023-10-14T12:30:03.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.778+0000 7f03621bf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035c0c1c60 con 0x7f035c15a8d0 2023-10-14T12:30:03.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.778+0000 7f03621bf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c15e350 con 0x7f035c0cb250 2023-10-14T12:30:03.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.778+0000 7f03619be640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f035c0ca660 0x7f035c0c9350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41964/0 (socket says 172.21.15.64:41964) 2023-10-14T12:30:03.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.778+0000 7f03619be640 1 -- 172.21.15.64:0/1750385718 learned_addr learned my addr 172.21.15.64:0/1750385718 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:03.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f03609bc640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 0x7f035c0c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3185914015 0 0) 0x7f0354001490 con 0x7f035c0ca660 2023-10-14T12:30:03.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0348003520 con 0x7f035c0ca660 2023-10-14T12:30:03.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2262568310 0 0) 0x7f0348003520 con 0x7f035c0ca660 2023-10-14T12:30:03.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 msgr2=0x7f035c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:03.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 0x7f035c0c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 >> v1:172.21.15.177:6789/0 conn(0x7f035c15a8d0 legacy=0x7f035c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c15e630 con 0x7f035c0ca660 2023-10-14T12:30:03.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f0354001b80 con 0x7f035c0ca660 2023-10-14T12:30:03.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 >> v1:172.21.15.64:6789/0 conn(0x7f035c0ca660 legacy=0x7f035c0c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03480039a0 0x7f0348003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 0x7f03480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0348004d00 0x7f0348005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c15e350 con 0x7f0348004d00 2023-10-14T12:30:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034800bb10 con 0x7f03480039a0 2023-10-14T12:30:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.779+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034800bca0 con 0x7f035c0cb250 2023-10-14T12:30:03.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03619be640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0348004d00 0x7f0348005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03609bc640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 0x7f03480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03611bd640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03480039a0 0x7f0348003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03619be640 1 -- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 msgr2=0x7f03480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:03.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03619be640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f035c0cb250 0x7f03480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03619be640 1 -- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03480039a0 msgr2=0x7f0348003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:03.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03619be640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f03480039a0 0x7f0348003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.780+0000 7f03619be640 1 -- 172.21.15.64:0/1750385718 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0348003520 con 0x7f0348004d00 2023-10-14T12:30:03.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.781+0000 7f03619be640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0348004d00 0x7f0348005180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f035400a830 tx=0x7f03480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba50d3cd37f6c03 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:03.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.781+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354034630 con 0x7f0348004d00 2023-10-14T12:30:03.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035402f070 con 0x7f0348004d00 2023-10-14T12:30:03.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f0353fff640 1 -- 172.21.15.64:0/1750385718 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03540349f0 con 0x7f0348004d00 2023-10-14T12:30:03.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f03621bf640 1 -- 172.21.15.64:0/1750385718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0348004d00 msgr2=0x7f0348005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f03621bf640 1 --2- 172.21.15.64:0/1750385718 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0348004d00 0x7f0348005180 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f035400a830 tx=0x7f03480057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f03619be640 1 -- 172.21.15.64:0/1750385718 reap_dead start 2023-10-14T12:30:03.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f03621bf640 1 -- 172.21.15.64:0/1750385718 shutdown_connections 2023-10-14T12:30:03.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f03621bf640 1 -- 172.21.15.64:0/1750385718 >> 172.21.15.64:0/1750385718 conn(0x7f035c06a470 msgr2=0x7f035c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:03.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f03621bf640 1 -- 172.21.15.64:0/1750385718 shutdown_connections 2023-10-14T12:30:03.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.782+0000 7f03621bf640 1 -- 172.21.15.64:0/1750385718 wait complete. 2023-10-14T12:30:03.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.784+0000 7f03621bf640 1 Processor -- start 2023-10-14T12:30:03.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.784+0000 7f03621bf640 1 -- start start 2023-10-14T12:30:03.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.785+0000 7f03621bf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0348004d00 0x7f035c147670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.785+0000 7f03621bf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c153320 0x7f035c1f3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.785+0000 7f03621bf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c156830 0x7f035c156cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.785+0000 7f03621bf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c1571f0 con 0x7f035c156830 2023-10-14T12:30:03.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.785+0000 7f03621bf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f035c1f47c0 con 0x7f035c153320 2023-10-14T12:30:03.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.785+0000 7f03621bf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f035c1f4200 con 0x7f0348004d00 2023-10-14T12:30:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.785+0000 7f03619be640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c156830 0x7f035c156cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c156830 0x7f035c156cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46008/0 (socket says 172.21.15.64:46008) 2023-10-14T12:30:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 -- 172.21.15.64:0/1892668917 learned_addr learned my addr 172.21.15.64:0/1892668917 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03611bd640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0348004d00 0x7f035c147670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03609bc640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c153320 0x7f035c1f3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 -- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0348004d00 msgr2=0x7f035c147670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0348004d00 0x7f035c147670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 -- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c153320 msgr2=0x7f035c1f3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:03.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c153320 0x7f035c1f3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:03.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 -- 172.21.15.64:0/1892668917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f035c1f44e0 con 0x7f035c156830 2023-10-14T12:30:03.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.786+0000 7f03619be640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c156830 0x7f035c156cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f035400a830 tx=0x7f0354001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:03.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.787+0000 7f0351ffb640 1 -- 172.21.15.64:0/1892668917 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354001b40 con 0x7f035c156830 2023-10-14T12:30:03.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.787+0000 7f0351ffb640 1 -- 172.21.15.64:0/1892668917 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0354004e90 con 0x7f035c156830 2023-10-14T12:30:03.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.787+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f035c1f1500 con 0x7f035c156830 2023-10-14T12:30:03.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.787+0000 7f0351ffb640 1 -- 172.21.15.64:0/1892668917 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354034650 con 0x7f035c156830 2023-10-14T12:30:03.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.787+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f035c147bb0 con 0x7f035c156830 2023-10-14T12:30:03.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.788+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035c147bb0 con 0x7f035c156830 2023-10-14T12:30:03.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.789+0000 7f0351ffb640 1 -- 172.21.15.64:0/1892668917 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0354031030 con 0x7f035c156830 2023-10-14T12:30:03.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.790+0000 7f0351ffb640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f034006ae70 0x7f034006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:03.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.790+0000 7f0351ffb640 1 -- 172.21.15.64:0/1892668917 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f03540ab630 con 0x7f035c156830 2023-10-14T12:30:03.798 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.791+0000 7f03611bd640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f034006ae70 0x7f034006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:03.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.792+0000 7f03611bd640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f034006ae70 0x7f034006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03580055b0 tx=0x7f0358009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:03.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.795+0000 7f0351ffb640 1 -- 172.21.15.64:0/1892668917 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f03540763a0 con 0x7f035c156830 2023-10-14T12:30:03.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.996+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f035c147bb0 con 0x7f035c156830 2023-10-14T12:30:04.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:03.999+0000 7f0351ffb640 1 -- 172.21.15.64:0/1892668917 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f03540799c0 con 0x7f035c156830 2023-10-14T12:30:04.002 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:04.002 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:04.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.002+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f034006ae70 msgr2=0x7f034006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.002+0000 7f03621bf640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f034006ae70 0x7f034006d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f03580055b0 tx=0x7f0358009040 comp rx=0 tx=0).stop 2023-10-14T12:30:04.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.002+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c156830 msgr2=0x7f035c156cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.002+0000 7f03621bf640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c156830 0x7f035c156cb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f035400a830 tx=0x7f0354001f10 comp rx=0 tx=0).stop 2023-10-14T12:30:04.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 shutdown_connections 2023-10-14T12:30:04.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f034006ae70 0x7f034006d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f035c156830 0x7f035c156cb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f035c153320 0x7f035c1f3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 --2- 172.21.15.64:0/1892668917 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0348004d00 0x7f035c147670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 >> 172.21.15.64:0/1892668917 conn(0x7f035c06a470 msgr2=0x7f035c159c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:04.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 shutdown_connections 2023-10-14T12:30:04.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.003+0000 7f03621bf640 1 -- 172.21.15.64:0/1892668917 wait complete. 2023-10-14T12:30:04.025 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:30:04.025 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:30:04.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.254+0000 7fe1e6c35640 1 Processor -- start 2023-10-14T12:30:04.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.254+0000 7fe1e6c35640 1 -- start start 2023-10-14T12:30:04.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.255+0000 7fe1e6c35640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe1e00cacf0 0x7fe1e00cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.255+0000 7fe1e6c35640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e015cb80 0x7fe1e00cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e6c35640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1e00cc1e0 con 0x7fe1e00cb0d0 2023-10-14T12:30:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e6c35640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e0070170 con 0x7fe1e00cacf0 2023-10-14T12:30:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e6c35640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00cd360 con 0x7fe1e015cb80 2023-10-14T12:30:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5c33640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe1e00cacf0 0x7fe1e00cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5c33640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe1e00cacf0 0x7fe1e00cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46024/0 (socket says 172.21.15.64:46024) 2023-10-14T12:30:04.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5c33640 1 -- 172.21.15.64:0/2312363578 learned_addr learned my addr 172.21.15.64:0/2312363578 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:04.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5432640 1 --2- 172.21.15.64:0/2312363578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e015cb80 0x7fe1e00cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5c33640 1 -- 172.21.15.64:0/2312363578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e015cb80 msgr2=0x7fe1e00cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5c33640 1 --2- 172.21.15.64:0/2312363578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e015cb80 0x7fe1e00cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5c33640 1 -- 172.21.15.64:0/2312363578 >> v1:172.21.15.177:6789/0 conn(0x7fe1e00cb0d0 legacy=0x7fe1e006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.256+0000 7fe1e5c33640 1 -- 172.21.15.64:0/2312363578 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00ccac0 con 0x7fe1e00cacf0 2023-10-14T12:30:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.258+0000 7fe1e5c33640 1 --2- 172.21.15.64:0/2312363578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e00cacf0 0x7fe1e00cdc20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009870 tx=0x7fe1dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df26a979c9e9e0a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:04.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.258+0000 7fe1e4c31640 1 -- 172.21.15.64:0/2312363578 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc031640 con 0x7fe1e00cacf0 2023-10-14T12:30:04.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.258+0000 7fe1e4c31640 1 -- 172.21.15.64:0/2312363578 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1dc0317a0 con 0x7fe1e00cacf0 2023-10-14T12:30:04.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.258+0000 7fe1e4c31640 1 -- 172.21.15.64:0/2312363578 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1dc031b30 con 0x7fe1e00cacf0 2023-10-14T12:30:04.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.258+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2312363578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e00cacf0 msgr2=0x7fe1e00cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.258+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2312363578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e00cacf0 0x7fe1e00cdc20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc009870 tx=0x7fe1dc02b8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.259+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2312363578 shutdown_connections 2023-10-14T12:30:04.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.259+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2312363578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e015cb80 0x7fe1e00cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.259+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2312363578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e00cacf0 0x7fe1e00cdc20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.259+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2312363578 >> 172.21.15.64:0/2312363578 conn(0x7fe1e006a470 msgr2=0x7fe1e00afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:04.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.259+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2312363578 shutdown_connections 2023-10-14T12:30:04.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.259+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2312363578 wait complete. 2023-10-14T12:30:04.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.260+0000 7fe1e6c35640 1 Processor -- start 2023-10-14T12:30:04.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.261+0000 7fe1e6c35640 1 -- start start 2023-10-14T12:30:04.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.261+0000 7fe1e6c35640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e00cacf0 0x7fe1e014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.261+0000 7fe1e6c35640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e00cb0d0 0x7fe1e00c53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.261+0000 7fe1e6c35640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e015cb80 0x7fe1e00c58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6c35640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e014cec0 con 0x7fe1e015cb80 2023-10-14T12:30:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6c35640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e0155c90 con 0x7fe1e00cb0d0 2023-10-14T12:30:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6c35640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e00c4450 con 0x7fe1e00cacf0 2023-10-14T12:30:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e015cb80 0x7fe1e00c58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e015cb80 0x7fe1e00c58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46034/0 (socket says 172.21.15.64:46034) 2023-10-14T12:30:04.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 -- 172.21.15.64:0/2405039704 learned_addr learned my addr 172.21.15.64:0/2405039704 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:04.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e5432640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e00cb0d0 0x7fe1e00c53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e5c33640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e00cacf0 0x7fe1e014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 -- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e00cacf0 msgr2=0x7fe1e014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e00cacf0 0x7fe1e014c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 -- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e00cb0d0 msgr2=0x7fe1e00c53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e00cb0d0 0x7fe1e00c53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.262+0000 7fe1e6434640 1 -- 172.21.15.64:0/2405039704 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1dc0094d0 con 0x7fe1e015cb80 2023-10-14T12:30:04.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.263+0000 7fe1e6434640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e015cb80 0x7fe1e00c58f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c780 tx=0x7fe1d800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:04.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.263+0000 7fe1d67fc640 1 -- 172.21.15.64:0/2405039704 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8004b60 con 0x7fe1e015cb80 2023-10-14T12:30:04.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.263+0000 7fe1d67fc640 1 -- 172.21.15.64:0/2405039704 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d800ce90 con 0x7fe1e015cb80 2023-10-14T12:30:04.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.263+0000 7fe1d67fc640 1 -- 172.21.15.64:0/2405039704 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d800a850 con 0x7fe1e015cb80 2023-10-14T12:30:04.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.263+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e00c4730 con 0x7fe1e015cb80 2023-10-14T12:30:04.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.263+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e015dad0 con 0x7fe1e015cb80 2023-10-14T12:30:04.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.264+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e004e9b0 con 0x7fe1e015cb80 2023-10-14T12:30:04.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.265+0000 7fe1d67fc640 1 -- 172.21.15.64:0/2405039704 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe1d800a9b0 con 0x7fe1e015cb80 2023-10-14T12:30:04.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.266+0000 7fe1d67fc640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe1c406ae70 0x7fe1c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.266+0000 7fe1d67fc640 1 -- 172.21.15.64:0/2405039704 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1d8089c30 con 0x7fe1e015cb80 2023-10-14T12:30:04.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.267+0000 7fe1e5c33640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe1c406ae70 0x7fe1c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.268+0000 7fe1e5c33640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe1c406ae70 0x7fe1c406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc036000 tx=0x7fe1dc03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:04.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.270+0000 7fe1d67fc640 1 -- 172.21.15.64:0/2405039704 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe1d8054880 con 0x7fe1e015cb80 2023-10-14T12:30:04.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.464+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe1e00c4e40 con 0x7fe1e015cb80 2023-10-14T12:30:04.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.464+0000 7fe1d67fc640 1 -- 172.21.15.64:0/2405039704 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe1d8057ea0 con 0x7fe1e015cb80 2023-10-14T12:30:04.467 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:30:04.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe1c406ae70 msgr2=0x7fe1c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe1c406ae70 0x7fe1c406d330 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe1dc036000 tx=0x7fe1dc03c040 comp rx=0 tx=0).stop 2023-10-14T12:30:04.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e015cb80 msgr2=0x7fe1e00c58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e015cb80 0x7fe1e00c58f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800c780 tx=0x7fe1d800cc40 comp rx=0 tx=0).stop 2023-10-14T12:30:04.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 shutdown_connections 2023-10-14T12:30:04.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe1c406ae70 0x7fe1c406d330 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe1e015cb80 0x7fe1e00c58f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe1e00cb0d0 0x7fe1e00c53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.470 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 --2- 172.21.15.64:0/2405039704 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe1e00cacf0 0x7fe1e014c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 >> 172.21.15.64:0/2405039704 conn(0x7fe1e006a470 msgr2=0x7fe1e00ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:04.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 shutdown_connections 2023-10-14T12:30:04.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.467+0000 7fe1e6c35640 1 -- 172.21.15.64:0/2405039704 wait complete. 2023-10-14T12:30:04.488 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:30:04.695 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.694+0000 7ff424f6c640 1 Processor -- start 2023-10-14T12:30:04.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.694+0000 7ff424f6c640 1 -- start start 2023-10-14T12:30:04.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff424f6c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff4200cdf50 0x7ff4200ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff424f6c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff4200cee60 0x7ff420070040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff424f6c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4200cdac0 con 0x7ff42015c8e0 2023-10-14T12:30:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff424f6c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff42006df90 con 0x7ff4200cee60 2023-10-14T12:30:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff424f6c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4200cd1f0 con 0x7ff4200cdf50 2023-10-14T12:30:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff41ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff4200cee60 0x7ff420070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff41ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff4200cee60 0x7ff420070040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46040/0 (socket says 172.21.15.64:46040) 2023-10-14T12:30:04.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.695+0000 7ff41ffff640 1 -- 172.21.15.64:0/2723504394 learned_addr learned my addr 172.21.15.64:0/2723504394 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.696+0000 7ff41effd640 1 --2- 172.21.15.64:0/2723504394 >> v2:172.21.15.177:3300/0 conn(0x7ff4200cdf50 0x7ff4200ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.696+0000 7ff41ffff640 1 -- 172.21.15.64:0/2723504394 >> v2:172.21.15.177:3300/0 conn(0x7ff4200cdf50 msgr2=0x7ff4200ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.696+0000 7ff41ffff640 1 --2- 172.21.15.64:0/2723504394 >> v2:172.21.15.177:3300/0 conn(0x7ff4200cdf50 0x7ff4200ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.696+0000 7ff41ffff640 1 -- 172.21.15.64:0/2723504394 >> v1:172.21.15.64:6789/0 conn(0x7ff42015c8e0 legacy=0x7ff42006d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.696+0000 7ff41ffff640 1 -- 172.21.15.64:0/2723504394 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4200cf270 con 0x7ff4200cee60 2023-10-14T12:30:04.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.696+0000 7ff41e7fc640 1 -- 172.21.15.64:0/2723504394 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1389275516 0 0) 0x7ff4200cdac0 con 0x7ff42015c8e0 2023-10-14T12:30:04.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.697+0000 7ff41ffff640 1 --2- 172.21.15.64:0/2723504394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cee60 0x7ff420070040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff4200c2000 tx=0x7ff41802b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c8f30abe74d6ad9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:04.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.697+0000 7ff41e7fc640 1 -- 172.21.15.64:0/2723504394 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418030880 con 0x7ff4200cee60 2023-10-14T12:30:04.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff41e7fc640 1 -- 172.21.15.64:0/2723504394 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4180309e0 con 0x7ff4200cee60 2023-10-14T12:30:04.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff41e7fc640 1 -- 172.21.15.64:0/2723504394 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff418030d70 con 0x7ff4200cee60 2023-10-14T12:30:04.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 -- 172.21.15.64:0/2723504394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cee60 msgr2=0x7ff420070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 --2- 172.21.15.64:0/2723504394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cee60 0x7ff420070040 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff4200c2000 tx=0x7ff41802b9c0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 -- 172.21.15.64:0/2723504394 shutdown_connections 2023-10-14T12:30:04.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 --2- 172.21.15.64:0/2723504394 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cee60 0x7ff420070040 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 --2- 172.21.15.64:0/2723504394 >> v2:172.21.15.177:3300/0 conn(0x7ff4200cdf50 0x7ff4200ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 -- 172.21.15.64:0/2723504394 >> 172.21.15.64:0/2723504394 conn(0x7ff42006a200 msgr2=0x7ff42006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:04.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 -- 172.21.15.64:0/2723504394 shutdown_connections 2023-10-14T12:30:04.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.698+0000 7ff424f6c640 1 -- 172.21.15.64:0/2723504394 wait complete. 2023-10-14T12:30:04.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.700+0000 7ff424f6c640 1 Processor -- start 2023-10-14T12:30:04.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.700+0000 7ff424f6c640 1 -- start start 2023-10-14T12:30:04.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.701+0000 7ff424f6c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cdf50 0x7ff420155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.701+0000 7ff424f6c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4200cee60 0x7ff420158550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.701+0000 7ff424f6c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42015c8e0 0x7ff420158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.701+0000 7ff424f6c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff42015ed40 con 0x7ff4200cdf50 2023-10-14T12:30:04.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.701+0000 7ff424f6c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff420155960 con 0x7ff4200cee60 2023-10-14T12:30:04.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.701+0000 7ff424f6c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff420158fd0 con 0x7ff42015c8e0 2023-10-14T12:30:04.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cdf50 0x7ff420155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.708 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cdf50 0x7ff420155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46052/0 (socket says 172.21.15.64:46052) 2023-10-14T12:30:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 -- 172.21.15.64:0/3900474936 learned_addr learned my addr 172.21.15.64:0/3900474936 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 -- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42015c8e0 msgr2=0x7ff420158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42015c8e0 0x7ff420158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 -- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4200cee60 msgr2=0x7ff420158550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41effd640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4200cee60 0x7ff420158550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4200cee60 0x7ff420158550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 -- 172.21.15.64:0/3900474936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4180094d0 con 0x7ff4200cdf50 2023-10-14T12:30:04.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.702+0000 7ff41f7fe640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cdf50 0x7ff420155420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c440 tx=0x7ff41000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:04.710 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.703+0000 7ff417fff640 1 -- 172.21.15.64:0/3900474936 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4100035f0 con 0x7ff4200cdf50 2023-10-14T12:30:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.703+0000 7ff417fff640 1 -- 172.21.15.64:0/3900474936 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff410003750 con 0x7ff4200cdf50 2023-10-14T12:30:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.703+0000 7ff417fff640 1 -- 172.21.15.64:0/3900474936 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff410003b00 con 0x7ff4200cdf50 2023-10-14T12:30:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.703+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff42015e100 con 0x7ff4200cdf50 2023-10-14T12:30:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.703+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff42015e680 con 0x7ff4200cdf50 2023-10-14T12:30:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.704+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff42004e9b0 con 0x7ff4200cdf50 2023-10-14T12:30:04.711 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.705+0000 7ff417fff640 1 -- 172.21.15.64:0/3900474936 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff410003c60 con 0x7ff4200cdf50 2023-10-14T12:30:04.712 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.706+0000 7ff417fff640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff40006ae70 0x7ff40006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:04.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.706+0000 7ff417fff640 1 -- 172.21.15.64:0/3900474936 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff410088f00 con 0x7ff4200cdf50 2023-10-14T12:30:04.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.707+0000 7ff41effd640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff40006ae70 0x7ff40006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:04.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.708+0000 7ff41effd640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff40006ae70 0x7ff40006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff420155ec0 tx=0x7ff40800b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:04.713 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.710+0000 7ff417fff640 1 -- 172.21.15.64:0/3900474936 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff410053c80 con 0x7ff4200cdf50 2023-10-14T12:30:04.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.906+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff420155b20 con 0x7ff4200cdf50 2023-10-14T12:30:04.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.907+0000 7ff417fff640 1 -- 172.21.15.64:0/3900474936 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff4100170a0 con 0x7ff4200cdf50 2023-10-14T12:30:04.908 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:04.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff40006ae70 msgr2=0x7ff40006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff40006ae70 0x7ff40006d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff420155ec0 tx=0x7ff40800b040 comp rx=0 tx=0).stop 2023-10-14T12:30:04.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cdf50 msgr2=0x7ff420155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:04.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cdf50 0x7ff420155420 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff41000c440 tx=0x7ff41000c900 comp rx=0 tx=0).stop 2023-10-14T12:30:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 shutdown_connections 2023-10-14T12:30:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff40006ae70 0x7ff40006d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff42015c8e0 0x7ff420158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff4200cee60 0x7ff420158550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 --2- 172.21.15.64:0/3900474936 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff4200cdf50 0x7ff420155420 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:04.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 >> 172.21.15.64:0/3900474936 conn(0x7ff42006a200 msgr2=0x7ff420071330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:04.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 shutdown_connections 2023-10-14T12:30:04.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:04.909+0000 7ff424f6c640 1 -- 172.21.15.64:0/3900474936 wait complete. 2023-10-14T12:30:04.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:30:05.156 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.155+0000 7fc67ccfc640 1 Processor -- start 2023-10-14T12:30:05.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.155+0000 7fc67ccfc640 1 -- start start 2023-10-14T12:30:05.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.156+0000 7fc67ccfc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc6780cf030 0x7fc67806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.156+0000 7fc67ccfc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc67806d360 0x7fc6780ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.156+0000 7fc67ccfc640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6781550f0 con 0x7fc678154d10 2023-10-14T12:30:05.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.156+0000 7fc67ccfc640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc67806db50 con 0x7fc6780cf030 2023-10-14T12:30:05.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.156+0000 7fc67ccfc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780b13f0 con 0x7fc67806d360 2023-10-14T12:30:05.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc6777fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fc678154d10 0x7fc6780ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41970/0 (socket says 172.21.15.64:41970) 2023-10-14T12:30:05.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc6777fe640 1 -- 172.21.15.64:0/2230373776 learned_addr learned my addr 172.21.15.64:0/2230373776 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:05.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc66effd640 1 --2- 172.21.15.64:0/2230373776 >> v2:172.21.15.64:3300/0 conn(0x7fc6780cf030 0x7fc67806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.161 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc677fff640 1 --2- 172.21.15.64:0/2230373776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc67806d360 0x7fc6780ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc676ffd640 1 -- 172.21.15.64:0/2230373776 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508504588 0 0) 0x7fc6781550f0 con 0x7fc678154d10 2023-10-14T12:30:05.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc676ffd640 1 -- 172.21.15.64:0/2230373776 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc664003520 con 0x7fc678154d10 2023-10-14T12:30:05.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc66effd640 1 -- 172.21.15.64:0/2230373776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc67806d360 msgr2=0x7fc6780ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:05.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc66effd640 1 --2- 172.21.15.64:0/2230373776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc67806d360 0x7fc6780ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.162 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc66effd640 1 -- 172.21.15.64:0/2230373776 >> v1:172.21.15.64:6789/0 conn(0x7fc678154d10 legacy=0x7fc6780ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.157+0000 7fc66effd640 1 -- 172.21.15.64:0/2230373776 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6780b16d0 con 0x7fc6780cf030 2023-10-14T12:30:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.159+0000 7fc66effd640 1 --2- 172.21.15.64:0/2230373776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67806ce20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371468e15d92717b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.159+0000 7fc676ffd640 1 -- 172.21.15.64:0/2230373776 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66002cc50 con 0x7fc6780cf030 2023-10-14T12:30:05.163 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.159+0000 7fc676ffd640 1 -- 172.21.15.64:0/2230373776 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66002cdb0 con 0x7fc6780cf030 2023-10-14T12:30:05.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.159+0000 7fc676ffd640 1 -- 172.21.15.64:0/2230373776 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660034640 con 0x7fc6780cf030 2023-10-14T12:30:05.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.159+0000 7fc67ccfc640 1 -- 172.21.15.64:0/2230373776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 msgr2=0x7fc67806ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.159+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/2230373776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67806ce20 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fc660009d90 tx=0x7fc66002bea0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.160+0000 7fc67ccfc640 1 -- 172.21.15.64:0/2230373776 shutdown_connections 2023-10-14T12:30:05.164 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.160+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/2230373776 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc67806d360 0x7fc6780ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.160+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/2230373776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67806ce20 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.160+0000 7fc67ccfc640 1 -- 172.21.15.64:0/2230373776 >> 172.21.15.64:0/2230373776 conn(0x7fc67806a200 msgr2=0x7fc67806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:05.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.160+0000 7fc67ccfc640 1 -- 172.21.15.64:0/2230373776 shutdown_connections 2023-10-14T12:30:05.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.160+0000 7fc67ccfc640 1 -- 172.21.15.64:0/2230373776 wait complete. 2023-10-14T12:30:05.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.161+0000 7fc67ccfc640 1 Processor -- start 2023-10-14T12:30:05.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.162+0000 7fc67ccfc640 1 -- start start 2023-10-14T12:30:05.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.162+0000 7fc67ccfc640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc67806d360 0x7fc6780ae620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc67ccfc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67815a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc67ccfc640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc678154d10 0x7fc678153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc67ccfc640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780c5770 con 0x7fc6780cf030 2023-10-14T12:30:05.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc67ccfc640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780aeb60 con 0x7fc67806d360 2023-10-14T12:30:05.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc67ccfc640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6780aed90 con 0x7fc678154d10 2023-10-14T12:30:05.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67815a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67815a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46062/0 (socket says 172.21.15.64:46062) 2023-10-14T12:30:05.169 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 -- 172.21.15.64:0/110291238 learned_addr learned my addr 172.21.15.64:0/110291238 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:05.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc677fff640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc678154d10 0x7fc678153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc6777fe640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc67806d360 0x7fc6780ae620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 -- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc678154d10 msgr2=0x7fc678153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc678154d10 0x7fc678153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 -- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc67806d360 msgr2=0x7fc6780ae620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc67806d360 0x7fc6780ae620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc66effd640 1 -- 172.21.15.64:0/110291238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc660009a70 con 0x7fc6780cf030 2023-10-14T12:30:05.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.163+0000 7fc677fff640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc678154d10 0x7fc678153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:05.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.164+0000 7fc66effd640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67815a0b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc660009eb0 tx=0x7fc660004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:05.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.164+0000 7fc674ff9640 1 -- 172.21.15.64:0/110291238 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66003e610 con 0x7fc6780cf030 2023-10-14T12:30:05.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.164+0000 7fc674ff9640 1 -- 172.21.15.64:0/110291238 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66003e770 con 0x7fc6780cf030 2023-10-14T12:30:05.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.164+0000 7fc674ff9640 1 -- 172.21.15.64:0/110291238 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66003eb20 con 0x7fc6780cf030 2023-10-14T12:30:05.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.164+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6780af070 con 0x7fc6780cf030 2023-10-14T12:30:05.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.164+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc678159bb0 con 0x7fc6780cf030 2023-10-14T12:30:05.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.166+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc67804e9b0 con 0x7fc6780cf030 2023-10-14T12:30:05.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.166+0000 7fc674ff9640 1 -- 172.21.15.64:0/110291238 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc66003b050 con 0x7fc6780cf030 2023-10-14T12:30:05.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.167+0000 7fc674ff9640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc65806ae70 0x7fc65806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.167+0000 7fc674ff9640 1 -- 172.21.15.64:0/110291238 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc6600ac400 con 0x7fc6780cf030 2023-10-14T12:30:05.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.168+0000 7fc6777fe640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc65806ae70 0x7fc65806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.169+0000 7fc6777fe640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc65806ae70 0x7fc65806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc668005880 tx=0x7fc668009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:05.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.172+0000 7fc674ff9640 1 -- 172.21.15.64:0/110291238 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc660077050 con 0x7fc6780cf030 2023-10-14T12:30:05.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.364+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc67806c9d0 con 0x7fc6780cf030 2023-10-14T12:30:05.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.365+0000 7fc674ff9640 1 -- 172.21.15.64:0/110291238 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc660009450 con 0x7fc6780cf030 2023-10-14T12:30:05.367 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:30:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc65806ae70 msgr2=0x7fc65806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc65806ae70 0x7fc65806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc668005880 tx=0x7fc668009040 comp rx=0 tx=0).stop 2023-10-14T12:30:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 msgr2=0x7fc67815a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67815a0b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fc660009eb0 tx=0x7fc660004a40 comp rx=0 tx=0).stop 2023-10-14T12:30:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 shutdown_connections 2023-10-14T12:30:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc65806ae70 0x7fc65806d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc678154d10 0x7fc678153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc6780cf030 0x7fc67815a0b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 --2- 172.21.15.64:0/110291238 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc67806d360 0x7fc6780ae620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 >> 172.21.15.64:0/110291238 conn(0x7fc67806a200 msgr2=0x7fc6780cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:05.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 shutdown_connections 2023-10-14T12:30:05.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.368+0000 7fc67ccfc640 1 -- 172.21.15.64:0/110291238 wait complete. 2023-10-14T12:30:05.387 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:30:05.616 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.615+0000 7f7bef59e640 1 Processor -- start 2023-10-14T12:30:05.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.615+0000 7f7bef59e640 1 -- start start 2023-10-14T12:30:05.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.616+0000 7f7bef59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 0x7f7bf006a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bef59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf00cd880 con 0x7f7bf0070860 2023-10-14T12:30:05.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bef59e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bf0071760 con 0x7f7bf00add40 2023-10-14T12:30:05.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bef59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0071a40 con 0x7f7bf0065ab0 2023-10-14T12:30:05.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bee59c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f7bf0070860 0x7f7bf0070c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:41984/0 (socket says 172.21.15.64:41984) 2023-10-14T12:30:05.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bee59c640 1 -- 172.21.15.64:0/2541235974 learned_addr learned my addr 172.21.15.64:0/2541235974 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:05.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bedd9b640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 0x7f7bf006a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539399222 0 0) 0x7f7bf00cd880 con 0x7f7bf0070860 2023-10-14T12:30:05.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.617+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bdc003520 con 0x7f7bf0070860 2023-10-14T12:30:05.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3841636438 0 0) 0x7f7bdc003520 con 0x7f7bf0070860 2023-10-14T12:30:05.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 msgr2=0x7f7bf006a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:05.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 0x7f7bf006a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 >> v1:172.21.15.177:6789/0 conn(0x7f7bf00add40 legacy=0x7f7bf006a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00cd230 con 0x7f7bf0070860 2023-10-14T12:30:05.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f7be00019f0 con 0x7f7bf0070860 2023-10-14T12:30:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 >> v1:172.21.15.64:6789/0 conn(0x7f7bf0070860 legacy=0x7f7bf0070c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 0x7f7bdc003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc003fe0 0x7f7bdc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bdc004d00 0x7f7bdc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf0071a40 con 0x7f7bdc004d00 2023-10-14T12:30:05.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00bbc0 con 0x7f7bdc003fe0 2023-10-14T12:30:05.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc00bd80 con 0x7f7bf0065ab0 2023-10-14T12:30:05.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.618+0000 7f7beed9d640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bdc004d00 0x7f7bdc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.619+0000 7f7bee59c640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 0x7f7bdc003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.619+0000 7f7bedd9b640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc003fe0 0x7f7bdc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.619+0000 7f7beed9d640 1 -- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 msgr2=0x7f7bdc003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:05.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.619+0000 7f7beed9d640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf0065ab0 0x7f7bdc003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.619+0000 7f7beed9d640 1 -- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc003fe0 msgr2=0x7f7bdc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:05.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.619+0000 7f7beed9d640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc003fe0 0x7f7bdc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.619+0000 7f7beed9d640 1 -- 172.21.15.64:0/2541235974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc003520 con 0x7f7bdc004d00 2023-10-14T12:30:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.620+0000 7f7beed9d640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bdc004d00 0x7f7bdc005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7bf006f370 tx=0x7f7bdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c60a14d66a20b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:05.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.620+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be80052d0 con 0x7f7bdc004d00 2023-10-14T12:30:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.620+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be802e050 con 0x7f7bdc004d00 2023-10-14T12:30:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.620+0000 7f7bed59a640 1 -- 172.21.15.64:0/2541235974 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7be8003830 con 0x7f7bdc004d00 2023-10-14T12:30:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.621+0000 7f7bef59e640 1 -- 172.21.15.64:0/2541235974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bdc004d00 msgr2=0x7f7bdc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.621+0000 7f7bef59e640 1 --2- 172.21.15.64:0/2541235974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bdc004d00 0x7f7bdc005180 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7bf006f370 tx=0x7f7bdc0057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.621+0000 7f7beed9d640 1 -- 172.21.15.64:0/2541235974 reap_dead start 2023-10-14T12:30:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.621+0000 7f7bef59e640 1 -- 172.21.15.64:0/2541235974 shutdown_connections 2023-10-14T12:30:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.621+0000 7f7bef59e640 1 -- 172.21.15.64:0/2541235974 >> 172.21.15.64:0/2541235974 conn(0x7f7bf00cb6d0 msgr2=0x7f7bf00cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.621+0000 7f7bef59e640 1 -- 172.21.15.64:0/2541235974 shutdown_connections 2023-10-14T12:30:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.621+0000 7f7bef59e640 1 -- 172.21.15.64:0/2541235974 wait complete. 2023-10-14T12:30:05.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.623+0000 7f7bef59e640 1 Processor -- start 2023-10-14T12:30:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.623+0000 7f7bef59e640 1 -- start start 2023-10-14T12:30:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.624+0000 7f7bef59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc004d00 0x7f7bf00c3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.624+0000 7f7bef59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf0159d30 0x7f7bf00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.624+0000 7f7bef59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf00af700 0x7f7bf00afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.624+0000 7f7bef59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00b00c0 con 0x7f7bf0159d30 2023-10-14T12:30:05.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.624+0000 7f7bef59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00c4c20 con 0x7f7bdc004d00 2023-10-14T12:30:05.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.624+0000 7f7bef59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bf00b3980 con 0x7f7bf00af700 2023-10-14T12:30:05.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.624+0000 7f7bedd9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf0159d30 0x7f7bf00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf0159d30 0x7f7bf00b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:46074/0 (socket says 172.21.15.64:46074) 2023-10-14T12:30:05.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 -- 172.21.15.64:0/1331361442 learned_addr learned my addr 172.21.15.64:0/1331361442 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:05.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bee59c640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc004d00 0x7f7bf00c3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7beed9d640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf00af700 0x7f7bf00afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 -- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf00af700 msgr2=0x7f7bf00afb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf00af700 0x7f7bf00afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 -- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc004d00 msgr2=0x7f7bf00c3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc004d00 0x7f7bf00c3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 -- 172.21.15.64:0/1331361442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bf00c4010 con 0x7f7bf0159d30 2023-10-14T12:30:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bee59c640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc004d00 0x7f7bf00c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.625+0000 7f7bedd9b640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf0159d30 0x7f7bf00b3440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011600 tx=0x7f7bd8011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.626+0000 7f7be6ffd640 1 -- 172.21.15.64:0/1331361442 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800f8c0 con 0x7f7bf0159d30 2023-10-14T12:30:05.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.626+0000 7f7be6ffd640 1 -- 172.21.15.64:0/1331361442 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800fa20 con 0x7f7bf0159d30 2023-10-14T12:30:05.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.626+0000 7f7be6ffd640 1 -- 172.21.15.64:0/1331361442 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800fd90 con 0x7f7bf0159d30 2023-10-14T12:30:05.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.626+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bf00c42f0 con 0x7f7bf0159d30 2023-10-14T12:30:05.635 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.626+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bf00c48b0 con 0x7f7bf0159d30 2023-10-14T12:30:05.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.627+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bf004e9b0 con 0x7f7bf0159d30 2023-10-14T12:30:05.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.628+0000 7f7be6ffd640 1 -- 172.21.15.64:0/1331361442 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7bd8015460 con 0x7f7bf0159d30 2023-10-14T12:30:05.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.629+0000 7f7be6ffd640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7bd006ae70 0x7f7bd006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:05.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.629+0000 7f7be6ffd640 1 -- 172.21.15.64:0/1331361442 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7bd8089f50 con 0x7f7bf0159d30 2023-10-14T12:30:05.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.630+0000 7f7bee59c640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7bd006ae70 0x7f7bd006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:05.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.631+0000 7f7bee59c640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7bd006ae70 0x7f7bd006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7be0002230 tx=0x7f7be0001310 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:05.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.634+0000 7f7be6ffd640 1 -- 172.21.15.64:0/1331361442 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7bd8054ba0 con 0x7f7bf0159d30 2023-10-14T12:30:05.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.829+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f7bf00c4d60 con 0x7f7bf0159d30 2023-10-14T12:30:05.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.830+0000 7f7be6ffd640 1 -- 172.21.15.64:0/1331361442 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7bd80220a0 con 0x7f7bf0159d30 2023-10-14T12:30:05.832 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:05.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.833+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7bd006ae70 msgr2=0x7f7bd006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.833+0000 7f7bef59e640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7bd006ae70 0x7f7bd006d330 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7be0002230 tx=0x7f7be0001310 comp rx=0 tx=0).stop 2023-10-14T12:30:05.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.833+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf0159d30 msgr2=0x7f7bf00b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:05.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.833+0000 7f7bef59e640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf0159d30 0x7f7bf00b3440 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7bd8011600 tx=0x7f7bd8011ac0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 shutdown_connections 2023-10-14T12:30:05.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7bd006ae70 0x7f7bd006d330 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7bf00af700 0x7f7bf00afb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7bf0159d30 0x7f7bf00b3440 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 --2- 172.21.15.64:0/1331361442 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7bdc004d00 0x7f7bf00c3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:05.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 >> 172.21.15.64:0/1331361442 conn(0x7f7bf00cb6d0 msgr2=0x7f7bf00ca9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:05.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 shutdown_connections 2023-10-14T12:30:05.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:05.834+0000 7f7bef59e640 1 -- 172.21.15.64:0/1331361442 wait complete. 2023-10-14T12:30:05.855 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:30:06.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.076+0000 7f3717d55640 1 Processor -- start 2023-10-14T12:30:06.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.077+0000 7f3717d55640 1 -- start start 2023-10-14T12:30:06.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.079+0000 7f3717d55640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f371015a960 0x7f37100b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.079+0000 7f3717d55640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37100b0d40 con 0x7f371006a4f0 2023-10-14T12:30:06.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.079+0000 7f3717d55640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37100b1040 con 0x7f37100b0900 2023-10-14T12:30:06.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.079+0000 7f3717d55640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37100ccfe0 con 0x7f371015a960 2023-10-14T12:30:06.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.079+0000 7f3715af1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f371015a960 0x7f37100b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.079+0000 7f3715af1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f371015a960 0x7f37100b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34060/0 (socket says 172.21.15.64:34060) 2023-10-14T12:30:06.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.079+0000 7f3715af1640 1 -- 172.21.15.64:0/1696985114 learned_addr learned my addr 172.21.15.64:0/1696985114 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:06.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.080+0000 7f3715af1640 1 -- 172.21.15.64:0/1696985114 >> v1:172.21.15.177:6789/0 conn(0x7f37100b0900 legacy=0x7f3710069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:06.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.080+0000 7f3715af1640 1 -- 172.21.15.64:0/1696985114 >> v1:172.21.15.64:6789/0 conn(0x7f371006a4f0 legacy=0x7f3710165820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.080+0000 7f3715af1640 1 -- 172.21.15.64:0/1696985114 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f371015e770 con 0x7f371015a960 2023-10-14T12:30:06.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.081+0000 7f3715af1640 1 --2- 172.21.15.64:0/1696985114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f371015a960 0x7f37100b03c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f370c009870 tx=0x7f370c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e42a85ceb6c7155e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:06.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.081+0000 7f3714aef640 1 -- 172.21.15.64:0/1696985114 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c030860 con 0x7f371015a960 2023-10-14T12:30:06.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.081+0000 7f3714aef640 1 -- 172.21.15.64:0/1696985114 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f370c0309c0 con 0x7f371015a960 2023-10-14T12:30:06.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.081+0000 7f3714aef640 1 -- 172.21.15.64:0/1696985114 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f370c030d50 con 0x7f371015a960 2023-10-14T12:30:06.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.082+0000 7f3717d55640 1 -- 172.21.15.64:0/1696985114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f371015a960 msgr2=0x7f37100b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.082+0000 7f3717d55640 1 --2- 172.21.15.64:0/1696985114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f371015a960 0x7f37100b03c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f370c009870 tx=0x7f370c02b9a0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.082+0000 7f3717d55640 1 -- 172.21.15.64:0/1696985114 shutdown_connections 2023-10-14T12:30:06.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.082+0000 7f3717d55640 1 --2- 172.21.15.64:0/1696985114 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f371015a960 0x7f37100b03c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.082+0000 7f3717d55640 1 -- 172.21.15.64:0/1696985114 >> 172.21.15.64:0/1696985114 conn(0x7f37100989e0 msgr2=0x7f37100cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:06.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.082+0000 7f3717d55640 1 -- 172.21.15.64:0/1696985114 shutdown_connections 2023-10-14T12:30:06.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.082+0000 7f3717d55640 1 -- 172.21.15.64:0/1696985114 wait complete. 2023-10-14T12:30:06.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.084+0000 7f3717d55640 1 Processor -- start 2023-10-14T12:30:06.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.084+0000 7f3717d55640 1 -- start start 2023-10-14T12:30:06.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.085+0000 7f3717d55640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371006a4f0 0x7f37100c2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.085+0000 7f3717d55640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37100b0900 0x7f371015bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.085+0000 7f3717d55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f371015a960 0x7f37101f1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.085+0000 7f3717d55640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37100c71b0 con 0x7f37100b0900 2023-10-14T12:30:06.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.085+0000 7f3717d55640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37101f1fa0 con 0x7f371015a960 2023-10-14T12:30:06.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.085+0000 7f3717d55640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37100cd3b0 con 0x7f371006a4f0 2023-10-14T12:30:06.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37100b0900 0x7f371015bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37100b0900 0x7f371015bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34074/0 (socket says 172.21.15.64:34074) 2023-10-14T12:30:06.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 -- 172.21.15.64:0/1110363598 learned_addr learned my addr 172.21.15.64:0/1110363598 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:06.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f3715af1640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371006a4f0 0x7f37100c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37162f2640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f371015a960 0x7f37101f1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 -- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371006a4f0 msgr2=0x7f37100c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371006a4f0 0x7f37100c2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 -- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f371015a960 msgr2=0x7f37101f1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f371015a960 0x7f37101f1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.086+0000 7f37152f0640 1 -- 172.21.15.64:0/1110363598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f370c0094d0 con 0x7f37100b0900 2023-10-14T12:30:06.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.087+0000 7f37152f0640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37100b0900 0x7f371015bd90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f370000c460 tx=0x7f370000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:06.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.087+0000 7f37067fc640 1 -- 172.21.15.64:0/1110363598 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700012830 con 0x7f37100b0900 2023-10-14T12:30:06.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.087+0000 7f37067fc640 1 -- 172.21.15.64:0/1110363598 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37000129d0 con 0x7f37100b0900 2023-10-14T12:30:06.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.087+0000 7f37067fc640 1 -- 172.21.15.64:0/1110363598 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3700012d80 con 0x7f37100b0900 2023-10-14T12:30:06.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.087+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37100cd690 con 0x7f37100b0900 2023-10-14T12:30:06.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.087+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37100c76e0 con 0x7f37100b0900 2023-10-14T12:30:06.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.088+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3710067180 con 0x7f37100b0900 2023-10-14T12:30:06.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.089+0000 7f37067fc640 1 -- 172.21.15.64:0/1110363598 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f370001a3b0 con 0x7f37100b0900 2023-10-14T12:30:06.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.090+0000 7f37067fc640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f406aec0 0x7f36f406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.090+0000 7f37067fc640 1 -- 172.21.15.64:0/1110363598 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3700089820 con 0x7f37100b0900 2023-10-14T12:30:06.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.091+0000 7f3715af1640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f406aec0 0x7f36f406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.092+0000 7f3715af1640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f406aec0 0x7f36f406d380 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f370c036000 tx=0x7f370c03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:06.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.094+0000 7f37067fc640 1 -- 172.21.15.64:0/1110363598 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f3700054580 con 0x7f37100b0900 2023-10-14T12:30:06.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.302+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3710071f10 con 0x7f37100b0900 2023-10-14T12:30:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.303+0000 7f37067fc640 1 -- 172.21.15.64:0/1110363598 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3700057ba0 con 0x7f37100b0900 2023-10-14T12:30:06.304 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:30:06.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f406aec0 msgr2=0x7f36f406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f406aec0 0x7f36f406d380 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f370c036000 tx=0x7f370c03b040 comp rx=0 tx=0).stop 2023-10-14T12:30:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37100b0900 msgr2=0x7f371015bd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37100b0900 0x7f371015bd90 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f370000c460 tx=0x7f370000c920 comp rx=0 tx=0).stop 2023-10-14T12:30:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 shutdown_connections 2023-10-14T12:30:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36f406aec0 0x7f36f406d380 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f371015a960 0x7f37101f1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f37100b0900 0x7f371015bd90 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 --2- 172.21.15.64:0/1110363598 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f371006a4f0 0x7f37100c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.305+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 >> 172.21.15.64:0/1110363598 conn(0x7f37100989e0 msgr2=0x7f371006dd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.306+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 shutdown_connections 2023-10-14T12:30:06.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.306+0000 7f3717d55640 1 -- 172.21.15.64:0/1110363598 wait complete. 2023-10-14T12:30:06.325 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:30:06.326 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:30:06.376 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:06.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.583+0000 7ff15759e640 1 Processor -- start 2023-10-14T12:30:06.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.584+0000 7ff15759e640 1 -- start start 2023-10-14T12:30:06.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.585+0000 7ff15759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.585+0000 7ff15759e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff1580cf850 0x7ff1580b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.585+0000 7ff15759e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1580d0320 con 0x7ff1580d16a0 2023-10-14T12:30:06.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.585+0000 7ff15759e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1580d0600 con 0x7ff1580cf850 2023-10-14T12:30:06.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.585+0000 7ff15759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580d08e0 con 0x7ff15815c9d0 2023-10-14T12:30:06.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff155d9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ff1580d16a0 0x7ff1580cf140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43462/0 (socket says 172.21.15.64:43462) 2023-10-14T12:30:06.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff155d9b640 1 -- 172.21.15.64:0/2188049465 learned_addr learned my addr 172.21.15.64:0/2188049465 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:06.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff156d9d640 1 --2- 172.21.15.64:0/2188049465 >> v2:172.21.15.64:3300/0 conn(0x7ff1580cf850 0x7ff1580b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff15659c640 1 --2- 172.21.15.64:0/2188049465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff156d9d640 1 -- 172.21.15.64:0/2188049465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 msgr2=0x7ff1580cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff156d9d640 1 --2- 172.21.15.64:0/2188049465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff156d9d640 1 -- 172.21.15.64:0/2188049465 >> v1:172.21.15.64:6789/0 conn(0x7ff1580d16a0 legacy=0x7ff1580cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff15559a640 1 -- 172.21.15.64:0/2188049465 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2980720499 0 0) 0x7ff1580d0320 con 0x7ff1580d16a0 2023-10-14T12:30:06.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.586+0000 7ff156d9d640 1 -- 172.21.15.64:0/2188049465 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1580d0bc0 con 0x7ff1580cf850 2023-10-14T12:30:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.587+0000 7ff156d9d640 1 --2- 172.21.15.64:0/2188049465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580cf850 0x7ff1580b1f80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff150009d90 tx=0x7ff15002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45aec2c2922f21cc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15559a640 1 -- 172.21.15.64:0/2188049465 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15002cc50 con 0x7ff1580cf850 2023-10-14T12:30:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15559a640 1 -- 172.21.15.64:0/2188049465 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15002cdb0 con 0x7ff1580cf850 2023-10-14T12:30:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15559a640 1 -- 172.21.15.64:0/2188049465 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150034660 con 0x7ff1580cf850 2023-10-14T12:30:06.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15759e640 1 -- 172.21.15.64:0/2188049465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580cf850 msgr2=0x7ff1580b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15759e640 1 --2- 172.21.15.64:0/2188049465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580cf850 0x7ff1580b1f80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff150009d90 tx=0x7ff15002bea0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15759e640 1 -- 172.21.15.64:0/2188049465 shutdown_connections 2023-10-14T12:30:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15759e640 1 --2- 172.21.15.64:0/2188049465 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580cf850 0x7ff1580b1f80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15759e640 1 --2- 172.21.15.64:0/2188049465 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.588+0000 7ff15759e640 1 -- 172.21.15.64:0/2188049465 >> 172.21.15.64:0/2188049465 conn(0x7ff15809bad0 msgr2=0x7ff1580d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:06.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.589+0000 7ff15759e640 1 -- 172.21.15.64:0/2188049465 shutdown_connections 2023-10-14T12:30:06.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.589+0000 7ff15759e640 1 -- 172.21.15.64:0/2188049465 wait complete. 2023-10-14T12:30:06.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.590+0000 7ff15759e640 1 Processor -- start 2023-10-14T12:30:06.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.590+0000 7ff15759e640 1 -- start start 2023-10-14T12:30:06.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.591+0000 7ff15759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1580cf850 0x7ff15815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.591+0000 7ff15759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580d16a0 0x7ff15815fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.591+0000 7ff15759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.591+0000 7ff15759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580c63b0 con 0x7ff1580d16a0 2023-10-14T12:30:06.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.591+0000 7ff15759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580c6690 con 0x7ff1580cf850 2023-10-14T12:30:06.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.591+0000 7ff15759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580c6970 con 0x7ff15815c9d0 2023-10-14T12:30:06.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580d16a0 0x7ff15815fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580d16a0 0x7ff15815fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34098/0 (socket says 172.21.15.64:34098) 2023-10-14T12:30:06.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 -- 172.21.15.64:0/1554113255 learned_addr learned my addr 172.21.15.64:0/1554113255 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:06.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff15659c640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1580cf850 0x7ff15815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff156d9d640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 -- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 msgr2=0x7ff1580c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580c7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 -- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1580cf850 msgr2=0x7ff15815ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1580cf850 0x7ff15815ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff155d9b640 1 -- 172.21.15.64:0/1554113255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff150009a70 con 0x7ff1580d16a0 2023-10-14T12:30:06.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff156d9d640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:06.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.592+0000 7ff15659c640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1580cf850 0x7ff15815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:06.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.593+0000 7ff155d9b640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580d16a0 0x7ff15815fad0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00c4d0 tx=0x7ff14c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:06.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.593+0000 7ff146ffd640 1 -- 172.21.15.64:0/1554113255 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c0074e0 con 0x7ff1580d16a0 2023-10-14T12:30:06.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.593+0000 7ff146ffd640 1 -- 172.21.15.64:0/1554113255 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14c007660 con 0x7ff1580d16a0 2023-10-14T12:30:06.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.593+0000 7ff146ffd640 1 -- 172.21.15.64:0/1554113255 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c004a20 con 0x7ff1580d16a0 2023-10-14T12:30:06.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.593+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1580c6c50 con 0x7ff1580d16a0 2023-10-14T12:30:06.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.593+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1581f6820 con 0x7ff1580d16a0 2023-10-14T12:30:06.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.594+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff15804e9b0 con 0x7ff1580d16a0 2023-10-14T12:30:06.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.595+0000 7ff146ffd640 1 -- 172.21.15.64:0/1554113255 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff14c004b80 con 0x7ff1580d16a0 2023-10-14T12:30:06.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.596+0000 7ff146ffd640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff13806ae70 0x7ff13806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:06.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.596+0000 7ff146ffd640 1 -- 172.21.15.64:0/1554113255 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff14c088ae0 con 0x7ff1580d16a0 2023-10-14T12:30:06.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.597+0000 7ff15659c640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff13806ae70 0x7ff13806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:06.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.598+0000 7ff15659c640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff13806ae70 0x7ff13806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff148006fd0 tx=0x7ff148008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:06.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.600+0000 7ff146ffd640 1 -- 172.21.15.64:0/1554113255 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff14c053860 con 0x7ff1580d16a0 2023-10-14T12:30:06.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.799+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff1580cfdd0 con 0x7ff1580d16a0 2023-10-14T12:30:06.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.801+0000 7ff146ffd640 1 -- 172.21.15.64:0/1554113255 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7ff14c018020 con 0x7ff1580d16a0 2023-10-14T12:30:06.803 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:06.804 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:06.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff13806ae70 msgr2=0x7ff13806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff13806ae70 0x7ff13806d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff148006fd0 tx=0x7ff148008040 comp rx=0 tx=0).stop 2023-10-14T12:30:06.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580d16a0 msgr2=0x7ff15815fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:06.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580d16a0 0x7ff15815fad0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff14c00c4d0 tx=0x7ff14c00c990 comp rx=0 tx=0).stop 2023-10-14T12:30:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 shutdown_connections 2023-10-14T12:30:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff13806ae70 0x7ff13806d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff15815c9d0 0x7ff1580c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff1580d16a0 0x7ff15815fad0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 --2- 172.21.15.64:0/1554113255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff1580cf850 0x7ff15815ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:06.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 >> 172.21.15.64:0/1554113255 conn(0x7ff15809bad0 msgr2=0x7ff1580b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:06.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 shutdown_connections 2023-10-14T12:30:06.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:06.804+0000 7ff15759e640 1 -- 172.21.15.64:0/1554113255 wait complete. 2023-10-14T12:30:06.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:30:06.827 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:30:07.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.052+0000 7f4f06fae640 1 Processor -- start 2023-10-14T12:30:07.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.052+0000 7f4f06fae640 1 -- start start 2023-10-14T12:30:07.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f06fae640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4f000b1a30 0x7f4f000cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f06fae640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4f000d0cd0 0x7f4f000d10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f06fae640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f0006b570 0x7f4f0006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f06fae640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f0006bf40 con 0x7f4f000d0cd0 2023-10-14T12:30:07.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f06fae640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f000d1620 con 0x7f4f000b1a30 2023-10-14T12:30:07.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f06fae640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000cfc20 con 0x7f4f0006b570 2023-10-14T12:30:07.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f057ab640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4f000d0cd0 0x7f4f000d10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f057ab640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4f000d0cd0 0x7f4f000d10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34100/0 (socket says 172.21.15.64:34100) 2023-10-14T12:30:07.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.054+0000 7f4f057ab640 1 -- 172.21.15.64:0/2576986732 learned_addr learned my addr 172.21.15.64:0/2576986732 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:07.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f057ab640 1 -- 172.21.15.64:0/2576986732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f0006b570 msgr2=0x7f4f0006ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:07.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f067ad640 1 --2- 172.21.15.64:0/2576986732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f0006b570 0x7f4f0006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f05fac640 1 --2- 172.21.15.64:0/2576986732 >> v2:172.21.15.177:3300/0 conn(0x7f4f000b1a30 0x7f4f000cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f057ab640 1 --2- 172.21.15.64:0/2576986732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f0006b570 0x7f4f0006ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f057ab640 1 -- 172.21.15.64:0/2576986732 >> v2:172.21.15.177:3300/0 conn(0x7f4f000b1a30 msgr2=0x7f4f000cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:07.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f057ab640 1 --2- 172.21.15.64:0/2576986732 >> v2:172.21.15.177:3300/0 conn(0x7f4f000b1a30 0x7f4f000cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f057ab640 1 -- 172.21.15.64:0/2576986732 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f000cd4a0 con 0x7f4f000d0cd0 2023-10-14T12:30:07.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.055+0000 7f4f05fac640 1 --2- 172.21.15.64:0/2576986732 >> v2:172.21.15.177:3300/0 conn(0x7f4f000b1a30 0x7f4f000cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:07.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.056+0000 7f4f057ab640 1 --2- 172.21.15.64:0/2576986732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f000d0cd0 0x7f4f000d10e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4f000d37f0 tx=0x7f4ef002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10aae3b844288ac server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.056+0000 7f4f04faa640 1 -- 172.21.15.64:0/2576986732 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0031870 con 0x7f4f000d0cd0 2023-10-14T12:30:07.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.056+0000 7f4f04faa640 1 -- 172.21.15.64:0/2576986732 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef00319d0 con 0x7f4f000d0cd0 2023-10-14T12:30:07.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.056+0000 7f4f04faa640 1 -- 172.21.15.64:0/2576986732 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0031d60 con 0x7f4f000d0cd0 2023-10-14T12:30:07.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 -- 172.21.15.64:0/2576986732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f000d0cd0 msgr2=0x7f4f000d10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 --2- 172.21.15.64:0/2576986732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f000d0cd0 0x7f4f000d10e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f4f000d37f0 tx=0x7f4ef002b910 comp rx=0 tx=0).stop 2023-10-14T12:30:07.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 -- 172.21.15.64:0/2576986732 shutdown_connections 2023-10-14T12:30:07.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 --2- 172.21.15.64:0/2576986732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f0006b570 0x7f4f0006ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 --2- 172.21.15.64:0/2576986732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f000d0cd0 0x7f4f000d10e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 --2- 172.21.15.64:0/2576986732 >> v2:172.21.15.177:3300/0 conn(0x7f4f000b1a30 0x7f4f000cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 -- 172.21.15.64:0/2576986732 >> 172.21.15.64:0/2576986732 conn(0x7f4f0008c140 msgr2=0x7f4f0009ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:07.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 -- 172.21.15.64:0/2576986732 shutdown_connections 2023-10-14T12:30:07.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.057+0000 7f4f06fae640 1 -- 172.21.15.64:0/2576986732 wait complete. 2023-10-14T12:30:07.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.059+0000 7f4f06fae640 1 Processor -- start 2023-10-14T12:30:07.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.059+0000 7f4f06fae640 1 -- start start 2023-10-14T12:30:07.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f06fae640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0006b570 0x7f4f001ef640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f06fae640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f000b1a30 0x7f4f000cbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f06fae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f000d0cd0 0x7f4f000ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f06fae640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000ca580 con 0x7f4f0006b570 2023-10-14T12:30:07.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f06fae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000cb4b0 con 0x7f4f000d0cd0 2023-10-14T12:30:07.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f06fae640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f000cb790 con 0x7f4f000b1a30 2023-10-14T12:30:07.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f05fac640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0006b570 0x7f4f001ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f05fac640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0006b570 0x7f4f001ef640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34114/0 (socket says 172.21.15.64:34114) 2023-10-14T12:30:07.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.060+0000 7f4f05fac640 1 -- 172.21.15.64:0/3416873934 learned_addr learned my addr 172.21.15.64:0/3416873934 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:07.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4f05fac640 1 -- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f000b1a30 msgr2=0x7f4f000cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4f057ab640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f000b1a30 0x7f4f000cbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4f05fac640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f000b1a30 0x7f4f000cbf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4f05fac640 1 -- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f000d0cd0 msgr2=0x7f4f000ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4f05fac640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f000d0cd0 0x7f4f000ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4f05fac640 1 -- 172.21.15.64:0/3416873934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef00094d0 con 0x7f4f0006b570 2023-10-14T12:30:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4f05fac640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0006b570 0x7f4f001ef640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c7f0 tx=0x7f4efc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.061+0000 7f4ef67fc640 1 -- 172.21.15.64:0/3416873934 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc007a30 con 0x7f4f0006b570 2023-10-14T12:30:07.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.062+0000 7f4ef67fc640 1 -- 172.21.15.64:0/3416873934 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4efc007b90 con 0x7f4f0006b570 2023-10-14T12:30:07.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.062+0000 7f4ef67fc640 1 -- 172.21.15.64:0/3416873934 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4efc00ce40 con 0x7f4f0006b570 2023-10-14T12:30:07.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.062+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f000cba70 con 0x7f4f0006b570 2023-10-14T12:30:07.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.062+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f000cc4d0 con 0x7f4f0006b570 2023-10-14T12:30:07.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.063+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f000cb310 con 0x7f4f0006b570 2023-10-14T12:30:07.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.064+0000 7f4ef67fc640 1 -- 172.21.15.64:0/3416873934 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4efc0113f0 con 0x7f4f0006b570 2023-10-14T12:30:07.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.065+0000 7f4ef67fc640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4ee406ae70 0x7f4ee406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.065+0000 7f4ef67fc640 1 -- 172.21.15.64:0/3416873934 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4efc089b80 con 0x7f4f0006b570 2023-10-14T12:30:07.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.065+0000 7f4f057ab640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4ee406ae70 0x7f4ee406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.067+0000 7f4f057ab640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4ee406ae70 0x7f4ee406d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0036000 tx=0x7f4ef0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.069+0000 7f4ef67fc640 1 -- 172.21.15.64:0/3416873934 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f000cb310 con 0x7f4f0006b570 2023-10-14T12:30:07.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.264+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f000cb310 con 0x7f4f0006b570 2023-10-14T12:30:07.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.265+0000 7f4ef67fc640 1 -- 172.21.15.64:0/3416873934 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f000cb310 con 0x7f4f0006b570 2023-10-14T12:30:07.267 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:30:07.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4ee406ae70 msgr2=0x7f4ee406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4ee406ae70 0x7f4ee406d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0036000 tx=0x7f4ef0008030 comp rx=0 tx=0).stop 2023-10-14T12:30:07.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0006b570 msgr2=0x7f4f001ef640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0006b570 0x7f4f001ef640 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4efc00c7f0 tx=0x7f4efc00cbf0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 shutdown_connections 2023-10-14T12:30:07.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4ee406ae70 0x7f4ee406d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f000d0cd0 0x7f4f000ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f000b1a30 0x7f4f000cbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 --2- 172.21.15.64:0/3416873934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f0006b570 0x7f4f001ef640 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 >> 172.21.15.64:0/3416873934 conn(0x7f4f0008c140 msgr2=0x7f4f000afd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:07.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 shutdown_connections 2023-10-14T12:30:07.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.268+0000 7f4f06fae640 1 -- 172.21.15.64:0/3416873934 wait complete. 2023-10-14T12:30:07.289 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:30:07.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.503+0000 7f6c871d0640 1 Processor -- start 2023-10-14T12:30:07.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.504+0000 7f6c871d0640 1 -- start start 2023-10-14T12:30:07.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.505+0000 7f6c871d0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6c800cd0f0 0x7f6c800cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.505+0000 7f6c871d0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c801625c0 0x7f6c801649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.505+0000 7f6c871d0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c800b37a0 con 0x7f6c8015a910 2023-10-14T12:30:07.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.505+0000 7f6c871d0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c800cdac0 con 0x7f6c801625c0 2023-10-14T12:30:07.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.505+0000 7f6c871d0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c800cf510 con 0x7f6c800cd0f0 2023-10-14T12:30:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c8576d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c801625c0 0x7f6c801649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c8576d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6c801625c0 0x7f6c801649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34130/0 (socket says 172.21.15.64:34130) 2023-10-14T12:30:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c8576d640 1 -- 172.21.15.64:0/1700947979 learned_addr learned my addr 172.21.15.64:0/1700947979 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c77fff640 1 --2- 172.21.15.64:0/1700947979 >> v2:172.21.15.177:3300/0 conn(0x7f6c800cd0f0 0x7f6c800cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c8576d640 1 -- 172.21.15.64:0/1700947979 >> v2:172.21.15.177:3300/0 conn(0x7f6c800cd0f0 msgr2=0x7f6c800cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c8576d640 1 --2- 172.21.15.64:0/1700947979 >> v2:172.21.15.177:3300/0 conn(0x7f6c800cd0f0 0x7f6c800cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c8576d640 1 -- 172.21.15.64:0/1700947979 >> v1:172.21.15.177:6789/0 conn(0x7f6c8015a910 legacy=0x7f6c800cee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.506+0000 7f6c8576d640 1 -- 172.21.15.64:0/1700947979 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c800b3a40 con 0x7f6c801625c0 2023-10-14T12:30:07.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.507+0000 7f6c8576d640 1 --2- 172.21.15.64:0/1700947979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c801625c0 0x7f6c801649b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c800c4230 tx=0x7f6c7802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd29287b3dab814 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c777fe640 1 -- 172.21.15.64:0/1700947979 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7802c9f0 con 0x7f6c801625c0 2023-10-14T12:30:07.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c777fe640 1 -- 172.21.15.64:0/1700947979 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7802cb50 con 0x7f6c801625c0 2023-10-14T12:30:07.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c777fe640 1 -- 172.21.15.64:0/1700947979 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780343f0 con 0x7f6c801625c0 2023-10-14T12:30:07.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c871d0640 1 -- 172.21.15.64:0/1700947979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c801625c0 msgr2=0x7f6c801649b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c871d0640 1 --2- 172.21.15.64:0/1700947979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c801625c0 0x7f6c801649b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f6c800c4230 tx=0x7f6c7802be50 comp rx=0 tx=0).stop 2023-10-14T12:30:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c871d0640 1 -- 172.21.15.64:0/1700947979 shutdown_connections 2023-10-14T12:30:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c871d0640 1 --2- 172.21.15.64:0/1700947979 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c801625c0 0x7f6c801649b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c871d0640 1 --2- 172.21.15.64:0/1700947979 >> v2:172.21.15.177:3300/0 conn(0x7f6c800cd0f0 0x7f6c800cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c871d0640 1 -- 172.21.15.64:0/1700947979 >> 172.21.15.64:0/1700947979 conn(0x7f6c800d0820 msgr2=0x7f6c800d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:07.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.508+0000 7f6c871d0640 1 -- 172.21.15.64:0/1700947979 shutdown_connections 2023-10-14T12:30:07.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.509+0000 7f6c871d0640 1 -- 172.21.15.64:0/1700947979 wait complete. 2023-10-14T12:30:07.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.510+0000 7f6c871d0640 1 Processor -- start 2023-10-14T12:30:07.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.510+0000 7f6c871d0640 1 -- start start 2023-10-14T12:30:07.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.511+0000 7f6c871d0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c800cd0f0 0x7f6c80157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.511+0000 7f6c871d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8015a910 0x7f6c80155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.511+0000 7f6c871d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c801625c0 0x7f6c80161700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.511+0000 7f6c871d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80155e50 con 0x7f6c8015a910 2023-10-14T12:30:07.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.511+0000 7f6c871d0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80156130 con 0x7f6c800cd0f0 2023-10-14T12:30:07.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.511+0000 7f6c871d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c80156410 con 0x7f6c801625c0 2023-10-14T12:30:07.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8015a910 0x7f6c80155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8015a910 0x7f6c80155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34140/0 (socket says 172.21.15.64:34140) 2023-10-14T12:30:07.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 -- 172.21.15.64:0/965206422 learned_addr learned my addr 172.21.15.64:0/965206422 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:07.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c84f6c640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c800cd0f0 0x7f6c80157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 -- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c801625c0 msgr2=0x7f6c80161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c801625c0 0x7f6c80161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 -- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c800cd0f0 msgr2=0x7f6c80157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c800cd0f0 0x7f6c80157300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 -- 172.21.15.64:0/965206422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c78009b30 con 0x7f6c8015a910 2023-10-14T12:30:07.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.512+0000 7f6c77fff640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8015a910 0x7f6c80155470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d800 tx=0x7f6c7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.513+0000 7f6c757fa640 1 -- 172.21.15.64:0/965206422 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000b6c0 con 0x7f6c8015a910 2023-10-14T12:30:07.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.513+0000 7f6c757fa640 1 -- 172.21.15.64:0/965206422 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7000b820 con 0x7f6c8015a910 2023-10-14T12:30:07.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.513+0000 7f6c757fa640 1 -- 172.21.15.64:0/965206422 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000bbb0 con 0x7f6c8015a910 2023-10-14T12:30:07.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.513+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c801566f0 con 0x7f6c8015a910 2023-10-14T12:30:07.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.513+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c80157840 con 0x7f6c8015a910 2023-10-14T12:30:07.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.514+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c801579d0 con 0x7f6c8015a910 2023-10-14T12:30:07.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.515+0000 7f6c757fa640 1 -- 172.21.15.64:0/965206422 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6c7000bd10 con 0x7f6c8015a910 2023-10-14T12:30:07.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.516+0000 7f6c757fa640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c6c06ae70 0x7f6c6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.516+0000 7f6c757fa640 1 -- 172.21.15.64:0/965206422 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6c70089f30 con 0x7f6c8015a910 2023-10-14T12:30:07.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.517+0000 7f6c84f6c640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c6c06ae70 0x7f6c6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.518+0000 7f6c84f6c640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c6c06ae70 0x7f6c6c06d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c003d90 tx=0x7f6c7c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.521+0000 7f6c757fa640 1 -- 172.21.15.64:0/965206422 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6c70054c20 con 0x7f6c8015a910 2023-10-14T12:30:07.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.720+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c80073ef0 con 0x7f6c8015a910 2023-10-14T12:30:07.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.721+0000 7f6c757fa640 1 -- 172.21.15.64:0/965206422 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c70058240 con 0x7f6c8015a910 2023-10-14T12:30:07.723 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:07.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c6c06ae70 msgr2=0x7f6c6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c6c06ae70 0x7f6c6c06d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c003d90 tx=0x7f6c7c009040 comp rx=0 tx=0).stop 2023-10-14T12:30:07.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8015a910 msgr2=0x7f6c80155470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8015a910 0x7f6c80155470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000d800 tx=0x7f6c7000dcc0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 shutdown_connections 2023-10-14T12:30:07.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6c6c06ae70 0x7f6c6c06d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6c801625c0 0x7f6c80161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6c8015a910 0x7f6c80155470 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 --2- 172.21.15.64:0/965206422 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6c800cd0f0 0x7f6c80157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 >> 172.21.15.64:0/965206422 conn(0x7f6c800d0820 msgr2=0x7f6c80072770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:07.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.724+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 shutdown_connections 2023-10-14T12:30:07.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.725+0000 7f6c871d0640 1 -- 172.21.15.64:0/965206422 wait complete. 2023-10-14T12:30:07.746 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:30:07.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.974+0000 7f32fab6c640 1 Processor -- start 2023-10-14T12:30:07.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.974+0000 7f32fab6c640 1 -- start start 2023-10-14T12:30:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.976+0000 7f32fab6c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f32f40cf030 0x7f32f406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.976+0000 7f32fab6c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f406d360 0x7f32f40ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.976+0000 7f32fab6c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f41550f0 con 0x7f32f4154d10 2023-10-14T12:30:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.976+0000 7f32fab6c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f406db50 con 0x7f32f40cf030 2023-10-14T12:30:07.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.976+0000 7f32fab6c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f40b13f0 con 0x7f32f406d360 2023-10-14T12:30:07.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.976+0000 7f32f9b6a640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f32f4154d10 0x7f32f40ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43476/0 (socket says 172.21.15.64:43476) 2023-10-14T12:30:07.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.976+0000 7f32f9b6a640 1 -- 172.21.15.64:0/1998778856 learned_addr learned my addr 172.21.15.64:0/1998778856 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f9369640 1 --2- 172.21.15.64:0/1998778856 >> v2:172.21.15.64:3300/0 conn(0x7f32f40cf030 0x7f32f406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f8b68640 1 -- 172.21.15.64:0/1998778856 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3443164850 0 0) 0x7f32f41550f0 con 0x7f32f4154d10 2023-10-14T12:30:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32fa36b640 1 --2- 172.21.15.64:0/1998778856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f406d360 0x7f32f40ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f8b68640 1 -- 172.21.15.64:0/1998778856 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e0003520 con 0x7f32f4154d10 2023-10-14T12:30:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f9369640 1 -- 172.21.15.64:0/1998778856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f406d360 msgr2=0x7f32f40ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f9369640 1 --2- 172.21.15.64:0/1998778856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f406d360 0x7f32f40ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f9369640 1 -- 172.21.15.64:0/1998778856 >> v1:172.21.15.64:6789/0 conn(0x7f32f4154d10 legacy=0x7f32f40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f8b68640 1 -- 172.21.15.64:0/1998778856 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 374081913 0 0) 0x7f32e0003520 con 0x7f32f4154d10 2023-10-14T12:30:07.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.977+0000 7f32f9369640 1 -- 172.21.15.64:0/1998778856 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f40b16d0 con 0x7f32f40cf030 2023-10-14T12:30:07.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.978+0000 7f32f9369640 1 --2- 172.21.15.64:0/1998778856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f40cf030 0x7f32f406ce20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097a0 tx=0x7f32e402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3039f177977b7b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32f8b68640 1 -- 172.21.15.64:0/1998778856 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0001670 con 0x7f32f40cf030 2023-10-14T12:30:07.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32f8b68640 1 -- 172.21.15.64:0/1998778856 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e402e050 con 0x7f32f40cf030 2023-10-14T12:30:07.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32f8b68640 1 -- 172.21.15.64:0/1998778856 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e4030730 con 0x7f32f40cf030 2023-10-14T12:30:07.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 -- 172.21.15.64:0/1998778856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f40cf030 msgr2=0x7f32f406ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 --2- 172.21.15.64:0/1998778856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f40cf030 0x7f32f406ce20 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f32e40097a0 tx=0x7f32e402b790 comp rx=0 tx=0).stop 2023-10-14T12:30:07.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 -- 172.21.15.64:0/1998778856 shutdown_connections 2023-10-14T12:30:07.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 --2- 172.21.15.64:0/1998778856 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f406d360 0x7f32f40ac1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 --2- 172.21.15.64:0/1998778856 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f40cf030 0x7f32f406ce20 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 -- 172.21.15.64:0/1998778856 >> 172.21.15.64:0/1998778856 conn(0x7f32f406a200 msgr2=0x7f32f406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:07.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 -- 172.21.15.64:0/1998778856 shutdown_connections 2023-10-14T12:30:07.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.979+0000 7f32fab6c640 1 -- 172.21.15.64:0/1998778856 wait complete. 2023-10-14T12:30:07.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.981+0000 7f32fab6c640 1 Processor -- start 2023-10-14T12:30:07.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.982+0000 7f32fab6c640 1 -- start start 2023-10-14T12:30:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fab6c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32f406d360 0x7f32f4097770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fab6c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f40cf030 0x7f32f4070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fab6c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f4154d10 0x7f32f40714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fab6c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f4151e30 con 0x7f32f4154d10 2023-10-14T12:30:07.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fab6c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f40c5d50 con 0x7f32f406d360 2023-10-14T12:30:07.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fab6c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f41520d0 con 0x7f32f40cf030 2023-10-14T12:30:07.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fa36b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f4154d10 0x7f32f40714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fa36b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f4154d10 0x7f32f40714d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34156/0 (socket says 172.21.15.64:34156) 2023-10-14T12:30:07.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.983+0000 7f32fa36b640 1 -- 172.21.15.64:0/2041973472 learned_addr learned my addr 172.21.15.64:0/2041973472 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32f9369640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f40cf030 0x7f32f4070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32f9b6a640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32f406d360 0x7f32f4097770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32fa36b640 1 -- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f40cf030 msgr2=0x7f32f4070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32fa36b640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f40cf030 0x7f32f4070f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32fa36b640 1 -- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32f406d360 msgr2=0x7f32f4097770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:07.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32fa36b640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32f406d360 0x7f32f4097770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:07.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32fa36b640 1 -- 172.21.15.64:0/2041973472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32e4009400 con 0x7f32f4154d10 2023-10-14T12:30:07.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32fa36b640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f4154d10 0x7f32f40714d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f32ec007e40 tx=0x7f32ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32ea7fc640 1 -- 172.21.15.64:0/2041973472 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec014620 con 0x7f32f4154d10 2023-10-14T12:30:07.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32ea7fc640 1 -- 172.21.15.64:0/2041973472 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec00ee90 con 0x7f32f4154d10 2023-10-14T12:30:07.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.984+0000 7f32ea7fc640 1 -- 172.21.15.64:0/2041973472 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0149e0 con 0x7f32f4154d10 2023-10-14T12:30:07.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.985+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f41523b0 con 0x7f32f4154d10 2023-10-14T12:30:07.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.985+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f4097cb0 con 0x7f32f4154d10 2023-10-14T12:30:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.986+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f41528d0 con 0x7f32f4154d10 2023-10-14T12:30:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.987+0000 7f32ea7fc640 1 -- 172.21.15.64:0/2041973472 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f32ec014b40 con 0x7f32f4154d10 2023-10-14T12:30:07.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.988+0000 7f32ea7fc640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d806ae70 0x7f32d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.988+0000 7f32ea7fc640 1 -- 172.21.15.64:0/2041973472 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32ec08a400 con 0x7f32f4154d10 2023-10-14T12:30:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.988+0000 7f32f9b6a640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d806ae70 0x7f32d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.989+0000 7f32f9b6a640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d806ae70 0x7f32d806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32f00011e0 tx=0x7f32f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:07.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:07.992+0000 7f32ea7fc640 1 -- 172.21.15.64:0/2041973472 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f32f41528d0 con 0x7f32f4154d10 2023-10-14T12:30:08.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.185+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f32f41528d0 con 0x7f32f4154d10 2023-10-14T12:30:08.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.186+0000 7f32ea7fc640 1 -- 172.21.15.64:0/2041973472 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f32f41528d0 con 0x7f32f4154d10 2023-10-14T12:30:08.188 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:30:08.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.188+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d806ae70 msgr2=0x7f32d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.188+0000 7f32fab6c640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d806ae70 0x7f32d806d330 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f32f00011e0 tx=0x7f32f0009040 comp rx=0 tx=0).stop 2023-10-14T12:30:08.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f4154d10 msgr2=0x7f32f40714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f4154d10 0x7f32f40714d0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f32ec007e40 tx=0x7f32ec00e4b0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 shutdown_connections 2023-10-14T12:30:08.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f32d806ae70 0x7f32d806d330 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f32f4154d10 0x7f32f40714d0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f32f40cf030 0x7f32f4070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 --2- 172.21.15.64:0/2041973472 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f32f406d360 0x7f32f4097770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 >> 172.21.15.64:0/2041973472 conn(0x7f32f406a200 msgr2=0x7f32f40b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:08.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 shutdown_connections 2023-10-14T12:30:08.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.189+0000 7f32fab6c640 1 -- 172.21.15.64:0/2041973472 wait complete. 2023-10-14T12:30:08.211 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:30:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.438+0000 7f743b1ff640 1 Processor -- start 2023-10-14T12:30:08.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.438+0000 7f743b1ff640 1 -- start start 2023-10-14T12:30:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743b1ff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f743415c940 0x7f74340d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743b1ff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f74340b6fe0 0x7f74340d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743b1ff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74340ce810 con 0x7f74340d0d80 2023-10-14T12:30:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743b1ff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74340d1740 con 0x7f743415c940 2023-10-14T12:30:08.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743b1ff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74340b5b40 con 0x7f74340b6fe0 2023-10-14T12:30:08.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743a1fd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f743415c940 0x7f74340d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743a1fd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f743415c940 0x7f74340d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34158/0 (socket says 172.21.15.64:34158) 2023-10-14T12:30:08.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f743a1fd640 1 -- 172.21.15.64:0/49188141 learned_addr learned my addr 172.21.15.64:0/49188141 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:08.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.440+0000 7f74399fc640 1 --1- 172.21.15.64:0/49188141 >> v1:172.21.15.64:6789/0 conn(0x7f74340d0d80 0x7f7434160520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43488/0 (socket says 172.21.15.64:43488) 2023-10-14T12:30:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.441+0000 7f743a9fe640 1 --2- 172.21.15.64:0/49188141 >> v2:172.21.15.177:3300/0 conn(0x7f74340b6fe0 0x7f74340d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.441+0000 7f743a1fd640 1 -- 172.21.15.64:0/49188141 >> v2:172.21.15.177:3300/0 conn(0x7f74340b6fe0 msgr2=0x7f74340d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.441+0000 7f743a1fd640 1 --2- 172.21.15.64:0/49188141 >> v2:172.21.15.177:3300/0 conn(0x7f74340b6fe0 0x7f74340d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.441+0000 7f743a1fd640 1 -- 172.21.15.64:0/49188141 >> v1:172.21.15.64:6789/0 conn(0x7f74340d0d80 legacy=0x7f7434160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.441+0000 7f743a1fd640 1 -- 172.21.15.64:0/49188141 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74340ce250 con 0x7f743415c940 2023-10-14T12:30:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.442+0000 7f743a1fd640 1 --2- 172.21.15.64:0/49188141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f743415c940 0x7f74340d0400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7434160460 tx=0x7f743002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989c4f6299d0c20e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.442+0000 7f74391fb640 1 -- 172.21.15.64:0/49188141 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430031870 con 0x7f743415c940 2023-10-14T12:30:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.442+0000 7f74391fb640 1 -- 172.21.15.64:0/49188141 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300319d0 con 0x7f743415c940 2023-10-14T12:30:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.442+0000 7f74391fb640 1 -- 172.21.15.64:0/49188141 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7430031d60 con 0x7f743415c940 2023-10-14T12:30:08.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 -- 172.21.15.64:0/49188141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f743415c940 msgr2=0x7f74340d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 --2- 172.21.15.64:0/49188141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f743415c940 0x7f74340d0400 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7434160460 tx=0x7f743002b910 comp rx=0 tx=0).stop 2023-10-14T12:30:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 -- 172.21.15.64:0/49188141 shutdown_connections 2023-10-14T12:30:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 --2- 172.21.15.64:0/49188141 >> v2:172.21.15.177:3300/0 conn(0x7f74340b6fe0 0x7f74340d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 --2- 172.21.15.64:0/49188141 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f743415c940 0x7f74340d0400 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 -- 172.21.15.64:0/49188141 >> 172.21.15.64:0/49188141 conn(0x7f743409bb30 msgr2=0x7f74340d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:08.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 -- 172.21.15.64:0/49188141 shutdown_connections 2023-10-14T12:30:08.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.443+0000 7f743b1ff640 1 -- 172.21.15.64:0/49188141 wait complete. 2023-10-14T12:30:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.445+0000 7f743b1ff640 1 Processor -- start 2023-10-14T12:30:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.445+0000 7f743b1ff640 1 -- start start 2023-10-14T12:30:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743b1ff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74340b6fe0 0x7f74340ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743b1ff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74340d0d80 0x7f743415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743b1ff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f743415c940 0x7f743415ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743b1ff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cb4b0 con 0x7f74340b6fe0 2023-10-14T12:30:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743b1ff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cb790 con 0x7f74340d0d80 2023-10-14T12:30:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743b1ff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74340cba70 con 0x7f743415c940 2023-10-14T12:30:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743a1fd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74340b6fe0 0x7f74340ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743a1fd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74340b6fe0 0x7f74340ca9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34170/0 (socket says 172.21.15.64:34170) 2023-10-14T12:30:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.446+0000 7f743a1fd640 1 -- 172.21.15.64:0/3424909566 learned_addr learned my addr 172.21.15.64:0/3424909566 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f74399fc640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74340d0d80 0x7f743415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a9fe640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f743415c940 0x7f743415ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a1fd640 1 -- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f743415c940 msgr2=0x7f743415ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a1fd640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f743415c940 0x7f743415ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a1fd640 1 -- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74340d0d80 msgr2=0x7f743415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a1fd640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74340d0d80 0x7f743415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a1fd640 1 -- 172.21.15.64:0/3424909566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74300094d0 con 0x7f74340b6fe0 2023-10-14T12:30:08.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a9fe640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f743415c940 0x7f743415ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:08.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f74399fc640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74340d0d80 0x7f743415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:08.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f743a1fd640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74340b6fe0 0x7f74340ca9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f743002b950 tx=0x7f74300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.447+0000 7f742affd640 1 -- 172.21.15.64:0/3424909566 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f743003ad30 con 0x7f74340b6fe0 2023-10-14T12:30:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.448+0000 7f742affd640 1 -- 172.21.15.64:0/3424909566 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74300443f0 con 0x7f74340b6fe0 2023-10-14T12:30:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.448+0000 7f742affd640 1 -- 172.21.15.64:0/3424909566 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74300447a0 con 0x7f74340b6fe0 2023-10-14T12:30:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.448+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74340cbd50 con 0x7f74340b6fe0 2023-10-14T12:30:08.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.448+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74340cc550 con 0x7f74340b6fe0 2023-10-14T12:30:08.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.449+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74340cc270 con 0x7f74340b6fe0 2023-10-14T12:30:08.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.450+0000 7f742affd640 1 -- 172.21.15.64:0/3424909566 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f743004d450 con 0x7f74340b6fe0 2023-10-14T12:30:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.451+0000 7f742affd640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f741806ae70 0x7f741806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.451+0000 7f742affd640 1 -- 172.21.15.64:0/3424909566 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f743002d040 con 0x7f74340b6fe0 2023-10-14T12:30:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.451+0000 7f74399fc640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f741806ae70 0x7f741806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.453+0000 7f74399fc640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f741806ae70 0x7f741806d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f743415b400 tx=0x7f7424009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:08.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.455+0000 7f742affd640 1 -- 172.21.15.64:0/3424909566 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f74340cc270 con 0x7f74340b6fe0 2023-10-14T12:30:08.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.647+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f74340cc270 con 0x7f74340b6fe0 2023-10-14T12:30:08.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.648+0000 7f742affd640 1 -- 172.21.15.64:0/3424909566 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f7430035070 con 0x7f74340b6fe0 2023-10-14T12:30:08.650 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:08.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f741806ae70 msgr2=0x7f741806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f741806ae70 0x7f741806d330 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f743415b400 tx=0x7f7424009040 comp rx=0 tx=0).stop 2023-10-14T12:30:08.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74340b6fe0 msgr2=0x7f74340ca9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74340b6fe0 0x7f74340ca9c0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f743002b950 tx=0x7f74300046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 shutdown_connections 2023-10-14T12:30:08.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f741806ae70 0x7f741806d330 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f743415c940 0x7f743415ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f74340d0d80 0x7f743415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 --2- 172.21.15.64:0/3424909566 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f74340b6fe0 0x7f74340ca9c0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 >> 172.21.15.64:0/3424909566 conn(0x7f743409bb30 msgr2=0x7f74340cd320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:08.655 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 shutdown_connections 2023-10-14T12:30:08.655 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.651+0000 7f743b1ff640 1 -- 172.21.15.64:0/3424909566 wait complete. 2023-10-14T12:30:08.673 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:30:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.899+0000 7f27e359e640 1 Processor -- start 2023-10-14T12:30:08.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.899+0000 7f27e359e640 1 -- start start 2023-10-14T12:30:08.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e359e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f27e40ce600 0x7f27e40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e359e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f27e40cd240 0x7f27e40cd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27e40cefa0 con 0x7f27e4157040 2023-10-14T12:30:08.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e359e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e406d4c0 con 0x7f27e40ce600 2023-10-14T12:30:08.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e359e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27e40cdfc0 con 0x7f27e40cd240 2023-10-14T12:30:08.903 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e1d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f27e40ce600 0x7f27e40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e1d9b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f27e40ce600 0x7f27e40cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34182/0 (socket says 172.21.15.64:34182) 2023-10-14T12:30:08.904 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e1d9b640 1 -- 172.21.15.64:0/2887670123 learned_addr learned my addr 172.21.15.64:0/2887670123 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:08.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e2d9d640 1 --2- 172.21.15.64:0/2887670123 >> v2:172.21.15.177:3300/0 conn(0x7f27e40cd240 0x7f27e40cd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e1d9b640 1 -- 172.21.15.64:0/2887670123 >> v2:172.21.15.177:3300/0 conn(0x7f27e40cd240 msgr2=0x7f27e40cd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:08.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e1d9b640 1 --2- 172.21.15.64:0/2887670123 >> v2:172.21.15.177:3300/0 conn(0x7f27e40cd240 0x7f27e40cd6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e1d9b640 1 -- 172.21.15.64:0/2887670123 >> v1:172.21.15.177:6789/0 conn(0x7f27e4157040 legacy=0x7f27e406d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:08.905 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.901+0000 7f27e1d9b640 1 -- 172.21.15.64:0/2887670123 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27e406ce70 con 0x7f27e40ce600 2023-10-14T12:30:08.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.902+0000 7f27e1d9b640 1 --2- 172.21.15.64:0/2887670123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40cea60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27e4072050 tx=0x7f27d802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddead47950a4f1b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:08.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.903+0000 7f27e159a640 1 -- 172.21.15.64:0/2887670123 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8031870 con 0x7f27e40ce600 2023-10-14T12:30:08.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.903+0000 7f27e159a640 1 -- 172.21.15.64:0/2887670123 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d80319d0 con 0x7f27e40ce600 2023-10-14T12:30:08.906 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.903+0000 7f27e159a640 1 -- 172.21.15.64:0/2887670123 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8031d60 con 0x7f27e40ce600 2023-10-14T12:30:08.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.903+0000 7f27e359e640 1 -- 172.21.15.64:0/2887670123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 msgr2=0x7f27e40cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.907 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.903+0000 7f27e359e640 1 --2- 172.21.15.64:0/2887670123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40cea60 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f27e4072050 tx=0x7f27d802b910 comp rx=0 tx=0).stop 2023-10-14T12:30:08.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.904+0000 7f27e359e640 1 -- 172.21.15.64:0/2887670123 shutdown_connections 2023-10-14T12:30:08.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.904+0000 7f27e359e640 1 --2- 172.21.15.64:0/2887670123 >> v2:172.21.15.177:3300/0 conn(0x7f27e40cd240 0x7f27e40cd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.904+0000 7f27e359e640 1 --2- 172.21.15.64:0/2887670123 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40cea60 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.904+0000 7f27e359e640 1 -- 172.21.15.64:0/2887670123 >> 172.21.15.64:0/2887670123 conn(0x7f27e4069fc0 msgr2=0x7f27e406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:08.908 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.904+0000 7f27e359e640 1 -- 172.21.15.64:0/2887670123 shutdown_connections 2023-10-14T12:30:08.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.904+0000 7f27e359e640 1 -- 172.21.15.64:0/2887670123 wait complete. 2023-10-14T12:30:08.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.906+0000 7f27e359e640 1 Processor -- start 2023-10-14T12:30:08.909 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.906+0000 7f27e359e640 1 -- start start 2023-10-14T12:30:08.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27e40cd240 0x7f27e41561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e4157040 0x7f27e40b1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.911 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e40cbaf0 con 0x7f27e40ce600 2023-10-14T12:30:08.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27e4156710 con 0x7f27e4157040 2023-10-14T12:30:08.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27e41e6700 con 0x7f27e40cd240 2023-10-14T12:30:08.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40af1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34198/0 (socket says 172.21.15.64:34198) 2023-10-14T12:30:08.912 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 -- 172.21.15.64:0/1369114577 learned_addr learned my addr 172.21.15.64:0/1369114577 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:08.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 -- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27e40cd240 msgr2=0x7f27e41561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27e40cd240 0x7f27e41561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 -- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e4157040 msgr2=0x7f27e40b1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:08.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e2d9d640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e4157040 0x7f27e40b1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.913 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e4157040 0x7f27e40b1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.907+0000 7f27e1d9b640 1 -- 172.21.15.64:0/1369114577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d80094d0 con 0x7f27e40ce600 2023-10-14T12:30:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.908+0000 7f27e1d9b640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40af1d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f27d802b950 tx=0x7f27d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.908+0000 7f27d2ffd640 1 -- 172.21.15.64:0/1369114577 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d8031860 con 0x7f27e40ce600 2023-10-14T12:30:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.908+0000 7f27d2ffd640 1 -- 172.21.15.64:0/1369114577 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27d80443f0 con 0x7f27e40ce600 2023-10-14T12:30:08.914 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.908+0000 7f27d2ffd640 1 -- 172.21.15.64:0/1369114577 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27d80447a0 con 0x7f27e40ce600 2023-10-14T12:30:08.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.908+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e40cdd90 con 0x7f27e40ce600 2023-10-14T12:30:08.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.908+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27e41e6cc0 con 0x7f27e40ce600 2023-10-14T12:30:08.915 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.909+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27e404e9b0 con 0x7f27e40ce600 2023-10-14T12:30:08.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.910+0000 7f27d2ffd640 1 -- 172.21.15.64:0/1369114577 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f27d804d450 con 0x7f27e40ce600 2023-10-14T12:30:08.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.911+0000 7f27d2ffd640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f27c406aea0 0x7f27c406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:08.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.911+0000 7f27d2ffd640 1 -- 172.21.15.64:0/1369114577 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27d802d040 con 0x7f27e40ce600 2023-10-14T12:30:08.916 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.912+0000 7f27e259c640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f27c406aea0 0x7f27c406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:08.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.913+0000 7f27e259c640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f27c406aea0 0x7f27c406d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009690 tx=0x7f27d4006b90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:08.917 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:08.916+0000 7f27d2ffd640 1 -- 172.21.15.64:0/1369114577 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f27d8076e60 con 0x7f27e40ce600 2023-10-14T12:30:09.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.124+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f27e40afc20 con 0x7f27e40ce600 2023-10-14T12:30:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.125+0000 7f27d2ffd640 1 -- 172.21.15.64:0/1369114577 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f27d8035020 con 0x7f27e40ce600 2023-10-14T12:30:09.126 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:30:09.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f27c406aea0 msgr2=0x7f27c406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f27c406aea0 0x7f27c406d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f27d4009690 tx=0x7f27d4006b90 comp rx=0 tx=0).stop 2023-10-14T12:30:09.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 msgr2=0x7f27e40af1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40af1d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f27d802b950 tx=0x7f27d80046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 shutdown_connections 2023-10-14T12:30:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f27c406aea0 0x7f27c406d360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f27e4157040 0x7f27e40b1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f27e40ce600 0x7f27e40af1d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 --2- 172.21.15.64:0/1369114577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f27e40cd240 0x7f27e41561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.127+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 >> 172.21.15.64:0/1369114577 conn(0x7f27e4069fc0 msgr2=0x7f27e406d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.128+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 shutdown_connections 2023-10-14T12:30:09.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.128+0000 7f27e359e640 1 -- 172.21.15.64:0/1369114577 wait complete. 2023-10-14T12:30:09.148 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi064.front.sepia.ceph.com... 2023-10-14T12:30:09.148 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:09.149 DEBUG:teuthology.orchestra.run.smithi064:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-10-14T12:30:09.247 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:30:09.248 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T12:30:09.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:09.250 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T12:30:09.309 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:30:09.310 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:30:09.374 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:30:09.375 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:30:09.433 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:09.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.668+0000 7f49edeea640 1 Processor -- start 2023-10-14T12:30:09.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.668+0000 7f49edeea640 1 -- start start 2023-10-14T12:30:09.671 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.670+0000 7f49edeea640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f49e80cb250 0x7f49e80c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.671 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.670+0000 7f49edeea640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e815acb0 con 0x7f49e80ca660 2023-10-14T12:30:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.670+0000 7f49edeea640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49e80c1c60 con 0x7f49e815a8d0 2023-10-14T12:30:09.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.670+0000 7f49edeea640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49e815e350 con 0x7f49e80cb250 2023-10-14T12:30:09.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.670+0000 7f49ed6e9640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f49e80ca660 0x7f49e80c9350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43490/0 (socket says 172.21.15.64:43490) 2023-10-14T12:30:09.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.670+0000 7f49ed6e9640 1 -- 172.21.15.64:0/677741636 learned_addr learned my addr 172.21.15.64:0/677741636 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:09.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.670+0000 7f49e7fff640 1 --2- 172.21.15.64:0/677741636 >> v2:172.21.15.177:3300/0 conn(0x7f49e80cb250 0x7f49e80c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.674 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4087436102 0 0) 0x7f49e0001110 con 0x7f49e80ca660 2023-10-14T12:30:09.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49d8003520 con 0x7f49e80ca660 2023-10-14T12:30:09.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3454630578 0 0) 0x7f49d8003520 con 0x7f49e80ca660 2023-10-14T12:30:09.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 >> v2:172.21.15.177:3300/0 conn(0x7f49e80cb250 msgr2=0x7f49e80c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:09.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 --2- 172.21.15.64:0/677741636 >> v2:172.21.15.177:3300/0 conn(0x7f49e80cb250 0x7f49e80c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 >> v1:172.21.15.177:6789/0 conn(0x7f49e815a8d0 legacy=0x7f49e80cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e815e630 con 0x7f49e80ca660 2023-10-14T12:30:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f49e0001800 con 0x7f49e80ca660 2023-10-14T12:30:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 >> v1:172.21.15.64:6789/0 conn(0x7f49e80ca660 legacy=0x7f49e80c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49d8003970 0x7f49d8003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49d80047c0 0x7f49d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8005180 0x7f49d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e815e350 con 0x7f49d8003970 2023-10-14T12:30:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800c050 con 0x7f49d80047c0 2023-10-14T12:30:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.671+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d800c210 con 0x7f49d8005180 2023-10-14T12:30:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ecee8640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49d8003970 0x7f49d8003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49e7fff640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49d80047c0 0x7f49d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ed6e9640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8005180 0x7f49d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ecee8640 1 -- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8005180 msgr2=0x7f49d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ecee8640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8005180 0x7f49d800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ecee8640 1 -- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49d80047c0 msgr2=0x7f49d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ecee8640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49d80047c0 0x7f49d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ecee8640 1 -- 172.21.15.64:0/677741636 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8003520 con 0x7f49d8003970 2023-10-14T12:30:09.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.672+0000 7f49ed6e9640 1 -- 172.21.15.64:0/677741636 reap_dead start 2023-10-14T12:30:09.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.673+0000 7f49ecee8640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49d8003970 0x7f49d8003db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001e70 tx=0x7f49d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85ace3621c7f77d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:09.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.673+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc003bc0 con 0x7f49d8003970 2023-10-14T12:30:09.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.673+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49dc003d20 con 0x7f49d8003970 2023-10-14T12:30:09.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.673+0000 7f49e77fe640 1 -- 172.21.15.64:0/677741636 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49dc005310 con 0x7f49d8003970 2023-10-14T12:30:09.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.674+0000 7f49edeea640 1 -- 172.21.15.64:0/677741636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49d8003970 msgr2=0x7f49d8003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.674+0000 7f49edeea640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49d8003970 0x7f49d8003db0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001e70 tx=0x7f49d80057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.674+0000 7f49edeea640 1 -- 172.21.15.64:0/677741636 shutdown_connections 2023-10-14T12:30:09.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.674+0000 7f49edeea640 1 --2- 172.21.15.64:0/677741636 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49d8003970 0x7f49d8003db0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.674+0000 7f49edeea640 1 -- 172.21.15.64:0/677741636 >> 172.21.15.64:0/677741636 conn(0x7f49e806a470 msgr2=0x7f49e80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:09.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.674+0000 7f49edeea640 1 -- 172.21.15.64:0/677741636 shutdown_connections 2023-10-14T12:30:09.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.674+0000 7f49edeea640 1 -- 172.21.15.64:0/677741636 wait complete. 2023-10-14T12:30:09.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.676+0000 7f49edeea640 1 Processor -- start 2023-10-14T12:30:09.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.676+0000 7f49edeea640 1 -- start start 2023-10-14T12:30:09.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49edeea640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8003970 0x7f49e80c1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49edeea640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49e80c7350 0x7f49e80c77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49edeea640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e80c5440 0x7f49e80c58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49edeea640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e815c4d0 con 0x7f49e80c5440 2023-10-14T12:30:09.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49edeea640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80c7d10 con 0x7f49e80c7350 2023-10-14T12:30:09.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49edeea640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49e80c5e00 con 0x7f49d8003970 2023-10-14T12:30:09.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49ed6e9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e80c5440 0x7f49e80c58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49ed6e9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e80c5440 0x7f49e80c58c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34226/0 (socket says 172.21.15.64:34226) 2023-10-14T12:30:09.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.677+0000 7f49ed6e9640 1 -- 172.21.15.64:0/3605014547 learned_addr learned my addr 172.21.15.64:0/3605014547 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:09.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49ecee8640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8003970 0x7f49e80c1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49e7fff640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49e80c7350 0x7f49e80c77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49ed6e9640 1 -- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8003970 msgr2=0x7f49e80c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49ed6e9640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8003970 0x7f49e80c1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49ed6e9640 1 -- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49e80c7350 msgr2=0x7f49e80c77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49ed6e9640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49e80c7350 0x7f49e80c77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49ed6e9640 1 -- 172.21.15.64:0/3605014547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e815bea0 con 0x7f49e80c5440 2023-10-14T12:30:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49e7fff640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49e80c7350 0x7f49e80c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49ed6e9640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e80c5440 0x7f49e80c58c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f49e806e0a0 tx=0x7f49e000d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49e57fa640 1 -- 172.21.15.64:0/3605014547 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0007440 con 0x7f49e80c5440 2023-10-14T12:30:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49e57fa640 1 -- 172.21.15.64:0/3605014547 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e00075a0 con 0x7f49e80c5440 2023-10-14T12:30:09.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49e57fa640 1 -- 172.21.15.64:0/3605014547 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0004a20 con 0x7f49e80c5440 2023-10-14T12:30:09.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.678+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49e80c1780 con 0x7f49e80c5440 2023-10-14T12:30:09.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.679+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49e80c81f0 con 0x7f49e80c5440 2023-10-14T12:30:09.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.680+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49e804e9b0 con 0x7f49e80c5440 2023-10-14T12:30:09.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.681+0000 7f49e57fa640 1 -- 172.21.15.64:0/3605014547 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f49e0004b80 con 0x7f49e80c5440 2023-10-14T12:30:09.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.682+0000 7f49e57fa640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f49cc06ae70 0x7f49cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:09.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.682+0000 7f49e57fa640 1 -- 172.21.15.64:0/3605014547 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f49e00894e0 con 0x7f49e80c5440 2023-10-14T12:30:09.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.682+0000 7f49ecee8640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f49cc06ae70 0x7f49cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:09.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.684+0000 7f49ecee8640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f49cc06ae70 0x7f49cc06d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001e70 tx=0x7f49dc009030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:09.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.686+0000 7f49e57fa640 1 -- 172.21.15.64:0/3605014547 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f49e00541d0 con 0x7f49e80c5440 2023-10-14T12:30:09.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.880+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49e815acb0 con 0x7f49e80c5440 2023-10-14T12:30:09.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.884+0000 7f49e57fa640 1 -- 172.21.15.64:0/3605014547 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f49e815acb0 con 0x7f49e80c5440 2023-10-14T12:30:09.886 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:09.886 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.886+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f49cc06ae70 msgr2=0x7f49cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.886+0000 7f49edeea640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f49cc06ae70 0x7f49cc06d330 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f49dc001e70 tx=0x7f49dc009030 comp rx=0 tx=0).stop 2023-10-14T12:30:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.886+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e80c5440 msgr2=0x7f49e80c58c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:09.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.886+0000 7f49edeea640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e80c5440 0x7f49e80c58c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f49e806e0a0 tx=0x7f49e000d9b0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 shutdown_connections 2023-10-14T12:30:09.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f49cc06ae70 0x7f49cc06d330 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f49e80c5440 0x7f49e80c58c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f49e80c7350 0x7f49e80c77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 --2- 172.21.15.64:0/3605014547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f49d8003970 0x7f49e80c1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:09.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 >> 172.21.15.64:0/3605014547 conn(0x7f49e806a470 msgr2=0x7f49e80af2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:09.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 shutdown_connections 2023-10-14T12:30:09.891 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:09.887+0000 7f49edeea640 1 -- 172.21.15.64:0/3605014547 wait complete. 2023-10-14T12:30:09.909 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:30:09.910 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:30:10.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.125+0000 7f79eaf11640 1 Processor -- start 2023-10-14T12:30:10.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.126+0000 7f79eaf11640 1 -- start start 2023-10-14T12:30:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.127+0000 7f79eaf11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 0x7f79e40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.127+0000 7f79eaf11640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40cfc20 con 0x7f79e406b570 2023-10-14T12:30:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.127+0000 7f79eaf11640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e40cd4a0 con 0x7f79e40d0cd0 2023-10-14T12:30:10.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.127+0000 7f79eaf11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40cd780 con 0x7f79e40b1a30 2023-10-14T12:30:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.128+0000 7f79ea710640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f79e406b570 0x7f79e406ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43492/0 (socket says 172.21.15.64:43492) 2023-10-14T12:30:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.128+0000 7f79ea710640 1 -- 172.21.15.64:0/2738670569 learned_addr learned my addr 172.21.15.64:0/2738670569 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.128+0000 7f79e9f0f640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 0x7f79e40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.128+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713241622 0 0) 0x7f79e40cfc20 con 0x7f79e406b570 2023-10-14T12:30:10.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.128+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d0003520 con 0x7f79e406b570 2023-10-14T12:30:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1235726288 0 0) 0x7f79d0003520 con 0x7f79e406b570 2023-10-14T12:30:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 msgr2=0x7f79e40cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 0x7f79e40cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 >> v1:172.21.15.177:6789/0 conn(0x7f79e40d0cd0 legacy=0x7f79e40d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40cda60 con 0x7f79e406b570 2023-10-14T12:30:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f79dc0019f0 con 0x7f79e406b570 2023-10-14T12:30:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 >> v1:172.21.15.64:6789/0 conn(0x7f79e406b570 legacy=0x7f79e406ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79d00039a0 0x7f79d0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 0x7f79d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79d0004d00 0x7f79d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40cd780 con 0x7f79d0004d00 2023-10-14T12:30:10.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79d000ba60 con 0x7f79d00039a0 2023-10-14T12:30:10.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79d000bc20 con 0x7f79e40b1a30 2023-10-14T12:30:10.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79ea710640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79d0004d00 0x7f79d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e9f0f640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79d00039a0 0x7f79d0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.129+0000 7f79e970e640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 0x7f79d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.130+0000 7f79ea710640 1 -- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 msgr2=0x7f79d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:10.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.130+0000 7f79ea710640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79e40b1a30 0x7f79d00047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.130+0000 7f79ea710640 1 -- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79d00039a0 msgr2=0x7f79d0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:10.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.130+0000 7f79ea710640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79d00039a0 0x7f79d0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.130+0000 7f79ea710640 1 -- 172.21.15.64:0/2738670569 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0003520 con 0x7f79d0004d00 2023-10-14T12:30:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.131+0000 7f79ea710640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79d0004d00 0x7f79d0005180 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f79dc002230 tx=0x7f79d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7adb2e452c0ab6db server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:10.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.131+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc034630 con 0x7f79d0004d00 2023-10-14T12:30:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.131+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc02f070 con 0x7f79d0004d00 2023-10-14T12:30:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.131+0000 7f79e8f0d640 1 -- 172.21.15.64:0/2738670569 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc034a10 con 0x7f79d0004d00 2023-10-14T12:30:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.131+0000 7f79eaf11640 1 -- 172.21.15.64:0/2738670569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79d0004d00 msgr2=0x7f79d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.131+0000 7f79eaf11640 1 --2- 172.21.15.64:0/2738670569 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79d0004d00 0x7f79d0005180 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f79dc002230 tx=0x7f79d00057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.131+0000 7f79ea710640 1 -- 172.21.15.64:0/2738670569 reap_dead start 2023-10-14T12:30:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.132+0000 7f79eaf11640 1 -- 172.21.15.64:0/2738670569 shutdown_connections 2023-10-14T12:30:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.132+0000 7f79eaf11640 1 -- 172.21.15.64:0/2738670569 >> 172.21.15.64:0/2738670569 conn(0x7f79e408c140 msgr2=0x7f79e409ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.132+0000 7f79eaf11640 1 -- 172.21.15.64:0/2738670569 shutdown_connections 2023-10-14T12:30:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.132+0000 7f79eaf11640 1 -- 172.21.15.64:0/2738670569 wait complete. 2023-10-14T12:30:10.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.133+0000 7f79eaf11640 1 Processor -- start 2023-10-14T12:30:10.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.134+0000 7f79eaf11640 1 -- start start 2023-10-14T12:30:10.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.134+0000 7f79eaf11640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79d0004d00 0x7f79e4159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.134+0000 7f79eaf11640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40cbb60 0x7f79e40cbfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79eaf11640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e40c7dc0 0x7f79e40c8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79eaf11640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40cc520 con 0x7f79e40cbb60 2023-10-14T12:30:10.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79eaf11640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40c72c0 con 0x7f79e40c7dc0 2023-10-14T12:30:10.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79eaf11640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e40c6220 con 0x7f79d0004d00 2023-10-14T12:30:10.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40cbb60 0x7f79e40cbfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40cbb60 0x7f79e40cbfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34232/0 (socket says 172.21.15.64:34232) 2023-10-14T12:30:10.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 -- 172.21.15.64:0/256080458 learned_addr learned my addr 172.21.15.64:0/256080458 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:10.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e9f0f640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79d0004d00 0x7f79e4159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 -- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79d0004d00 msgr2=0x7f79e4159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79d0004d00 0x7f79e4159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 -- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e40c7dc0 msgr2=0x7f79e40c8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e40c7dc0 0x7f79e40c8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.135+0000 7f79e970e640 1 -- 172.21.15.64:0/256080458 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e40c6500 con 0x7f79e40cbb60 2023-10-14T12:30:10.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.136+0000 7f79e970e640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40cbb60 0x7f79e40cbfe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f79d8001eb0 tx=0x7f79d800d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:10.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.136+0000 7f79d67fc640 1 -- 172.21.15.64:0/256080458 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d800b070 con 0x7f79e40cbb60 2023-10-14T12:30:10.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.136+0000 7f79d67fc640 1 -- 172.21.15.64:0/256080458 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d80054e0 con 0x7f79e40cbb60 2023-10-14T12:30:10.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.136+0000 7f79d67fc640 1 -- 172.21.15.64:0/256080458 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d8003810 con 0x7f79e40cbb60 2023-10-14T12:30:10.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.136+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e40c67e0 con 0x7f79e40cbb60 2023-10-14T12:30:10.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.136+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e40c6da0 con 0x7f79e40cbb60 2023-10-14T12:30:10.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.137+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e40c6f60 con 0x7f79e40cbb60 2023-10-14T12:30:10.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.138+0000 7f79d67fc640 1 -- 172.21.15.64:0/256080458 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f79d8003970 con 0x7f79e40cbb60 2023-10-14T12:30:10.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.139+0000 7f79d67fc640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79c806ae70 0x7f79c806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.139+0000 7f79d67fc640 1 -- 172.21.15.64:0/256080458 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f79d8089210 con 0x7f79e40cbb60 2023-10-14T12:30:10.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.140+0000 7f79e9f0f640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79c806ae70 0x7f79c806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.141+0000 7f79e9f0f640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79c806ae70 0x7f79c806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f79e40cc8c0 tx=0x7f79e0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:10.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.143+0000 7f79d67fc640 1 -- 172.21.15.64:0/256080458 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f79d8053fa0 con 0x7f79e40cbb60 2023-10-14T12:30:10.285 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:30:10.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:30:10.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.335+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79e404e9b0 con 0x7f79e40cbb60 2023-10-14T12:30:10.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.336+0000 7f79d67fc640 1 -- 172.21.15.64:0/256080458 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79d80180a0 con 0x7f79e40cbb60 2023-10-14T12:30:10.338 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:30:10.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79c806ae70 msgr2=0x7f79c806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79c806ae70 0x7f79c806d330 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f79e40cc8c0 tx=0x7f79e0008040 comp rx=0 tx=0).stop 2023-10-14T12:30:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40cbb60 msgr2=0x7f79e40cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40cbb60 0x7f79e40cbfe0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f79d8001eb0 tx=0x7f79d800d9d0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 shutdown_connections 2023-10-14T12:30:10.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f79c806ae70 0x7f79c806d330 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f79e40c7dc0 0x7f79e40c8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f79e40cbb60 0x7f79e40cbfe0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 --2- 172.21.15.64:0/256080458 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f79d0004d00 0x7f79e4159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.338+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 >> 172.21.15.64:0/256080458 conn(0x7f79e408c140 msgr2=0x7f79e40b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:10.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.339+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 shutdown_connections 2023-10-14T12:30:10.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.339+0000 7f79eaf11640 1 -- 172.21.15.64:0/256080458 wait complete. 2023-10-14T12:30:10.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:30:10.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.636+0000 7f02989bf640 1 Processor -- start 2023-10-14T12:30:10.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.636+0000 7f02989bf640 1 -- start start 2023-10-14T12:30:10.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.637+0000 7f02989bf640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f02940cf030 0x7f029406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.637+0000 7f02989bf640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02941550f0 con 0x7f029406d360 2023-10-14T12:30:10.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.637+0000 7f02989bf640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f029406db50 con 0x7f0294154d10 2023-10-14T12:30:10.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.637+0000 7f02989bf640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02940b13f0 con 0x7f02940cf030 2023-10-14T12:30:10.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.638+0000 7f028bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f02940cf030 0x7f029406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.638+0000 7f028bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f02940cf030 0x7f029406ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34234/0 (socket says 172.21.15.64:34234) 2023-10-14T12:30:10.640 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.638+0000 7f028bfff640 1 -- 172.21.15.64:0/3671053183 learned_addr learned my addr 172.21.15.64:0/3671053183 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:10.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.638+0000 7f028bfff640 1 -- 172.21.15.64:0/3671053183 >> v1:172.21.15.177:6789/0 conn(0x7f0294154d10 legacy=0x7f02940ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:10.641 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.638+0000 7f028bfff640 1 -- 172.21.15.64:0/3671053183 >> v1:172.21.15.64:6789/0 conn(0x7f029406d360 legacy=0x7f02940ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.638+0000 7f028bfff640 1 -- 172.21.15.64:0/3671053183 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02940b16d0 con 0x7f02940cf030 2023-10-14T12:30:10.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.639+0000 7f028bfff640 1 --2- 172.21.15.64:0/3671053183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f029406ce20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691e1a32ca1d1e2a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:10.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.640+0000 7f0292ffd640 1 -- 172.21.15.64:0/3671053183 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c030860 con 0x7f02940cf030 2023-10-14T12:30:10.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.640+0000 7f0292ffd640 1 -- 172.21.15.64:0/3671053183 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c0309c0 con 0x7f02940cf030 2023-10-14T12:30:10.642 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.640+0000 7f0292ffd640 1 -- 172.21.15.64:0/3671053183 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c030d50 con 0x7f02940cf030 2023-10-14T12:30:10.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.640+0000 7f02989bf640 1 -- 172.21.15.64:0/3671053183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 msgr2=0x7f029406ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.643 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.640+0000 7f02989bf640 1 --2- 172.21.15.64:0/3671053183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f029406ce20 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c02b9a0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.640+0000 7f02989bf640 1 -- 172.21.15.64:0/3671053183 shutdown_connections 2023-10-14T12:30:10.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.640+0000 7f02989bf640 1 --2- 172.21.15.64:0/3671053183 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f029406ce20 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.641+0000 7f02989bf640 1 -- 172.21.15.64:0/3671053183 >> 172.21.15.64:0/3671053183 conn(0x7f029406a200 msgr2=0x7f029406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:10.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.641+0000 7f02989bf640 1 -- 172.21.15.64:0/3671053183 shutdown_connections 2023-10-14T12:30:10.644 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.641+0000 7f02989bf640 1 -- 172.21.15.64:0/3671053183 wait complete. 2023-10-14T12:30:10.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.642+0000 7f02989bf640 1 Processor -- start 2023-10-14T12:30:10.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.643+0000 7f02989bf640 1 -- start start 2023-10-14T12:30:10.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f02989bf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f029406d360 0x7f0294155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f02989bf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f0294156fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.647 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f02989bf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0294154d10 0x7f02940ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f02989bf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294157660 con 0x7f02940cf030 2023-10-14T12:30:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f02989bf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294157d50 con 0x7f0294154d10 2023-10-14T12:30:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f02989bf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02941578b0 con 0x7f029406d360 2023-10-14T12:30:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f0294156fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f0294156fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34236/0 (socket says 172.21.15.64:34236) 2023-10-14T12:30:10.648 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 -- 172.21.15.64:0/1293183184 learned_addr learned my addr 172.21.15.64:0/1293183184 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f02937fe640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f029406d360 0x7f0294155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f0293fff640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0294154d10 0x7f02940ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 -- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f029406d360 msgr2=0x7f0294155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f029406d360 0x7f0294155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 -- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0294154d10 msgr2=0x7f02940ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0294154d10 0x7f02940ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f028bfff640 1 -- 172.21.15.64:0/1293183184 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c0094d0 con 0x7f02940cf030 2023-10-14T12:30:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.644+0000 7f0293fff640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0294154d10 0x7f02940ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.645+0000 7f028bfff640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f0294156fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:10.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.645+0000 7f0290ff9640 1 -- 172.21.15.64:0/1293183184 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c030810 con 0x7f02940cf030 2023-10-14T12:30:10.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.645+0000 7f0290ff9640 1 -- 172.21.15.64:0/1293183184 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f027c043400 con 0x7f02940cf030 2023-10-14T12:30:10.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.645+0000 7f0290ff9640 1 -- 172.21.15.64:0/1293183184 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c0437b0 con 0x7f02940cf030 2023-10-14T12:30:10.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.645+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02940cdc50 con 0x7f02940cf030 2023-10-14T12:30:10.651 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.645+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02940cc1f0 con 0x7f02940cf030 2023-10-14T12:30:10.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.646+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f029404e9b0 con 0x7f02940cf030 2023-10-14T12:30:10.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.647+0000 7f0290ff9640 1 -- 172.21.15.64:0/1293183184 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f027c043910 con 0x7f02940cf030 2023-10-14T12:30:10.652 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.648+0000 7f0290ff9640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f027406ae70 0x7f027406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:10.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.648+0000 7f0290ff9640 1 -- 172.21.15.64:0/1293183184 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f027c03e070 con 0x7f02940cf030 2023-10-14T12:30:10.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.649+0000 7f02937fe640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f027406ae70 0x7f027406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:10.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.650+0000 7f02937fe640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f027406ae70 0x7f027406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f02941f5890 tx=0x7f0284009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:10.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.652+0000 7f0290ff9640 1 -- 172.21.15.64:0/1293183184 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f027c0aee60 con 0x7f02940cf030 2023-10-14T12:30:10.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.849+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f029406c9d0 con 0x7f02940cf030 2023-10-14T12:30:10.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.850+0000 7f0290ff9640 1 -- 172.21.15.64:0/1293183184 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f027c034020 con 0x7f02940cf030 2023-10-14T12:30:10.852 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:10.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.852+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f027406ae70 msgr2=0x7f027406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.852+0000 7f02989bf640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f027406ae70 0x7f027406d330 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f02941f5890 tx=0x7f0284009040 comp rx=0 tx=0).stop 2023-10-14T12:30:10.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.852+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 msgr2=0x7f0294156fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:10.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.852+0000 7f02989bf640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f0294156fe0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f027c009870 tx=0x7f027c004730 comp rx=0 tx=0).stop 2023-10-14T12:30:10.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 shutdown_connections 2023-10-14T12:30:10.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f027406ae70 0x7f027406d330 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0294154d10 0x7f02940ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02940cf030 0x7f0294156fe0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 --2- 172.21.15.64:0/1293183184 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f029406d360 0x7f0294155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 >> 172.21.15.64:0/1293183184 conn(0x7f029406a200 msgr2=0x7f02940ca3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:10.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 shutdown_connections 2023-10-14T12:30:10.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:10.853+0000 7f02989bf640 1 -- 172.21.15.64:0/1293183184 wait complete. 2023-10-14T12:30:10.873 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:30:11.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.104+0000 7f0f71e6e640 1 Processor -- start 2023-10-14T12:30:11.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.104+0000 7f0f71e6e640 1 -- start start 2023-10-14T12:30:11.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.105+0000 7f0f71e6e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0f6c15c940 0x7f0f6c0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f71e6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c0d0d80 0x7f0f6c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f71e6e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f6c0ce810 con 0x7f0f6c160520 2023-10-14T12:30:11.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f71e6e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c0d1740 con 0x7f0f6c15c940 2023-10-14T12:30:11.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f71e6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0b5b40 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f70e6c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0f6c15c940 0x7f0f6c0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f7166d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f0f6c160520 0x7f0f6c1609b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43512/0 (socket says 172.21.15.64:43512) 2023-10-14T12:30:11.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f7166d640 1 -- 172.21.15.64:0/1784195746 learned_addr learned my addr 172.21.15.64:0/1784195746 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:11.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f70e6c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0f6c15c940 0x7f0f6c0d0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34250/0 (socket says 172.21.15.64:34250) 2023-10-14T12:30:11.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.106+0000 7f0f63fff640 1 --2- 172.21.15.64:0/1784195746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c0d0d80 0x7f0f6c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.107+0000 7f0f70e6c640 1 -- 172.21.15.64:0/1784195746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c0d0d80 msgr2=0x7f0f6c0d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:11.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.107+0000 7f0f70e6c640 1 --2- 172.21.15.64:0/1784195746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c0d0d80 0x7f0f6c0d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.107+0000 7f0f70e6c640 1 -- 172.21.15.64:0/1784195746 >> v1:172.21.15.64:6789/0 conn(0x7f0f6c160520 legacy=0x7f0f6c1609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.107+0000 7f0f70e6c640 1 -- 172.21.15.64:0/1784195746 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c0ce250 con 0x7f0f6c15c940 2023-10-14T12:30:11.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.107+0000 7f0f637fe640 1 -- 172.21.15.64:0/1784195746 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824065432 0 0) 0x7f0f6c0ce810 con 0x7f0f6c160520 2023-10-14T12:30:11.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.108+0000 7f0f70e6c640 1 --2- 172.21.15.64:0/1784195746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0d0400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097a0 tx=0x7f0f6802b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ef8b28ff78263 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:11.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.108+0000 7f0f637fe640 1 -- 172.21.15.64:0/1784195746 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68031780 con 0x7f0f6c15c940 2023-10-14T12:30:11.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.108+0000 7f0f637fe640 1 -- 172.21.15.64:0/1784195746 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f680318e0 con 0x7f0f6c15c940 2023-10-14T12:30:11.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.108+0000 7f0f637fe640 1 -- 172.21.15.64:0/1784195746 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68031c70 con 0x7f0f6c15c940 2023-10-14T12:30:11.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 -- 172.21.15.64:0/1784195746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15c940 msgr2=0x7f0f6c0d0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/1784195746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0d0400 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0f680097a0 tx=0x7f0f6802b820 comp rx=0 tx=0).stop 2023-10-14T12:30:11.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 -- 172.21.15.64:0/1784195746 shutdown_connections 2023-10-14T12:30:11.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/1784195746 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c0d0d80 0x7f0f6c0d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/1784195746 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0d0400 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 -- 172.21.15.64:0/1784195746 >> 172.21.15.64:0/1784195746 conn(0x7f0f6c09bb30 msgr2=0x7f0f6c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:11.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 -- 172.21.15.64:0/1784195746 shutdown_connections 2023-10-14T12:30:11.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.109+0000 7f0f71e6e640 1 -- 172.21.15.64:0/1784195746 wait complete. 2023-10-14T12:30:11.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.110+0000 7f0f71e6e640 1 Processor -- start 2023-10-14T12:30:11.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.111+0000 7f0f71e6e640 1 -- start start 2023-10-14T12:30:11.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f71e6e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0d0d80 0x7f0f6c09fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f71e6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f71e6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c160520 0x7f0f6c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f71e6e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c1f23b0 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f71e6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c6490 con 0x7f0f6c15c940 2023-10-14T12:30:11.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f71e6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0c6770 con 0x7f0f6c160520 2023-10-14T12:30:11.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0d0d80 0x7f0f6c09fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0d0d80 0x7f0f6c09fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34252/0 (socket says 172.21.15.64:34252) 2023-10-14T12:30:11.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 -- 172.21.15.64:0/389248234 learned_addr learned my addr 172.21.15.64:0/389248234 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:11.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f63fff640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 -- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c160520 msgr2=0x7f0f6c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f7166d640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c160520 0x7f0f6c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c160520 0x7f0f6c0cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 -- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6c15c940 msgr2=0x7f0f6c0cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f70e6c640 1 -- 172.21.15.64:0/389248234 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009400 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.112+0000 7f0f63fff640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:11.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.113+0000 7f0f70e6c640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0d0d80 0x7f0f6c09fd10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034040 tx=0x7f0f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:11.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.113+0000 7f0f617fa640 1 -- 172.21.15.64:0/389248234 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68004230 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.113+0000 7f0f617fa640 1 -- 172.21.15.64:0/389248234 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f68004390 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.113+0000 7f0f617fa640 1 -- 172.21.15.64:0/389248234 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68032860 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.113+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c0c6a50 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.113+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c0a0250 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.114+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c0c6f70 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.115+0000 7f0f617fa640 1 -- 172.21.15.64:0/389248234 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0f680329c0 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.116+0000 7f0f617fa640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0f5806ae70 0x7f0f5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.117+0000 7f0f617fa640 1 -- 172.21.15.64:0/389248234 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f680abb20 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.117+0000 7f0f63fff640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0f5806ae70 0x7f0f5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.118+0000 7f0f63fff640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0f5806ae70 0x7f0f5806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c006fd0 tx=0x7f0f5c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:11.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.121+0000 7f0f617fa640 1 -- 172.21.15.64:0/389248234 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0f6c0c6f70 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.316+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f6c0c6f70 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.317+0000 7f0f617fa640 1 -- 172.21.15.64:0/389248234 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f6c0c6f70 con 0x7f0f6c0d0d80 2023-10-14T12:30:11.319 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:30:11.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0f5806ae70 msgr2=0x7f0f5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0f5806ae70 0x7f0f5806d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c006fd0 tx=0x7f0f5c008040 comp rx=0 tx=0).stop 2023-10-14T12:30:11.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0d0d80 msgr2=0x7f0f6c09fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0d0d80 0x7f0f6c09fd10 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0f68034040 tx=0x7f0f680046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 shutdown_connections 2023-10-14T12:30:11.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0f5806ae70 0x7f0f5806d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0f6c160520 0x7f0f6c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0f6c15c940 0x7f0f6c0cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 --2- 172.21.15.64:0/389248234 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0f6c0d0d80 0x7f0f6c09fd10 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 >> 172.21.15.64:0/389248234 conn(0x7f0f6c09bb30 msgr2=0x7f0f6c06c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 shutdown_connections 2023-10-14T12:30:11.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.321+0000 7f0f71e6e640 1 -- 172.21.15.64:0/389248234 wait complete. 2023-10-14T12:30:11.351 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:30:11.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.577+0000 7fd629652640 1 Processor -- start 2023-10-14T12:30:11.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.577+0000 7fd629652640 1 -- start start 2023-10-14T12:30:11.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd629652640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd6240cdae0 0x7fd6240cad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd629652640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd6240cb250 0x7fd6240c8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd629652640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6240cb690 con 0x7fd624158f80 2023-10-14T12:30:11.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd629652640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6240ce3c0 con 0x7fd6240cb250 2023-10-14T12:30:11.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd629652640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd62415a840 con 0x7fd6240cdae0 2023-10-14T12:30:11.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd628e51640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd6240cb250 0x7fd6240c8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd628e51640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd6240cb250 0x7fd6240c8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34254/0 (socket says 172.21.15.64:34254) 2023-10-14T12:30:11.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.579+0000 7fd628e51640 1 -- 172.21.15.64:0/2797853585 learned_addr learned my addr 172.21.15.64:0/2797853585 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:11.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.580+0000 7fd61b7fe640 1 --2- 172.21.15.64:0/2797853585 >> v2:172.21.15.177:3300/0 conn(0x7fd6240cdae0 0x7fd6240cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.580+0000 7fd628e51640 1 -- 172.21.15.64:0/2797853585 >> v2:172.21.15.177:3300/0 conn(0x7fd6240cdae0 msgr2=0x7fd6240cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.580+0000 7fd628e51640 1 --2- 172.21.15.64:0/2797853585 >> v2:172.21.15.177:3300/0 conn(0x7fd6240cdae0 0x7fd6240cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.580+0000 7fd628e51640 1 -- 172.21.15.64:0/2797853585 >> v1:172.21.15.177:6789/0 conn(0x7fd624158f80 legacy=0x7fd62415a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:11.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.580+0000 7fd628e51640 1 -- 172.21.15.64:0/2797853585 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62406d8f0 con 0x7fd6240cb250 2023-10-14T12:30:11.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.580+0000 7fd61b7fe640 1 --2- 172.21.15.64:0/2797853585 >> v2:172.21.15.177:3300/0 conn(0x7fd6240cdae0 0x7fd6240cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:11.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.581+0000 7fd628e51640 1 --2- 172.21.15.64:0/2797853585 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cb250 0x7fd6240c8ea0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd6240cf5a0 tx=0x7fd61c02deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a724e4383177661 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:11.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.581+0000 7fd6237fe640 1 -- 172.21.15.64:0/2797853585 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c02ec60 con 0x7fd6240cb250 2023-10-14T12:30:11.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.581+0000 7fd6237fe640 1 -- 172.21.15.64:0/2797853585 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd61c032070 con 0x7fd6240cb250 2023-10-14T12:30:11.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.581+0000 7fd6237fe640 1 -- 172.21.15.64:0/2797853585 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd61c038400 con 0x7fd6240cb250 2023-10-14T12:30:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 -- 172.21.15.64:0/2797853585 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cb250 msgr2=0x7fd6240c8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 --2- 172.21.15.64:0/2797853585 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cb250 0x7fd6240c8ea0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd6240cf5a0 tx=0x7fd61c02deb0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 -- 172.21.15.64:0/2797853585 shutdown_connections 2023-10-14T12:30:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 --2- 172.21.15.64:0/2797853585 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cb250 0x7fd6240c8ea0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 --2- 172.21.15.64:0/2797853585 >> v2:172.21.15.177:3300/0 conn(0x7fd6240cdae0 0x7fd6240cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 -- 172.21.15.64:0/2797853585 >> 172.21.15.64:0/2797853585 conn(0x7fd62406a200 msgr2=0x7fd62406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 -- 172.21.15.64:0/2797853585 shutdown_connections 2023-10-14T12:30:11.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.582+0000 7fd629652640 1 -- 172.21.15.64:0/2797853585 wait complete. 2023-10-14T12:30:11.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.584+0000 7fd629652640 1 Processor -- start 2023-10-14T12:30:11.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.584+0000 7fd629652640 1 -- start start 2023-10-14T12:30:11.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.585+0000 7fd629652640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6240cb250 0x7fd6240c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.585+0000 7fd629652640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cdae0 0x7fd6241e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.585+0000 7fd629652640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd624158f80 0x7fd6240c2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.585+0000 7fd629652640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240c4a70 con 0x7fd6240cdae0 2023-10-14T12:30:11.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.585+0000 7fd629652640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240c3e60 con 0x7fd6240cb250 2023-10-14T12:30:11.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.585+0000 7fd629652640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6240c40d0 con 0x7fd624158f80 2023-10-14T12:30:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.585+0000 7fd61b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cdae0 0x7fd6241e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cdae0 0x7fd6241e3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34260/0 (socket says 172.21.15.64:34260) 2023-10-14T12:30:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 -- 172.21.15.64:0/3277129832 learned_addr learned my addr 172.21.15.64:0/3277129832 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd623fff640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6240cb250 0x7fd6240c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd628e51640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd624158f80 0x7fd6240c2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 -- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd624158f80 msgr2=0x7fd6240c2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd624158f80 0x7fd6240c2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 -- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6240cb250 msgr2=0x7fd6240c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6240cb250 0x7fd6240c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 -- 172.21.15.64:0/3277129832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd61c00b760 con 0x7fd6240cdae0 2023-10-14T12:30:11.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd623fff640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6240cb250 0x7fd6240c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.586+0000 7fd61b7fe640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cdae0 0x7fd6241e3e90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd60c007fa0 tx=0x7fd60c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.587+0000 7fd6217fa640 1 -- 172.21.15.64:0/3277129832 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c003b90 con 0x7fd6240cdae0 2023-10-14T12:30:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.587+0000 7fd6217fa640 1 -- 172.21.15.64:0/3277129832 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd60c00f040 con 0x7fd6240cdae0 2023-10-14T12:30:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.587+0000 7fd6217fa640 1 -- 172.21.15.64:0/3277129832 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60c004030 con 0x7fd6240cdae0 2023-10-14T12:30:11.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.587+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6240c43b0 con 0x7fd6240cdae0 2023-10-14T12:30:11.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.587+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6241e43d0 con 0x7fd6240cdae0 2023-10-14T12:30:11.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.588+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd62404e9b0 con 0x7fd6240cdae0 2023-10-14T12:30:11.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.589+0000 7fd6217fa640 1 -- 172.21.15.64:0/3277129832 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd60c004190 con 0x7fd6240cdae0 2023-10-14T12:30:11.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.590+0000 7fd6217fa640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd60406ae70 0x7fd60406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:11.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.590+0000 7fd6217fa640 1 -- 172.21.15.64:0/3277129832 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd60c089d10 con 0x7fd6240cdae0 2023-10-14T12:30:11.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.591+0000 7fd623fff640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd60406ae70 0x7fd60406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:11.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.592+0000 7fd623fff640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd60406ae70 0x7fd60406d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd614006fd0 tx=0x7fd614008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:11.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.594+0000 7fd6217fa640 1 -- 172.21.15.64:0/3277129832 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd60c08f020 con 0x7fd6240cdae0 2023-10-14T12:30:11.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.789+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd624071ff0 con 0x7fd6240cdae0 2023-10-14T12:30:11.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.790+0000 7fd6217fa640 1 -- 172.21.15.64:0/3277129832 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd60c01a020 con 0x7fd6240cdae0 2023-10-14T12:30:11.791 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.792+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd60406ae70 msgr2=0x7fd60406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.792+0000 7fd629652640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd60406ae70 0x7fd60406d330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd614006fd0 tx=0x7fd614008040 comp rx=0 tx=0).stop 2023-10-14T12:30:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cdae0 msgr2=0x7fd6241e3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cdae0 0x7fd6241e3e90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd60c007fa0 tx=0x7fd60c00d560 comp rx=0 tx=0).stop 2023-10-14T12:30:11.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 shutdown_connections 2023-10-14T12:30:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd60406ae70 0x7fd60406d330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd624158f80 0x7fd6240c2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd6240cdae0 0x7fd6241e3e90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 --2- 172.21.15.64:0/3277129832 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd6240cb250 0x7fd6240c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:11.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 >> 172.21.15.64:0/3277129832 conn(0x7fd62406a200 msgr2=0x7fd6240715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:11.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 shutdown_connections 2023-10-14T12:30:11.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:11.793+0000 7fd629652640 1 -- 172.21.15.64:0/3277129832 wait complete. 2023-10-14T12:30:11.815 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:30:12.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.045+0000 7f00db59e640 1 Processor -- start 2023-10-14T12:30:12.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.045+0000 7f00db59e640 1 -- start start 2023-10-14T12:30:12.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00db59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f00dc0cfe70 0x7f00dc0cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00db59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc0d3760 con 0x7f00dc0d14d0 2023-10-14T12:30:12.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00db59e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00dc0cf9e0 con 0x7f00dc15cc90 2023-10-14T12:30:12.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00db59e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00dc15d070 con 0x7f00dc0cfe70 2023-10-14T12:30:12.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00dad9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f00dc0cfe70 0x7f00dc0cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00dad9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f00dc0cfe70 0x7f00dc0cda00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34270/0 (socket says 172.21.15.64:34270) 2023-10-14T12:30:12.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00d3fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f00dc0d14d0 0x7f00dc0cd2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43518/0 (socket says 172.21.15.64:43518) 2023-10-14T12:30:12.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.047+0000 7f00dad9d640 1 -- 172.21.15.64:0/745844195 learned_addr learned my addr 172.21.15.64:0/745844195 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:12.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.048+0000 7f00dad9d640 1 -- 172.21.15.64:0/745844195 >> v1:172.21.15.177:6789/0 conn(0x7f00dc15cc90 legacy=0x7f00dc0d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:12.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.048+0000 7f00dad9d640 1 -- 172.21.15.64:0/745844195 >> v1:172.21.15.64:6789/0 conn(0x7f00dc0d14d0 legacy=0x7f00dc0cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.048+0000 7f00dad9d640 1 -- 172.21.15.64:0/745844195 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00dc0b1870 con 0x7f00dc0cfe70 2023-10-14T12:30:12.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.049+0000 7f00dad9d640 1 --2- 172.21.15.64:0/745844195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0cfe70 0x7f00dc0cda00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e80 tx=0x7f00d402bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e17272eabbfd81c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:12.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.049+0000 7f00d9d9b640 1 -- 172.21.15.64:0/745844195 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d402ca60 con 0x7f00dc0cfe70 2023-10-14T12:30:12.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.049+0000 7f00d9d9b640 1 -- 172.21.15.64:0/745844195 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00d402cbc0 con 0x7f00dc0cfe70 2023-10-14T12:30:12.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.049+0000 7f00d9d9b640 1 -- 172.21.15.64:0/745844195 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40343f0 con 0x7f00dc0cfe70 2023-10-14T12:30:12.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.050+0000 7f00db59e640 1 -- 172.21.15.64:0/745844195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0cfe70 msgr2=0x7f00dc0cda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.050+0000 7f00db59e640 1 --2- 172.21.15.64:0/745844195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0cfe70 0x7f00dc0cda00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009e80 tx=0x7f00d402bec0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.050+0000 7f00db59e640 1 -- 172.21.15.64:0/745844195 shutdown_connections 2023-10-14T12:30:12.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.050+0000 7f00db59e640 1 --2- 172.21.15.64:0/745844195 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0cfe70 0x7f00dc0cda00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.050+0000 7f00db59e640 1 -- 172.21.15.64:0/745844195 >> 172.21.15.64:0/745844195 conn(0x7f00dc0d27e0 msgr2=0x7f00dc0d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:12.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.050+0000 7f00db59e640 1 -- 172.21.15.64:0/745844195 shutdown_connections 2023-10-14T12:30:12.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.050+0000 7f00db59e640 1 -- 172.21.15.64:0/745844195 wait complete. 2023-10-14T12:30:12.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.052+0000 7f00db59e640 1 Processor -- start 2023-10-14T12:30:12.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.052+0000 7f00db59e640 1 -- start start 2023-10-14T12:30:12.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00db59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00dc0cfe70 0x7f00dc0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00db59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0d14d0 0x7f00dc0b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00db59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00dc15cc90 0x7f00dc0b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00db59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0b45b0 con 0x7f00dc0d14d0 2023-10-14T12:30:12.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00db59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0ca950 con 0x7f00dc15cc90 2023-10-14T12:30:12.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00db59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00dc0cac30 con 0x7f00dc0cfe70 2023-10-14T12:30:12.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00d3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0d14d0 0x7f00dc0b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.053+0000 7f00d3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0d14d0 0x7f00dc0b74e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34272/0 (socket says 172.21.15.64:34272) 2023-10-14T12:30:12.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00d3fff640 1 -- 172.21.15.64:0/2391115267 learned_addr learned my addr 172.21.15.64:0/2391115267 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:12.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00dad9d640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00dc15cc90 0x7f00dc0b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00da59c640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00dc0cfe70 0x7f00dc0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00d3fff640 1 -- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00dc0cfe70 msgr2=0x7f00dc0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00d3fff640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00dc0cfe70 0x7f00dc0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00d3fff640 1 -- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00dc15cc90 msgr2=0x7f00dc0b7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00d3fff640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00dc15cc90 0x7f00dc0b7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00d3fff640 1 -- 172.21.15.64:0/2391115267 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d4009b30 con 0x7f00dc0d14d0 2023-10-14T12:30:12.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.054+0000 7f00d3fff640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0d14d0 0x7f00dc0b74e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c450 tx=0x7f00c400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:12.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.055+0000 7f00d2ffd640 1 -- 172.21.15.64:0/2391115267 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4007480 con 0x7f00dc0d14d0 2023-10-14T12:30:12.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.055+0000 7f00d2ffd640 1 -- 172.21.15.64:0/2391115267 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00c40075e0 con 0x7f00dc0d14d0 2023-10-14T12:30:12.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.055+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00dc0caf10 con 0x7f00dc0d14d0 2023-10-14T12:30:12.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.055+0000 7f00d2ffd640 1 -- 172.21.15.64:0/2391115267 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00c4004a00 con 0x7f00dc0d14d0 2023-10-14T12:30:12.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.055+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00dc157e60 con 0x7f00dc0d14d0 2023-10-14T12:30:12.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.056+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00dc0b1da0 con 0x7f00dc0d14d0 2023-10-14T12:30:12.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.057+0000 7f00d2ffd640 1 -- 172.21.15.64:0/2391115267 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f00c4004b60 con 0x7f00dc0d14d0 2023-10-14T12:30:12.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.058+0000 7f00d2ffd640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f00bc06ae70 0x7f00bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.058+0000 7f00d2ffd640 1 -- 172.21.15.64:0/2391115267 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00c4088da0 con 0x7f00dc0d14d0 2023-10-14T12:30:12.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.059+0000 7f00da59c640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f00bc06ae70 0x7f00bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.060+0000 7f00da59c640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f00bc06ae70 0x7f00bc06d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00cc006fd0 tx=0x7f00cc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:12.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.063+0000 7f00d2ffd640 1 -- 172.21.15.64:0/2391115267 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f00c4053a80 con 0x7f00dc0d14d0 2023-10-14T12:30:12.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.271+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f00dc04e9b0 con 0x7f00dc0d14d0 2023-10-14T12:30:12.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.272+0000 7f00d2ffd640 1 -- 172.21.15.64:0/2391115267 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f00c4018080 con 0x7f00dc0d14d0 2023-10-14T12:30:12.274 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:30:12.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f00bc06ae70 msgr2=0x7f00bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f00bc06ae70 0x7f00bc06d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00cc006fd0 tx=0x7f00cc008040 comp rx=0 tx=0).stop 2023-10-14T12:30:12.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0d14d0 msgr2=0x7f00dc0b74e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0d14d0 0x7f00dc0b74e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f00c400c450 tx=0x7f00c400c910 comp rx=0 tx=0).stop 2023-10-14T12:30:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 shutdown_connections 2023-10-14T12:30:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f00bc06ae70 0x7f00bc06d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f00dc15cc90 0x7f00dc0b7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f00dc0d14d0 0x7f00dc0b74e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 --2- 172.21.15.64:0/2391115267 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f00dc0cfe70 0x7f00dc0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 >> 172.21.15.64:0/2391115267 conn(0x7f00dc0d27e0 msgr2=0x7f00dc158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:12.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 shutdown_connections 2023-10-14T12:30:12.279 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.275+0000 7f00db59e640 1 -- 172.21.15.64:0/2391115267 wait complete. 2023-10-14T12:30:12.296 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T12:30:12.296 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T12:30:12.357 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:12.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.588+0000 7f52fbfff640 1 Processor -- start 2023-10-14T12:30:12.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.588+0000 7f52fbfff640 1 -- start start 2023-10-14T12:30:12.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.590+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc0cad30 0x7f52fc0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.590+0000 7f52fbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f52fc1651e0 0x7f52fc070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.590+0000 7f52fbfff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52fc164a20 con 0x7f52fc0c8d40 2023-10-14T12:30:12.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.590+0000 7f52fbfff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52fc0721e0 con 0x7f52fc1651e0 2023-10-14T12:30:12.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc0c9270 con 0x7f52fc0cad30 2023-10-14T12:30:12.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fb7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f52fc1651e0 0x7f52fc070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fb7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f52fc1651e0 0x7f52fc070080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34280/0 (socket says 172.21.15.64:34280) 2023-10-14T12:30:12.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fb7fe640 1 -- 172.21.15.64:0/3649144864 learned_addr learned my addr 172.21.15.64:0/3649144864 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:12.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52faffd640 1 --2- 172.21.15.64:0/3649144864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc0cad30 0x7f52fc0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fb7fe640 1 -- 172.21.15.64:0/3649144864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc0cad30 msgr2=0x7f52fc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:12.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fb7fe640 1 --2- 172.21.15.64:0/3649144864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc0cad30 0x7f52fc0cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fb7fe640 1 -- 172.21.15.64:0/3649144864 >> v1:172.21.15.177:6789/0 conn(0x7f52fc0c8d40 legacy=0x7f52fc0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:12.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.591+0000 7f52fb7fe640 1 -- 172.21.15.64:0/3649144864 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc0c9550 con 0x7f52fc1651e0 2023-10-14T12:30:12.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.593+0000 7f52fb7fe640 1 --2- 172.21.15.64:0/3649144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc1651e0 0x7f52fc070080 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009870 tx=0x7f52f402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3406c3a0001024ea server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:12.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.593+0000 7f52fa7fc640 1 -- 172.21.15.64:0/3649144864 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40317c0 con 0x7f52fc1651e0 2023-10-14T12:30:12.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.593+0000 7f52fa7fc640 1 -- 172.21.15.64:0/3649144864 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f4031920 con 0x7f52fc1651e0 2023-10-14T12:30:12.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.593+0000 7f52fa7fc640 1 -- 172.21.15.64:0/3649144864 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4031cb0 con 0x7f52fc1651e0 2023-10-14T12:30:12.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.593+0000 7f52fbfff640 1 -- 172.21.15.64:0/3649144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc1651e0 msgr2=0x7f52fc070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.593+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3649144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc1651e0 0x7f52fc070080 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f52f4009870 tx=0x7f52f402b860 comp rx=0 tx=0).stop 2023-10-14T12:30:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.594+0000 7f52fbfff640 1 -- 172.21.15.64:0/3649144864 shutdown_connections 2023-10-14T12:30:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.594+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3649144864 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc1651e0 0x7f52fc070080 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.594+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3649144864 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc0cad30 0x7f52fc0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.594+0000 7f52fbfff640 1 -- 172.21.15.64:0/3649144864 >> 172.21.15.64:0/3649144864 conn(0x7f52fc06a470 msgr2=0x7f52fc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:12.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.594+0000 7f52fbfff640 1 -- 172.21.15.64:0/3649144864 shutdown_connections 2023-10-14T12:30:12.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.594+0000 7f52fbfff640 1 -- 172.21.15.64:0/3649144864 wait complete. 2023-10-14T12:30:12.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.595+0000 7f52fbfff640 1 Processor -- start 2023-10-14T12:30:12.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.596+0000 7f52fbfff640 1 -- start start 2023-10-14T12:30:12.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52fc0c8d40 0x7f52fc1f5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0cad30 0x7f52fc0c4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52fbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc1651e0 0x7f52fc0c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52fbfff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc161f90 con 0x7f52fc0cad30 2023-10-14T12:30:12.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52fbfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc1f6270 con 0x7f52fc0c8d40 2023-10-14T12:30:12.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52fbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52fc161380 con 0x7f52fc1651e0 2023-10-14T12:30:12.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0cad30 0x7f52fc0c4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0cad30 0x7f52fc0c4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34286/0 (socket says 172.21.15.64:34286) 2023-10-14T12:30:12.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 -- 172.21.15.64:0/3552427867 learned_addr learned my addr 172.21.15.64:0/3552427867 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:12.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52faffd640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52fc0c8d40 0x7f52fc1f5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 -- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc1651e0 msgr2=0x7f52fc0c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc1651e0 0x7f52fc0c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 -- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52fc0c8d40 msgr2=0x7f52fc1f5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52fc0c8d40 0x7f52fc1f5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52f27fc640 1 -- 172.21.15.64:0/3552427867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40094d0 con 0x7f52fc0cad30 2023-10-14T12:30:12.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.597+0000 7f52faffd640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52fc0c8d40 0x7f52fc1f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:12.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.598+0000 7f52f27fc640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0cad30 0x7f52fc0c4400 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f52e400b9c0 tx=0x7f52e400be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:12.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.598+0000 7f52f3fff640 1 -- 172.21.15.64:0/3552427867 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e400cba0 con 0x7f52fc0cad30 2023-10-14T12:30:12.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.598+0000 7f52f3fff640 1 -- 172.21.15.64:0/3552427867 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52e400cd00 con 0x7f52fc0cad30 2023-10-14T12:30:12.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.598+0000 7f52f3fff640 1 -- 172.21.15.64:0/3552427867 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52e4003bb0 con 0x7f52fc0cad30 2023-10-14T12:30:12.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.598+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52fc161660 con 0x7f52fc0cad30 2023-10-14T12:30:12.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.598+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52fc161c20 con 0x7f52fc0cad30 2023-10-14T12:30:12.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.599+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52fc04e9b0 con 0x7f52fc0cad30 2023-10-14T12:30:12.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.600+0000 7f52f3fff640 1 -- 172.21.15.64:0/3552427867 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f52e4014440 con 0x7f52fc0cad30 2023-10-14T12:30:12.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.601+0000 7f52f3fff640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52dc06aea0 0x7f52dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:12.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.601+0000 7f52f3fff640 1 -- 172.21.15.64:0/3552427867 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52e4089800 con 0x7f52fc0cad30 2023-10-14T12:30:12.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.602+0000 7f52faffd640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52dc06aea0 0x7f52dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:12.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.603+0000 7f52faffd640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52dc06aea0 0x7f52dc06d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009780 tx=0x7f52ec008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:12.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.606+0000 7f52f3fff640 1 -- 172.21.15.64:0/3552427867 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52e4054450 con 0x7f52fc0cad30 2023-10-14T12:30:12.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.798+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f52fc0c9800 con 0x7f52fc0cad30 2023-10-14T12:30:12.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.800+0000 7f52f3fff640 1 -- 172.21.15.64:0/3552427867 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7f52e4057a70 con 0x7f52fc0cad30 2023-10-14T12:30:12.802 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:12.803 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:12.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.802+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52dc06aea0 msgr2=0x7f52dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.802+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52dc06aea0 0x7f52dc06d360 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f52ec009780 tx=0x7f52ec008040 comp rx=0 tx=0).stop 2023-10-14T12:30:12.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.802+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0cad30 msgr2=0x7f52fc0c4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:12.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.802+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0cad30 0x7f52fc0c4400 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f52e400b9c0 tx=0x7f52e400be80 comp rx=0 tx=0).stop 2023-10-14T12:30:12.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 shutdown_connections 2023-10-14T12:30:12.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52dc06aea0 0x7f52dc06d360 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f52fc1651e0 0x7f52fc0c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f52fc0cad30 0x7f52fc0c4400 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 --2- 172.21.15.64:0/3552427867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f52fc0c8d40 0x7f52fc1f5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:12.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 >> 172.21.15.64:0/3552427867 conn(0x7f52fc06a470 msgr2=0x7f52fc0ade90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:12.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 shutdown_connections 2023-10-14T12:30:12.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:12.803+0000 7f52fbfff640 1 -- 172.21.15.64:0/3552427867 wait complete. 2023-10-14T12:30:12.825 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:30:12.826 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:30:13.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.047+0000 7fbc9aac2640 1 Processor -- start 2023-10-14T12:30:13.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.048+0000 7fbc9aac2640 1 -- start start 2023-10-14T12:30:13.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.049+0000 7fbc9aac2640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbc94070a30 0x7fbc940cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.049+0000 7fbc9aac2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc940c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.049+0000 7fbc9aac2640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc940cf040 con 0x7fbc9415a830 2023-10-14T12:30:13.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.049+0000 7fbc9aac2640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc940ca9e0 con 0x7fbc94070a30 2023-10-14T12:30:13.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.049+0000 7fbc9aac2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc940ce430 con 0x7fbc940ca550 2023-10-14T12:30:13.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.049+0000 7fbc93fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbc94070a30 0x7fbc940cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc93fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbc94070a30 0x7fbc940cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34300/0 (socket says 172.21.15.64:34300) 2023-10-14T12:30:13.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc93fff640 1 -- 172.21.15.64:0/4230134049 learned_addr learned my addr 172.21.15.64:0/4230134049 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:13.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc9905f640 1 --2- 172.21.15.64:0/4230134049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc940c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc93fff640 1 -- 172.21.15.64:0/4230134049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 msgr2=0x7fbc940c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:13.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc93fff640 1 --2- 172.21.15.64:0/4230134049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc940c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc93fff640 1 -- 172.21.15.64:0/4230134049 >> v1:172.21.15.177:6789/0 conn(0x7fbc9415a830 legacy=0x7fbc94070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:13.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc93fff640 1 -- 172.21.15.64:0/4230134049 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc940ce710 con 0x7fbc94070a30 2023-10-14T12:30:13.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.050+0000 7fbc9905f640 1 --2- 172.21.15.64:0/4230134049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc940c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:13.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.051+0000 7fbc93fff640 1 --2- 172.21.15.64:0/4230134049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc940cb640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009870 tx=0x7fbc8002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34990c5f85cf6ec server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:13.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.052+0000 7fbc937fe640 1 -- 172.21.15.64:0/4230134049 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80031640 con 0x7fbc94070a30 2023-10-14T12:30:13.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.052+0000 7fbc937fe640 1 -- 172.21.15.64:0/4230134049 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc800317a0 con 0x7fbc94070a30 2023-10-14T12:30:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.052+0000 7fbc937fe640 1 -- 172.21.15.64:0/4230134049 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc80031b30 con 0x7fbc94070a30 2023-10-14T12:30:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.052+0000 7fbc9aac2640 1 -- 172.21.15.64:0/4230134049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 msgr2=0x7fbc940cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.052+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/4230134049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc940cb640 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fbc80009870 tx=0x7fbc8002b8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.053+0000 7fbc9aac2640 1 -- 172.21.15.64:0/4230134049 shutdown_connections 2023-10-14T12:30:13.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.053+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/4230134049 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc940c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.053+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/4230134049 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc940cb640 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.053+0000 7fbc9aac2640 1 -- 172.21.15.64:0/4230134049 >> 172.21.15.64:0/4230134049 conn(0x7fbc940b0030 msgr2=0x7fbc940b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:13.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.053+0000 7fbc9aac2640 1 -- 172.21.15.64:0/4230134049 shutdown_connections 2023-10-14T12:30:13.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.053+0000 7fbc9aac2640 1 -- 172.21.15.64:0/4230134049 wait complete. 2023-10-14T12:30:13.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.054+0000 7fbc9aac2640 1 Processor -- start 2023-10-14T12:30:13.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.055+0000 7fbc9aac2640 1 -- start start 2023-10-14T12:30:13.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.055+0000 7fbc9aac2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc9415e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.055+0000 7fbc9aac2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc94155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.055+0000 7fbc9aac2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9415a830 0x7fbc94158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9aac2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9415ec20 con 0x7fbc94070a30 2023-10-14T12:30:13.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9aac2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc941565c0 con 0x7fbc9415a830 2023-10-14T12:30:13.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9aac2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc941568a0 con 0x7fbc940ca550 2023-10-14T12:30:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc9415e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc9415e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34314/0 (socket says 172.21.15.64:34314) 2023-10-14T12:30:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 -- 172.21.15.64:0/3626553653 learned_addr learned my addr 172.21.15.64:0/3626553653 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9905f640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9415a830 0x7fbc94158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc93fff640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc94155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 -- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 msgr2=0x7fbc94155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc94155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 -- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9415a830 msgr2=0x7fbc94158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9415a830 0x7fbc94158db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.056+0000 7fbc9885e640 1 -- 172.21.15.64:0/3626553653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc800094d0 con 0x7fbc94070a30 2023-10-14T12:30:13.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.057+0000 7fbc9885e640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc9415e6e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b3f0 tx=0x7fbc8800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:13.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.057+0000 7fbc917fa640 1 -- 172.21.15.64:0/3626553653 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88011830 con 0x7fbc94070a30 2023-10-14T12:30:13.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.057+0000 7fbc917fa640 1 -- 172.21.15.64:0/3626553653 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc88011990 con 0x7fbc94070a30 2023-10-14T12:30:13.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.057+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc94156b80 con 0x7fbc94070a30 2023-10-14T12:30:13.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.057+0000 7fbc917fa640 1 -- 172.21.15.64:0/3626553653 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc88011d40 con 0x7fbc94070a30 2023-10-14T12:30:13.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.057+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc94157140 con 0x7fbc94070a30 2023-10-14T12:30:13.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.058+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc94073ef0 con 0x7fbc94070a30 2023-10-14T12:30:13.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.059+0000 7fbc917fa640 1 -- 172.21.15.64:0/3626553653 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc8801a400 con 0x7fbc94070a30 2023-10-14T12:30:13.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.060+0000 7fbc917fa640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc7806ae70 0x7fbc7806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.060+0000 7fbc917fa640 1 -- 172.21.15.64:0/3626553653 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbc88089880 con 0x7fbc94070a30 2023-10-14T12:30:13.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.061+0000 7fbc93fff640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc7806ae70 0x7fbc7806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.062+0000 7fbc93fff640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc7806ae70 0x7fbc7806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc80036000 tx=0x7fbc8003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:13.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.064+0000 7fbc917fa640 1 -- 172.21.15.64:0/3626553653 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc88054570 con 0x7fbc94070a30 2023-10-14T12:30:13.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.261+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc94070810 con 0x7fbc94070a30 2023-10-14T12:30:13.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.261+0000 7fbc917fa640 1 -- 172.21.15.64:0/3626553653 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc88057b90 con 0x7fbc94070a30 2023-10-14T12:30:13.264 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:30:13.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc7806ae70 msgr2=0x7fbc7806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc7806ae70 0x7fbc7806d330 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbc80036000 tx=0x7fbc8003c040 comp rx=0 tx=0).stop 2023-10-14T12:30:13.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 msgr2=0x7fbc9415e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc9415e6e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b3f0 tx=0x7fbc8800b8b0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 shutdown_connections 2023-10-14T12:30:13.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc7806ae70 0x7fbc7806d330 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc9415a830 0x7fbc94158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbc940ca550 0x7fbc94155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 --2- 172.21.15.64:0/3626553653 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc94070a30 0x7fbc9415e6e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 >> 172.21.15.64:0/3626553653 conn(0x7fbc940b0030 msgr2=0x7fbc940b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:13.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 shutdown_connections 2023-10-14T12:30:13.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.265+0000 7fbc9aac2640 1 -- 172.21.15.64:0/3626553653 wait complete. 2023-10-14T12:30:13.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:30:13.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.515+0000 7f8df7fff640 1 Processor -- start 2023-10-14T12:30:13.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.516+0000 7f8df7fff640 1 -- start start 2023-10-14T12:30:13.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.517+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 0x7f8df806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.517+0000 7f8df7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f8df806d360 0x7f8df80ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.517+0000 7f8df7fff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8df81550f0 con 0x7f8df8154d10 2023-10-14T12:30:13.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.517+0000 7f8df7fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8df806db50 con 0x7f8df806d360 2023-10-14T12:30:13.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.517+0000 7f8df7fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80b13f0 con 0x7f8df80cf030 2023-10-14T12:30:13.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.517+0000 7f8df6ffd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f8df8154d10 0x7f8df80ce920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43530/0 (socket says 172.21.15.64:43530) 2023-10-14T12:30:13.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.517+0000 7f8df6ffd640 1 -- 172.21.15.64:0/3577006880 learned_addr learned my addr 172.21.15.64:0/3577006880 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:13.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020983848 0 0) 0x7f8df81550f0 con 0x7f8df8154d10 2023-10-14T12:30:13.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8de4003520 con 0x7f8df8154d10 2023-10-14T12:30:13.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8deffff640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 0x7f8df806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df77fe640 1 --2- 172.21.15.64:0/3577006880 >> v2:172.21.15.177:3300/0 conn(0x7f8df806d360 0x7f8df80ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 985842151 0 0) 0x7f8de4003520 con 0x7f8df8154d10 2023-10-14T12:30:13.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 msgr2=0x7f8df806ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:13.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 0x7f8df806ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 >> v2:172.21.15.177:3300/0 conn(0x7f8df806d360 msgr2=0x7f8df80ac1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:13.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 --2- 172.21.15.64:0/3577006880 >> v2:172.21.15.177:3300/0 conn(0x7f8df806d360 0x7f8df80ac1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df80b16d0 con 0x7f8df8154d10 2023-10-14T12:30:13.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f8de8001670 con 0x7f8df8154d10 2023-10-14T12:30:13.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 >> v1:172.21.15.64:6789/0 conn(0x7f8df8154d10 legacy=0x7f8df80ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 0x7f8de40039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8de4004060 0x7f8de40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8de4004d00 0x7f8de4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df806db50 con 0x7f8de4004d00 2023-10-14T12:30:13.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df80b13f0 con 0x7f8de4004060 2023-10-14T12:30:13.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.518+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de400bb60 con 0x7f8df80cf030 2023-10-14T12:30:13.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8df77fe640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8de4004d00 0x7f8de4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8deffff640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8de4004060 0x7f8de40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8df6ffd640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 0x7f8de40039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8df77fe640 1 -- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 msgr2=0x7f8de40039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:13.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8df77fe640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8df80cf030 0x7f8de40039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8df77fe640 1 -- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8de4004060 msgr2=0x7f8de40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:13.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8df77fe640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8de4004060 0x7f8de40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8df77fe640 1 -- 172.21.15.64:0/3577006880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de4003520 con 0x7f8de4004d00 2023-10-14T12:30:13.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.519+0000 7f8deffff640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8de4004060 0x7f8de40047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:13.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.520+0000 7f8df77fe640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8de4004d00 0x7f8de4005180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007360 tx=0x7f8de40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7e6c89ae19d306 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:13.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.520+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df002ccf0 con 0x7f8de4004d00 2023-10-14T12:30:13.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.520+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df002ce50 con 0x7f8de4004d00 2023-10-14T12:30:13.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.520+0000 7f8df67fc640 1 -- 172.21.15.64:0/3577006880 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df0034660 con 0x7f8de4004d00 2023-10-14T12:30:13.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.521+0000 7f8df7fff640 1 -- 172.21.15.64:0/3577006880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8de4004d00 msgr2=0x7f8de4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.521+0000 7f8df7fff640 1 --2- 172.21.15.64:0/3577006880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8de4004d00 0x7f8de4005180 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8df0007360 tx=0x7f8de40057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.521+0000 7f8df77fe640 1 -- 172.21.15.64:0/3577006880 reap_dead start 2023-10-14T12:30:13.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.521+0000 7f8df7fff640 1 -- 172.21.15.64:0/3577006880 shutdown_connections 2023-10-14T12:30:13.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.521+0000 7f8df7fff640 1 -- 172.21.15.64:0/3577006880 >> 172.21.15.64:0/3577006880 conn(0x7f8df806a200 msgr2=0x7f8df806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:13.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.521+0000 7f8df7fff640 1 -- 172.21.15.64:0/3577006880 shutdown_connections 2023-10-14T12:30:13.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.521+0000 7f8df7fff640 1 -- 172.21.15.64:0/3577006880 wait complete. 2023-10-14T12:30:13.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.523+0000 7f8df7fff640 1 Processor -- start 2023-10-14T12:30:13.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.523+0000 7f8df7fff640 1 -- start start 2023-10-14T12:30:13.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8de4004d00 0x7f8df8148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df814b750 0x7f8df81587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8df7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df80c33a0 0x7f8df8070f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8df7fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8158d20 con 0x7f8df814b750 2023-10-14T12:30:13.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8df7fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8df8158fc0 con 0x7f8df80c33a0 2023-10-14T12:30:13.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8df7fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8df81592a0 con 0x7f8de4004d00 2023-10-14T12:30:13.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8deffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df814b750 0x7f8df81587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8deffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df814b750 0x7f8df81587e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34332/0 (socket says 172.21.15.64:34332) 2023-10-14T12:30:13.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.524+0000 7f8deffff640 1 -- 172.21.15.64:0/1695297876 learned_addr learned my addr 172.21.15.64:0/1695297876 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:13.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8df77fe640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df80c33a0 0x7f8df8070f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8deffff640 1 -- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8de4004d00 msgr2=0x7f8df8148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8deffff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8de4004d00 0x7f8df8148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8deffff640 1 -- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df80c33a0 msgr2=0x7f8df8070f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8deffff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df80c33a0 0x7f8df8070f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8deffff640 1 -- 172.21.15.64:0/1695297876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df8159580 con 0x7f8df814b750 2023-10-14T12:30:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8deffff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df814b750 0x7f8df81587e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8de000e7e0 tx=0x7f8de000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8def7fe640 1 -- 172.21.15.64:0/1695297876 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000c6d0 con 0x7f8df814b750 2023-10-14T12:30:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8def7fe640 1 -- 172.21.15.64:0/1695297876 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de000c830 con 0x7f8df814b750 2023-10-14T12:30:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8def7fe640 1 -- 172.21.15.64:0/1695297876 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de000cba0 con 0x7f8df814b750 2023-10-14T12:30:13.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.525+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8df8159860 con 0x7f8df814b750 2023-10-14T12:30:13.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.526+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8df80c3820 con 0x7f8df814b750 2023-10-14T12:30:13.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.527+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8df804e9b0 con 0x7f8df814b750 2023-10-14T12:30:13.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.528+0000 7f8def7fe640 1 -- 172.21.15.64:0/1695297876 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8de000cd00 con 0x7f8df814b750 2023-10-14T12:30:13.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.529+0000 7f8def7fe640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8dd806ae70 0x7f8dd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.529+0000 7f8def7fe640 1 -- 172.21.15.64:0/1695297876 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8de0089820 con 0x7f8df814b750 2023-10-14T12:30:13.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.529+0000 7f8df6ffd640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8dd806ae70 0x7f8dd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.531+0000 7f8df6ffd640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8dd806ae70 0x7f8dd806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000ff0 tx=0x7f8de8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:13.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.533+0000 7f8def7fe640 1 -- 172.21.15.64:0/1695297876 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8de0054470 con 0x7f8df814b750 2023-10-14T12:30:13.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.728+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8df806c9d0 con 0x7f8df814b750 2023-10-14T12:30:13.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.729+0000 7f8def7fe640 1 -- 172.21.15.64:0/1695297876 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8de0057a90 con 0x7f8df814b750 2023-10-14T12:30:13.730 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:13.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8dd806ae70 msgr2=0x7f8dd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8dd806ae70 0x7f8dd806d330 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8de8000ff0 tx=0x7f8de8009040 comp rx=0 tx=0).stop 2023-10-14T12:30:13.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df814b750 msgr2=0x7f8df81587e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df814b750 0x7f8df81587e0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8de000e7e0 tx=0x7f8de000eca0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 shutdown_connections 2023-10-14T12:30:13.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8dd806ae70 0x7f8dd806d330 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8df80c33a0 0x7f8df8070f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8df814b750 0x7f8df81587e0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 --2- 172.21.15.64:0/1695297876 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8de4004d00 0x7f8df8148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 >> 172.21.15.64:0/1695297876 conn(0x7f8df806a200 msgr2=0x7f8df80acc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:13.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 shutdown_connections 2023-10-14T12:30:13.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.731+0000 7f8df7fff640 1 -- 172.21.15.64:0/1695297876 wait complete. 2023-10-14T12:30:13.753 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:30:13.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.987+0000 7ff65e825640 1 Processor -- start 2023-10-14T12:30:13.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.987+0000 7ff65e825640 1 -- start start 2023-10-14T12:30:13.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.989+0000 7ff65e825640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff6580717c0 0x7ff6580b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:13.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.989+0000 7ff65e825640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6580cc460 con 0x7ff65815acb0 2023-10-14T12:30:13.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.989+0000 7ff65e825640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff65815b090 con 0x7ff658070f70 2023-10-14T12:30:13.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.989+0000 7ff65e825640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6580b1ba0 con 0x7ff6580717c0 2023-10-14T12:30:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.990+0000 7ff65d823640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ff65815acb0 0x7ff658070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43542/0 (socket says 172.21.15.64:43542) 2023-10-14T12:30:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.990+0000 7ff65d823640 1 -- 172.21.15.64:0/3035853255 learned_addr learned my addr 172.21.15.64:0/3035853255 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:13.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.990+0000 7ff65e024640 1 --2- 172.21.15.64:0/3035853255 >> v2:172.21.15.177:3300/0 conn(0x7ff6580717c0 0x7ff6580b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.991+0000 7ff65e024640 1 -- 172.21.15.64:0/3035853255 >> v1:172.21.15.177:6789/0 conn(0x7ff658070f70 legacy=0x7ff6580b1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.991+0000 7ff65e024640 1 -- 172.21.15.64:0/3035853255 >> v1:172.21.15.64:6789/0 conn(0x7ff65815acb0 legacy=0x7ff658070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.991+0000 7ff65e024640 1 -- 172.21.15.64:0/3035853255 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6580c9440 con 0x7ff6580717c0 2023-10-14T12:30:13.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.993+0000 7ff65e024640 1 --2- 172.21.15.64:0/3035853255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 0x7ff6580b2500 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65002bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9bb9a3a102a04a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:13.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.995+0000 7ff65c821640 1 -- 172.21.15.64:0/3035853255 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65002cd80 con 0x7ff6580717c0 2023-10-14T12:30:13.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.995+0000 7ff65c821640 1 -- 172.21.15.64:0/3035853255 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff650034440 con 0x7ff6580717c0 2023-10-14T12:30:13.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.995+0000 7ff65c821640 1 -- 172.21.15.64:0/3035853255 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6500347d0 con 0x7ff6580717c0 2023-10-14T12:30:13.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.995+0000 7ff65e825640 1 -- 172.21.15.64:0/3035853255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 msgr2=0x7ff6580b2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:13.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.995+0000 7ff65e825640 1 --2- 172.21.15.64:0/3035853255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 0x7ff6580b2500 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65002bfd0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.996+0000 7ff65e825640 1 -- 172.21.15.64:0/3035853255 shutdown_connections 2023-10-14T12:30:13.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.996+0000 7ff65e825640 1 --2- 172.21.15.64:0/3035853255 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 0x7ff6580b2500 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:13.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.996+0000 7ff65e825640 1 -- 172.21.15.64:0/3035853255 >> 172.21.15.64:0/3035853255 conn(0x7ff6580cb6d0 msgr2=0x7ff6580cbae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:13.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.996+0000 7ff65e825640 1 -- 172.21.15.64:0/3035853255 shutdown_connections 2023-10-14T12:30:13.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.996+0000 7ff65e825640 1 -- 172.21.15.64:0/3035853255 wait complete. 2023-10-14T12:30:14.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.998+0000 7ff65e825640 1 Processor -- start 2023-10-14T12:30:14.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.998+0000 7ff65e825640 1 -- start start 2023-10-14T12:30:14.002 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.999+0000 7ff65e825640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff658070f70 0x7ff658152120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.002 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.999+0000 7ff65e825640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 0x7ff65815bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.002 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.999+0000 7ff65e825640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff65815acb0 0x7ff6580af890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.999+0000 7ff65e825640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff658153750 con 0x7ff658070f70 2023-10-14T12:30:14.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.999+0000 7ff65e825640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65815c6b0 con 0x7ff6580717c0 2023-10-14T12:30:14.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:13.999+0000 7ff65e825640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65815c990 con 0x7ff65815acb0 2023-10-14T12:30:14.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff658070f70 0x7ff658152120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff658070f70 0x7ff658152120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34336/0 (socket says 172.21.15.64:34336) 2023-10-14T12:30:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 -- 172.21.15.64:0/1174749880 learned_addr learned my addr 172.21.15.64:0/1174749880 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d022640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 0x7ff65815bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65e024640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff65815acb0 0x7ff6580af890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 -- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff65815acb0 msgr2=0x7ff6580af890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff65815acb0 0x7ff6580af890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 -- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 msgr2=0x7ff65815bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 0x7ff65815bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.000+0000 7ff65d823640 1 -- 172.21.15.64:0/1174749880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009a70 con 0x7ff658070f70 2023-10-14T12:30:14.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.001+0000 7ff65d823640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff658070f70 0x7ff658152120 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c480 tx=0x7ff65400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.001+0000 7ff64e7fc640 1 -- 172.21.15.64:0/1174749880 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff654005ce0 con 0x7ff658070f70 2023-10-14T12:30:14.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.001+0000 7ff64e7fc640 1 -- 172.21.15.64:0/1174749880 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff654005e40 con 0x7ff658070f70 2023-10-14T12:30:14.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.001+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff658153370 con 0x7ff658070f70 2023-10-14T12:30:14.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.001+0000 7ff64e7fc640 1 -- 172.21.15.64:0/1174749880 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6540072f0 con 0x7ff658070f70 2023-10-14T12:30:14.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.001+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6581ef540 con 0x7ff658070f70 2023-10-14T12:30:14.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.002+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65804e9b0 con 0x7ff658070f70 2023-10-14T12:30:14.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.003+0000 7ff64e7fc640 1 -- 172.21.15.64:0/1174749880 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff654007510 con 0x7ff658070f70 2023-10-14T12:30:14.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.004+0000 7ff64e7fc640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff63c06ae70 0x7ff63c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.004+0000 7ff64e7fc640 1 -- 172.21.15.64:0/1174749880 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff654088e00 con 0x7ff658070f70 2023-10-14T12:30:14.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.005+0000 7ff65d022640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff63c06ae70 0x7ff63c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.006+0000 7ff65d022640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff63c06ae70 0x7ff63c06d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff65815dfb0 tx=0x7ff648009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.009+0000 7ff64e7fc640 1 -- 172.21.15.64:0/1174749880 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff654053c30 con 0x7ff658070f70 2023-10-14T12:30:14.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.208+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6580cea30 con 0x7ff658070f70 2023-10-14T12:30:14.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.209+0000 7ff64e7fc640 1 -- 172.21.15.64:0/1174749880 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff654017020 con 0x7ff658070f70 2023-10-14T12:30:14.211 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:30:14.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff63c06ae70 msgr2=0x7ff63c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff63c06ae70 0x7ff63c06d330 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff65815dfb0 tx=0x7ff648009040 comp rx=0 tx=0).stop 2023-10-14T12:30:14.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff658070f70 msgr2=0x7ff658152120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff658070f70 0x7ff658152120 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff65400c480 tx=0x7ff65400c940 comp rx=0 tx=0).stop 2023-10-14T12:30:14.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 shutdown_connections 2023-10-14T12:30:14.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff63c06ae70 0x7ff63c06d330 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff65815acb0 0x7ff6580af890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6580717c0 0x7ff65815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 --2- 172.21.15.64:0/1174749880 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff658070f70 0x7ff658152120 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 >> 172.21.15.64:0/1174749880 conn(0x7ff6580cb6d0 msgr2=0x7ff658155750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:14.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 shutdown_connections 2023-10-14T12:30:14.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.212+0000 7ff65e825640 1 -- 172.21.15.64:0/1174749880 wait complete. 2023-10-14T12:30:14.235 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:30:14.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.470+0000 7f840d69b640 1 Processor -- start 2023-10-14T12:30:14.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.470+0000 7f840d69b640 1 -- start start 2023-10-14T12:30:14.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.471+0000 7f840d69b640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8408070a30 0x7f84080cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.471+0000 7f840d69b640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f84080ca550 0x7f84080c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.471+0000 7f840d69b640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84080cf040 con 0x7f840815a830 2023-10-14T12:30:14.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.471+0000 7f840d69b640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84080ca9e0 con 0x7f8408070a30 2023-10-14T12:30:14.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.471+0000 7f840d69b640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84080ce430 con 0x7f84080ca550 2023-10-14T12:30:14.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.471+0000 7f83fe7fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8408070a30 0x7f84080cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f83fe7fc640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8408070a30 0x7f84080cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34344/0 (socket says 172.21.15.64:34344) 2023-10-14T12:30:14.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f83fe7fc640 1 -- 172.21.15.64:0/777450928 learned_addr learned my addr 172.21.15.64:0/777450928 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:14.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f8406ffd640 1 --1- 172.21.15.64:0/777450928 >> v1:172.21.15.64:6789/0 conn(0x7f840815a830 0x7f8408070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43550/0 (socket says 172.21.15.64:43550) 2023-10-14T12:30:14.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f84077fe640 1 --2- 172.21.15.64:0/777450928 >> v2:172.21.15.177:3300/0 conn(0x7f84080ca550 0x7f84080c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f83fe7fc640 1 -- 172.21.15.64:0/777450928 >> v2:172.21.15.177:3300/0 conn(0x7f84080ca550 msgr2=0x7f84080c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f83fe7fc640 1 --2- 172.21.15.64:0/777450928 >> v2:172.21.15.177:3300/0 conn(0x7f84080ca550 0x7f84080c8b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f83fe7fc640 1 -- 172.21.15.64:0/777450928 >> v1:172.21.15.64:6789/0 conn(0x7f840815a830 legacy=0x7f8408070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f83fe7fc640 1 -- 172.21.15.64:0/777450928 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84080ce710 con 0x7f8408070a30 2023-10-14T12:30:14.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.472+0000 7f84067fc640 1 -- 172.21.15.64:0/777450928 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214019591 0 0) 0x7f84080cf040 con 0x7f840815a830 2023-10-14T12:30:14.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.473+0000 7f83fe7fc640 1 --2- 172.21.15.64:0/777450928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8408070a30 0x7f84080cb640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f84080cefb0 tx=0x7f83f002b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bd2a016b30640d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f84067fc640 1 -- 172.21.15.64:0/777450928 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0030880 con 0x7f8408070a30 2023-10-14T12:30:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f84067fc640 1 -- 172.21.15.64:0/777450928 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f00309e0 con 0x7f8408070a30 2023-10-14T12:30:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f84067fc640 1 -- 172.21.15.64:0/777450928 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f0030d70 con 0x7f8408070a30 2023-10-14T12:30:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 -- 172.21.15.64:0/777450928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8408070a30 msgr2=0x7f84080cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 --2- 172.21.15.64:0/777450928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8408070a30 0x7f84080cb640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f84080cefb0 tx=0x7f83f002b9c0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 -- 172.21.15.64:0/777450928 shutdown_connections 2023-10-14T12:30:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 --2- 172.21.15.64:0/777450928 >> v2:172.21.15.177:3300/0 conn(0x7f84080ca550 0x7f84080c8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 --2- 172.21.15.64:0/777450928 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8408070a30 0x7f84080cb640 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 -- 172.21.15.64:0/777450928 >> 172.21.15.64:0/777450928 conn(0x7f84080b0030 msgr2=0x7f84080b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 -- 172.21.15.64:0/777450928 shutdown_connections 2023-10-14T12:30:14.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.474+0000 7f840d69b640 1 -- 172.21.15.64:0/777450928 wait complete. 2023-10-14T12:30:14.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.476+0000 7f840d69b640 1 Processor -- start 2023-10-14T12:30:14.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.476+0000 7f840d69b640 1 -- start start 2023-10-14T12:30:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.477+0000 7f840d69b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8408070a30 0x7f84080c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.477+0000 7f840d69b640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84080ca550 0x7f8408151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.477+0000 7f840d69b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f840815a830 0x7f8408155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.477+0000 7f840d69b640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408152850 con 0x7f840815a830 2023-10-14T12:30:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.477+0000 7f840d69b640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8408151bd0 con 0x7f84080ca550 2023-10-14T12:30:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.477+0000 7f840d69b640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8408151eb0 con 0x7f8408070a30 2023-10-14T12:30:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f840815a830 0x7f8408155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f840815a830 0x7f8408155290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34360/0 (socket says 172.21.15.64:34360) 2023-10-14T12:30:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 -- 172.21.15.64:0/925687733 learned_addr learned my addr 172.21.15.64:0/925687733 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:14.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 -- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8408070a30 msgr2=0x7f84080c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f83fe7fc640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84080ca550 0x7f8408151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f8406ffd640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8408070a30 0x7f84080c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8408070a30 0x7f84080c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 -- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84080ca550 msgr2=0x7f8408151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84080ca550 0x7f8408151350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 -- 172.21.15.64:0/925687733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f00094d0 con 0x7f840815a830 2023-10-14T12:30:14.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f8406ffd640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8408070a30 0x7f84080c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:14.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.478+0000 7f84077fe640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f840815a830 0x7f8408155290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f840000d800 tx=0x7f840000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.479+0000 7f83fffff640 1 -- 172.21.15.64:0/925687733 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000b6c0 con 0x7f840815a830 2023-10-14T12:30:14.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.479+0000 7f83fffff640 1 -- 172.21.15.64:0/925687733 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f840000b840 con 0x7f840815a830 2023-10-14T12:30:14.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.479+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8408152190 con 0x7f840815a830 2023-10-14T12:30:14.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.479+0000 7f83fffff640 1 -- 172.21.15.64:0/925687733 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f840000bbf0 con 0x7f840815a830 2023-10-14T12:30:14.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.479+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8408151890 con 0x7f840815a830 2023-10-14T12:30:14.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.480+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8408152990 con 0x7f840815a830 2023-10-14T12:30:14.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.481+0000 7f83fffff640 1 -- 172.21.15.64:0/925687733 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f840000bd50 con 0x7f840815a830 2023-10-14T12:30:14.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.482+0000 7f83fffff640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f83e806aea0 0x7f83e806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.482+0000 7f83fffff640 1 -- 172.21.15.64:0/925687733 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8400089f40 con 0x7f840815a830 2023-10-14T12:30:14.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.483+0000 7f8406ffd640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f83e806aea0 0x7f83e806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.484+0000 7f8406ffd640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f83e806aea0 0x7f83e806d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83f8007fd0 tx=0x7f83f8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.486+0000 7f83fffff640 1 -- 172.21.15.64:0/925687733 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8408152990 con 0x7f840815a830 2023-10-14T12:30:14.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.680+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f8408152990 con 0x7f840815a830 2023-10-14T12:30:14.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.681+0000 7f83fffff640 1 -- 172.21.15.64:0/925687733 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8408152990 con 0x7f840815a830 2023-10-14T12:30:14.683 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:14.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f83e806aea0 msgr2=0x7f83e806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f83e806aea0 0x7f83e806d360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f83f8007fd0 tx=0x7f83f8009040 comp rx=0 tx=0).stop 2023-10-14T12:30:14.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f840815a830 msgr2=0x7f8408155290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f840815a830 0x7f8408155290 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f840000d800 tx=0x7f840000dcc0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 shutdown_connections 2023-10-14T12:30:14.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f83e806aea0 0x7f83e806d360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f840815a830 0x7f8408155290 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f84080ca550 0x7f8408151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 --2- 172.21.15.64:0/925687733 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8408070a30 0x7f84080c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 >> 172.21.15.64:0/925687733 conn(0x7f84080b0030 msgr2=0x7f8408158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:14.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 shutdown_connections 2023-10-14T12:30:14.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.684+0000 7f840d69b640 1 -- 172.21.15.64:0/925687733 wait complete. 2023-10-14T12:30:14.706 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-10-14T12:30:14.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.938+0000 7ff2da139640 1 Processor -- start 2023-10-14T12:30:14.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.938+0000 7ff2da139640 1 -- start start 2023-10-14T12:30:14.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.939+0000 7ff2da139640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff2d40b08c0 0x7ff2d40c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.939+0000 7ff2da139640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff2d406c760 0x7ff2d40b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2da139640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d406cbf0 con 0x7ff2d415aa60 2023-10-14T12:30:14.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2da139640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d415ae40 con 0x7ff2d40b08c0 2023-10-14T12:30:14.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2da139640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d40b1580 con 0x7ff2d406c760 2023-10-14T12:30:14.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d2ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff2d40b08c0 0x7ff2d40c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d2ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff2d40b08c0 0x7ff2d40c9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34376/0 (socket says 172.21.15.64:34376) 2023-10-14T12:30:14.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d2ffd640 1 -- 172.21.15.64:0/2706388073 learned_addr learned my addr 172.21.15.64:0/2706388073 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:14.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d3fff640 1 --2- 172.21.15.64:0/2706388073 >> v2:172.21.15.177:3300/0 conn(0x7ff2d406c760 0x7ff2d40b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d2ffd640 1 -- 172.21.15.64:0/2706388073 >> v2:172.21.15.177:3300/0 conn(0x7ff2d406c760 msgr2=0x7ff2d40b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:14.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d2ffd640 1 --2- 172.21.15.64:0/2706388073 >> v2:172.21.15.177:3300/0 conn(0x7ff2d406c760 0x7ff2d40b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d2ffd640 1 -- 172.21.15.64:0/2706388073 >> v1:172.21.15.177:6789/0 conn(0x7ff2d415aa60 legacy=0x7ff2d40b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:14.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.940+0000 7ff2d2ffd640 1 -- 172.21.15.64:0/2706388073 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d40c98f0 con 0x7ff2d40b08c0 2023-10-14T12:30:14.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.942+0000 7ff2d2ffd640 1 --2- 172.21.15.64:0/2706388073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d40b08c0 0x7ff2d40c9260 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40b4870 tx=0x7ff2bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990df57862a806df server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.942+0000 7ff2d27fc640 1 -- 172.21.15.64:0/2706388073 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc0317e0 con 0x7ff2d40b08c0 2023-10-14T12:30:14.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.942+0000 7ff2d27fc640 1 -- 172.21.15.64:0/2706388073 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2bc031940 con 0x7ff2d40b08c0 2023-10-14T12:30:14.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.942+0000 7ff2d27fc640 1 -- 172.21.15.64:0/2706388073 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc031cd0 con 0x7ff2d40b08c0 2023-10-14T12:30:14.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.942+0000 7ff2da139640 1 -- 172.21.15.64:0/2706388073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d40b08c0 msgr2=0x7ff2d40c9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.946 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.942+0000 7ff2da139640 1 --2- 172.21.15.64:0/2706388073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d40b08c0 0x7ff2d40c9260 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff2d40b4870 tx=0x7ff2bc02b880 comp rx=0 tx=0).stop 2023-10-14T12:30:14.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.943+0000 7ff2da139640 1 -- 172.21.15.64:0/2706388073 shutdown_connections 2023-10-14T12:30:14.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.943+0000 7ff2da139640 1 --2- 172.21.15.64:0/2706388073 >> v2:172.21.15.177:3300/0 conn(0x7ff2d406c760 0x7ff2d40b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.943+0000 7ff2da139640 1 --2- 172.21.15.64:0/2706388073 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d40b08c0 0x7ff2d40c9260 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.943+0000 7ff2da139640 1 -- 172.21.15.64:0/2706388073 >> 172.21.15.64:0/2706388073 conn(0x7ff2d40cb1b0 msgr2=0x7ff2d40cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:14.947 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.943+0000 7ff2da139640 1 -- 172.21.15.64:0/2706388073 shutdown_connections 2023-10-14T12:30:14.948 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.943+0000 7ff2da139640 1 -- 172.21.15.64:0/2706388073 wait complete. 2023-10-14T12:30:14.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.944+0000 7ff2da139640 1 Processor -- start 2023-10-14T12:30:14.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.945+0000 7ff2da139640 1 -- start start 2023-10-14T12:30:14.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2da139640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d406c760 0x7ff2d41552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2da139640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d40b08c0 0x7ff2d4151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.950 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2da139640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d415aa60 0x7ff2d41f24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2da139640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d4155820 con 0x7ff2d406c760 2023-10-14T12:30:14.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2da139640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d415c460 con 0x7ff2d40b08c0 2023-10-14T12:30:14.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2da139640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d415c740 con 0x7ff2d415aa60 2023-10-14T12:30:14.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d406c760 0x7ff2d41552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.951 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d406c760 0x7ff2d41552e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34390/0 (socket says 172.21.15.64:34390) 2023-10-14T12:30:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 -- 172.21.15.64:0/704174676 learned_addr learned my addr 172.21.15.64:0/704174676 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 -- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d415aa60 msgr2=0x7ff2d41f24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d415aa60 0x7ff2d41f24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 -- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d40b08c0 msgr2=0x7ff2d4151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:14.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d2ffd640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d40b08c0 0x7ff2d4151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d40b08c0 0x7ff2d4151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d37fe640 1 -- 172.21.15.64:0/704174676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2bc0094d0 con 0x7ff2d406c760 2023-10-14T12:30:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.946+0000 7ff2d2ffd640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d40b08c0 0x7ff2d4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.947+0000 7ff2d37fe640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d406c760 0x7ff2d41552e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400ba50 tx=0x7ff2c400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.947+0000 7ff2cbfff640 1 -- 172.21.15.64:0/704174676 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c400cbe0 con 0x7ff2d406c760 2023-10-14T12:30:14.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.947+0000 7ff2cbfff640 1 -- 172.21.15.64:0/704174676 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c400cd80 con 0x7ff2d406c760 2023-10-14T12:30:14.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.947+0000 7ff2cbfff640 1 -- 172.21.15.64:0/704174676 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4014680 con 0x7ff2d406c760 2023-10-14T12:30:14.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.947+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d415ca20 con 0x7ff2d406c760 2023-10-14T12:30:14.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.947+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d415cfe0 con 0x7ff2d406c760 2023-10-14T12:30:14.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.948+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d40cafb0 con 0x7ff2d406c760 2023-10-14T12:30:14.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.949+0000 7ff2cbfff640 1 -- 172.21.15.64:0/704174676 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff2c40147e0 con 0x7ff2d406c760 2023-10-14T12:30:14.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.950+0000 7ff2cbfff640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff2b406ae70 0x7ff2b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:14.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.950+0000 7ff2cbfff640 1 -- 172.21.15.64:0/704174676 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff2c4089800 con 0x7ff2d406c760 2023-10-14T12:30:14.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.951+0000 7ff2d2ffd640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff2b406ae70 0x7ff2b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:14.956 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.952+0000 7ff2d2ffd640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff2b406ae70 0x7ff2b406d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc036000 tx=0x7ff2bc03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:14.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:14.954+0000 7ff2cbfff640 1 -- 172.21.15.64:0/704174676 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff2c4054630 con 0x7ff2d406c760 2023-10-14T12:30:15.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.165+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff2d4073ef0 con 0x7ff2d406c760 2023-10-14T12:30:15.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.166+0000 7ff2cbfff640 1 -- 172.21.15.64:0/704174676 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff2c4019080 con 0x7ff2d406c760 2023-10-14T12:30:15.167 INFO:teuthology.orchestra.run.smithi064.stderr:listed 0 entries 2023-10-14T12:30:15.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff2b406ae70 msgr2=0x7ff2b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff2b406ae70 0x7ff2b406d330 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc036000 tx=0x7ff2bc03d040 comp rx=0 tx=0).stop 2023-10-14T12:30:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d406c760 msgr2=0x7ff2d41552e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d406c760 0x7ff2d41552e0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400ba50 tx=0x7ff2c400bf10 comp rx=0 tx=0).stop 2023-10-14T12:30:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 shutdown_connections 2023-10-14T12:30:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff2b406ae70 0x7ff2b406d330 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff2d415aa60 0x7ff2d41f24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff2d40b08c0 0x7ff2d4151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 --2- 172.21.15.64:0/704174676 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff2d406c760 0x7ff2d41552e0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 >> 172.21.15.64:0/704174676 conn(0x7ff2d40cb1b0 msgr2=0x7ff2d40cd730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 shutdown_connections 2023-10-14T12:30:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.169+0000 7ff2da139640 1 -- 172.21.15.64:0/704174676 wait complete. 2023-10-14T12:30:15.190 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi177.front.sepia.ceph.com... 2023-10-14T12:30:15.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:15.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-10-14T12:30:15.299 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:30:15.299 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T12:30:15.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:15.300 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T12:30:15.352 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-14T12:30:15.353 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:30:15.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.589+0000 7fadf71f4640 1 Processor -- start 2023-10-14T12:30:15.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.589+0000 7fadf71f4640 1 -- start start 2023-10-14T12:30:15.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.590+0000 7fadf71f4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fadf015a8d0 0x7fadf00cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:15.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.590+0000 7fadf71f4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf00ca660 0x7fadf00cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:15.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.590+0000 7fadf71f4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf015acb0 con 0x7fadf006ff40 2023-10-14T12:30:15.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.590+0000 7fadf71f4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf00c1c60 con 0x7fadf015a8d0 2023-10-14T12:30:15.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.590+0000 7fadf71f4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf015e350 con 0x7fadf00ca660 2023-10-14T12:30:15.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.591+0000 7fadf61f2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fadf015a8d0 0x7fadf00cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:15.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.591+0000 7fadf59f1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf00ca660 0x7fadf00cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:15.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.591+0000 7fadf61f2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fadf015a8d0 0x7fadf00cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:40504/0 (socket says 172.21.15.64:40504) 2023-10-14T12:30:15.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.591+0000 7fadf61f2640 1 -- 172.21.15.64:0/1763690076 learned_addr learned my addr 172.21.15.64:0/1763690076 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:15.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.592+0000 7fadf61f2640 1 -- 172.21.15.64:0/1763690076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf00ca660 msgr2=0x7fadf00cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:15.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.592+0000 7fadf61f2640 1 --2- 172.21.15.64:0/1763690076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf00ca660 0x7fadf00cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.592+0000 7fadf61f2640 1 -- 172.21.15.64:0/1763690076 >> v1:172.21.15.177:6789/0 conn(0x7fadf006ff40 legacy=0x7fadf006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.592+0000 7fadf61f2640 1 -- 172.21.15.64:0/1763690076 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf015e630 con 0x7fadf015a8d0 2023-10-14T12:30:15.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.593+0000 7fadf61f2640 1 --2- 172.21.15.64:0/1763690076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf015a8d0 0x7fadf00cab40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadec009850 tx=0x7fadec02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3ce5d4ab367705f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:15.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.594+0000 7fadf51f0640 1 -- 172.21.15.64:0/1763690076 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec004230 con 0x7fadf015a8d0 2023-10-14T12:30:15.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.594+0000 7fadf51f0640 1 -- 172.21.15.64:0/1763690076 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec004390 con 0x7fadf015a8d0 2023-10-14T12:30:15.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.594+0000 7fadf51f0640 1 -- 172.21.15.64:0/1763690076 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec003810 con 0x7fadf015a8d0 2023-10-14T12:30:15.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.594+0000 7fadf71f4640 1 -- 172.21.15.64:0/1763690076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf015a8d0 msgr2=0x7fadf00cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.594+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1763690076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf015a8d0 0x7fadf00cab40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fadec009850 tx=0x7fadec02b960 comp rx=0 tx=0).stop 2023-10-14T12:30:15.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.595+0000 7fadf71f4640 1 -- 172.21.15.64:0/1763690076 shutdown_connections 2023-10-14T12:30:15.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.595+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1763690076 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf00ca660 0x7fadf00cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.595+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1763690076 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf015a8d0 0x7fadf00cab40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.595+0000 7fadf71f4640 1 -- 172.21.15.64:0/1763690076 >> 172.21.15.64:0/1763690076 conn(0x7fadf006a470 msgr2=0x7fadf00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:15.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.595+0000 7fadf71f4640 1 -- 172.21.15.64:0/1763690076 shutdown_connections 2023-10-14T12:30:15.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.595+0000 7fadf71f4640 1 -- 172.21.15.64:0/1763690076 wait complete. 2023-10-14T12:30:15.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.597+0000 7fadf71f4640 1 Processor -- start 2023-10-14T12:30:15.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.597+0000 7fadf71f4640 1 -- start start 2023-10-14T12:30:15.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.598+0000 7fadf71f4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadf006ff40 0x7fadf00ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:15.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf71f4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf00ca660 0x7fadf014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf71f4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf015a8d0 0x7fadf00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf71f4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01f5700 con 0x7fadf006ff40 2023-10-14T12:30:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf71f4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf014cb60 con 0x7fadf00ca660 2023-10-14T12:30:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf71f4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf014ce40 con 0x7fadf015a8d0 2023-10-14T12:30:15.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf61f2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadf006ff40 0x7fadf00ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:15.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf61f2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadf006ff40 0x7fadf00ad7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34400/0 (socket says 172.21.15.64:34400) 2023-10-14T12:30:15.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf61f2640 1 -- 172.21.15.64:0/1801578546 learned_addr learned my addr 172.21.15.64:0/1801578546 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:15.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf59f1640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf00ca660 0x7fadf014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:15.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf69f3640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf015a8d0 0x7fadf00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:15.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf61f2640 1 -- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf015a8d0 msgr2=0x7fadf00c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.599+0000 7fadf61f2640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf015a8d0 0x7fadf00c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fadf61f2640 1 -- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf00ca660 msgr2=0x7fadf014a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fadf61f2640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf00ca660 0x7fadf014a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fadf61f2640 1 -- 172.21.15.64:0/1801578546 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec009460 con 0x7fadf006ff40 2023-10-14T12:30:15.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fadf61f2640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadf006ff40 0x7fadf00ad7d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fadec02b9a0 tx=0x7fadec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:15.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fade6ffd640 1 -- 172.21.15.64:0/1801578546 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec03d070 con 0x7fadf006ff40 2023-10-14T12:30:15.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fade6ffd640 1 -- 172.21.15.64:0/1801578546 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadec004500 con 0x7fadf006ff40 2023-10-14T12:30:15.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fade6ffd640 1 -- 172.21.15.64:0/1801578546 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec003e10 con 0x7fadf006ff40 2023-10-14T12:30:15.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf014d120 con 0x7fadf006ff40 2023-10-14T12:30:15.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.600+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf0150890 con 0x7fadf006ff40 2023-10-14T12:30:15.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.602+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf015eeb0 con 0x7fadf006ff40 2023-10-14T12:30:15.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.602+0000 7fade6ffd640 1 -- 172.21.15.64:0/1801578546 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fadec006040 con 0x7fadf006ff40 2023-10-14T12:30:15.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.603+0000 7fade6ffd640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fadd406ae70 0x7fadd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:15.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.603+0000 7fade6ffd640 1 -- 172.21.15.64:0/1801578546 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fadec0ab4c0 con 0x7fadf006ff40 2023-10-14T12:30:15.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.604+0000 7fadf59f1640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fadd406ae70 0x7fadd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:15.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.606+0000 7fadf59f1640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fadd406ae70 0x7fadd406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fadf00afdb0 tx=0x7fade0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:15.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.608+0000 7fade6ffd640 1 -- 172.21.15.64:0/1801578546 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fadf015eeb0 con 0x7fadf006ff40 2023-10-14T12:30:15.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.846+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf015eeb0 con 0x7fadf006ff40 2023-10-14T12:30:15.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.847+0000 7fade6ffd640 1 -- 172.21.15.64:0/1801578546 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7fadf015eeb0 con 0x7fadf006ff40 2023-10-14T12:30:15.849 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:15.849 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:30:15.850 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:30:15.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fadd406ae70 msgr2=0x7fadd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fadd406ae70 0x7fadd406d330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fadf00afdb0 tx=0x7fade0008040 comp rx=0 tx=0).stop 2023-10-14T12:30:15.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadf006ff40 msgr2=0x7fadf00ad7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:15.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadf006ff40 0x7fadf00ad7d0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fadec02b9a0 tx=0x7fadec0046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 shutdown_connections 2023-10-14T12:30:15.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fadd406ae70 0x7fadd406d330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fadf015a8d0 0x7fadf00c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fadf00ca660 0x7fadf014a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 --2- 172.21.15.64:0/1801578546 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fadf006ff40 0x7fadf00ad7d0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:15.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 >> 172.21.15.64:0/1801578546 conn(0x7fadf006a470 msgr2=0x7fadf00c1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:15.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 shutdown_connections 2023-10-14T12:30:15.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:15.850+0000 7fadf71f4640 1 -- 172.21.15.64:0/1801578546 wait complete. 2023-10-14T12:30:15.872 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:16.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.093+0000 7fda8359e640 1 Processor -- start 2023-10-14T12:30:16.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.093+0000 7fda8359e640 1 -- start start 2023-10-14T12:30:16.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.094+0000 7fda8359e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fda840cd980 0x7fda840cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.095+0000 7fda8359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda84154110 con 0x7fda8406bf30 2023-10-14T12:30:16.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.095+0000 7fda8359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda8415d1f0 con 0x7fda84159c00 2023-10-14T12:30:16.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.095+0000 7fda8359e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda8415e0c0 con 0x7fda840cd980 2023-10-14T12:30:16.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.095+0000 7fda82d9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fda8406bf30 0x7fda840710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35124/0 (socket says 172.21.15.64:35124) 2023-10-14T12:30:16.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.095+0000 7fda82d9d640 1 -- 172.21.15.64:0/2398204327 learned_addr learned my addr 172.21.15.64:0/2398204327 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:16.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.095+0000 7fda8259c640 1 --2- 172.21.15.64:0/2398204327 >> v2:172.21.15.177:3300/0 conn(0x7fda840cd980 0x7fda840cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2385955303 0 0) 0x7fda84154110 con 0x7fda8406bf30 2023-10-14T12:30:16.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda6c003520 con 0x7fda8406bf30 2023-10-14T12:30:16.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2618321499 0 0) 0x7fda6c003520 con 0x7fda8406bf30 2023-10-14T12:30:16.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 >> v2:172.21.15.177:3300/0 conn(0x7fda840cd980 msgr2=0x7fda840cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:16.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 --2- 172.21.15.64:0/2398204327 >> v2:172.21.15.177:3300/0 conn(0x7fda840cd980 0x7fda840cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 >> v1:172.21.15.177:6789/0 conn(0x7fda84159c00 legacy=0x7fda8415d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8415a4c0 con 0x7fda8406bf30 2023-10-14T12:30:16.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fda7c0019f0 con 0x7fda8406bf30 2023-10-14T12:30:16.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 >> v1:172.21.15.64:6789/0 conn(0x7fda8406bf30 legacy=0x7fda840710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda6c0039c0 0x7fda6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda6c0047c0 0x7fda6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda6c00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8415e0c0 con 0x7fda6c005180 2023-10-14T12:30:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c00e290 con 0x7fda6c0039c0 2023-10-14T12:30:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.096+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda6c00e450 con 0x7fda6c0047c0 2023-10-14T12:30:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda82d9d640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda6c00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda8259c640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda6c0039c0 0x7fda6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda81d9b640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda6c0047c0 0x7fda6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda82d9d640 1 -- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda6c0047c0 msgr2=0x7fda6c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:16.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda82d9d640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda6c0047c0 0x7fda6c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda82d9d640 1 -- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda6c0039c0 msgr2=0x7fda6c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:16.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda82d9d640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda6c0039c0 0x7fda6c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.097+0000 7fda82d9d640 1 -- 172.21.15.64:0/2398204327 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda6c003520 con 0x7fda6c005180 2023-10-14T12:30:16.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.098+0000 7fda82d9d640 1 -- 172.21.15.64:0/2398204327 reap_dead start 2023-10-14T12:30:16.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.098+0000 7fda82d9d640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda6c00db90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00a810 tx=0x7fda6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca5083e5af02271 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:16.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c034630 con 0x7fda6c005180 2023-10-14T12:30:16.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda7c02f070 con 0x7fda6c005180 2023-10-14T12:30:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8159a640 1 -- 172.21.15.64:0/2398204327 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0349f0 con 0x7fda6c005180 2023-10-14T12:30:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8359e640 1 -- 172.21.15.64:0/2398204327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 msgr2=0x7fda6c00db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8359e640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda6c00db90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00a810 tx=0x7fda6c0057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8359e640 1 -- 172.21.15.64:0/2398204327 shutdown_connections 2023-10-14T12:30:16.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8359e640 1 --2- 172.21.15.64:0/2398204327 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda6c00db90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8359e640 1 -- 172.21.15.64:0/2398204327 >> 172.21.15.64:0/2398204327 conn(0x7fda8406a470 msgr2=0x7fda840afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:16.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8359e640 1 -- 172.21.15.64:0/2398204327 shutdown_connections 2023-10-14T12:30:16.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.099+0000 7fda8359e640 1 -- 172.21.15.64:0/2398204327 wait complete. 2023-10-14T12:30:16.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.101+0000 7fda8359e640 1 Processor -- start 2023-10-14T12:30:16.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.101+0000 7fda8359e640 1 -- start start 2023-10-14T12:30:16.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.102+0000 7fda8359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda840ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.102+0000 7fda8359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda841f5e20 0x7fda840a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.102+0000 7fda8359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda841f5280 0x7fda841f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.102+0000 7fda8359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda840a7990 con 0x7fda6c005180 2023-10-14T12:30:16.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.102+0000 7fda8359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda841f5c40 con 0x7fda841f5280 2023-10-14T12:30:16.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.102+0000 7fda8359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda84157250 con 0x7fda841f5e20 2023-10-14T12:30:16.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda840ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.112 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda840ad4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36638/0 (socket says 172.21.15.64:36638) 2023-10-14T12:30:16.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 -- 172.21.15.64:0/1987586017 learned_addr learned my addr 172.21.15.64:0/1987586017 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:16.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda81d9b640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda841f5e20 0x7fda840a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 -- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda841f5e20 msgr2=0x7fda840a7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda82d9d640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda841f5280 0x7fda841f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda841f5e20 0x7fda840a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 -- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda841f5280 msgr2=0x7fda841f5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda841f5280 0x7fda841f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 -- 172.21.15.64:0/1987586017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda84156ca0 con 0x7fda6c005180 2023-10-14T12:30:16.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.103+0000 7fda8259c640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda840ad4e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fda74011570 tx=0x7fda74011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:16.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.104+0000 7fda72ffd640 1 -- 172.21.15.64:0/1987586017 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74015870 con 0x7fda6c005180 2023-10-14T12:30:16.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.104+0000 7fda72ffd640 1 -- 172.21.15.64:0/1987586017 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda740159d0 con 0x7fda6c005180 2023-10-14T12:30:16.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.104+0000 7fda72ffd640 1 -- 172.21.15.64:0/1987586017 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda74015d40 con 0x7fda6c005180 2023-10-14T12:30:16.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.104+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda84156f70 con 0x7fda6c005180 2023-10-14T12:30:16.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.104+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda841548a0 con 0x7fda6c005180 2023-10-14T12:30:16.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.105+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda84154420 con 0x7fda6c005180 2023-10-14T12:30:16.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.106+0000 7fda72ffd640 1 -- 172.21.15.64:0/1987586017 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fda7401d400 con 0x7fda6c005180 2023-10-14T12:30:16.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.107+0000 7fda72ffd640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda6406ae70 0x7fda6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.107+0000 7fda72ffd640 1 -- 172.21.15.64:0/1987586017 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fda7408a150 con 0x7fda6c005180 2023-10-14T12:30:16.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.108+0000 7fda81d9b640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda6406ae70 0x7fda6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.109+0000 7fda81d9b640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda6406ae70 0x7fda6406d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda78007fd0 tx=0x7fda78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:16.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.111+0000 7fda72ffd640 1 -- 172.21.15.64:0/1987586017 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fda84154420 con 0x7fda6c005180 2023-10-14T12:30:16.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.304+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda84154420 con 0x7fda6c005180 2023-10-14T12:30:16.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.307+0000 7fda72ffd640 1 -- 172.21.15.64:0/1987586017 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fda84154420 con 0x7fda6c005180 2023-10-14T12:30:16.308 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:16.308 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:16.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda6406ae70 msgr2=0x7fda6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda6406ae70 0x7fda6406d330 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fda78007fd0 tx=0x7fda78009040 comp rx=0 tx=0).stop 2023-10-14T12:30:16.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 msgr2=0x7fda840ad4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda840ad4e0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fda74011570 tx=0x7fda74011a30 comp rx=0 tx=0).stop 2023-10-14T12:30:16.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 shutdown_connections 2023-10-14T12:30:16.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda6406ae70 0x7fda6406d330 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fda841f5280 0x7fda841f5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fda841f5e20 0x7fda840a7450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 --2- 172.21.15.64:0/1987586017 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fda6c005180 0x7fda840ad4e0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 >> 172.21.15.64:0/1987586017 conn(0x7fda8406a470 msgr2=0x7fda840b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:16.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 shutdown_connections 2023-10-14T12:30:16.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.310+0000 7fda8359e640 1 -- 172.21.15.64:0/1987586017 wait complete. 2023-10-14T12:30:16.329 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-14T12:28:44.514967+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-14T12:28:45.533456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-10-14T12:28:49.141088+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-14T12:30:16.330 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:30:16.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.559+0000 7f40d50c3640 1 Processor -- start 2023-10-14T12:30:16.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.559+0000 7f40d50c3640 1 -- start start 2023-10-14T12:30:16.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.560+0000 7f40d50c3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f40d00b1a30 0x7f40d00cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.560+0000 7f40d50c3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00d0cd0 0x7f40d00d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.560+0000 7f40d50c3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d00cfc20 con 0x7f40d006b570 2023-10-14T12:30:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.560+0000 7f40d50c3640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d00d15f0 con 0x7f40d00b1a30 2023-10-14T12:30:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.560+0000 7f40d50c3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00cd4a0 con 0x7f40d00d0cd0 2023-10-14T12:30:16.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f40d00b1a30 0x7f40d00cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f40d00b1a30 0x7f40d00cdf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36652/0 (socket says 172.21.15.64:36652) 2023-10-14T12:30:16.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cffff640 1 -- 172.21.15.64:0/3667082808 learned_addr learned my addr 172.21.15.64:0/3667082808 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:16.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40d48c2640 1 --1- 172.21.15.64:0/3667082808 >> v1:172.21.15.64:6789/0 conn(0x7f40d006b570 0x7f40d006ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35136/0 (socket says 172.21.15.64:35136) 2023-10-14T12:30:16.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cf7fe640 1 --2- 172.21.15.64:0/3667082808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00d0cd0 0x7f40d00d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cffff640 1 -- 172.21.15.64:0/3667082808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00d0cd0 msgr2=0x7f40d00d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:16.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cffff640 1 --2- 172.21.15.64:0/3667082808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00d0cd0 0x7f40d00d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cffff640 1 -- 172.21.15.64:0/3667082808 >> v1:172.21.15.64:6789/0 conn(0x7f40d006b570 legacy=0x7f40d006ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.561+0000 7f40cffff640 1 -- 172.21.15.64:0/3667082808 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d00cd780 con 0x7f40d00b1a30 2023-10-14T12:30:16.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.562+0000 7f40cffff640 1 --2- 172.21.15.64:0/3667082808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00b1a30 0x7f40d00cdf80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009e50 tx=0x7f40c002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5590974fb966207 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:16.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40ceffd640 1 -- 172.21.15.64:0/3667082808 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c002cb00 con 0x7f40d00b1a30 2023-10-14T12:30:16.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40ceffd640 1 -- 172.21.15.64:0/3667082808 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c002cc60 con 0x7f40d00b1a30 2023-10-14T12:30:16.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40ceffd640 1 -- 172.21.15.64:0/3667082808 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00343f0 con 0x7f40d00b1a30 2023-10-14T12:30:16.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40d50c3640 1 -- 172.21.15.64:0/3667082808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00b1a30 msgr2=0x7f40d00cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40d50c3640 1 --2- 172.21.15.64:0/3667082808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00b1a30 0x7f40d00cdf80 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f40c0009e50 tx=0x7f40c002bf60 comp rx=0 tx=0).stop 2023-10-14T12:30:16.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40d50c3640 1 -- 172.21.15.64:0/3667082808 shutdown_connections 2023-10-14T12:30:16.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40d50c3640 1 --2- 172.21.15.64:0/3667082808 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00d0cd0 0x7f40d00d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40d50c3640 1 --2- 172.21.15.64:0/3667082808 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00b1a30 0x7f40d00cdf80 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40d50c3640 1 -- 172.21.15.64:0/3667082808 >> 172.21.15.64:0/3667082808 conn(0x7f40d008c140 msgr2=0x7f40d009ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:16.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.563+0000 7f40d50c3640 1 -- 172.21.15.64:0/3667082808 shutdown_connections 2023-10-14T12:30:16.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.564+0000 7f40d50c3640 1 -- 172.21.15.64:0/3667082808 wait complete. 2023-10-14T12:30:16.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.565+0000 7f40d50c3640 1 Processor -- start 2023-10-14T12:30:16.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.565+0000 7f40d50c3640 1 -- start start 2023-10-14T12:30:16.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.566+0000 7f40d50c3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d006b570 0x7f40d0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.566+0000 7f40d50c3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00b1a30 0x7f40d015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.566+0000 7f40d50c3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00d0cd0 0x7f40d0150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.566+0000 7f40d50c3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015dab0 con 0x7f40d00d0cd0 2023-10-14T12:30:16.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.566+0000 7f40d50c3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015ac40 con 0x7f40d006b570 2023-10-14T12:30:16.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.566+0000 7f40d50c3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d015ae70 con 0x7f40d00b1a30 2023-10-14T12:30:16.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00d0cd0 0x7f40d0150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00d0cd0 0x7f40d0150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36668/0 (socket says 172.21.15.64:36668) 2023-10-14T12:30:16.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 -- 172.21.15.64:0/163708403 learned_addr learned my addr 172.21.15.64:0/163708403 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:16.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40cf7fe640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00b1a30 0x7f40d015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40cffff640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d006b570 0x7f40d0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 -- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00b1a30 msgr2=0x7f40d015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00b1a30 0x7f40d015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 -- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d006b570 msgr2=0x7f40d0159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d006b570 0x7f40d0159dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40d48c2640 1 -- 172.21.15.64:0/163708403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009b30 con 0x7f40d00d0cd0 2023-10-14T12:30:16.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.567+0000 7f40cf7fe640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00b1a30 0x7f40d015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:16.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.568+0000 7f40d48c2640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00d0cd0 0x7f40d0150be0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f40c800c3c0 tx=0x7f40c8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:16.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.568+0000 7f40ccff9640 1 -- 172.21.15.64:0/163708403 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80074e0 con 0x7f40d00d0cd0 2023-10-14T12:30:16.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.568+0000 7f40ccff9640 1 -- 172.21.15.64:0/163708403 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c8007640 con 0x7f40d00d0cd0 2023-10-14T12:30:16.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.568+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d01f5cb0 con 0x7f40d00d0cd0 2023-10-14T12:30:16.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.568+0000 7f40ccff9640 1 -- 172.21.15.64:0/163708403 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8004a00 con 0x7f40d00d0cd0 2023-10-14T12:30:16.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.568+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d01f6270 con 0x7f40d00d0cd0 2023-10-14T12:30:16.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.569+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d004e9b0 con 0x7f40d00d0cd0 2023-10-14T12:30:16.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.570+0000 7f40ccff9640 1 -- 172.21.15.64:0/163708403 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f40c8004b60 con 0x7f40d00d0cd0 2023-10-14T12:30:16.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.571+0000 7f40ccff9640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f40bc06ae70 0x7f40bc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:16.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.571+0000 7f40ccff9640 1 -- 172.21.15.64:0/163708403 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40c8089340 con 0x7f40d00d0cd0 2023-10-14T12:30:16.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.572+0000 7f40cffff640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f40bc06ae70 0x7f40bc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:16.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.573+0000 7f40cffff640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f40bc06ae70 0x7f40bc06d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40c0035000 tx=0x7f40c0030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:16.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.575+0000 7f40ccff9640 1 -- 172.21.15.64:0/163708403 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f40c8054030 con 0x7f40d00d0cd0 2023-10-14T12:30:16.767 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.767+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40d00d3120 con 0x7f40d00d0cd0 2023-10-14T12:30:16.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.768+0000 7f40ccff9640 1 -- 172.21.15.64:0/163708403 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40c8057650 con 0x7f40d00d0cd0 2023-10-14T12:30:16.769 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:30:16.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f40bc06ae70 msgr2=0x7f40bc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f40bc06ae70 0x7f40bc06d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f40c0035000 tx=0x7f40c0030000 comp rx=0 tx=0).stop 2023-10-14T12:30:16.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00d0cd0 msgr2=0x7f40d0150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:16.771 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00d0cd0 0x7f40d0150be0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f40c800c3c0 tx=0x7f40c8001e70 comp rx=0 tx=0).stop 2023-10-14T12:30:16.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 shutdown_connections 2023-10-14T12:30:16.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f40bc06ae70 0x7f40bc06d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f40d00d0cd0 0x7f40d0150be0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f40d00b1a30 0x7f40d015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 --2- 172.21.15.64:0/163708403 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f40d006b570 0x7f40d0159dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.770+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 >> 172.21.15.64:0/163708403 conn(0x7f40d008c140 msgr2=0x7f40d00b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.771+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 shutdown_connections 2023-10-14T12:30:16.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:16.771+0000 7f40d50c3640 1 -- 172.21.15.64:0/163708403 wait complete. 2023-10-14T12:30:16.792 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-14T12:30:17.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.022+0000 7f9789fae640 1 Processor -- start 2023-10-14T12:30:17.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.022+0000 7f9789fae640 1 -- start start 2023-10-14T12:30:17.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f9789fae640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f97840ad940 0x7f978406c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f9789fae640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f978406cbf0 0x7f97840ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f9789fae640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9784159ca0 con 0x7f97840ca3a0 2023-10-14T12:30:17.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f9789fae640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97840b34c0 con 0x7f978406cbf0 2023-10-14T12:30:17.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f9789fae640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97840b2fd0 con 0x7f97840ad940 2023-10-14T12:30:17.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f9783fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f978406cbf0 0x7f97840ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f97897ad640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f97840ca3a0 0x7f978415d370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35148/0 (socket says 172.21.15.64:35148) 2023-10-14T12:30:17.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f9783fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f978406cbf0 0x7f97840ce9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36676/0 (socket says 172.21.15.64:36676) 2023-10-14T12:30:17.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.024+0000 7f97897ad640 1 -- 172.21.15.64:0/2818015597 learned_addr learned my addr 172.21.15.64:0/2818015597 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:17.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.025+0000 7f9788fac640 1 --2- 172.21.15.64:0/2818015597 >> v2:172.21.15.177:3300/0 conn(0x7f97840ad940 0x7f978406c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.025+0000 7f9783fff640 1 -- 172.21.15.64:0/2818015597 >> v2:172.21.15.177:3300/0 conn(0x7f97840ad940 msgr2=0x7f978406c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:17.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.025+0000 7f9783fff640 1 --2- 172.21.15.64:0/2818015597 >> v2:172.21.15.177:3300/0 conn(0x7f97840ad940 0x7f978406c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.025+0000 7f9783fff640 1 -- 172.21.15.64:0/2818015597 >> v1:172.21.15.64:6789/0 conn(0x7f97840ca3a0 legacy=0x7f978415d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.025+0000 7f9783fff640 1 -- 172.21.15.64:0/2818015597 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97840cac20 con 0x7f978406cbf0 2023-10-14T12:30:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.025+0000 7f97837fe640 1 -- 172.21.15.64:0/2818015597 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2153516227 0 0) 0x7f9784159ca0 con 0x7f97840ca3a0 2023-10-14T12:30:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.026+0000 7f9783fff640 1 --2- 172.21.15.64:0/2818015597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978406cbf0 0x7f97840ce9b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f978406d790 tx=0x7f977002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd919b9fcebdb27c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.026+0000 7f97837fe640 1 -- 172.21.15.64:0/2818015597 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770031830 con 0x7f978406cbf0 2023-10-14T12:30:17.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.026+0000 7f97837fe640 1 -- 172.21.15.64:0/2818015597 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9770031990 con 0x7f978406cbf0 2023-10-14T12:30:17.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.026+0000 7f97837fe640 1 -- 172.21.15.64:0/2818015597 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9770031d20 con 0x7f978406cbf0 2023-10-14T12:30:17.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 -- 172.21.15.64:0/2818015597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978406cbf0 msgr2=0x7f97840ce9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 --2- 172.21.15.64:0/2818015597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978406cbf0 0x7f97840ce9b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f978406d790 tx=0x7f977002b8d0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 -- 172.21.15.64:0/2818015597 shutdown_connections 2023-10-14T12:30:17.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 --2- 172.21.15.64:0/2818015597 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978406cbf0 0x7f97840ce9b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 --2- 172.21.15.64:0/2818015597 >> v2:172.21.15.177:3300/0 conn(0x7f97840ad940 0x7f978406c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 -- 172.21.15.64:0/2818015597 >> 172.21.15.64:0/2818015597 conn(0x7f978406a200 msgr2=0x7f978406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:17.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 -- 172.21.15.64:0/2818015597 shutdown_connections 2023-10-14T12:30:17.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.027+0000 7f9789fae640 1 -- 172.21.15.64:0/2818015597 wait complete. 2023-10-14T12:30:17.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.029+0000 7f9789fae640 1 Processor -- start 2023-10-14T12:30:17.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.029+0000 7f9789fae640 1 -- start start 2023-10-14T12:30:17.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.030+0000 7f9789fae640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97840ad940 0x7f9784097570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.030+0000 7f9789fae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97840ca3a0 0x7f978415bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.030+0000 7f9789fae640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978414f770 0x7f97840c1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.030+0000 7f9789fae640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97840ae8e0 con 0x7f978414f770 2023-10-14T12:30:17.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.030+0000 7f9789fae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9784097ab0 con 0x7f97840ca3a0 2023-10-14T12:30:17.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.030+0000 7f9789fae640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f978415c2e0 con 0x7f97840ad940 2023-10-14T12:30:17.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.030+0000 7f97897ad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978414f770 0x7f97840c1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978414f770 0x7f97840c1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36680/0 (socket says 172.21.15.64:36680) 2023-10-14T12:30:17.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 -- 172.21.15.64:0/3450117643 learned_addr learned my addr 172.21.15.64:0/3450117643 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:17.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f9783fff640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97840ca3a0 0x7f978415bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 -- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97840ad940 msgr2=0x7f9784097570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97840ad940 0x7f9784097570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 -- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97840ca3a0 msgr2=0x7f978415bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97840ca3a0 0x7f978415bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 -- 172.21.15.64:0/3450117643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9770009400 con 0x7f978414f770 2023-10-14T12:30:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f9783fff640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97840ca3a0 0x7f978415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97897ad640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978414f770 0x7f97840c1c40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c780 tx=0x7f977c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.031+0000 7f97817fa640 1 -- 172.21.15.64:0/3450117643 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00ce90 con 0x7f978414f770 2023-10-14T12:30:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.032+0000 7f97817fa640 1 -- 172.21.15.64:0/3450117643 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f977c00a640 con 0x7f978414f770 2023-10-14T12:30:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.032+0000 7f97817fa640 1 -- 172.21.15.64:0/3450117643 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f977c00a9d0 con 0x7f978414f770 2023-10-14T12:30:17.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.032+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f978415c560 con 0x7f978414f770 2023-10-14T12:30:17.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.032+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f978415cb20 con 0x7f978414f770 2023-10-14T12:30:17.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.033+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f978415cd10 con 0x7f978414f770 2023-10-14T12:30:17.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.034+0000 7f97817fa640 1 -- 172.21.15.64:0/3450117643 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f977c00ab30 con 0x7f978414f770 2023-10-14T12:30:17.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.035+0000 7f97817fa640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f976806ae70 0x7f976806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.035+0000 7f97817fa640 1 -- 172.21.15.64:0/3450117643 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f977c088fe0 con 0x7f978414f770 2023-10-14T12:30:17.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.035+0000 7f9788fac640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f976806ae70 0x7f976806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.037+0000 7f9788fac640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f976806ae70 0x7f976806d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97780098f0 tx=0x7f9778008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.039+0000 7f97817fa640 1 -- 172.21.15.64:0/3450117643 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f977c053be0 con 0x7f978414f770 2023-10-14T12:30:17.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.233+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f97840aea20 con 0x7f978414f770 2023-10-14T12:30:17.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.234+0000 7f97817fa640 1 -- 172.21.15.64:0/3450117643 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f97840aea20 con 0x7f978414f770 2023-10-14T12:30:17.235 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:17.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.236+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f976806ae70 msgr2=0x7f976806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.236+0000 7f9789fae640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f976806ae70 0x7f976806d330 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f97780098f0 tx=0x7f9778008040 comp rx=0 tx=0).stop 2023-10-14T12:30:17.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.236+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978414f770 msgr2=0x7f97840c1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.236+0000 7f9789fae640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978414f770 0x7f97840c1c40 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f977c00c780 tx=0x7f977c00cc40 comp rx=0 tx=0).stop 2023-10-14T12:30:17.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 shutdown_connections 2023-10-14T12:30:17.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f976806ae70 0x7f976806d330 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f978414f770 0x7f97840c1c40 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f97840ca3a0 0x7f978415bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 --2- 172.21.15.64:0/3450117643 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f97840ad940 0x7f9784097570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 >> 172.21.15.64:0/3450117643 conn(0x7f978406a200 msgr2=0x7f97840708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:17.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 shutdown_connections 2023-10-14T12:30:17.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.237+0000 7f9789fae640 1 -- 172.21.15.64:0/3450117643 wait complete. 2023-10-14T12:30:17.257 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-14T12:30:17.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.487+0000 7fb528a38640 1 Processor -- start 2023-10-14T12:30:17.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.487+0000 7fb528a38640 1 -- start start 2023-10-14T12:30:17.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.489+0000 7fb528a38640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb52415c940 0x7fb5240d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.489+0000 7fb528a38640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb5240d0d80 0x7fb5240d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.489+0000 7fb528a38640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5240ce810 con 0x7fb524160520 2023-10-14T12:30:17.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.489+0000 7fb528a38640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240d1740 con 0x7fb5240d0d80 2023-10-14T12:30:17.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.489+0000 7fb528a38640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5240b5b40 con 0x7fb52415c940 2023-10-14T12:30:17.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.489+0000 7fb51bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb5240d0d80 0x7fb5240d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.489+0000 7fb51bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb5240d0d80 0x7fb5240d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36696/0 (socket says 172.21.15.64:36696) 2023-10-14T12:30:17.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.490+0000 7fb51bfff640 1 -- 172.21.15.64:0/1923843057 learned_addr learned my addr 172.21.15.64:0/1923843057 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:17.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.490+0000 7fb522d9d640 1 --2- 172.21.15.64:0/1923843057 >> v2:172.21.15.177:3300/0 conn(0x7fb52415c940 0x7fb5240d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.490+0000 7fb51bfff640 1 -- 172.21.15.64:0/1923843057 >> v2:172.21.15.177:3300/0 conn(0x7fb52415c940 msgr2=0x7fb5240d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:17.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.490+0000 7fb51bfff640 1 --2- 172.21.15.64:0/1923843057 >> v2:172.21.15.177:3300/0 conn(0x7fb52415c940 0x7fb5240d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.490+0000 7fb51bfff640 1 -- 172.21.15.64:0/1923843057 >> v1:172.21.15.177:6789/0 conn(0x7fb524160520 legacy=0x7fb524160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:17.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.490+0000 7fb51bfff640 1 -- 172.21.15.64:0/1923843057 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5240ce250 con 0x7fb5240d0d80 2023-10-14T12:30:17.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.490+0000 7fb522d9d640 1 --2- 172.21.15.64:0/1923843057 >> v2:172.21.15.177:3300/0 conn(0x7fb52415c940 0x7fb5240d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:17.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.491+0000 7fb51bfff640 1 --2- 172.21.15.64:0/1923843057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5240d0d80 0x7fb5240d1200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb5240671a0 tx=0x7fb50c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17223049ae982cc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.492+0000 7fb52259c640 1 -- 172.21.15.64:0/1923843057 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c031800 con 0x7fb5240d0d80 2023-10-14T12:30:17.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.492+0000 7fb52259c640 1 -- 172.21.15.64:0/1923843057 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb50c031960 con 0x7fb5240d0d80 2023-10-14T12:30:17.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.492+0000 7fb52259c640 1 -- 172.21.15.64:0/1923843057 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb50c031cf0 con 0x7fb5240d0d80 2023-10-14T12:30:17.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.492+0000 7fb528a38640 1 -- 172.21.15.64:0/1923843057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5240d0d80 msgr2=0x7fb5240d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.492+0000 7fb528a38640 1 --2- 172.21.15.64:0/1923843057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5240d0d80 0x7fb5240d1200 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb5240671a0 tx=0x7fb50c02b8a0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.493+0000 7fb528a38640 1 -- 172.21.15.64:0/1923843057 shutdown_connections 2023-10-14T12:30:17.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.493+0000 7fb528a38640 1 --2- 172.21.15.64:0/1923843057 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb5240d0d80 0x7fb5240d1200 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.493+0000 7fb528a38640 1 --2- 172.21.15.64:0/1923843057 >> v2:172.21.15.177:3300/0 conn(0x7fb52415c940 0x7fb5240d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.493+0000 7fb528a38640 1 -- 172.21.15.64:0/1923843057 >> 172.21.15.64:0/1923843057 conn(0x7fb52409bb30 msgr2=0x7fb5240d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:17.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.493+0000 7fb528a38640 1 -- 172.21.15.64:0/1923843057 shutdown_connections 2023-10-14T12:30:17.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.493+0000 7fb528a38640 1 -- 172.21.15.64:0/1923843057 wait complete. 2023-10-14T12:30:17.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.495+0000 7fb528a38640 1 Processor -- start 2023-10-14T12:30:17.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.495+0000 7fb528a38640 1 -- start start 2023-10-14T12:30:17.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb528a38640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240d0d80 0x7fb5241f5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb528a38640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52415c940 0x7fb52415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb528a38640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb524160520 0x7fb524151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb528a38640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb52415e730 con 0x7fb524160520 2023-10-14T12:30:17.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb528a38640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241f6ad0 con 0x7fb52415c940 2023-10-14T12:30:17.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb528a38640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5241f6230 con 0x7fb5240d0d80 2023-10-14T12:30:17.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb52359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb524160520 0x7fb524151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb52359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb524160520 0x7fb524151c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36712/0 (socket says 172.21.15.64:36712) 2023-10-14T12:30:17.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb52359e640 1 -- 172.21.15.64:0/770276975 learned_addr learned my addr 172.21.15.64:0/770276975 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:17.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.496+0000 7fb51bfff640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52415c940 0x7fb52415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb522d9d640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240d0d80 0x7fb5241f5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb52359e640 1 -- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240d0d80 msgr2=0x7fb5241f5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb52359e640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240d0d80 0x7fb5241f5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb52359e640 1 -- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52415c940 msgr2=0x7fb52415e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb52359e640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52415c940 0x7fb52415e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb52359e640 1 -- 172.21.15.64:0/770276975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb50c0094d0 con 0x7fb524160520 2023-10-14T12:30:17.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb52359e640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb524160520 0x7fb524151c70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c780 tx=0x7fb51c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb51b7fe640 1 -- 172.21.15.64:0/770276975 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c004b60 con 0x7fb524160520 2023-10-14T12:30:17.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb51b7fe640 1 -- 172.21.15.64:0/770276975 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb51c00ce90 con 0x7fb524160520 2023-10-14T12:30:17.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb51b7fe640 1 -- 172.21.15.64:0/770276975 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb51c00a850 con 0x7fb524160520 2023-10-14T12:30:17.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.497+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5241f6510 con 0x7fb524160520 2023-10-14T12:30:17.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.498+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5240c7350 con 0x7fb524160520 2023-10-14T12:30:17.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.499+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5240c7540 con 0x7fb524160520 2023-10-14T12:30:17.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.500+0000 7fb51b7fe640 1 -- 172.21.15.64:0/770276975 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb51c00a9b0 con 0x7fb524160520 2023-10-14T12:30:17.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.500+0000 7fb51b7fe640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb50406ae70 0x7fb50406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.501+0000 7fb51b7fe640 1 -- 172.21.15.64:0/770276975 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb51c089b00 con 0x7fb524160520 2023-10-14T12:30:17.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.501+0000 7fb522d9d640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb50406ae70 0x7fb50406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.502+0000 7fb522d9d640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb50406ae70 0x7fb50406d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb514006fd0 tx=0x7fb514008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.505+0000 7fb51b7fe640 1 -- 172.21.15.64:0/770276975 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb51c054880 con 0x7fb524160520 2023-10-14T12:30:17.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.697+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb52404e9b0 con 0x7fb524160520 2023-10-14T12:30:17.699 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.698+0000 7fb51b7fe640 1 -- 172.21.15.64:0/770276975 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb51c057ea0 con 0x7fb524160520 2023-10-14T12:30:17.699 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T12:30:17.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.700+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb50406ae70 msgr2=0x7fb50406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.700+0000 7fb528a38640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb50406ae70 0x7fb50406d330 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb514006fd0 tx=0x7fb514008040 comp rx=0 tx=0).stop 2023-10-14T12:30:17.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb524160520 msgr2=0x7fb524151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb524160520 0x7fb524151c70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb51c00c780 tx=0x7fb51c00cc40 comp rx=0 tx=0).stop 2023-10-14T12:30:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 shutdown_connections 2023-10-14T12:30:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb50406ae70 0x7fb50406d330 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb524160520 0x7fb524151c70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb52415c940 0x7fb52415e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 --2- 172.21.15.64:0/770276975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb5240d0d80 0x7fb5241f5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 >> 172.21.15.64:0/770276975 conn(0x7fb52409bb30 msgr2=0x7fb5240d05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:17.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 shutdown_connections 2023-10-14T12:30:17.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.701+0000 7fb528a38640 1 -- 172.21.15.64:0/770276975 wait complete. 2023-10-14T12:30:17.722 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-10-14T12:30:17.952 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.951+0000 7fba4d09e640 1 Processor -- start 2023-10-14T12:30:17.953 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.952+0000 7fba4d09e640 1 -- start start 2023-10-14T12:30:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.953+0000 7fba4d09e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fba480cf0c0 0x7fba4815d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.953+0000 7fba4d09e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba48159ca0 con 0x7fba480ca3a0 2023-10-14T12:30:17.954 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.953+0000 7fba4d09e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba480cac20 con 0x7fba480ad940 2023-10-14T12:30:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.953+0000 7fba4d09e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba480b34c0 con 0x7fba480cf0c0 2023-10-14T12:30:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.954+0000 7fba4c89d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fba480cf0c0 0x7fba4815d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.954+0000 7fba4c89d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fba480cf0c0 0x7fba4815d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36724/0 (socket says 172.21.15.64:36724) 2023-10-14T12:30:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.954+0000 7fba4c89d640 1 -- 172.21.15.64:0/4112904832 learned_addr learned my addr 172.21.15.64:0/4112904832 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:17.955 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.954+0000 7fba477fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fba480ca3a0 0x7fba480ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35154/0 (socket says 172.21.15.64:35154) 2023-10-14T12:30:17.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.954+0000 7fba4c89d640 1 -- 172.21.15.64:0/4112904832 >> v1:172.21.15.177:6789/0 conn(0x7fba480ad940 legacy=0x7fba4806c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:17.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.954+0000 7fba4c89d640 1 -- 172.21.15.64:0/4112904832 >> v1:172.21.15.64:6789/0 conn(0x7fba480ca3a0 legacy=0x7fba480ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.954+0000 7fba4c89d640 1 -- 172.21.15.64:0/4112904832 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4806cdc0 con 0x7fba480cf0c0 2023-10-14T12:30:17.957 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.955+0000 7fba4c89d640 1 --2- 172.21.15.64:0/4112904832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480cf0c0 0x7fba4815d370 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba40009870 tx=0x7fba4002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d5c3f90714d424 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.955+0000 7fba46ffd640 1 -- 172.21.15.64:0/4112904832 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba40030860 con 0x7fba480cf0c0 2023-10-14T12:30:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.955+0000 7fba46ffd640 1 -- 172.21.15.64:0/4112904832 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba400309c0 con 0x7fba480cf0c0 2023-10-14T12:30:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.955+0000 7fba46ffd640 1 -- 172.21.15.64:0/4112904832 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba40030d50 con 0x7fba480cf0c0 2023-10-14T12:30:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.956+0000 7fba4d09e640 1 -- 172.21.15.64:0/4112904832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480cf0c0 msgr2=0x7fba4815d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.956+0000 7fba4d09e640 1 --2- 172.21.15.64:0/4112904832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480cf0c0 0x7fba4815d370 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fba40009870 tx=0x7fba4002b9a0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.956+0000 7fba4d09e640 1 -- 172.21.15.64:0/4112904832 shutdown_connections 2023-10-14T12:30:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.956+0000 7fba4d09e640 1 --2- 172.21.15.64:0/4112904832 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480cf0c0 0x7fba4815d370 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.956+0000 7fba4d09e640 1 -- 172.21.15.64:0/4112904832 >> 172.21.15.64:0/4112904832 conn(0x7fba4806a200 msgr2=0x7fba4806a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.956+0000 7fba4d09e640 1 -- 172.21.15.64:0/4112904832 shutdown_connections 2023-10-14T12:30:17.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.956+0000 7fba4d09e640 1 -- 172.21.15.64:0/4112904832 wait complete. 2023-10-14T12:30:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.958+0000 7fba4d09e640 1 Processor -- start 2023-10-14T12:30:17.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.958+0000 7fba4d09e640 1 -- start start 2023-10-14T12:30:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.959+0000 7fba4d09e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba480ad940 0x7fba4815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.959+0000 7fba4d09e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480ca3a0 0x7fba481f55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.959+0000 7fba4d09e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba480cf0c0 0x7fba481f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.959+0000 7fba4d09e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4815acb0 con 0x7fba480ca3a0 2023-10-14T12:30:17.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.959+0000 7fba4d09e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4815af90 con 0x7fba480ad940 2023-10-14T12:30:17.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.959+0000 7fba4d09e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4815b270 con 0x7fba480cf0c0 2023-10-14T12:30:17.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480ca3a0 0x7fba481f55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480ca3a0 0x7fba481f55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36728/0 (socket says 172.21.15.64:36728) 2023-10-14T12:30:17.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 -- 172.21.15.64:0/3594039673 learned_addr learned my addr 172.21.15.64:0/3594039673 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba47fff640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba480ad940 0x7fba4815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba4c89d640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba480cf0c0 0x7fba481f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 -- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba480cf0c0 msgr2=0x7fba481f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba480cf0c0 0x7fba481f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 -- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba480ad940 msgr2=0x7fba4815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba480ad940 0x7fba4815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 -- 172.21.15.64:0/3594039673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba400094d0 con 0x7fba480ca3a0 2023-10-14T12:30:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.960+0000 7fba477fe640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480ca3a0 0x7fba481f55b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c4d0 tx=0x7fba3c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.961+0000 7fba44ff9640 1 -- 172.21.15.64:0/3594039673 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c007480 con 0x7fba480ca3a0 2023-10-14T12:30:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.961+0000 7fba44ff9640 1 -- 172.21.15.64:0/3594039673 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba3c0075e0 con 0x7fba480ca3a0 2023-10-14T12:30:17.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.961+0000 7fba44ff9640 1 -- 172.21.15.64:0/3594039673 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3c0049e0 con 0x7fba480ca3a0 2023-10-14T12:30:17.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.961+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4815b550 con 0x7fba480ca3a0 2023-10-14T12:30:17.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.961+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4815a840 con 0x7fba480ca3a0 2023-10-14T12:30:17.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.962+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4815ba70 con 0x7fba480ca3a0 2023-10-14T12:30:17.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.963+0000 7fba44ff9640 1 -- 172.21.15.64:0/3594039673 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fba3c004b40 con 0x7fba480ca3a0 2023-10-14T12:30:17.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.964+0000 7fba44ff9640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fba3406ae70 0x7fba3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:17.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.964+0000 7fba44ff9640 1 -- 172.21.15.64:0/3594039673 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba3c088b50 con 0x7fba480ca3a0 2023-10-14T12:30:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.964+0000 7fba47fff640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fba3406ae70 0x7fba3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.966+0000 7fba47fff640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fba3406ae70 0x7fba3406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba38009f20 tx=0x7fba380094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:17.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:17.968+0000 7fba44ff9640 1 -- 172.21.15.64:0/3594039673 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fba4815ba70 con 0x7fba480ca3a0 2023-10-14T12:30:18.167 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.166+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fba4815ba70 con 0x7fba480ca3a0 2023-10-14T12:30:18.168 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.167+0000 7fba44ff9640 1 -- 172.21.15.64:0/3594039673 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fba4815ba70 con 0x7fba480ca3a0 2023-10-14T12:30:18.168 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T12:30:18.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fba3406ae70 msgr2=0x7fba3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fba3406ae70 0x7fba3406d330 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fba38009f20 tx=0x7fba380094d0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480ca3a0 msgr2=0x7fba481f55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480ca3a0 0x7fba481f55b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00c4d0 tx=0x7fba3c00c990 comp rx=0 tx=0).stop 2023-10-14T12:30:18.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 shutdown_connections 2023-10-14T12:30:18.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fba3406ae70 0x7fba3406d330 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fba480cf0c0 0x7fba481f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fba480ca3a0 0x7fba481f55b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 --2- 172.21.15.64:0/3594039673 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fba480ad940 0x7fba4815bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 >> 172.21.15.64:0/3594039673 conn(0x7fba4806a200 msgr2=0x7fba480ab150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:18.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 shutdown_connections 2023-10-14T12:30:18.173 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.170+0000 7fba4d09e640 1 -- 172.21.15.64:0/3594039673 wait complete. 2023-10-14T12:30:18.190 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:30:18.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.415+0000 7f6f21b1a640 1 Processor -- start 2023-10-14T12:30:18.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.415+0000 7f6f21b1a640 1 -- start start 2023-10-14T12:30:18.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f21b1a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6f1c15a8d0 0x7f6f1c0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f21b1a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c0ca660 0x7f6f1c0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f21b1a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f1c15acb0 con 0x7f6f1c06ff40 2023-10-14T12:30:18.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f21b1a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f1c0c1c60 con 0x7f6f1c15a8d0 2023-10-14T12:30:18.418 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f21b1a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c15e350 con 0x7f6f1c0ca660 2023-10-14T12:30:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f20b18640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6f1c15a8d0 0x7f6f1c0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f20b18640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6f1c15a8d0 0x7f6f1c0cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36740/0 (socket says 172.21.15.64:36740) 2023-10-14T12:30:18.419 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f20b18640 1 -- 172.21.15.64:0/4025065491 learned_addr learned my addr 172.21.15.64:0/4025065491 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:18.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.417+0000 7f6f13fff640 1 --2- 172.21.15.64:0/4025065491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c0ca660 0x7f6f1c0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.418+0000 7f6f20b18640 1 -- 172.21.15.64:0/4025065491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c0ca660 msgr2=0x7f6f1c0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:18.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.418+0000 7f6f20b18640 1 --2- 172.21.15.64:0/4025065491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c0ca660 0x7f6f1c0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.420 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.418+0000 7f6f20b18640 1 -- 172.21.15.64:0/4025065491 >> v1:172.21.15.177:6789/0 conn(0x7f6f1c06ff40 legacy=0x7f6f1c06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:18.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.418+0000 7f6f20b18640 1 -- 172.21.15.64:0/4025065491 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f1c15e630 con 0x7f6f1c15a8d0 2023-10-14T12:30:18.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.419+0000 7f6f20b18640 1 --2- 172.21.15.64:0/4025065491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c15a8d0 0x7f6f1c0cab40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009ea0 tx=0x7f6f1802bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfc3859fbbe8f644 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:18.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.419+0000 7f6f137fe640 1 -- 172.21.15.64:0/4025065491 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f1802cab0 con 0x7f6f1c15a8d0 2023-10-14T12:30:18.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.419+0000 7f6f137fe640 1 -- 172.21.15.64:0/4025065491 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f1802cc10 con 0x7f6f1c15a8d0 2023-10-14T12:30:18.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.419+0000 7f6f137fe640 1 -- 172.21.15.64:0/4025065491 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f180343f0 con 0x7f6f1c15a8d0 2023-10-14T12:30:18.422 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 -- 172.21.15.64:0/4025065491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c15a8d0 msgr2=0x7f6f1c0cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/4025065491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c15a8d0 0x7f6f1c0cab40 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009ea0 tx=0x7f6f1802bf10 comp rx=0 tx=0).stop 2023-10-14T12:30:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 -- 172.21.15.64:0/4025065491 shutdown_connections 2023-10-14T12:30:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/4025065491 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c0ca660 0x7f6f1c0cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/4025065491 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c15a8d0 0x7f6f1c0cab40 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 -- 172.21.15.64:0/4025065491 >> 172.21.15.64:0/4025065491 conn(0x7f6f1c06a470 msgr2=0x7f6f1c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:18.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 -- 172.21.15.64:0/4025065491 shutdown_connections 2023-10-14T12:30:18.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.420+0000 7f6f21b1a640 1 -- 172.21.15.64:0/4025065491 wait complete. 2023-10-14T12:30:18.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.422+0000 7f6f21b1a640 1 Processor -- start 2023-10-14T12:30:18.424 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.422+0000 7f6f21b1a640 1 -- start start 2023-10-14T12:30:18.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f21b1a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f1c06ff40 0x7f6f1c149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f21b1a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c0ca660 0x7f6f1c14a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f21b1a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c15a8d0 0x7f6f1c0c3190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.426 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f21b1a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c1f6470 con 0x7f6f1c0ca660 2023-10-14T12:30:18.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f21b1a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c14a870 con 0x7f6f1c06ff40 2023-10-14T12:30:18.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f21b1a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f1c1f58f0 con 0x7f6f1c15a8d0 2023-10-14T12:30:18.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c0ca660 0x7f6f1c14a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c0ca660 0x7f6f1c14a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36754/0 (socket says 172.21.15.64:36754) 2023-10-14T12:30:18.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.423+0000 7f6f13fff640 1 -- 172.21.15.64:0/297044325 learned_addr learned my addr 172.21.15.64:0/297044325 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:18.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f13fff640 1 -- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c15a8d0 msgr2=0x7f6f1c0c3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f13fff640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c15a8d0 0x7f6f1c0c3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f13fff640 1 -- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f1c06ff40 msgr2=0x7f6f1c149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.428 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f13fff640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f1c06ff40 0x7f6f1c149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f13fff640 1 -- 172.21.15.64:0/297044325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18009b30 con 0x7f6f1c0ca660 2023-10-14T12:30:18.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f13fff640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c0ca660 0x7f6f1c14a330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00d800 tx=0x7f6f0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:18.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f117fa640 1 -- 172.21.15.64:0/297044325 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00b660 con 0x7f6f1c0ca660 2023-10-14T12:30:18.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f117fa640 1 -- 172.21.15.64:0/297044325 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c00b7c0 con 0x7f6f1c0ca660 2023-10-14T12:30:18.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f117fa640 1 -- 172.21.15.64:0/297044325 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00bb50 con 0x7f6f1c0ca660 2023-10-14T12:30:18.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.424+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f1c1f5bd0 con 0x7f6f1c0ca660 2023-10-14T12:30:18.430 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.425+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f1c1f6190 con 0x7f6f1c0ca660 2023-10-14T12:30:18.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.426+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f1c04e9b0 con 0x7f6f1c0ca660 2023-10-14T12:30:18.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.427+0000 7f6f117fa640 1 -- 172.21.15.64:0/297044325 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6f0c00bcb0 con 0x7f6f1c0ca660 2023-10-14T12:30:18.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.428+0000 7f6f117fa640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6f0806ae70 0x7f6f0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.428+0000 7f6f117fa640 1 -- 172.21.15.64:0/297044325 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f0c089fa0 con 0x7f6f1c0ca660 2023-10-14T12:30:18.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.428+0000 7f6f20b18640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6f0806ae70 0x7f6f0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.429+0000 7f6f20b18640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6f0806ae70 0x7f6f0806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f18035000 tx=0x7f6f1802e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:18.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.432+0000 7f6f117fa640 1 -- 172.21.15.64:0/297044325 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6f0c054c80 con 0x7f6f1c0ca660 2023-10-14T12:30:18.667 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.666+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f1c0b0d70 con 0x7f6f1c0ca660 2023-10-14T12:30:18.668 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.667+0000 7f6f117fa640 1 -- 172.21.15.64:0/297044325 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f6f0c0582a0 con 0x7f6f1c0ca660 2023-10-14T12:30:18.668 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:18.669 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:30:18.669 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:30:18.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6f0806ae70 msgr2=0x7f6f0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.671 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6f0806ae70 0x7f6f0806d330 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6f18035000 tx=0x7f6f1802e000 comp rx=0 tx=0).stop 2023-10-14T12:30:18.671 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c0ca660 msgr2=0x7f6f1c14a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.671 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c0ca660 0x7f6f1c14a330 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c00d800 tx=0x7f6f0c00dcc0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 shutdown_connections 2023-10-14T12:30:18.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6f0806ae70 0x7f6f0806d330 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6f1c15a8d0 0x7f6f1c0c3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6f1c0ca660 0x7f6f1c14a330 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.672 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 --2- 172.21.15.64:0/297044325 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6f1c06ff40 0x7f6f1c149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 >> 172.21.15.64:0/297044325 conn(0x7f6f1c06a470 msgr2=0x7f6f1c0cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:18.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 shutdown_connections 2023-10-14T12:30:18.673 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.670+0000 7f6f21b1a640 1 -- 172.21.15.64:0/297044325 wait complete. 2023-10-14T12:30:18.690 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.922+0000 7fc940a90640 1 Processor -- start 2023-10-14T12:30:18.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.922+0000 7fc940a90640 1 -- start start 2023-10-14T12:30:18.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.924+0000 7fc940a90640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc93c0ca660 0x7fc93c0c9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.924+0000 7fc940a90640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c15acb0 con 0x7fc93c15a8d0 2023-10-14T12:30:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.924+0000 7fc940a90640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc93c0c1c60 con 0x7fc93c0cb250 2023-10-14T12:30:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.924+0000 7fc940a90640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc93c15e350 con 0x7fc93c0ca660 2023-10-14T12:30:18.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.924+0000 7fc93b7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fc93c15a8d0 0x7fc93c0cab40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35156/0 (socket says 172.21.15.64:35156) 2023-10-14T12:30:18.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.924+0000 7fc93b7fe640 1 -- 172.21.15.64:0/2136786678 learned_addr learned my addr 172.21.15.64:0/2136786678 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:18.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.925+0000 7fc93bfff640 1 --2- 172.21.15.64:0/2136786678 >> v2:172.21.15.177:3300/0 conn(0x7fc93c0ca660 0x7fc93c0c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.925+0000 7fc93affd640 1 -- 172.21.15.64:0/2136786678 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2360804895 0 0) 0x7fc92c001290 con 0x7fc93c15a8d0 2023-10-14T12:30:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.925+0000 7fc93affd640 1 -- 172.21.15.64:0/2136786678 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc928003520 con 0x7fc93c15a8d0 2023-10-14T12:30:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.925+0000 7fc93bfff640 1 -- 172.21.15.64:0/2136786678 >> v1:172.21.15.177:6789/0 conn(0x7fc93c0cb250 legacy=0x7fc93c0c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.925+0000 7fc93bfff640 1 -- 172.21.15.64:0/2136786678 >> v1:172.21.15.64:6789/0 conn(0x7fc93c15a8d0 legacy=0x7fc93c0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.927 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.925+0000 7fc93bfff640 1 -- 172.21.15.64:0/2136786678 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c15e630 con 0x7fc93c0ca660 2023-10-14T12:30:18.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.927+0000 7fc93bfff640 1 --2- 172.21.15.64:0/2136786678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0ca660 0x7fc93c0c9520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0c1df0 tx=0x7fc93402bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4649c7ab12818720 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:18.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.927+0000 7fc93affd640 1 -- 172.21.15.64:0/2136786678 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93402cce0 con 0x7fc93c0ca660 2023-10-14T12:30:18.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.927+0000 7fc93affd640 1 -- 172.21.15.64:0/2136786678 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93402ce40 con 0x7fc93c0ca660 2023-10-14T12:30:18.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.927+0000 7fc93affd640 1 -- 172.21.15.64:0/2136786678 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc934034660 con 0x7fc93c0ca660 2023-10-14T12:30:18.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.928+0000 7fc940a90640 1 -- 172.21.15.64:0/2136786678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0ca660 msgr2=0x7fc93c0c9520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.928+0000 7fc940a90640 1 --2- 172.21.15.64:0/2136786678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0ca660 0x7fc93c0c9520 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0c1df0 tx=0x7fc93402bf30 comp rx=0 tx=0).stop 2023-10-14T12:30:18.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.928+0000 7fc940a90640 1 -- 172.21.15.64:0/2136786678 shutdown_connections 2023-10-14T12:30:18.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.928+0000 7fc940a90640 1 --2- 172.21.15.64:0/2136786678 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0ca660 0x7fc93c0c9520 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.928+0000 7fc940a90640 1 -- 172.21.15.64:0/2136786678 >> 172.21.15.64:0/2136786678 conn(0x7fc93c06a470 msgr2=0x7fc93c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:18.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.928+0000 7fc940a90640 1 -- 172.21.15.64:0/2136786678 shutdown_connections 2023-10-14T12:30:18.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.928+0000 7fc940a90640 1 -- 172.21.15.64:0/2136786678 wait complete. 2023-10-14T12:30:18.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.930+0000 7fc940a90640 1 Processor -- start 2023-10-14T12:30:18.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.930+0000 7fc940a90640 1 -- start start 2023-10-14T12:30:18.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.931+0000 7fc940a90640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc93c0ca660 0x7fc93c0b0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.931+0000 7fc940a90640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0cb250 0x7fc93c158d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.931+0000 7fc940a90640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc93c15a8d0 0x7fc93c0ce350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.931+0000 7fc940a90640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c15b610 con 0x7fc93c0ca660 2023-10-14T12:30:18.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.931+0000 7fc940a90640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c1592b0 con 0x7fc93c0cb250 2023-10-14T12:30:18.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.931+0000 7fc940a90640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc93c15b330 con 0x7fc93c15a8d0 2023-10-14T12:30:18.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.931+0000 7fc93b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc93c0ca660 0x7fc93c0b0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc93c0ca660 0x7fc93c0b0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36768/0 (socket says 172.21.15.64:36768) 2023-10-14T12:30:18.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 -- 172.21.15.64:0/54607836 learned_addr learned my addr 172.21.15.64:0/54607836 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:18.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93bfff640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc93c15a8d0 0x7fc93c0ce350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc933fff640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0cb250 0x7fc93c158d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 -- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc93c15a8d0 msgr2=0x7fc93c0ce350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc93c15a8d0 0x7fc93c0ce350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 -- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0cb250 msgr2=0x7fc93c158d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:18.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0cb250 0x7fc93c158d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:18.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 -- 172.21.15.64:0/54607836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934009a70 con 0x7fc93c0ca660 2023-10-14T12:30:18.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.932+0000 7fc93b7fe640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc93c0ca660 0x7fc93c0b0f90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c400 tx=0x7fc92c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:18.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.933+0000 7fc938ff9640 1 -- 172.21.15.64:0/54607836 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0074e0 con 0x7fc93c0ca660 2023-10-14T12:30:18.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.933+0000 7fc938ff9640 1 -- 172.21.15.64:0/54607836 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92c007640 con 0x7fc93c0ca660 2023-10-14T12:30:18.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.933+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93c0c78c0 con 0x7fc93c0ca660 2023-10-14T12:30:18.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.933+0000 7fc938ff9640 1 -- 172.21.15.64:0/54607836 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92c0059c0 con 0x7fc93c0ca660 2023-10-14T12:30:18.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.933+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93c0c7e80 con 0x7fc93c0ca660 2023-10-14T12:30:18.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.934+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93c0c7720 con 0x7fc93c0ca660 2023-10-14T12:30:18.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.935+0000 7fc938ff9640 1 -- 172.21.15.64:0/54607836 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc92c005b20 con 0x7fc93c0ca660 2023-10-14T12:30:18.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.936+0000 7fc938ff9640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc91c06ae70 0x7fc91c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:18.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.936+0000 7fc938ff9640 1 -- 172.21.15.64:0/54607836 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc92c088fa0 con 0x7fc93c0ca660 2023-10-14T12:30:18.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.936+0000 7fc933fff640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc91c06ae70 0x7fc91c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:18.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.938+0000 7fc933fff640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc91c06ae70 0x7fc91c06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0ad530 tx=0x7fc924009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:18.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:18.940+0000 7fc938ff9640 1 -- 172.21.15.64:0/54607836 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc93c0c7720 con 0x7fc93c0ca660 2023-10-14T12:30:19.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.135+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc93c0c7720 con 0x7fc93c0ca660 2023-10-14T12:30:19.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.137+0000 7fc938ff9640 1 -- 172.21.15.64:0/54607836 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7fc93c0c7720 con 0x7fc93c0ca660 2023-10-14T12:30:19.138 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:19.138 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:19.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.139+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc91c06ae70 msgr2=0x7fc91c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.139+0000 7fc940a90640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc91c06ae70 0x7fc91c06d330 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc93c0ad530 tx=0x7fc924009040 comp rx=0 tx=0).stop 2023-10-14T12:30:19.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.139+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc93c0ca660 msgr2=0x7fc93c0b0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.139+0000 7fc940a90640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc93c0ca660 0x7fc93c0b0f90 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fc92c00c400 tx=0x7fc92c00c8c0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 shutdown_connections 2023-10-14T12:30:19.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc91c06ae70 0x7fc91c06d330 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc93c15a8d0 0x7fc93c0ce350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc93c0cb250 0x7fc93c158d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 --2- 172.21.15.64:0/54607836 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc93c0ca660 0x7fc93c0b0f90 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 >> 172.21.15.64:0/54607836 conn(0x7fc93c06a470 msgr2=0x7fc93c0cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:19.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 shutdown_connections 2023-10-14T12:30:19.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.140+0000 7fc940a90640 1 -- 172.21.15.64:0/54607836 wait complete. 2023-10-14T12:30:19.163 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T12:30:19.164 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:30:19.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.381+0000 7f4d0e9ae640 1 Processor -- start 2023-10-14T12:30:19.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.382+0000 7f4d0e9ae640 1 -- start start 2023-10-14T12:30:19.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.383+0000 7f4d0e9ae640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cdd90 0x7f4d080cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.383+0000 7f4d0e9ae640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d080cad30 0x7f4d080cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.383+0000 7f4d0e9ae640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d0815d570 con 0x7f4d0815cba0 2023-10-14T12:30:19.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.383+0000 7f4d0e9ae640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d080cb700 con 0x7f4d080cad30 2023-10-14T12:30:19.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.383+0000 7f4d0e9ae640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0815cf80 con 0x7f4d080cdd90 2023-10-14T12:30:19.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0d9ac640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f4d0815cba0 0x7f4d0815da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35172/0 (socket says 172.21.15.64:35172) 2023-10-14T12:30:19.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0d9ac640 1 -- 172.21.15.64:0/341280083 learned_addr learned my addr 172.21.15.64:0/341280083 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:19.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0e1ad640 1 --2- 172.21.15.64:0/341280083 >> v2:172.21.15.64:3300/0 conn(0x7f4d080cad30 0x7f4d080cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0d1ab640 1 --2- 172.21.15.64:0/341280083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cdd90 0x7f4d080cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0c9aa640 1 -- 172.21.15.64:0/341280083 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 498162326 0 0) 0x7f4d0815d570 con 0x7f4d0815cba0 2023-10-14T12:30:19.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0c9aa640 1 -- 172.21.15.64:0/341280083 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4cf4003520 con 0x7f4d0815cba0 2023-10-14T12:30:19.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0e1ad640 1 -- 172.21.15.64:0/341280083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cdd90 msgr2=0x7f4d080cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:19.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0e1ad640 1 --2- 172.21.15.64:0/341280083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cdd90 0x7f4d080cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0e1ad640 1 -- 172.21.15.64:0/341280083 >> v1:172.21.15.64:6789/0 conn(0x7f4d0815cba0 legacy=0x7f4d0815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.384+0000 7f4d0e1ad640 1 -- 172.21.15.64:0/341280083 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d080ccfc0 con 0x7f4d080cad30 2023-10-14T12:30:19.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.386+0000 7f4d0e1ad640 1 --2- 172.21.15.64:0/341280083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d080cad30 0x7f4d080cb1c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009d90 tx=0x7f4d0002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f755eaef76124792 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:19.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.386+0000 7f4d0c9aa640 1 -- 172.21.15.64:0/341280083 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0002cc50 con 0x7f4d080cad30 2023-10-14T12:30:19.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.386+0000 7f4d0c9aa640 1 -- 172.21.15.64:0/341280083 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0002cdb0 con 0x7f4d080cad30 2023-10-14T12:30:19.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.386+0000 7f4d0c9aa640 1 -- 172.21.15.64:0/341280083 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d00034660 con 0x7f4d080cad30 2023-10-14T12:30:19.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.386+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/341280083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d080cad30 msgr2=0x7f4d080cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.386+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/341280083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d080cad30 0x7f4d080cb1c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009d90 tx=0x7f4d0002bea0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.387+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/341280083 shutdown_connections 2023-10-14T12:30:19.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.387+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/341280083 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d080cad30 0x7f4d080cb1c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.387+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/341280083 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cdd90 0x7f4d080cc650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.387+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/341280083 >> 172.21.15.64:0/341280083 conn(0x7f4d0806a470 msgr2=0x7f4d080afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:19.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.387+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/341280083 shutdown_connections 2023-10-14T12:30:19.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.387+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/341280083 wait complete. 2023-10-14T12:30:19.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.388+0000 7f4d0e9ae640 1 Processor -- start 2023-10-14T12:30:19.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.389+0000 7f4d0e9ae640 1 -- start start 2023-10-14T12:30:19.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e9ae640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cad30 0x7f4d080c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e9ae640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d080cdd90 0x7f4d080c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e9ae640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d0815cba0 0x7f4d081f60e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e9ae640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0815da90 con 0x7f4d0815cba0 2023-10-14T12:30:19.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e9ae640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0815e540 con 0x7f4d080cdd90 2023-10-14T12:30:19.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e9ae640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d0815dca0 con 0x7f4d080cad30 2023-10-14T12:30:19.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d0815cba0 0x7f4d081f60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d0815cba0 0x7f4d081f60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36788/0 (socket says 172.21.15.64:36788) 2023-10-14T12:30:19.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 -- 172.21.15.64:0/1160351450 learned_addr learned my addr 172.21.15.64:0/1160351450 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:19.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0d9ac640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cad30 0x7f4d080c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0d1ab640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d080cdd90 0x7f4d080c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 -- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cad30 msgr2=0x7f4d080c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cad30 0x7f4d080c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 -- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d080cdd90 msgr2=0x7f4d080c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d080cdd90 0x7f4d080c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0e1ad640 1 -- 172.21.15.64:0/1160351450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d00009a70 con 0x7f4d0815cba0 2023-10-14T12:30:19.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.390+0000 7f4d0d1ab640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d080cdd90 0x7f4d080c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:19.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.391+0000 7f4d0e1ad640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d0815cba0 0x7f4d081f60e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009eb0 tx=0x7f4d00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:19.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.391+0000 7f4cfe7fc640 1 -- 172.21.15.64:0/1160351450 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0003e610 con 0x7f4d0815cba0 2023-10-14T12:30:19.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.391+0000 7f4cfe7fc640 1 -- 172.21.15.64:0/1160351450 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0003e770 con 0x7f4d0815cba0 2023-10-14T12:30:19.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.391+0000 7f4cfe7fc640 1 -- 172.21.15.64:0/1160351450 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0003eb20 con 0x7f4d0815cba0 2023-10-14T12:30:19.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.391+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d0815df80 con 0x7f4d0815cba0 2023-10-14T12:30:19.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.391+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d080b1050 con 0x7f4d0815cba0 2023-10-14T12:30:19.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.392+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d0804e9b0 con 0x7f4d0815cba0 2023-10-14T12:30:19.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.393+0000 7f4cfe7fc640 1 -- 172.21.15.64:0/1160351450 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d0003b050 con 0x7f4d0815cba0 2023-10-14T12:30:19.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.394+0000 7f4cfe7fc640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06ae70 0x7f4cec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.394+0000 7f4cfe7fc640 1 -- 172.21.15.64:0/1160351450 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d000abc10 con 0x7f4d0815cba0 2023-10-14T12:30:19.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.395+0000 7f4d0d9ac640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06ae70 0x7f4cec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.396+0000 7f4d0d9ac640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06ae70 0x7f4cec06d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d04001360 tx=0x7f4d04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:19.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.399+0000 7f4cfe7fc640 1 -- 172.21.15.64:0/1160351450 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d00076a20 con 0x7f4d0815cba0 2023-10-14T12:30:19.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.632+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d080b42f0 con 0x7f4d0815cba0 2023-10-14T12:30:19.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.633+0000 7f4cfe7fc640 1 -- 172.21.15.64:0/1160351450 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f4d00039090 con 0x7f4d0815cba0 2023-10-14T12:30:19.634 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:19.634 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:30:19.634 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:30:19.636 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06ae70 msgr2=0x7f4cec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06ae70 0x7f4cec06d330 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d04001360 tx=0x7f4d04009040 comp rx=0 tx=0).stop 2023-10-14T12:30:19.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d0815cba0 msgr2=0x7f4d081f60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d0815cba0 0x7f4d081f60e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4d00009eb0 tx=0x7f4d00004a40 comp rx=0 tx=0).stop 2023-10-14T12:30:19.637 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 shutdown_connections 2023-10-14T12:30:19.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4cec06ae70 0x7f4cec06d330 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d0815cba0 0x7f4d081f60e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d080cdd90 0x7f4d080c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 --2- 172.21.15.64:0/1160351450 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d080cad30 0x7f4d080c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.638 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 >> 172.21.15.64:0/1160351450 conn(0x7f4d0806a470 msgr2=0x7f4d0806fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:19.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 shutdown_connections 2023-10-14T12:30:19.639 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.636+0000 7f4d0e9ae640 1 -- 172.21.15.64:0/1160351450 wait complete. 2023-10-14T12:30:19.654 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:30:19.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.870+0000 7f2c0a6d7640 1 Processor -- start 2023-10-14T12:30:19.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.870+0000 7f2c0a6d7640 1 -- start start 2023-10-14T12:30:19.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.871+0000 7f2c0a6d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c040c9e00 0x7f2c040c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.872 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.871+0000 7f2c0a6d7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2c04071800 0x7f2c040cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.872+0000 7f2c0a6d7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c04071e40 con 0x7f2c040ca1e0 2023-10-14T12:30:19.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.872+0000 7f2c0a6d7640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c04071c30 con 0x7f2c04071800 2023-10-14T12:30:19.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.872+0000 7f2c0a6d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040cde00 con 0x7f2c040c9e00 2023-10-14T12:30:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.872+0000 7f2c08c74640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2c04071800 0x7f2c040cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.872+0000 7f2c08c74640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2c04071800 0x7f2c040cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36794/0 (socket says 172.21.15.64:36794) 2023-10-14T12:30:19.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.872+0000 7f2c08c74640 1 -- 172.21.15.64:0/3306783633 learned_addr learned my addr 172.21.15.64:0/3306783633 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.872+0000 7f2c03fff640 1 --2- 172.21.15.64:0/3306783633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c040c9e00 0x7f2c040c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.873+0000 7f2c08c74640 1 -- 172.21.15.64:0/3306783633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c040c9e00 msgr2=0x7f2c040c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.873+0000 7f2c08c74640 1 --2- 172.21.15.64:0/3306783633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c040c9e00 0x7f2c040c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.873+0000 7f2c08c74640 1 -- 172.21.15.64:0/3306783633 >> v1:172.21.15.177:6789/0 conn(0x7f2c040ca1e0 legacy=0x7f2c040710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:19.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.873+0000 7f2c08c74640 1 -- 172.21.15.64:0/3306783633 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c04072120 con 0x7f2c04071800 2023-10-14T12:30:19.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.874+0000 7f2c08c74640 1 --2- 172.21.15.64:0/3306783633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c04071800 0x7f2c040cca00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009870 tx=0x7f2bfc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbbd4e84a3e98f36 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.874+0000 7f2c02ffd640 1 -- 172.21.15.64:0/3306783633 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc031640 con 0x7f2c04071800 2023-10-14T12:30:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.874+0000 7f2c02ffd640 1 -- 172.21.15.64:0/3306783633 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bfc0317a0 con 0x7f2c04071800 2023-10-14T12:30:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.874+0000 7f2c02ffd640 1 -- 172.21.15.64:0/3306783633 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc031b30 con 0x7f2c04071800 2023-10-14T12:30:19.877 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/3306783633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c04071800 msgr2=0x7f2c040cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/3306783633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c04071800 0x7f2c040cca00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc009870 tx=0x7f2bfc02b8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/3306783633 shutdown_connections 2023-10-14T12:30:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/3306783633 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c04071800 0x7f2c040cca00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/3306783633 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c040c9e00 0x7f2c040c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.878 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/3306783633 >> 172.21.15.64:0/3306783633 conn(0x7f2c0406c1c0 msgr2=0x7f2c0406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:19.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/3306783633 shutdown_connections 2023-10-14T12:30:19.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.875+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/3306783633 wait complete. 2023-10-14T12:30:19.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.877+0000 7f2c0a6d7640 1 Processor -- start 2023-10-14T12:30:19.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.877+0000 7f2c0a6d7640 1 -- start start 2023-10-14T12:30:19.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c0a6d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c04071800 0x7f2c040c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c0a6d7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c040c9e00 0x7f2c040b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c0a6d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040ca1e0 0x7f2c04154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c0a6d7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040b10b0 con 0x7f2c040c9e00 2023-10-14T12:30:19.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c0a6d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c041549b0 con 0x7f2c040ca1e0 2023-10-14T12:30:19.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c0a6d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c040c9590 con 0x7f2c04071800 2023-10-14T12:30:19.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c037fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c040c9e00 0x7f2c040b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c037fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c040c9e00 0x7f2c040b0080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36804/0 (socket says 172.21.15.64:36804) 2023-10-14T12:30:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.878+0000 7f2c037fe640 1 -- 172.21.15.64:0/2379729021 learned_addr learned my addr 172.21.15.64:0/2379729021 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c03fff640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c04071800 0x7f2c040c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c08c74640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040ca1e0 0x7f2c04154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c037fe640 1 -- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c04071800 msgr2=0x7f2c040c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c037fe640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c04071800 0x7f2c040c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c037fe640 1 -- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040ca1e0 msgr2=0x7f2c04154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:19.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c037fe640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040ca1e0 0x7f2c04154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:19.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c037fe640 1 -- 172.21.15.64:0/2379729021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bfc0094d0 con 0x7f2c040c9e00 2023-10-14T12:30:19.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c08c74640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040ca1e0 0x7f2c04154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:19.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c037fe640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c040c9e00 0x7f2c040b0080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c430 tx=0x7f2bf800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:19.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c00ff9640 1 -- 172.21.15.64:0/2379729021 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8011790 con 0x7f2c040c9e00 2023-10-14T12:30:19.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c00ff9640 1 -- 172.21.15.64:0/2379729021 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bf80118f0 con 0x7f2c040c9e00 2023-10-14T12:30:19.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c00ff9640 1 -- 172.21.15.64:0/2379729021 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bf8011ca0 con 0x7f2c040c9e00 2023-10-14T12:30:19.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.879+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c040c9870 con 0x7f2c040c9e00 2023-10-14T12:30:19.886 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.880+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c040b0cd0 con 0x7f2c040c9e00 2023-10-14T12:30:19.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.881+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c040c1930 con 0x7f2c040c9e00 2023-10-14T12:30:19.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.882+0000 7f2c00ff9640 1 -- 172.21.15.64:0/2379729021 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2bf801c460 con 0x7f2c040c9e00 2023-10-14T12:30:19.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.883+0000 7f2c00ff9640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2bf006ae70 0x7f2bf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:19.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.883+0000 7f2c00ff9640 1 -- 172.21.15.64:0/2379729021 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2bf8089980 con 0x7f2c040c9e00 2023-10-14T12:30:19.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.884+0000 7f2c03fff640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2bf006ae70 0x7f2bf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:19.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.885+0000 7f2c03fff640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2bf006ae70 0x7f2bf006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009f30 tx=0x7f2bf400b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:19.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:19.888+0000 7f2c00ff9640 1 -- 172.21.15.64:0/2379729021 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2bf8054670 con 0x7f2c040c9e00 2023-10-14T12:30:20.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.125+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2c040723d0 con 0x7f2c040c9e00 2023-10-14T12:30:20.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.127+0000 7f2c00ff9640 1 -- 172.21.15.64:0/2379729021 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4903 (secure 0 0 0) 0x7f2bf8057c90 con 0x7f2c040c9e00 2023-10-14T12:30:20.128 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:20.128 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4239,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/360222870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":360222870},{"type":"v1","addr":"172.21.15.64:6833","nonce":360222870}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/3770643728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3770643728},{"type":"v1","addr":"172.21.15.64:6835","nonce":3770643728}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4264,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/89946543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":89946543},{"type":"v1","addr":"172.21.15.177:6836","nonce":89946543}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:28:46.535748+0000","modified":"2023-10-14T12:29:07.332595+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.177:6837/150618122","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":150618122},{"type":"v1","addr":"172.21.15.177:6837","nonce":150618122}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-10-14T12:30:20.128 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 9 2023-10-14T12:30:20.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2bf006ae70 msgr2=0x7f2bf006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2bf006ae70 0x7f2bf006d330 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4009f30 tx=0x7f2bf400b040 comp rx=0 tx=0).stop 2023-10-14T12:30:20.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c040c9e00 msgr2=0x7f2c040b0080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c040c9e00 0x7f2c040b0080 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f2bf800c430 tx=0x7f2bf800c8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 shutdown_connections 2023-10-14T12:30:20.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2bf006ae70 0x7f2bf006d330 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c040ca1e0 0x7f2c04154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c040c9e00 0x7f2c040b0080 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.129+0000 7f2c0a6d7640 1 --2- 172.21.15.64:0/2379729021 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c04071800 0x7f2c040c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.130+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 >> 172.21.15.64:0/2379729021 conn(0x7f2c0406c1c0 msgr2=0x7f2c040ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:20.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.130+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 shutdown_connections 2023-10-14T12:30:20.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.130+0000 7f2c0a6d7640 1 -- 172.21.15.64:0/2379729021 wait complete. 2023-10-14T12:30:20.148 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:20.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.369+0000 7ff35b59e640 1 Processor -- start 2023-10-14T12:30:20.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.369+0000 7ff35b59e640 1 -- start start 2023-10-14T12:30:20.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35b59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff35c0d16a0 0x7ff35c0cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35b59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff35c0cf680 0x7ff35c0b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35b59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0cfa90 con 0x7ff35c15c9d0 2023-10-14T12:30:20.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35b59e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0d0320 con 0x7ff35c0cf680 2023-10-14T12:30:20.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35b59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0d0600 con 0x7ff35c0d16a0 2023-10-14T12:30:20.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35ad9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff35c0cf680 0x7ff35c0b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35ad9d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff35c0cf680 0x7ff35c0b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36810/0 (socket says 172.21.15.64:36810) 2023-10-14T12:30:20.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.370+0000 7ff35ad9d640 1 -- 172.21.15.64:0/3095797582 learned_addr learned my addr 172.21.15.64:0/3095797582 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:20.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.371+0000 7ff359d9b640 1 --2- 172.21.15.64:0/3095797582 >> v2:172.21.15.177:3300/0 conn(0x7ff35c0d16a0 0x7ff35c0cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.371+0000 7ff35ad9d640 1 -- 172.21.15.64:0/3095797582 >> v2:172.21.15.177:3300/0 conn(0x7ff35c0d16a0 msgr2=0x7ff35c0cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:20.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.371+0000 7ff35ad9d640 1 --2- 172.21.15.64:0/3095797582 >> v2:172.21.15.177:3300/0 conn(0x7ff35c0d16a0 0x7ff35c0cf140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.371+0000 7ff35ad9d640 1 -- 172.21.15.64:0/3095797582 >> v1:172.21.15.64:6789/0 conn(0x7ff35c15c9d0 legacy=0x7ff35c0cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.371+0000 7ff35ad9d640 1 -- 172.21.15.64:0/3095797582 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c0d08e0 con 0x7ff35c0cf680 2023-10-14T12:30:20.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.371+0000 7ff359d9b640 1 --2- 172.21.15.64:0/3095797582 >> v2:172.21.15.177:3300/0 conn(0x7ff35c0d16a0 0x7ff35c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:20.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.372+0000 7ff35ad9d640 1 --2- 172.21.15.64:0/3095797582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c0cf680 0x7ff35c0b1f80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff35c08bc00 tx=0x7ff35402b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a604b73c672362e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:20.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.372+0000 7ff35959a640 1 -- 172.21.15.64:0/3095797582 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354030870 con 0x7ff35c0cf680 2023-10-14T12:30:20.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.372+0000 7ff35959a640 1 -- 172.21.15.64:0/3095797582 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3540309d0 con 0x7ff35c0cf680 2023-10-14T12:30:20.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.372+0000 7ff35959a640 1 -- 172.21.15.64:0/3095797582 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354030d60 con 0x7ff35c0cf680 2023-10-14T12:30:20.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 -- 172.21.15.64:0/3095797582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c0cf680 msgr2=0x7ff35c0b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 --2- 172.21.15.64:0/3095797582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c0cf680 0x7ff35c0b1f80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff35c08bc00 tx=0x7ff35402b9b0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 -- 172.21.15.64:0/3095797582 shutdown_connections 2023-10-14T12:30:20.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 --2- 172.21.15.64:0/3095797582 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c0cf680 0x7ff35c0b1f80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 --2- 172.21.15.64:0/3095797582 >> v2:172.21.15.177:3300/0 conn(0x7ff35c0d16a0 0x7ff35c0cf140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 -- 172.21.15.64:0/3095797582 >> 172.21.15.64:0/3095797582 conn(0x7ff35c09bad0 msgr2=0x7ff35c0d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:20.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 -- 172.21.15.64:0/3095797582 shutdown_connections 2023-10-14T12:30:20.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.373+0000 7ff35b59e640 1 -- 172.21.15.64:0/3095797582 wait complete. 2023-10-14T12:30:20.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.375+0000 7ff35b59e640 1 Processor -- start 2023-10-14T12:30:20.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.375+0000 7ff35b59e640 1 -- start start 2023-10-14T12:30:20.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35b59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff35c0cf680 0x7ff35c09ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35b59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0d16a0 0x7ff35c0cc100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35b59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c15c9d0 0x7ff35c1f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35b59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1f31b0 con 0x7ff35c15c9d0 2023-10-14T12:30:20.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35b59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0ccc80 con 0x7ff35c0d16a0 2023-10-14T12:30:20.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35b59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0c9950 con 0x7ff35c0cf680 2023-10-14T12:30:20.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c15c9d0 0x7ff35c1f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c15c9d0 0x7ff35c1f57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36822/0 (socket says 172.21.15.64:36822) 2023-10-14T12:30:20.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 -- 172.21.15.64:0/2428586756 learned_addr learned my addr 172.21.15.64:0/2428586756 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:20.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff359d9b640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0d16a0 0x7ff35c0cc100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 -- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff35c0cf680 msgr2=0x7ff35c09ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff35c0cf680 0x7ff35c09ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 -- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0d16a0 msgr2=0x7ff35c0cc100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0d16a0 0x7ff35c0cc100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.376+0000 7ff35ad9d640 1 -- 172.21.15.64:0/2428586756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3540094d0 con 0x7ff35c15c9d0 2023-10-14T12:30:20.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.377+0000 7ff35ad9d640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c15c9d0 0x7ff35c1f57b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff35402b9f0 tx=0x7ff354004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:20.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.377+0000 7ff352ffd640 1 -- 172.21.15.64:0/2428586756 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff354030800 con 0x7ff35c15c9d0 2023-10-14T12:30:20.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.377+0000 7ff352ffd640 1 -- 172.21.15.64:0/2428586756 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff354043400 con 0x7ff35c15c9d0 2023-10-14T12:30:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.377+0000 7ff352ffd640 1 -- 172.21.15.64:0/2428586756 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3540437b0 con 0x7ff35c15c9d0 2023-10-14T12:30:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.377+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c0c9c30 con 0x7ff35c15c9d0 2023-10-14T12:30:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.377+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c0ca1f0 con 0x7ff35c15c9d0 2023-10-14T12:30:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.378+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c04e9b0 con 0x7ff35c15c9d0 2023-10-14T12:30:20.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.379+0000 7ff352ffd640 1 -- 172.21.15.64:0/2428586756 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff354043910 con 0x7ff35c15c9d0 2023-10-14T12:30:20.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.380+0000 7ff352ffd640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff33c06ae70 0x7ff33c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.380+0000 7ff352ffd640 1 -- 172.21.15.64:0/2428586756 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff35403e070 con 0x7ff35c15c9d0 2023-10-14T12:30:20.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.381+0000 7ff35a59c640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff33c06ae70 0x7ff33c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.382+0000 7ff35a59c640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff33c06ae70 0x7ff33c06d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff34c000f60 tx=0x7ff34c0079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:20.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.385+0000 7ff352ffd640 1 -- 172.21.15.64:0/2428586756 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff354077b50 con 0x7ff35c15c9d0 2023-10-14T12:30:20.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.573+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff35c0d3320 con 0x7ff35c15c9d0 2023-10-14T12:30:20.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.575+0000 7ff352ffd640 1 -- 172.21.15.64:0/2428586756 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18723 (secure 0 0 0) 0x7ff35407b170 con 0x7ff35c15c9d0 2023-10-14T12:30:20.576 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:20.576 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":29,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:29:32.795703+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-14T12:28:44.514967+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-14T12:28:45.533456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-10-14T12:28:49.141088+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.23","mappings":[{"from":3,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":1}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]},{"pgid":"4.1c","mappings":[{"from":1,"to":0}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:20.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.577+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff33c06ae70 msgr2=0x7ff33c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.577+0000 7ff35b59e640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff33c06ae70 0x7ff33c06d330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff34c000f60 tx=0x7ff34c0079b0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.577+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c15c9d0 msgr2=0x7ff35c1f57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.577+0000 7ff35b59e640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c15c9d0 0x7ff35c1f57b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff35402b9f0 tx=0x7ff354004730 comp rx=0 tx=0).stop 2023-10-14T12:30:20.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 shutdown_connections 2023-10-14T12:30:20.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff33c06ae70 0x7ff33c06d330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff35c15c9d0 0x7ff35c1f57b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff35c0d16a0 0x7ff35c0cc100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 --2- 172.21.15.64:0/2428586756 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff35c0cf680 0x7ff35c09ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 >> 172.21.15.64:0/2428586756 conn(0x7ff35c09bad0 msgr2=0x7ff35c0cebf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:20.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 shutdown_connections 2023-10-14T12:30:20.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.578+0000 7ff35b59e640 1 -- 172.21.15.64:0/2428586756 wait complete. 2023-10-14T12:30:20.597 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-14T12:30:20.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.825+0000 7f5304de4640 1 Processor -- start 2023-10-14T12:30:20.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.825+0000 7f5304de4640 1 -- start start 2023-10-14T12:30:20.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.826+0000 7f5304de4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f53000b2dd0 0x7f530006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.826+0000 7f5304de4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f53000ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.826+0000 7f5304de4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f530015f0d0 con 0x7f53000ceb40 2023-10-14T12:30:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.826+0000 7f5304de4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53000ceff0 con 0x7f53000b2dd0 2023-10-14T12:30:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.826+0000 7f5304de4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f530015e2b0 con 0x7f530006dc20 2023-10-14T12:30:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52fffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f53000ceb40 0x7f53000b1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35188/0 (socket says 172.21.15.64:35188) 2023-10-14T12:30:20.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52fffff640 1 -- 172.21.15.64:0/890612352 learned_addr learned my addr 172.21.15.64:0/890612352 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:20.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52ff7fe640 1 --2- 172.21.15.64:0/890612352 >> v2:172.21.15.64:3300/0 conn(0x7f53000b2dd0 0x7f530006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52feffd640 1 --2- 172.21.15.64:0/890612352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f53000ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52fe7fc640 1 -- 172.21.15.64:0/890612352 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639746932 0 0) 0x7f530015f0d0 con 0x7f53000ceb40 2023-10-14T12:30:20.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52fe7fc640 1 -- 172.21.15.64:0/890612352 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f52e8003520 con 0x7f53000ceb40 2023-10-14T12:30:20.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52ff7fe640 1 -- 172.21.15.64:0/890612352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 msgr2=0x7f53000ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:20.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52ff7fe640 1 --2- 172.21.15.64:0/890612352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f53000ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52ff7fe640 1 -- 172.21.15.64:0/890612352 >> v1:172.21.15.64:6789/0 conn(0x7f53000ceb40 legacy=0x7f53000b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.827+0000 7f52ff7fe640 1 -- 172.21.15.64:0/890612352 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530015ab50 con 0x7f53000b2dd0 2023-10-14T12:30:20.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f52ff7fe640 1 --2- 172.21.15.64:0/890612352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000b2dd0 0x7f530006d6e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009790 tx=0x7f52f002b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96e0b33498e1751 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:20.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f52fe7fc640 1 -- 172.21.15.64:0/890612352 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0031800 con 0x7f53000b2dd0 2023-10-14T12:30:20.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f52fe7fc640 1 -- 172.21.15.64:0/890612352 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f0031960 con 0x7f53000b2dd0 2023-10-14T12:30:20.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f52fe7fc640 1 -- 172.21.15.64:0/890612352 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0031cf0 con 0x7f53000b2dd0 2023-10-14T12:30:20.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f5304de4640 1 -- 172.21.15.64:0/890612352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000b2dd0 msgr2=0x7f530006d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f5304de4640 1 --2- 172.21.15.64:0/890612352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000b2dd0 0x7f530006d6e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f52f0009790 tx=0x7f52f002b8a0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f5304de4640 1 -- 172.21.15.64:0/890612352 shutdown_connections 2023-10-14T12:30:20.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f5304de4640 1 --2- 172.21.15.64:0/890612352 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f53000ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.829+0000 7f5304de4640 1 --2- 172.21.15.64:0/890612352 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000b2dd0 0x7f530006d6e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.830+0000 7f5304de4640 1 -- 172.21.15.64:0/890612352 >> 172.21.15.64:0/890612352 conn(0x7f5300069fc0 msgr2=0x7f530006a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:20.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.830+0000 7f5304de4640 1 -- 172.21.15.64:0/890612352 shutdown_connections 2023-10-14T12:30:20.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.830+0000 7f5304de4640 1 -- 172.21.15.64:0/890612352 wait complete. 2023-10-14T12:30:20.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.832+0000 7f5304de4640 1 Processor -- start 2023-10-14T12:30:20.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.832+0000 7f5304de4640 1 -- start start 2023-10-14T12:30:20.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f5304de4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f5300159590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f5304de4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53000b2dd0 0x7f53000c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f5304de4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000ceb40 0x7f53000ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f5304de4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c6dc0 con 0x7f53000ceb40 2023-10-14T12:30:20.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f5304de4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c70a0 con 0x7f53000b2dd0 2023-10-14T12:30:20.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f5304de4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000c7380 con 0x7f530006dc20 2023-10-14T12:30:20.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f52fffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000ceb40 0x7f53000ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f52fffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000ceb40 0x7f53000ae960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36826/0 (socket says 172.21.15.64:36826) 2023-10-14T12:30:20.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.833+0000 7f52fffff640 1 -- 172.21.15.64:0/1348153994 learned_addr learned my addr 172.21.15.64:0/1348153994 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:20.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52ff7fe640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f5300159590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52feffd640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53000b2dd0 0x7f53000c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52fffff640 1 -- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 msgr2=0x7f5300159590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52fffff640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f5300159590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52fffff640 1 -- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53000b2dd0 msgr2=0x7f53000c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:20.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52fffff640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53000b2dd0 0x7f53000c64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:20.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52fffff640 1 -- 172.21.15.64:0/1348153994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f00093a0 con 0x7f53000ceb40 2023-10-14T12:30:20.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52fffff640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000ceb40 0x7f53000ae960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f52f800c9f0 tx=0x7f52f800ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:20.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52e7fff640 1 -- 172.21.15.64:0/1348153994 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f800ab70 con 0x7f53000ceb40 2023-10-14T12:30:20.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52e7fff640 1 -- 172.21.15.64:0/1348153994 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f800acd0 con 0x7f53000ceb40 2023-10-14T12:30:20.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f530015aeb0 con 0x7f53000ceb40 2023-10-14T12:30:20.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.834+0000 7f52e7fff640 1 -- 172.21.15.64:0/1348153994 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f8012600 con 0x7f53000ceb40 2023-10-14T12:30:20.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.835+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53000c8180 con 0x7f53000ceb40 2023-10-14T12:30:20.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.836+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53000c8460 con 0x7f53000ceb40 2023-10-14T12:30:20.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.836+0000 7f52e7fff640 1 -- 172.21.15.64:0/1348153994 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f52f8007070 con 0x7f53000ceb40 2023-10-14T12:30:20.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.838+0000 7f52e7fff640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52ec06aec0 0x7f52ec06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:20.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.838+0000 7f52e7fff640 1 -- 172.21.15.64:0/1348153994 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f52f8089770 con 0x7f53000ceb40 2023-10-14T12:30:20.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.838+0000 7f52ff7fe640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52ec06aec0 0x7f52ec06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:20.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.839+0000 7f52ff7fe640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52ec06aec0 0x7f52ec06d380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52f0036000 tx=0x7f52f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:20.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:20.841+0000 7f52e7fff640 1 -- 172.21.15.64:0/1348153994 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f52f8054580 con 0x7f53000ceb40 2023-10-14T12:30:21.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.070+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f530015b0f0 con 0x7f53000ceb40 2023-10-14T12:30:21.072 INFO:tasks.ceph.mon.a.smithi064.stderr:2023-10-14T12:30:21.071+0000 7fd0af0b1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T12:30:21.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.074+0000 7f52e7fff640 1 -- 172.21.15.64:0/1348153994 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f530015b0f0 con 0x7f53000ceb40 2023-10-14T12:30:21.075 INFO:teuthology.orchestra.run.smithi064.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T12:30:21.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.076+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52ec06aec0 msgr2=0x7f52ec06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:21.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.076+0000 7f5304de4640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52ec06aec0 0x7f52ec06d380 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f52f0036000 tx=0x7f52f0008030 comp rx=0 tx=0).stop 2023-10-14T12:30:21.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.076+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000ceb40 msgr2=0x7f53000ae960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:21.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.076+0000 7f5304de4640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000ceb40 0x7f53000ae960 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f52f800c9f0 tx=0x7f52f800ceb0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 shutdown_connections 2023-10-14T12:30:21.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f52ec06aec0 0x7f52ec06d380 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f53000ceb40 0x7f53000ae960 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f53000b2dd0 0x7f53000c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 --2- 172.21.15.64:0/1348153994 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f530006dc20 0x7f5300159590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 >> 172.21.15.64:0/1348153994 conn(0x7f5300069fc0 msgr2=0x7f53000b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:21.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 shutdown_connections 2023-10-14T12:30:21.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.077+0000 7f5304de4640 1 -- 172.21.15.64:0/1348153994 wait complete. 2023-10-14T12:30:21.097 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-14T12:30:21.110 INFO:tasks.ceph.mds.d.smithi177.stderr: -5001> 2023-10-14T12:28:50.244+0000 7fb037f22640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:30:21.202 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2023-10-14T12:30:21.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.319+0000 7f054ffff640 1 Processor -- start 2023-10-14T12:30:21.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.319+0000 7f054ffff640 1 -- start start 2023-10-14T12:30:21.321 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.321+0000 7f054ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05500cf030 0x7f055006ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:21.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.321+0000 7f054ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f055006d360 0x7f05500ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:21.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.321+0000 7f054ffff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05501550f0 con 0x7f0550154d10 2023-10-14T12:30:21.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.321+0000 7f054ffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f055006db50 con 0x7f05500cf030 2023-10-14T12:30:21.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.321+0000 7f054ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05500b13f0 con 0x7f055006d360 2023-10-14T12:30:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.322+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f055006d360 0x7f05500ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.322+0000 7f0547fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f05500cf030 0x7f055006ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:21.323 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.322+0000 7f054f7fe640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f055006d360 0x7f05500ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:57100/0 (socket says 172.21.15.64:57100) 2023-10-14T12:30:21.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.322+0000 7f054f7fe640 1 -- 172.21.15.64:0/2069872613 learned_addr learned my addr 172.21.15.64:0/2069872613 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:21.324 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.323+0000 7f054f7fe640 1 -- 172.21.15.64:0/2069872613 >> v2:172.21.15.177:3300/0 conn(0x7f05500cf030 msgr2=0x7f055006ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:21.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.323+0000 7f054f7fe640 1 --2- 172.21.15.64:0/2069872613 >> v2:172.21.15.177:3300/0 conn(0x7f05500cf030 0x7f055006ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.323+0000 7f054f7fe640 1 -- 172.21.15.64:0/2069872613 >> v1:172.21.15.177:6789/0 conn(0x7f0550154d10 legacy=0x7f05500ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:21.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.323+0000 7f054f7fe640 1 -- 172.21.15.64:0/2069872613 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500b16d0 con 0x7f055006d360 2023-10-14T12:30:21.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.323+0000 7f054e7fc640 1 -- 172.21.15.64:0/2069872613 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1933179758 0 0) 0x7f05501550f0 con 0x7f0550154d10 2023-10-14T12:30:21.325 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.323+0000 7f0547fff640 1 --2- 172.21.15.64:0/2069872613 >> v2:172.21.15.177:3300/0 conn(0x7f05500cf030 0x7f055006ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T12:30:21.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.325+0000 7f054f7fe640 1 --2- 172.21.15.64:0/2069872613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f055006d360 0x7f05500ac1d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0548009e50 tx=0x7f054802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fbd0ef6cb5010ca server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:21.326 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.325+0000 7f054e7fc640 1 -- 172.21.15.64:0/2069872613 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054802cb00 con 0x7f055006d360 2023-10-14T12:30:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.325+0000 7f054e7fc640 1 -- 172.21.15.64:0/2069872613 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054802cc60 con 0x7f055006d360 2023-10-14T12:30:21.327 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.325+0000 7f054e7fc640 1 -- 172.21.15.64:0/2069872613 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05480343f0 con 0x7f055006d360 2023-10-14T12:30:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 -- 172.21.15.64:0/2069872613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f055006d360 msgr2=0x7f05500ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 --2- 172.21.15.64:0/2069872613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f055006d360 0x7f05500ac1d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0548009e50 tx=0x7f054802bf60 comp rx=0 tx=0).stop 2023-10-14T12:30:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 -- 172.21.15.64:0/2069872613 shutdown_connections 2023-10-14T12:30:21.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 --2- 172.21.15.64:0/2069872613 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f055006d360 0x7f05500ac1d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 --2- 172.21.15.64:0/2069872613 >> v2:172.21.15.177:3300/0 conn(0x7f05500cf030 0x7f055006ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 -- 172.21.15.64:0/2069872613 >> 172.21.15.64:0/2069872613 conn(0x7f055006a200 msgr2=0x7f055006a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 -- 172.21.15.64:0/2069872613 shutdown_connections 2023-10-14T12:30:21.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.326+0000 7f054ffff640 1 -- 172.21.15.64:0/2069872613 wait complete. 2023-10-14T12:30:21.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.329+0000 7f054ffff640 1 Processor -- start 2023-10-14T12:30:21.330 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.329+0000 7f054ffff640 1 -- start start 2023-10-14T12:30:21.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.330+0000 7f054ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f055006d360 0x7f055015ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:21.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05500cf030 0x7f05501550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:21.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0550154d10 0x7f05500c4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:21.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054ffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055015b070 con 0x7f055006d360 2023-10-14T12:30:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054ffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055015a440 con 0x7f0550154d10 2023-10-14T12:30:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05501588a0 con 0x7f05500cf030 2023-10-14T12:30:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f055006d360 0x7f055015ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f055006d360 0x7f055015ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36842/0 (socket says 172.21.15.64:36842) 2023-10-14T12:30:21.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 -- 172.21.15.64:0/198614535 learned_addr learned my addr 172.21.15.64:0/198614535 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:21.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054f7fe640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0550154d10 0x7f05500c4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:21.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f0547fff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05500cf030 0x7f05501550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:21.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 -- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05500cf030 msgr2=0x7f05501550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:21.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05500cf030 0x7f05501550f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 -- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0550154d10 msgr2=0x7f05500c4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0550154d10 0x7f05500c4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054effd640 1 -- 172.21.15.64:0/198614535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009400 con 0x7f055006d360 2023-10-14T12:30:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.331+0000 7f054f7fe640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0550154d10 0x7f05500c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:21.335 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.332+0000 7f054effd640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f055006d360 0x7f055015ab30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f054000c4b0 tx=0x7f054000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.332+0000 7f05477fe640 1 -- 172.21.15.64:0/198614535 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0540005480 con 0x7f055006d360 2023-10-14T12:30:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.332+0000 7f05477fe640 1 -- 172.21.15.64:0/198614535 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05400035f0 con 0x7f055006d360 2023-10-14T12:30:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.332+0000 7f05477fe640 1 -- 172.21.15.64:0/198614535 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05400039e0 con 0x7f055006d360 2023-10-14T12:30:21.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.332+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0548009b30 con 0x7f055006d360 2023-10-14T12:30:21.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.332+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05501f2840 con 0x7f055006d360 2023-10-14T12:30:21.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.333+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055004e9b0 con 0x7f055006d360 2023-10-14T12:30:21.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.334+0000 7f05477fe640 1 -- 172.21.15.64:0/198614535 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0540003b40 con 0x7f055006d360 2023-10-14T12:30:21.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.335+0000 7f05477fe640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f053006ae70 0x7f053006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:21.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.336+0000 7f05477fe640 1 -- 172.21.15.64:0/198614535 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f0540088fe0 con 0x7f055006d360 2023-10-14T12:30:21.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.336+0000 7f0547fff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f053006ae70 0x7f053006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:21.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.337+0000 7f0547fff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f053006ae70 0x7f053006d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05500c8be0 tx=0x7f0538008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:21.340 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.340+0000 7f05477fe640 1 -- 172.21.15.64:0/198614535 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0540053cb0 con 0x7f055006d360 2023-10-14T12:30:21.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:21.582+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f0550158220 con 0x7f055006d360 2023-10-14T12:30:22.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.078+0000 7f05477fe640 1 -- 172.21.15.64:0/198614535 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0540017020 con 0x7f055006d360 2023-10-14T12:30:22.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.084+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f053006ae70 msgr2=0x7f053006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:22.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.084+0000 7f054ffff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f053006ae70 0x7f053006d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f05500c8be0 tx=0x7f0538008040 comp rx=0 tx=0).stop 2023-10-14T12:30:22.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f055006d360 msgr2=0x7f055015ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:22.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f055006d360 0x7f055015ab30 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f054000c4b0 tx=0x7f054000c970 comp rx=0 tx=0).stop 2023-10-14T12:30:22.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 shutdown_connections 2023-10-14T12:30:22.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f053006ae70 0x7f053006d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0550154d10 0x7f05500c4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f05500cf030 0x7f05501550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 --2- 172.21.15.64:0/198614535 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f055006d360 0x7f055015ab30 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 >> 172.21.15.64:0/198614535 conn(0x7f055006a200 msgr2=0x7f05500cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.085+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 shutdown_connections 2023-10-14T12:30:22.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.086+0000 7f054ffff640 1 -- 172.21.15.64:0/198614535 wait complete. 2023-10-14T12:30:22.110 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-14T12:30:22.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.341+0000 7fbcb10f3640 1 Processor -- start 2023-10-14T12:30:22.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.342+0000 7fbcb10f3640 1 -- start start 2023-10-14T12:30:22.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.343+0000 7fbcb10f3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac0b1a30 0x7fbcac0cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.343+0000 7fbcb10f3640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fbcac0d0cd0 0x7fbcac0d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.343+0000 7fbcb10f3640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbcac0cfc20 con 0x7fbcac06b570 2023-10-14T12:30:22.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.343+0000 7fbcb10f3640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcac0d15f0 con 0x7fbcac0d0cd0 2023-10-14T12:30:22.345 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.343+0000 7fbcb10f3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0cd4a0 con 0x7fbcac0b1a30 2023-10-14T12:30:22.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.344+0000 7fbcb08f2640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fbcac06b570 0x7fbcac06ba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35192/0 (socket says 172.21.15.64:35192) 2023-10-14T12:30:22.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.344+0000 7fbcb08f2640 1 -- 172.21.15.64:0/3287987396 learned_addr learned my addr 172.21.15.64:0/3287987396 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:22.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.344+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac0b1a30 0x7fbcac0cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.344+0000 7fbca3fff640 1 --2- 172.21.15.64:0/3287987396 >> v2:172.21.15.177:3300/0 conn(0x7fbcac0d0cd0 0x7fbcac0d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.344+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1469932058 0 0) 0x7fbcac0cfc20 con 0x7fbcac06b570 2023-10-14T12:30:22.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc98003520 con 0x7fbcac06b570 2023-10-14T12:30:22.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 834525125 0 0) 0x7fbc98003520 con 0x7fbcac06b570 2023-10-14T12:30:22.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac0b1a30 msgr2=0x7fbcac0cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:22.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac0b1a30 0x7fbcac0cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 >> v2:172.21.15.177:3300/0 conn(0x7fbcac0d0cd0 msgr2=0x7fbcac0d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:22.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 --2- 172.21.15.64:0/3287987396 >> v2:172.21.15.177:3300/0 conn(0x7fbcac0d0cd0 0x7fbcac0d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac0cd780 con 0x7fbcac06b570 2023-10-14T12:30:22.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fbca40019f0 con 0x7fbcac06b570 2023-10-14T12:30:22.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 >> v1:172.21.15.64:6789/0 conn(0x7fbcac06b570 legacy=0x7fbcac06ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:22.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbc98003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc980047c0 0x7fbc98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac0b1a30 0x7fbc98005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0d15f0 con 0x7fbc98003970 2023-10-14T12:30:22.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0cd4a0 con 0x7fbc980047c0 2023-10-14T12:30:22.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc9800b980 con 0x7fbcac0b1a30 2023-10-14T12:30:22.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.345+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbc98003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.346+0000 7fbca3fff640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc980047c0 0x7fbc98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.346+0000 7fbcabfff640 1 -- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac0b1a30 msgr2=0x7fbc98005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:22.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.346+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac0b1a30 0x7fbc98005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.346+0000 7fbcabfff640 1 -- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc980047c0 msgr2=0x7fbc98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:22.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.346+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc980047c0 0x7fbc98004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.346+0000 7fbcabfff640 1 -- 172.21.15.64:0/3287987396 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc98003520 con 0x7fbc98003970 2023-10-14T12:30:22.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.346+0000 7fbca3fff640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbc980047c0 0x7fbc98004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:22.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.347+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbc98003d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009ac0 tx=0x7fbc980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d867e721b952a44c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:22.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.347+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c02c6d0 con 0x7fbc98003970 2023-10-14T12:30:22.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.347+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c02c830 con 0x7fbc98003970 2023-10-14T12:30:22.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.347+0000 7fbcab7fe640 1 -- 172.21.15.64:0/3287987396 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c02cbc0 con 0x7fbc98003970 2023-10-14T12:30:22.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.348+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3287987396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 msgr2=0x7fbc98003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:22.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.348+0000 7fbcb10f3640 1 --2- 172.21.15.64:0/3287987396 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbc98003d90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c009ac0 tx=0x7fbc980057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.348+0000 7fbcb08f2640 1 -- 172.21.15.64:0/3287987396 reap_dead start 2023-10-14T12:30:22.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.348+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3287987396 shutdown_connections 2023-10-14T12:30:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.348+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3287987396 >> 172.21.15.64:0/3287987396 conn(0x7fbcac08c140 msgr2=0x7fbcac09ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.348+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3287987396 shutdown_connections 2023-10-14T12:30:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.348+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3287987396 wait complete. 2023-10-14T12:30:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.350+0000 7fbcb10f3640 1 Processor -- start 2023-10-14T12:30:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.350+0000 7fbcb10f3640 1 -- start start 2023-10-14T12:30:22.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcb10f3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbcac15d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcb10f3640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac15a640 0x7fbcac159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcb10f3640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcac0b3390 0x7fbcac0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcb10f3640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac0b3d50 con 0x7fbc98003970 2023-10-14T12:30:22.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcb10f3640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1f54d0 con 0x7fbcac0b3390 2023-10-14T12:30:22.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcb10f3640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcac1f5d70 con 0x7fbcac15a640 2023-10-14T12:30:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbcac15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcabfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbcac15d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36858/0 (socket says 172.21.15.64:36858) 2023-10-14T12:30:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.351+0000 7fbcabfff640 1 -- 172.21.15.64:0/3041115506 learned_addr learned my addr 172.21.15.64:0/3041115506 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcb08f2640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcac0b3390 0x7fbcac0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbca3fff640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac15a640 0x7fbcac159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcabfff640 1 -- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac15a640 msgr2=0x7fbcac159d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:22.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac15a640 0x7fbcac159d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcabfff640 1 -- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcac0b3390 msgr2=0x7fbcac0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:22.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcac0b3390 0x7fbcac0b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:22.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcabfff640 1 -- 172.21.15.64:0/3041115506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcac15ab90 con 0x7fbc98003970 2023-10-14T12:30:22.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbca3fff640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac15a640 0x7fbcac159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:22.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcabfff640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbcac15d630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c037040 tx=0x7fbc9c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:22.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbca97fa640 1 -- 172.21.15.64:0/3041115506 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c003810 con 0x7fbc98003970 2023-10-14T12:30:22.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbca97fa640 1 -- 172.21.15.64:0/3041115506 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc9c003970 con 0x7fbc98003970 2023-10-14T12:30:22.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbca97fa640 1 -- 172.21.15.64:0/3041115506 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc9c003ce0 con 0x7fbc98003970 2023-10-14T12:30:22.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.352+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcac1f5720 con 0x7fbc98003970 2023-10-14T12:30:22.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.353+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac15b290 con 0x7fbc98003970 2023-10-14T12:30:22.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.354+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcac04e9b0 con 0x7fbc98003970 2023-10-14T12:30:22.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.354+0000 7fbca97fa640 1 -- 172.21.15.64:0/3041115506 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbc9c034440 con 0x7fbc98003970 2023-10-14T12:30:22.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.355+0000 7fbca97fa640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc8c06ae70 0x7fbc8c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:22.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.355+0000 7fbca97fa640 1 -- 172.21.15.64:0/3041115506 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fbc9c0abbb0 con 0x7fbc98003970 2023-10-14T12:30:22.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.356+0000 7fbca3fff640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc8c06ae70 0x7fbc8c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:22.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.357+0000 7fbca3fff640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc8c06ae70 0x7fbc8c06d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0cf700 tx=0x7fbc94008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:22.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.360+0000 7fbca97fa640 1 -- 172.21.15.64:0/3041115506 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fbc9c076980 con 0x7fbc98003970 2023-10-14T12:30:22.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:22.551+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbcac0d3120 con 0x7fbc98003970 2023-10-14T12:30:23.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.093+0000 7fbca97fa640 1 -- 172.21.15.64:0/3041115506 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbc9c04c0d0 con 0x7fbc98003970 2023-10-14T12:30:23.094 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_metadata' removed 2023-10-14T12:30:23.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.097+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc8c06ae70 msgr2=0x7fbc8c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:23.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.097+0000 7fbcb10f3640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc8c06ae70 0x7fbc8c06d330 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbcac0cf700 tx=0x7fbc94008040 comp rx=0 tx=0).stop 2023-10-14T12:30:23.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.097+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 msgr2=0x7fbcac15d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:23.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.097+0000 7fbcb10f3640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbcac15d630 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c037040 tx=0x7fbc9c004730 comp rx=0 tx=0).stop 2023-10-14T12:30:23.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 shutdown_connections 2023-10-14T12:30:23.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbc8c06ae70 0x7fbc8c06d330 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbcac0b3390 0x7fbcac0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbcac15a640 0x7fbcac159d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 --2- 172.21.15.64:0/3041115506 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbc98003970 0x7fbcac15d630 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 >> 172.21.15.64:0/3041115506 conn(0x7fbcac08c140 msgr2=0x7fbcac0af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:23.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 shutdown_connections 2023-10-14T12:30:23.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.098+0000 7fbcb10f3640 1 -- 172.21.15.64:0/3041115506 wait complete. 2023-10-14T12:30:23.124 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-14T12:30:23.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.341+0000 7fd87e921640 1 Processor -- start 2023-10-14T12:30:23.342 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.341+0000 7fd87e921640 1 -- start start 2023-10-14T12:30:23.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.342+0000 7fd87e921640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd87815ce30 0x7fd87815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.342+0000 7fd87e921640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd87815d810 con 0x7fd87815ca50 2023-10-14T12:30:23.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.342+0000 7fd87e921640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd878161220 con 0x7fd8780cbef0 2023-10-14T12:30:23.343 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.342+0000 7fd87e921640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd87815d2c0 con 0x7fd87815ce30 2023-10-14T12:30:23.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.343+0000 7fd87d91f640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd87815ca50 0x7fd8781607d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35196/0 (socket says 172.21.15.64:35196) 2023-10-14T12:30:23.344 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.343+0000 7fd87d91f640 1 -- 172.21.15.64:0/453492991 learned_addr learned my addr 172.21.15.64:0/453492991 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:23.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.343+0000 7fd87d11e640 1 --2- 172.21.15.64:0/453492991 >> v2:172.21.15.177:3300/0 conn(0x7fd87815ce30 0x7fd87815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:23.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.343+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153146470 0 0) 0x7fd87815d810 con 0x7fd87815ca50 2023-10-14T12:30:23.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.343+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd860003520 con 0x7fd87815ca50 2023-10-14T12:30:23.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2420976368 0 0) 0x7fd860003520 con 0x7fd87815ca50 2023-10-14T12:30:23.347 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 >> v2:172.21.15.177:3300/0 conn(0x7fd87815ce30 msgr2=0x7fd87815dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:23.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 --2- 172.21.15.64:0/453492991 >> v2:172.21.15.177:3300/0 conn(0x7fd87815ce30 0x7fd87815dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 >> v1:172.21.15.177:6789/0 conn(0x7fd8780cbef0 legacy=0x7fd87806a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:23.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878161500 con 0x7fd87815ca50 2023-10-14T12:30:23.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fd868001670 con 0x7fd87815ca50 2023-10-14T12:30:23.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 >> v1:172.21.15.64:6789/0 conn(0x7fd87815ca50 legacy=0x7fd8781607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:23.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8600039a0 0x7fd860003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd860004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8600052a0 0x7fd86000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87815d2c0 con 0x7fd8600047c0 2023-10-14T12:30:23.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000c1a0 con 0x7fd8600039a0 2023-10-14T12:30:23.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86000c360 con 0x7fd8600052a0 2023-10-14T12:30:23.349 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.344+0000 7fd87d11e640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd860004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:23.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87d91f640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8600039a0 0x7fd860003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:23.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87d11e640 1 -- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8600052a0 msgr2=0x7fd86000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:23.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87d11e640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8600052a0 0x7fd86000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87d11e640 1 -- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8600039a0 msgr2=0x7fd860003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:23.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87d11e640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8600039a0 0x7fd860003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87d11e640 1 -- 172.21.15.64:0/453492991 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860003520 con 0x7fd8600047c0 2023-10-14T12:30:23.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87d91f640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8600039a0 0x7fd860003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:23.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.345+0000 7fd87e120640 1 -- 172.21.15.64:0/453492991 reap_dead start 2023-10-14T12:30:23.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.346+0000 7fd87d11e640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd860004c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009a90 tx=0x7fd8600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912844f410ef2af8 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:23.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.346+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c02c680 con 0x7fd8600047c0 2023-10-14T12:30:23.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.346+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd86c02c7e0 con 0x7fd8600047c0 2023-10-14T12:30:23.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.346+0000 7fd87c91d640 1 -- 172.21.15.64:0/453492991 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd86c02cb70 con 0x7fd8600047c0 2023-10-14T12:30:23.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.347+0000 7fd87e921640 1 -- 172.21.15.64:0/453492991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 msgr2=0x7fd860004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.347+0000 7fd87e921640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd860004c40 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd86c009a90 tx=0x7fd8600057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.347+0000 7fd87e921640 1 -- 172.21.15.64:0/453492991 shutdown_connections 2023-10-14T12:30:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.347+0000 7fd87e921640 1 --2- 172.21.15.64:0/453492991 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd860004c40 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.347+0000 7fd87e921640 1 -- 172.21.15.64:0/453492991 >> 172.21.15.64:0/453492991 conn(0x7fd8780b0fd0 msgr2=0x7fd8780b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:23.356 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.347+0000 7fd87e921640 1 -- 172.21.15.64:0/453492991 shutdown_connections 2023-10-14T12:30:23.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.347+0000 7fd87e921640 1 -- 172.21.15.64:0/453492991 wait complete. 2023-10-14T12:30:23.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.349+0000 7fd87e921640 1 Processor -- start 2023-10-14T12:30:23.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.349+0000 7fd87e921640 1 -- start start 2023-10-14T12:30:23.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87e921640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd878158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87e921640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8780cae30 0x7fd8780cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87e921640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8780b46d0 0x7fd8780b4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87e921640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780b38c0 con 0x7fd8600047c0 2023-10-14T12:30:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87e921640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780cb7f0 con 0x7fd8780cae30 2023-10-14T12:30:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87e921640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8780b2c40 con 0x7fd8780b46d0 2023-10-14T12:30:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87d91f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd878158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87d91f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd878158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36876/0 (socket says 172.21.15.64:36876) 2023-10-14T12:30:23.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.350+0000 7fd87d91f640 1 -- 172.21.15.64:0/2815197177 learned_addr learned my addr 172.21.15.64:0/2815197177 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87d91f640 1 -- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8780b46d0 msgr2=0x7fd8780b4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87d91f640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8780b46d0 0x7fd8780b4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87d91f640 1 -- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8780cae30 msgr2=0x7fd8780cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87d91f640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8780cae30 0x7fd8780cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87d91f640 1 -- 172.21.15.64:0/2815197177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8780b2f20 con 0x7fd8600047c0 2023-10-14T12:30:23.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87d91f640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd878158fd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd86800d7e0 tx=0x7fd86800dca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd8767fc640 1 -- 172.21.15.64:0/2815197177 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680074e0 con 0x7fd8600047c0 2023-10-14T12:30:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd8767fc640 1 -- 172.21.15.64:0/2815197177 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd868007640 con 0x7fd8600047c0 2023-10-14T12:30:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8780b3200 con 0x7fd8600047c0 2023-10-14T12:30:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd8767fc640 1 -- 172.21.15.64:0/2815197177 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8680049e0 con 0x7fd8600047c0 2023-10-14T12:30:23.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.351+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8780b5090 con 0x7fd8600047c0 2023-10-14T12:30:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.352+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd87804e9b0 con 0x7fd8600047c0 2023-10-14T12:30:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.353+0000 7fd8767fc640 1 -- 172.21.15.64:0/2815197177 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd868004b40 con 0x7fd8600047c0 2023-10-14T12:30:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.355+0000 7fd8767fc640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd86406ae70 0x7fd86406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:23.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.355+0000 7fd8767fc640 1 -- 172.21.15.64:0/2815197177 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fd868089420 con 0x7fd8600047c0 2023-10-14T12:30:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.356+0000 7fd87d11e640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd86406ae70 0x7fd86406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.357+0000 7fd87d11e640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd86406ae70 0x7fd86406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd86c036000 tx=0x7fd86c02e000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:23.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.359+0000 7fd8767fc640 1 -- 172.21.15.64:0/2815197177 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd868054320 con 0x7fd8600047c0 2023-10-14T12:30:23.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:23.555+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8780c9980 con 0x7fd8600047c0 2023-10-14T12:30:24.097 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.096+0000 7fd8767fc640 1 -- 172.21.15.64:0/2815197177 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd868057940 con 0x7fd8600047c0 2023-10-14T12:30:24.098 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data' removed 2023-10-14T12:30:24.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd86406ae70 msgr2=0x7fd86406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:24.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd86406ae70 0x7fd86406d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd86c036000 tx=0x7fd86c02e000 comp rx=0 tx=0).stop 2023-10-14T12:30:24.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 msgr2=0x7fd878158fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:24.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd878158fd0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd86800d7e0 tx=0x7fd86800dca0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 shutdown_connections 2023-10-14T12:30:24.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd86406ae70 0x7fd86406d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd8780b46d0 0x7fd8780b4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd8780cae30 0x7fd8780cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 --2- 172.21.15.64:0/2815197177 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd8600047c0 0x7fd878158fd0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.100+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 >> 172.21.15.64:0/2815197177 conn(0x7fd8780b0fd0 msgr2=0x7fd8780ca5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:24.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.101+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 shutdown_connections 2023-10-14T12:30:24.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.101+0000 7fd87e921640 1 -- 172.21.15.64:0/2815197177 wait complete. 2023-10-14T12:30:24.129 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-10-14T12:30:24.350 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.349+0000 7f78cdf6c640 1 Processor -- start 2023-10-14T12:30:24.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.350+0000 7f78cdf6c640 1 -- start start 2023-10-14T12:30:24.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.351+0000 7f78cdf6c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f78c80cecd0 0x7f78c8161060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.351+0000 7f78cdf6c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f78c80cce40 0x7f78c80cd250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.351+0000 7f78cdf6c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78c81615a0 con 0x7f78c815ca80 2023-10-14T12:30:24.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.351+0000 7f78cdf6c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c806c320 con 0x7f78c80cecd0 2023-10-14T12:30:24.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.351+0000 7f78cdf6c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78c806b710 con 0x7f78c80cce40 2023-10-14T12:30:24.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.352+0000 7f78c6ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f78c80cecd0 0x7f78c8161060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:24.354 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.352+0000 7f78c6ffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f78c80cecd0 0x7f78c8161060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36882/0 (socket says 172.21.15.64:36882) 2023-10-14T12:30:24.355 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.352+0000 7f78c6ffd640 1 -- 172.21.15.64:0/1829055201 learned_addr learned my addr 172.21.15.64:0/1829055201 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:24.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.352+0000 7f78c7fff640 1 --2- 172.21.15.64:0/1829055201 >> v2:172.21.15.177:3300/0 conn(0x7f78c80cce40 0x7f78c80cd250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:24.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.352+0000 7f78c6ffd640 1 -- 172.21.15.64:0/1829055201 >> v2:172.21.15.177:3300/0 conn(0x7f78c80cce40 msgr2=0x7f78c80cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.352+0000 7f78c6ffd640 1 --2- 172.21.15.64:0/1829055201 >> v2:172.21.15.177:3300/0 conn(0x7f78c80cce40 0x7f78c80cd250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.352+0000 7f78c6ffd640 1 -- 172.21.15.64:0/1829055201 >> v1:172.21.15.177:6789/0 conn(0x7f78c815ca80 legacy=0x7f78c80ce5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.353+0000 7f78c6ffd640 1 -- 172.21.15.64:0/1829055201 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78c806b9f0 con 0x7f78c80cecd0 2023-10-14T12:30:24.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.354+0000 7f78c6ffd640 1 --2- 172.21.15.64:0/1829055201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c8161060 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78c80cad30 tx=0x7f78b002ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b282b3d2fbcfb84a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.354+0000 7f78c67fc640 1 -- 172.21.15.64:0/1829055201 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b002f850 con 0x7f78c80cecd0 2023-10-14T12:30:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.354+0000 7f78c67fc640 1 -- 172.21.15.64:0/1829055201 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b002f9b0 con 0x7f78c80cecd0 2023-10-14T12:30:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.354+0000 7f78c67fc640 1 -- 172.21.15.64:0/1829055201 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b002fd40 con 0x7f78c80cecd0 2023-10-14T12:30:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 -- 172.21.15.64:0/1829055201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 msgr2=0x7f78c8161060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:24.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/1829055201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c8161060 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f78c80cad30 tx=0x7f78b002ba30 comp rx=0 tx=0).stop 2023-10-14T12:30:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 -- 172.21.15.64:0/1829055201 shutdown_connections 2023-10-14T12:30:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/1829055201 >> v2:172.21.15.177:3300/0 conn(0x7f78c80cce40 0x7f78c80cd250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/1829055201 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c8161060 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 -- 172.21.15.64:0/1829055201 >> 172.21.15.64:0/1829055201 conn(0x7f78c806e2d0 msgr2=0x7f78c806e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:24.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 -- 172.21.15.64:0/1829055201 shutdown_connections 2023-10-14T12:30:24.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.355+0000 7f78cdf6c640 1 -- 172.21.15.64:0/1829055201 wait complete. 2023-10-14T12:30:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.357+0000 7f78cdf6c640 1 Processor -- start 2023-10-14T12:30:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.357+0000 7f78cdf6c640 1 -- start start 2023-10-14T12:30:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78cdf6c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c80cce40 0x7f78c80ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78cdf6c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c815ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:24.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78cdf6c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78c815ca80 0x7f78c815f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:24.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78cdf6c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c815e530 con 0x7f78c80cecd0 2023-10-14T12:30:24.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78cdf6c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78c815d920 con 0x7f78c80cce40 2023-10-14T12:30:24.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78cdf6c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78c815dc00 con 0x7f78c815ca80 2023-10-14T12:30:24.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78c6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c815ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:24.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78c6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c815ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36890/0 (socket says 172.21.15.64:36890) 2023-10-14T12:30:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.358+0000 7f78c6ffd640 1 -- 172.21.15.64:0/4193811411 learned_addr learned my addr 172.21.15.64:0/4193811411 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78c77fe640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c80cce40 0x7f78c80ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78c6ffd640 1 -- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78c815ca80 msgr2=0x7f78c815f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78c6ffd640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78c815ca80 0x7f78c815f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78c6ffd640 1 -- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c80cce40 msgr2=0x7f78c80ca1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:24.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78c6ffd640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c80cce40 0x7f78c80ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:24.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78c6ffd640 1 -- 172.21.15.64:0/4193811411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00094d0 con 0x7f78c80cecd0 2023-10-14T12:30:24.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78c6ffd640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c815ce60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f78b0000c00 tx=0x7f78b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:24.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.359+0000 7f78bffff640 1 -- 172.21.15.64:0/4193811411 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b003b040 con 0x7f78c80cecd0 2023-10-14T12:30:24.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.360+0000 7f78bffff640 1 -- 172.21.15.64:0/4193811411 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0037c40 con 0x7f78c80cecd0 2023-10-14T12:30:24.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.360+0000 7f78bffff640 1 -- 172.21.15.64:0/4193811411 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0042480 con 0x7f78c80cecd0 2023-10-14T12:30:24.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.360+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78c815dee0 con 0x7f78c80cecd0 2023-10-14T12:30:24.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.360+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78c80b4a40 con 0x7f78c80cecd0 2023-10-14T12:30:24.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.361+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78c815e6e0 con 0x7f78c80cecd0 2023-10-14T12:30:24.367 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.362+0000 7f78bffff640 1 -- 172.21.15.64:0/4193811411 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f78b0042600 con 0x7f78c80cecd0 2023-10-14T12:30:24.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.363+0000 7f78bffff640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f78a806aea0 0x7f78a806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:24.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.363+0000 7f78bffff640 1 -- 172.21.15.64:0/4193811411 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f78b00ac860 con 0x7f78c80cecd0 2023-10-14T12:30:24.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.364+0000 7f78c77fe640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f78a806aea0 0x7f78a806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:24.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.365+0000 7f78c77fe640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f78a806aea0 0x7f78a806d360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f78b8007fd0 tx=0x7f78b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:24.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.367+0000 7f78bffff640 1 -- 172.21.15.64:0/4193811411 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f78c815e6e0 con 0x7f78c80cecd0 2023-10-14T12:30:24.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:24.578+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f78c8073ef0 con 0x7f78c80cecd0 2023-10-14T12:30:25.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.120+0000 7f78bffff640 1 -- 172.21.15.64:0/4193811411 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f78b007b350 con 0x7f78c80cecd0 2023-10-14T12:30:25.121 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'cephfs_data_ec' removed 2023-10-14T12:30:25.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f78a806aea0 msgr2=0x7f78a806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:25.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f78a806aea0 0x7f78a806d360 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f78b8007fd0 tx=0x7f78b8009040 comp rx=0 tx=0).stop 2023-10-14T12:30:25.125 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 msgr2=0x7f78c815ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:25.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c815ce60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f78b0000c00 tx=0x7f78b00046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 shutdown_connections 2023-10-14T12:30:25.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f78a806aea0 0x7f78a806d360 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f78c815ca80 0x7f78c815f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f78c80cecd0 0x7f78c815ce60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 --2- 172.21.15.64:0/4193811411 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f78c80cce40 0x7f78c80ca1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 >> 172.21.15.64:0/4193811411 conn(0x7f78c806e2d0 msgr2=0x7f78c80cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:25.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.124+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 shutdown_connections 2023-10-14T12:30:25.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.125+0000 7f78cdf6c640 1 -- 172.21.15.64:0/4193811411 wait complete. 2023-10-14T12:30:25.155 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-14T12:30:25.155 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-14T12:30:25.156 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T12:30:25.156 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:30:25.156 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-14T12:30:25.157 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-14T12:30:25.157 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T12:30:25.157 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:30:25.158 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-14T12:30:25.158 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-14T12:30:25.158 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T12:30:25.158 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:30:25.159 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-14T12:30:25.159 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-14T12:30:25.159 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T12:30:25.160 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T12:30:25.180 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T12:30:25.180 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-14T12:30:25.181 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T12:30:25.181 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-14T12:30:25.182 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T12:30:25.183 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-14T12:30:25.184 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T12:30:25.184 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-14T12:30:25.230 INFO:tasks.ceph.mds.b:Started 2023-10-14T12:30:25.230 DEBUG:teuthology.parallel:result is None 2023-10-14T12:30:25.231 INFO:tasks.ceph.mds.a:Started 2023-10-14T12:30:25.232 DEBUG:teuthology.parallel:result is None 2023-10-14T12:30:25.236 INFO:tasks.ceph.mds.d:Started 2023-10-14T12:30:25.236 DEBUG:teuthology.parallel:result is None 2023-10-14T12:30:25.238 INFO:tasks.ceph.mds.c:Started 2023-10-14T12:30:25.238 DEBUG:teuthology.parallel:result is None 2023-10-14T12:30:25.239 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-14T12:30:25.384 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-14T12:30:25.389 INFO:tasks.ceph.mds.b.smithi177.stdout:starting mds.b at 2023-10-14T12:30:25.390 INFO:tasks.ceph.mds.d.smithi177.stdout:starting mds.d at 2023-10-14T12:30:25.393 INFO:tasks.ceph.mds.a.smithi064.stdout:starting mds.a at 2023-10-14T12:30:25.396 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2023-10-14T12:30:25.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.440+0000 7f8a9e197640 1 Processor -- start 2023-10-14T12:30:25.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.440+0000 7f8a9e197640 1 -- start start 2023-10-14T12:30:25.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a9e197640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a980c9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:25.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a9e197640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8a9806c760 0x7f8a980b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:25.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a9e197640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a9815ae40 con 0x7f8a980b06f0 2023-10-14T12:30:25.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a9e197640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a980b0b80 con 0x7f8a9806c760 2023-10-14T12:30:25.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a9e197640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9806cbc0 con 0x7f8a9815aa60 2023-10-14T12:30:25.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a8ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8a9806c760 0x7f8a980b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:25.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a97fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f8a980b06f0 0x7f8a98070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:35212/0 (socket says 172.21.15.64:35212) 2023-10-14T12:30:25.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a97fff640 1 -- 172.21.15.64:0/316834248 learned_addr learned my addr 172.21.15.64:0/316834248 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:25.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.441+0000 7f8a977fe640 1 --2- 172.21.15.64:0/316834248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a980c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:25.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.442+0000 7f8a8ffff640 1 -- 172.21.15.64:0/316834248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 msgr2=0x7f8a980c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:25.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.442+0000 7f8a8ffff640 1 --2- 172.21.15.64:0/316834248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a980c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.442+0000 7f8a8ffff640 1 -- 172.21.15.64:0/316834248 >> v1:172.21.15.64:6789/0 conn(0x7f8a980b06f0 legacy=0x7f8a98070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:25.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.442+0000 7f8a8ffff640 1 -- 172.21.15.64:0/316834248 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a980b1580 con 0x7f8a9806c760 2023-10-14T12:30:25.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.442+0000 7f8a96ffd640 1 -- 172.21.15.64:0/316834248 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4243679845 0 0) 0x7f8a9815ae40 con 0x7f8a980b06f0 2023-10-14T12:30:25.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.443+0000 7f8a8ffff640 1 --2- 172.21.15.64:0/316834248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a9806c760 0x7f8a980b01b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a8002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5d9f7b03ac4044f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:25.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a96ffd640 1 -- 172.21.15.64:0/316834248 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80031780 con 0x7f8a9806c760 2023-10-14T12:30:25.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a96ffd640 1 -- 172.21.15.64:0/316834248 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a800318e0 con 0x7f8a9806c760 2023-10-14T12:30:25.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a96ffd640 1 -- 172.21.15.64:0/316834248 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80031c70 con 0x7f8a9806c760 2023-10-14T12:30:25.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 -- 172.21.15.64:0/316834248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a9806c760 msgr2=0x7f8a980b01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:25.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 --2- 172.21.15.64:0/316834248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a9806c760 0x7f8a980b01b0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a8002b820 comp rx=0 tx=0).stop 2023-10-14T12:30:25.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 -- 172.21.15.64:0/316834248 shutdown_connections 2023-10-14T12:30:25.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 --2- 172.21.15.64:0/316834248 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a9806c760 0x7f8a980b01b0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 --2- 172.21.15.64:0/316834248 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a980c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 -- 172.21.15.64:0/316834248 >> 172.21.15.64:0/316834248 conn(0x7f8a980cb1b0 msgr2=0x7f8a980cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:25.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 -- 172.21.15.64:0/316834248 shutdown_connections 2023-10-14T12:30:25.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.444+0000 7f8a9e197640 1 -- 172.21.15.64:0/316834248 wait complete. 2023-10-14T12:30:25.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.446+0000 7f8a9e197640 1 Processor -- start 2023-10-14T12:30:25.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.446+0000 7f8a9e197640 1 -- start start 2023-10-14T12:30:25.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.447+0000 7f8a9e197640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9806c760 0x7f8a980af810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:25.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.447+0000 7f8a9e197640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a980b06f0 0x7f8a98156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:25.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.447+0000 7f8a9e197640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a981f0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:25.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.447+0000 7f8a9e197640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a98157420 con 0x7f8a980b06f0 2023-10-14T12:30:25.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.447+0000 7f8a9e197640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9815c0f0 con 0x7f8a9806c760 2023-10-14T12:30:25.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.447+0000 7f8a9e197640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a981f0a00 con 0x7f8a9815aa60 2023-10-14T12:30:25.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a980b06f0 0x7f8a98156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:25.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a980b06f0 0x7f8a98156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36944/0 (socket says 172.21.15.64:36944) 2023-10-14T12:30:25.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 -- 172.21.15.64:0/471569971 learned_addr learned my addr 172.21.15.64:0/471569971 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:25.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a977fe640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9806c760 0x7f8a980af810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:25.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a97fff640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a981f0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:25.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 -- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 msgr2=0x7f8a981f0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:25.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a981f0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 -- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9806c760 msgr2=0x7f8a980af810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:25.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9806c760 0x7f8a980af810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:25.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 -- 172.21.15.64:0/471569971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a80009400 con 0x7f8a980b06f0 2023-10-14T12:30:25.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.448+0000 7f8a8ffff640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a980b06f0 0x7f8a98156ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:25.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.449+0000 7f8a94ff9640 1 -- 172.21.15.64:0/471569971 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80004230 con 0x7f8a980b06f0 2023-10-14T12:30:25.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.449+0000 7f8a94ff9640 1 -- 172.21.15.64:0/471569971 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a800043b0 con 0x7f8a980b06f0 2023-10-14T12:30:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.449+0000 7f8a94ff9640 1 -- 172.21.15.64:0/471569971 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80004520 con 0x7f8a980b06f0 2023-10-14T12:30:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.449+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a981f0ce0 con 0x7f8a980b06f0 2023-10-14T12:30:25.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.449+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9815c340 con 0x7f8a980b06f0 2023-10-14T12:30:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.450+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a980cafb0 con 0x7f8a980b06f0 2023-10-14T12:30:25.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.451+0000 7f8a94ff9640 1 -- 172.21.15.64:0/471569971 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8a80032860 con 0x7f8a980b06f0 2023-10-14T12:30:25.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.452+0000 7f8a94ff9640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a7806aea0 0x7f8a7806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:25.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.452+0000 7f8a94ff9640 1 -- 172.21.15.64:0/471569971 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8a800ab650 con 0x7f8a980b06f0 2023-10-14T12:30:25.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.453+0000 7f8a977fe640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a7806aea0 0x7f8a7806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:25.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.453+0000 7f8a977fe640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a7806aea0 0x7f8a7806d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009aa0 tx=0x7f8a88009190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:25.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.457+0000 7f8a94ff9640 1 -- 172.21.15.64:0/471569971 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8a800769e0 con 0x7f8a980b06f0 2023-10-14T12:30:25.662 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:25.662+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8a98073ef0 con 0x7f8a980b06f0 2023-10-14T12:30:26.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.143+0000 7f8a94ff9640 1 -- 172.21.15.64:0/471569971 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8a8007a000 con 0x7f8a980b06f0 2023-10-14T12:30:26.144 INFO:teuthology.orchestra.run.smithi064.stderr: removed all blocklist entries 2023-10-14T12:30:26.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a7806aea0 msgr2=0x7f8a7806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a7806aea0 0x7f8a7806d360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8a88009aa0 tx=0x7f8a88009190 comp rx=0 tx=0).stop 2023-10-14T12:30:26.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a980b06f0 msgr2=0x7f8a98156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a980b06f0 0x7f8a98156ee0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f8a800097a0 tx=0x7f8a800046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 shutdown_connections 2023-10-14T12:30:26.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8a7806aea0 0x7f8a7806d360 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8a9815aa60 0x7f8a981f0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8a980b06f0 0x7f8a98156ee0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 --2- 172.21.15.64:0/471569971 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8a9806c760 0x7f8a980af810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 >> 172.21.15.64:0/471569971 conn(0x7f8a980cb1b0 msgr2=0x7f8a980b26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:26.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 shutdown_connections 2023-10-14T12:30:26.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.148+0000 7f8a9e197640 1 -- 172.21.15.64:0/471569971 wait complete. 2023-10-14T12:30:26.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-14T12:30:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.390+0000 7f839de60640 1 Processor -- start 2023-10-14T12:30:26.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.390+0000 7f839de60640 1 -- start start 2023-10-14T12:30:26.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.392+0000 7f839de60640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.392+0000 7f839de60640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f83980ca660 0x7f83980cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.392+0000 7f839de60640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f839806ff40 0x7f839806bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.392+0000 7f839de60640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f839815acb0 con 0x7f839806ff40 2023-10-14T12:30:26.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.392+0000 7f839de60640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980c1c60 con 0x7f83980ca660 2023-10-14T12:30:26.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.392+0000 7f839de60640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f839815e350 con 0x7f839815a8d0 2023-10-14T12:30:26.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f839806ff40 0x7f839806bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f839806ff40 0x7f839806bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53130/0 (socket says 172.21.15.64:53130) 2023-10-14T12:30:26.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 -- 172.21.15.64:0/3995752319 learned_addr learned my addr 172.21.15.64:0/3995752319 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:26.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839ce5e640 1 --2- 172.21.15.64:0/3995752319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f8397fff640 1 --2- 172.21.15.64:0/3995752319 >> v2:172.21.15.177:3300/0 conn(0x7f83980ca660 0x7f83980cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 -- 172.21.15.64:0/3995752319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 msgr2=0x7f83980cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:26.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 --2- 172.21.15.64:0/3995752319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 -- 172.21.15.64:0/3995752319 >> v2:172.21.15.177:3300/0 conn(0x7f83980ca660 msgr2=0x7f83980cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:26.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 --2- 172.21.15.64:0/3995752319 >> v2:172.21.15.177:3300/0 conn(0x7f83980ca660 0x7f83980cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.393+0000 7f839d65f640 1 -- 172.21.15.64:0/3995752319 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839815e630 con 0x7f839806ff40 2023-10-14T12:30:26.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.394+0000 7f839d65f640 1 --2- 172.21.15.64:0/3995752319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f839806bf30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f839806cfc0 tx=0x7f839002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c5b2e99fb37c98 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:26.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f83977fe640 1 -- 172.21.15.64:0/3995752319 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839002ca70 con 0x7f839806ff40 2023-10-14T12:30:26.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f83977fe640 1 -- 172.21.15.64:0/3995752319 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839002cbd0 con 0x7f839806ff40 2023-10-14T12:30:26.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f83977fe640 1 -- 172.21.15.64:0/3995752319 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83900343f0 con 0x7f839806ff40 2023-10-14T12:30:26.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f839de60640 1 -- 172.21.15.64:0/3995752319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 msgr2=0x7f839806bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f839de60640 1 --2- 172.21.15.64:0/3995752319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f839806bf30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f839806cfc0 tx=0x7f839002bed0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f839de60640 1 -- 172.21.15.64:0/3995752319 shutdown_connections 2023-10-14T12:30:26.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f839de60640 1 --2- 172.21.15.64:0/3995752319 >> v2:172.21.15.177:3300/0 conn(0x7f83980ca660 0x7f83980cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f839de60640 1 --2- 172.21.15.64:0/3995752319 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f839806bf30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f839de60640 1 --2- 172.21.15.64:0/3995752319 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.395+0000 7f839de60640 1 -- 172.21.15.64:0/3995752319 >> 172.21.15.64:0/3995752319 conn(0x7f839806a470 msgr2=0x7f83980afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:26.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.396+0000 7f839de60640 1 -- 172.21.15.64:0/3995752319 shutdown_connections 2023-10-14T12:30:26.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.396+0000 7f839de60640 1 -- 172.21.15.64:0/3995752319 wait complete. 2023-10-14T12:30:26.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.398+0000 7f839de60640 1 Processor -- start 2023-10-14T12:30:26.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.398+0000 7f839de60640 1 -- start start 2023-10-14T12:30:26.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839de60640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f83981545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839de60640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83980ca660 0x7f83980c31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839de60640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980c3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839de60640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83980ab8d0 con 0x7f839806ff40 2023-10-14T12:30:26.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839de60640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83981550b0 con 0x7f83980ca660 2023-10-14T12:30:26.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839de60640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980b34b0 con 0x7f839815a8d0 2023-10-14T12:30:26.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839ce5e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f83981545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839ce5e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f83981545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53142/0 (socket says 172.21.15.64:53142) 2023-10-14T12:30:26.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.399+0000 7f839ce5e640 1 -- 172.21.15.64:0/306510829 learned_addr learned my addr 172.21.15.64:0/306510829 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:26.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f8397fff640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83980ca660 0x7f83980c31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f839d65f640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980c3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f839ce5e640 1 -- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 msgr2=0x7f83980c3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f839ce5e640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980c3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f839ce5e640 1 -- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83980ca660 msgr2=0x7f83980c31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f839ce5e640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83980ca660 0x7f83980c31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f839ce5e640 1 -- 172.21.15.64:0/306510829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009b30 con 0x7f839806ff40 2023-10-14T12:30:26.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f8397fff640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83980ca660 0x7f83980c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:26.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f839ce5e640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f83981545d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f838c00e900 tx=0x7f838c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:26.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f83957fa640 1 -- 172.21.15.64:0/306510829 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c009660 con 0x7f839806ff40 2023-10-14T12:30:26.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.400+0000 7f83957fa640 1 -- 172.21.15.64:0/306510829 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838c00ca00 con 0x7f839806ff40 2023-10-14T12:30:26.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.401+0000 7f83957fa640 1 -- 172.21.15.64:0/306510829 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838c00cd70 con 0x7f839806ff40 2023-10-14T12:30:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.401+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83980b3790 con 0x7f839806ff40 2023-10-14T12:30:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.401+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83980b3d50 con 0x7f839806ff40 2023-10-14T12:30:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.402+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83980abb40 con 0x7f839806ff40 2023-10-14T12:30:26.409 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.403+0000 7f83957fa640 1 -- 172.21.15.64:0/306510829 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f838c013470 con 0x7f839806ff40 2023-10-14T12:30:26.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.404+0000 7f83957fa640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f837c06ae70 0x7f837c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.410 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.404+0000 7f83957fa640 1 -- 172.21.15.64:0/306510829 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f838c089a50 con 0x7f839806ff40 2023-10-14T12:30:26.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.405+0000 7f8397fff640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f837c06ae70 0x7f837c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.406+0000 7f8397fff640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f837c06ae70 0x7f837c06d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8398071830 tx=0x7f8384008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:26.411 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.408+0000 7f83957fa640 1 -- 172.21.15.64:0/306510829 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f838c054d00 con 0x7f839806ff40 2023-10-14T12:30:26.669 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.669+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f839804e9b0 con 0x7f839806ff40 2023-10-14T12:30:26.670 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.670+0000 7f83957fa640 1 -- 172.21.15.64:0/306510829 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f838c021090 con 0x7f839806ff40 2023-10-14T12:30:26.671 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:26.672 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:30:26.672 INFO:teuthology.orchestra.run.smithi064.stdout: "auth_dump": [ 2023-10-14T12:30:26.672 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.672 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.a", 2023-10-14T12:30:26.672 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBAiSpliOyMABAA+prdm7RIH9jAU54jikqEXQ==", 2023-10-14T12:30:26.673 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.673 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.673 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2023-10-14T12:30:26.673 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2023-10-14T12:30:26.673 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.674 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.674 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.674 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.674 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.b", 2023-10-14T12:30:26.674 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBAiSplJJXkJBAAnW1BD8RTSmIHa5A3cKhc2g==", 2023-10-14T12:30:26.675 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.675 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.675 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2023-10-14T12:30:26.675 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2023-10-14T12:30:26.675 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.676 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.676 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.676 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.676 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.c", 2023-10-14T12:30:26.676 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBAiSplzGGaExAAh4oGDyi8NKrwzxW/yC4UTQ==", 2023-10-14T12:30:26.677 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.677 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.677 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2023-10-14T12:30:26.677 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2023-10-14T12:30:26.677 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.678 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.678 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.678 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.678 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mds.d", 2023-10-14T12:30:26.678 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBAiSplMk+2MxAAkPeAM/sIhjtsCAiYBkx0Zw==", 2023-10-14T12:30:26.679 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.679 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.679 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2023-10-14T12:30:26.679 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2023-10-14T12:30:26.679 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.679 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.680 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.680 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.680 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.0", 2023-10-14T12:30:26.680 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBGiSplWe6ZBBAAZVQjc85I9bqh+oqATKTwEw==", 2023-10-14T12:30:26.680 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.681 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.681 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.681 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.681 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.681 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.681 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.682 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.1", 2023-10-14T12:30:26.682 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBJiSplL+UVHxAAlLnWEF6td+5QxwDmIIlJIA==", 2023-10-14T12:30:26.682 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.682 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.682 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.683 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.683 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.683 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.683 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.683 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.2", 2023-10-14T12:30:26.684 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBMiSplsy4uOBAA5LLEdrFSZ7Fn464jOjhIlw==", 2023-10-14T12:30:26.684 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.684 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.684 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.684 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.685 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.685 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.685 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.3", 2023-10-14T12:30:26.685 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBQiSpl90TNBxAA3c2beAcsjbwkgoFPInzJLg==", 2023-10-14T12:30:26.685 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.686 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.686 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.686 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.686 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.686 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.687 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.687 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.4", 2023-10-14T12:30:26.687 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBXiSpl9TciERAAExVwLzDDDKJSjKd/FPn3/A==", 2023-10-14T12:30:26.687 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.687 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.687 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.688 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.688 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.688 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.688 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.688 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.5", 2023-10-14T12:30:26.689 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBaiSplzjt8KxAAPSyhbj8lpdvHwMq3mXdKrw==", 2023-10-14T12:30:26.689 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.689 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.689 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.689 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.690 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.690 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.690 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.690 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.6", 2023-10-14T12:30:26.690 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBeiSplmgCeCBAAON7G20efkqN6XB5SUGq/wg==", 2023-10-14T12:30:26.691 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.691 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.691 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.691 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.691 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.691 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.692 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.692 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "osd.7", 2023-10-14T12:30:26.692 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBhiSpl0xBoIRAAFdn8eD5VbuMNkPGPABAeYQ==", 2023-10-14T12:30:26.692 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.692 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow profile osd", 2023-10-14T12:30:26.693 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile osd", 2023-10-14T12:30:26.693 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.693 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.693 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.693 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.693 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.0", 2023-10-14T12:30:26.694 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBBiSplkVBXBhAA+eSaJH/y9hONFgFzhTnWKQ==", 2023-10-14T12:30:26.694 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.694 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.694 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2023-10-14T12:30:26.694 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2023-10-14T12:30:26.695 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2023-10-14T12:30:26.695 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.695 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.695 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.696 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.1", 2023-10-14T12:30:26.696 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBBiSpl7kPXHRAAir049pudwgcATViT7fjA3A==", 2023-10-14T12:30:26.696 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.696 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.697 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2023-10-14T12:30:26.697 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2023-10-14T12:30:26.697 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2023-10-14T12:30:26.697 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.697 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.698 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.698 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.2", 2023-10-14T12:30:26.698 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBBiSplJ9JDEhAAB0x7cWi/OxWVBcF4yJSvjQ==", 2023-10-14T12:30:26.698 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.698 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.699 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2023-10-14T12:30:26.699 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2023-10-14T12:30:26.699 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2023-10-14T12:30:26.699 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.699 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.700 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.700 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.3", 2023-10-14T12:30:26.700 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBBiSplRIACLBAA+KlMnLui3uhL7tmE35LDTQ==", 2023-10-14T12:30:26.700 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.700 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow", 2023-10-14T12:30:26.700 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow r", 2023-10-14T12:30:26.701 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow rw", 2023-10-14T12:30:26.701 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow rwx" 2023-10-14T12:30:26.701 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.701 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.701 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.702 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.admin", 2023-10-14T12:30:26.702 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQA+iSpl1oF6LhAAuhBxJB02FxMYZUC47L5i6g==", 2023-10-14T12:30:26.702 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.702 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2023-10-14T12:30:26.702 INFO:teuthology.orchestra.run.smithi064.stdout: "mgr": "allow *", 2023-10-14T12:30:26.703 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow *", 2023-10-14T12:30:26.703 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.703 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.703 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.703 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.703 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-mds", 2023-10-14T12:30:26.704 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBqiSplKC2xLRAAH6lgDU6RVSyMfzBf8dpuzg==", 2023-10-14T12:30:26.704 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.704 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-mds" 2023-10-14T12:30:26.704 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.704 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.704 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.705 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-mgr", 2023-10-14T12:30:26.705 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBqiSplODaxLRAA2HuFbowaLAk7HvqVSJUJTA==", 2023-10-14T12:30:26.705 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.705 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-14T12:30:26.705 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.706 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.706 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.706 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-osd", 2023-10-14T12:30:26.706 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBqiSpl1z6xLRAAlESYFayNnnHzkUjX8lO1tg==", 2023-10-14T12:30:26.706 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.707 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-osd" 2023-10-14T12:30:26.707 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.707 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.707 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.707 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-rbd", 2023-10-14T12:30:26.708 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBqiSplYUexLRAAopgkUFtb4kUV2UDzULdtxA==", 2023-10-14T12:30:26.708 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.708 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-14T12:30:26.708 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.708 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.708 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.709 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-14T12:30:26.709 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBqiSpl8HuxLRAARxTahENMiwndvjLlvyed6Q==", 2023-10-14T12:30:26.709 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.709 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-14T12:30:26.709 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.710 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.710 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.710 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "client.bootstrap-rgw", 2023-10-14T12:30:26.710 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQBqiSpl+IWxLRAAnoNZukGWcPhvuvvTHAcMFA==", 2023-10-14T12:30:26.710 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.711 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-14T12:30:26.711 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.711 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.711 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.711 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.x", 2023-10-14T12:30:26.712 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQA/iSplCeuALxAALpyDfrHvy59BDVFExs09CQ==", 2023-10-14T12:30:26.712 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.712 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2023-10-14T12:30:26.712 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2023-10-14T12:30:26.712 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.713 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.713 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:26.713 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:26.713 INFO:teuthology.orchestra.run.smithi064.stdout: "entity": "mgr.y", 2023-10-14T12:30:26.714 INFO:teuthology.orchestra.run.smithi064.stdout: "key": "AQA/iSpln7I0JBAAzQ/eOHXgfCe0k2C9dA5xzQ==", 2023-10-14T12:30:26.714 INFO:teuthology.orchestra.run.smithi064.stdout: "caps": { 2023-10-14T12:30:26.714 INFO:teuthology.orchestra.run.smithi064.stdout: "mds": "allow *", 2023-10-14T12:30:26.714 INFO:teuthology.orchestra.run.smithi064.stdout: "mon": "allow profile mgr", 2023-10-14T12:30:26.715 INFO:teuthology.orchestra.run.smithi064.stdout: "osd": "allow *" 2023-10-14T12:30:26.715 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.715 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:26.716 INFO:teuthology.orchestra.run.smithi064.stdout: ] 2023-10-14T12:30:26.716 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:30:26.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.672+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f837c06ae70 msgr2=0x7f837c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.672+0000 7f839de60640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f837c06ae70 0x7f837c06d330 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8398071830 tx=0x7f8384008040 comp rx=0 tx=0).stop 2023-10-14T12:30:26.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.672+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 msgr2=0x7f83981545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.672+0000 7f839de60640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f83981545d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f838c00e900 tx=0x7f838c00edc0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 shutdown_connections 2023-10-14T12:30:26.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f837c06ae70 0x7f837c06d330 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f839815a8d0 0x7f83980c3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f83980ca660 0x7f83980c31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.720 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 --2- 172.21.15.64:0/306510829 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f839806ff40 0x7f83981545d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 >> 172.21.15.64:0/306510829 conn(0x7f839806a470 msgr2=0x7f83980cabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:26.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 shutdown_connections 2023-10-14T12:30:26.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.673+0000 7f839de60640 1 -- 172.21.15.64:0/306510829 wait complete. 2023-10-14T12:30:26.722 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-14T12:30:26.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.960+0000 7f042e802640 1 Processor -- start 2023-10-14T12:30:26.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.960+0000 7f042e802640 1 -- start start 2023-10-14T12:30:26.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.962+0000 7f042e802640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0428160d10 0x7f042806c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.962+0000 7f042e802640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 0x7f04280c1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.962+0000 7f042e802640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04280cc550 con 0x7f04280c18d0 2023-10-14T12:30:26.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.962+0000 7f042e802640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04280c1d60 con 0x7f0428160d10 2023-10-14T12:30:26.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.962+0000 7f042e802640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f042806ca30 con 0x7f042806c590 2023-10-14T12:30:26.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.962+0000 7f042e001640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f04280c18d0 0x7f04280cadd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34226/0 (socket says 172.21.15.64:34226) 2023-10-14T12:30:26.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.962+0000 7f042e001640 1 -- 172.21.15.64:0/3128197046 learned_addr learned my addr 172.21.15.64:0/3128197046 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:26.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f042cfff640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 0x7f04280c1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f042d800640 1 --2- 172.21.15.64:0/3128197046 >> v2:172.21.15.177:3300/0 conn(0x7f0428160d10 0x7f042806c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187005376 0 0) 0x7f04280cc550 con 0x7f04280c18d0 2023-10-14T12:30:26.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0414003520 con 0x7f04280c18d0 2023-10-14T12:30:26.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1406275779 0 0) 0x7f0414003520 con 0x7f04280c18d0 2023-10-14T12:30:26.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 msgr2=0x7f04280c1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:26.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 0x7f04280c1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 >> v2:172.21.15.177:3300/0 conn(0x7f0428160d10 msgr2=0x7f042806c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:26.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 --2- 172.21.15.64:0/3128197046 >> v2:172.21.15.177:3300/0 conn(0x7f0428160d10 0x7f042806c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042806cd10 con 0x7f04280c18d0 2023-10-14T12:30:26.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f04200019f0 con 0x7f04280c18d0 2023-10-14T12:30:26.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.963+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 >> v1:172.21.15.64:6789/0 conn(0x7f04280c18d0 legacy=0x7f04280cadd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f041ffff640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 0x7f0414003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f041ffff640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0414003ef0 0x7f04140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f041ffff640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0414004d00 0x7f0414005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280c1d60 con 0x7f0414004d00 2023-10-14T12:30:26.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f042806ca30 con 0x7f0414003ef0 2023-10-14T12:30:26.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f041400b9b0 con 0x7f042806c590 2023-10-14T12:30:26.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f042e001640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0414004d00 0x7f0414005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f042cfff640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0414003ef0 0x7f04140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f042d800640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 0x7f0414003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.964+0000 7f042e001640 1 -- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 msgr2=0x7f0414003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:26.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.965+0000 7f042e001640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 0x7f0414003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.965+0000 7f042e001640 1 -- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0414003ef0 msgr2=0x7f04140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:26.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.965+0000 7f042e001640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0414003ef0 0x7f04140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.965+0000 7f042e001640 1 -- 172.21.15.64:0/3128197046 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0414003520 con 0x7f0414004d00 2023-10-14T12:30:26.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.965+0000 7f042cfff640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0414003ef0 0x7f04140047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:26.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.965+0000 7f042d800640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f042806c590 0x7f0414003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:26.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.966+0000 7f042e001640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0414004d00 0x7f0414005180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f042000a860 tx=0x7f04140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c45889fb1036ad72 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:26.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.966+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420034630 con 0x7f0414004d00 2023-10-14T12:30:26.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.966+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042002f070 con 0x7f0414004d00 2023-10-14T12:30:26.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.966+0000 7f041ffff640 1 -- 172.21.15.64:0/3128197046 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0420034a30 con 0x7f0414004d00 2023-10-14T12:30:26.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.967+0000 7f042e802640 1 -- 172.21.15.64:0/3128197046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0414004d00 msgr2=0x7f0414005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.967+0000 7f042e802640 1 --2- 172.21.15.64:0/3128197046 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0414004d00 0x7f0414005180 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f042000a860 tx=0x7f04140057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.967+0000 7f042e001640 1 -- 172.21.15.64:0/3128197046 reap_dead start 2023-10-14T12:30:26.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.967+0000 7f042e802640 1 -- 172.21.15.64:0/3128197046 shutdown_connections 2023-10-14T12:30:26.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.967+0000 7f042e802640 1 -- 172.21.15.64:0/3128197046 >> 172.21.15.64:0/3128197046 conn(0x7f0428069fc0 msgr2=0x7f042806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:26.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.967+0000 7f042e802640 1 -- 172.21.15.64:0/3128197046 shutdown_connections 2023-10-14T12:30:26.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.967+0000 7f042e802640 1 -- 172.21.15.64:0/3128197046 wait complete. 2023-10-14T12:30:26.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.969+0000 7f042e802640 1 Processor -- start 2023-10-14T12:30:26.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.969+0000 7f042e802640 1 -- start start 2023-10-14T12:30:26.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042e802640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0414004d00 0x7f04281636e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042e802640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04280cc930 0x7f04280ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042e802640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0428162450 0x7f04281628d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042e802640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04281fa3b0 con 0x7f04280cc930 2023-10-14T12:30:26.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042e802640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04280cd2d0 con 0x7f0428162450 2023-10-14T12:30:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042e802640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0428163c20 con 0x7f0414004d00 2023-10-14T12:30:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042cfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04280cc930 0x7f04280ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042cfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04280cc930 0x7f04280ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53158/0 (socket says 172.21.15.64:53158) 2023-10-14T12:30:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042cfff640 1 -- 172.21.15.64:0/1070094002 learned_addr learned my addr 172.21.15.64:0/1070094002 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:26.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042e001640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0428162450 0x7f04281628d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.970+0000 7f042d800640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0414004d00 0x7f04281636e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042cfff640 1 -- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0414004d00 msgr2=0x7f04281636e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042cfff640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0414004d00 0x7f04281636e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042cfff640 1 -- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0428162450 msgr2=0x7f04281628d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042cfff640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0428162450 0x7f04281628d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042cfff640 1 -- 172.21.15.64:0/1070094002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04281f94c0 con 0x7f04280cc930 2023-10-14T12:30:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042d800640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0414004d00 0x7f04281636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042cfff640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04280cc930 0x7f04280ccd90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0418011630 tx=0x7f0418011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:26.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f041dffb640 1 -- 172.21.15.64:0/1070094002 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800f920 con 0x7f04280cc930 2023-10-14T12:30:26.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f041dffb640 1 -- 172.21.15.64:0/1070094002 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f041800fa80 con 0x7f04280cc930 2023-10-14T12:30:26.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f041dffb640 1 -- 172.21.15.64:0/1070094002 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f041800fe10 con 0x7f04280cc930 2023-10-14T12:30:26.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04281f97a0 con 0x7f04280cc930 2023-10-14T12:30:26.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.971+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04281f9d60 con 0x7f04280cc930 2023-10-14T12:30:26.983 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.973+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f042804e9b0 con 0x7f04280cc930 2023-10-14T12:30:26.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.974+0000 7f041dffb640 1 -- 172.21.15.64:0/1070094002 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0418015460 con 0x7f04280cc930 2023-10-14T12:30:26.984 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.975+0000 7f041dffb640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f040c06ae70 0x7f040c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:26.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.975+0000 7f041dffb640 1 -- 172.21.15.64:0/1070094002 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f0418089d00 con 0x7f04280cc930 2023-10-14T12:30:26.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.975+0000 7f042d800640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f040c06ae70 0x7f040c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:26.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.976+0000 7f042d800640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f040c06ae70 0x7f040c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0424009b10 tx=0x7f0424008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:26.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:26.979+0000 7f041dffb640 1 -- 172.21.15.64:0/1070094002 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0418054f20 con 0x7f04280cc930 2023-10-14T12:30:27.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.248+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f04280ca940 con 0x7f04280cc930 2023-10-14T12:30:27.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.253+0000 7f041dffb640 1 -- 172.21.15.64:0/1070094002 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f04180220a0 con 0x7f04280cc930 2023-10-14T12:30:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f040c06ae70 msgr2=0x7f040c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f040c06ae70 0x7f040c06d330 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0424009b10 tx=0x7f0424008040 comp rx=0 tx=0).stop 2023-10-14T12:30:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04280cc930 msgr2=0x7f04280ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:27.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04280cc930 0x7f04280ccd90 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f0418011630 tx=0x7f0418011af0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 shutdown_connections 2023-10-14T12:30:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f040c06ae70 0x7f040c06d330 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0428162450 0x7f04281628d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04280cc930 0x7f04280ccd90 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 --2- 172.21.15.64:0/1070094002 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0414004d00 0x7f04281636e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.255+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 >> 172.21.15.64:0/1070094002 conn(0x7f0428069fc0 msgr2=0x7f042806ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:27.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.256+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 shutdown_connections 2023-10-14T12:30:27.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.256+0000 7f042e802640 1 -- 172.21.15.64:0/1070094002 wait complete. 2023-10-14T12:30:27.275 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-14T12:30:27.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.489+0000 7fc4933a5640 1 Processor -- start 2023-10-14T12:30:27.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.490+0000 7fc4933a5640 1 -- start start 2023-10-14T12:30:27.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.491+0000 7fc4933a5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc48c0b2dd0 0x7fc48c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:27.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.491+0000 7fc4933a5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc48c06dc20 0x7fc48c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:27.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.491+0000 7fc4933a5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc48c15f0d0 con 0x7fc48c0ceb40 2023-10-14T12:30:27.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.491+0000 7fc4933a5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c0ceff0 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.491+0000 7fc4933a5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48c15e2b0 con 0x7fc48c06dc20 2023-10-14T12:30:27.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.491+0000 7fc4923a3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc48c0b2dd0 0x7fc48c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:27.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.492+0000 7fc4923a3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc48c0b2dd0 0x7fc48c06d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53164/0 (socket says 172.21.15.64:53164) 2023-10-14T12:30:27.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.492+0000 7fc4923a3640 1 -- 172.21.15.64:0/1329830737 learned_addr learned my addr 172.21.15.64:0/1329830737 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:27.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.492+0000 7fc491ba2640 1 --2- 172.21.15.64:0/1329830737 >> v2:172.21.15.177:3300/0 conn(0x7fc48c06dc20 0x7fc48c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:27.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.492+0000 7fc4923a3640 1 -- 172.21.15.64:0/1329830737 >> v2:172.21.15.177:3300/0 conn(0x7fc48c06dc20 msgr2=0x7fc48c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:27.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.492+0000 7fc4923a3640 1 --2- 172.21.15.64:0/1329830737 >> v2:172.21.15.177:3300/0 conn(0x7fc48c06dc20 0x7fc48c0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.492+0000 7fc4923a3640 1 -- 172.21.15.64:0/1329830737 >> v1:172.21.15.64:6789/0 conn(0x7fc48c0ceb40 legacy=0x7fc48c0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:27.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.492+0000 7fc4923a3640 1 -- 172.21.15.64:0/1329830737 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48c15ab50 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.493+0000 7fc4923a3640 1 --2- 172.21.15.64:0/1329830737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c06d6e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0c1ea0 tx=0x7fc48802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9caed5e54200b11a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:27.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4913a1640 1 -- 172.21.15.64:0/1329830737 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488004230 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4913a1640 1 -- 172.21.15.64:0/1329830737 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc488004390 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4913a1640 1 -- 172.21.15.64:0/1329830737 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488030840 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 -- 172.21.15.64:0/1329830737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 msgr2=0x7fc48c06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:27.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 --2- 172.21.15.64:0/1329830737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c06d6e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc48c0c1ea0 tx=0x7fc48802b980 comp rx=0 tx=0).stop 2023-10-14T12:30:27.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 -- 172.21.15.64:0/1329830737 shutdown_connections 2023-10-14T12:30:27.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 --2- 172.21.15.64:0/1329830737 >> v2:172.21.15.177:3300/0 conn(0x7fc48c06dc20 0x7fc48c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 --2- 172.21.15.64:0/1329830737 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c06d6e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 -- 172.21.15.64:0/1329830737 >> 172.21.15.64:0/1329830737 conn(0x7fc48c069fc0 msgr2=0x7fc48c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:27.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 -- 172.21.15.64:0/1329830737 shutdown_connections 2023-10-14T12:30:27.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.494+0000 7fc4933a5640 1 -- 172.21.15.64:0/1329830737 wait complete. 2023-10-14T12:30:27.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.496+0000 7fc4933a5640 1 Processor -- start 2023-10-14T12:30:27.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.496+0000 7fc4933a5640 1 -- start start 2023-10-14T12:30:27.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.497+0000 7fc4933a5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c06dc20 0x7fc48c15a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:27.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.497+0000 7fc4933a5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c0ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:27.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.497+0000 7fc4933a5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0ceb40 0x7fc48c0acc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:27.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.497+0000 7fc4933a5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15ba00 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.497+0000 7fc4933a5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c15bce0 con 0x7fc48c06dc20 2023-10-14T12:30:27.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.497+0000 7fc4933a5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c0c5490 con 0x7fc48c0ceb40 2023-10-14T12:30:27.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c0ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:27.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c0ac6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53174/0 (socket says 172.21.15.64:53174) 2023-10-14T12:30:27.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 -- 172.21.15.64:0/2017969503 learned_addr learned my addr 172.21.15.64:0/2017969503 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:27.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc4923a3640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c06dc20 0x7fc48c15a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:27.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc492ba4640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0ceb40 0x7fc48c0acc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:27.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 -- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0ceb40 msgr2=0x7fc48c0acc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:27.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0ceb40 0x7fc48c0acc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 -- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c06dc20 msgr2=0x7fc48c15a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:27.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c06dc20 0x7fc48c15a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.498+0000 7fc491ba2640 1 -- 172.21.15.64:0/2017969503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc488009460 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.499+0000 7fc491ba2640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c0ac6e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00d7d0 tx=0x7fc47c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:27.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.499+0000 7fc482ffd640 1 -- 172.21.15.64:0/2017969503 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c018070 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.499+0000 7fc482ffd640 1 -- 172.21.15.64:0/2017969503 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c004020 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.499+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c0c5770 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.499+0000 7fc482ffd640 1 -- 172.21.15.64:0/2017969503 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0041b0 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.499+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c15b680 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.500+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c15bb40 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.502+0000 7fc482ffd640 1 -- 172.21.15.64:0/2017969503 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc47c004310 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.502+0000 7fc482ffd640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc47006ae70 0x7fc47006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:27.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.503+0000 7fc482ffd640 1 -- 172.21.15.64:0/2017969503 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc47c0892a0 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.503+0000 7fc4923a3640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc47006ae70 0x7fc47006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:27.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.504+0000 7fc4923a3640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc47006ae70 0x7fc47006d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc488035000 tx=0x7fc488008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:27.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.507+0000 7fc482ffd640 1 -- 172.21.15.64:0/2017969503 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc48c15bb40 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.768 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.767+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fc48c15bb40 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.771+0000 7fc482ffd640 1 -- 172.21.15.64:0/2017969503 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc48c15bb40 con 0x7fc48c0b2dd0 2023-10-14T12:30:27.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc47006ae70 msgr2=0x7fc47006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:27.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc47006ae70 0x7fc47006d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc488035000 tx=0x7fc488008030 comp rx=0 tx=0).stop 2023-10-14T12:30:27.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 msgr2=0x7fc48c0ac6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:27.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c0ac6e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00d7d0 tx=0x7fc47c00dc90 comp rx=0 tx=0).stop 2023-10-14T12:30:27.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 shutdown_connections 2023-10-14T12:30:27.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc47006ae70 0x7fc47006d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc48c0ceb40 0x7fc48c0acc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc48c0b2dd0 0x7fc48c0ac6e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 --2- 172.21.15.64:0/2017969503 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc48c06dc20 0x7fc48c15a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:27.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 >> 172.21.15.64:0/2017969503 conn(0x7fc48c069fc0 msgr2=0x7fc48c070d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:27.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 shutdown_connections 2023-10-14T12:30:27.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:27.774+0000 7fc4933a5640 1 -- 172.21.15.64:0/2017969503 wait complete. 2023-10-14T12:30:27.792 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-14T12:30:28.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.011+0000 7fa019264640 1 Processor -- start 2023-10-14T12:30:28.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.011+0000 7fa019264640 1 -- start start 2023-10-14T12:30:28.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa019264640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ad970 0x7fa0140b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa019264640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa0140b2e90 0x7fa0140ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa019264640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa0140ceb40 0x7fa0140b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa019264640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa014159b40 con 0x7fa0140b2e90 2023-10-14T12:30:28.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa019264640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0140cefb0 con 0x7fa0140ceb40 2023-10-14T12:30:28.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa019264640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0140c8a10 con 0x7fa0140ad970 2023-10-14T12:30:28.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa0137fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa0140b2e90 0x7fa0140ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa0137fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa0140b2e90 0x7fa0140ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53190/0 (socket says 172.21.15.64:53190) 2023-10-14T12:30:28.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.012+0000 7fa0137fe640 1 -- 172.21.15.64:0/303215451 learned_addr learned my addr 172.21.15.64:0/303215451 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:28.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.013+0000 7fa018a63640 1 --2- 172.21.15.64:0/303215451 >> v2:172.21.15.177:3300/0 conn(0x7fa0140ceb40 0x7fa0140b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.013+0000 7fa013fff640 1 --2- 172.21.15.64:0/303215451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ad970 0x7fa0140b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.013+0000 7fa0137fe640 1 -- 172.21.15.64:0/303215451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ad970 msgr2=0x7fa0140b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:28.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.013+0000 7fa0137fe640 1 --2- 172.21.15.64:0/303215451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ad970 0x7fa0140b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.013+0000 7fa0137fe640 1 -- 172.21.15.64:0/303215451 >> v2:172.21.15.177:3300/0 conn(0x7fa0140ceb40 msgr2=0x7fa0140b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:28.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.013+0000 7fa0137fe640 1 --2- 172.21.15.64:0/303215451 >> v2:172.21.15.177:3300/0 conn(0x7fa0140ceb40 0x7fa0140b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.013+0000 7fa0137fe640 1 -- 172.21.15.64:0/303215451 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01415d1a0 con 0x7fa0140b2e90 2023-10-14T12:30:28.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.014+0000 7fa0137fe640 1 --2- 172.21.15.64:0/303215451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140b2e90 0x7fa0140ce600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa01406df60 tx=0x7fa00802e030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7119a80ed4296d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:28.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.014+0000 7fa012ffd640 1 -- 172.21.15.64:0/303215451 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00802ede0 con 0x7fa0140b2e90 2023-10-14T12:30:28.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.014+0000 7fa012ffd640 1 -- 172.21.15.64:0/303215451 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa008036440 con 0x7fa0140b2e90 2023-10-14T12:30:28.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.014+0000 7fa012ffd640 1 -- 172.21.15.64:0/303215451 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0080367d0 con 0x7fa0140b2e90 2023-10-14T12:30:28.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 -- 172.21.15.64:0/303215451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140b2e90 msgr2=0x7fa0140ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 --2- 172.21.15.64:0/303215451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140b2e90 0x7fa0140ce600 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fa01406df60 tx=0x7fa00802e030 comp rx=0 tx=0).stop 2023-10-14T12:30:28.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 -- 172.21.15.64:0/303215451 shutdown_connections 2023-10-14T12:30:28.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 --2- 172.21.15.64:0/303215451 >> v2:172.21.15.177:3300/0 conn(0x7fa0140ceb40 0x7fa0140b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 --2- 172.21.15.64:0/303215451 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140b2e90 0x7fa0140ce600 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 --2- 172.21.15.64:0/303215451 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ad970 0x7fa0140b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 -- 172.21.15.64:0/303215451 >> 172.21.15.64:0/303215451 conn(0x7fa014069fc0 msgr2=0x7fa01406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:28.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 -- 172.21.15.64:0/303215451 shutdown_connections 2023-10-14T12:30:28.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.015+0000 7fa019264640 1 -- 172.21.15.64:0/303215451 wait complete. 2023-10-14T12:30:28.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.017+0000 7fa019264640 1 Processor -- start 2023-10-14T12:30:28.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.017+0000 7fa019264640 1 -- start start 2023-10-14T12:30:28.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa019264640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140ad970 0x7fa0140acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa019264640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0140b2e90 0x7fa014155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa019264640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ceb40 0x7fa0140af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa019264640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0141558a0 con 0x7fa0140ad970 2023-10-14T12:30:28.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa019264640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0141562a0 con 0x7fa0140b2e90 2023-10-14T12:30:28.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa019264640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa014154ae0 con 0x7fa0140ceb40 2023-10-14T12:30:28.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140ad970 0x7fa0140acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140ad970 0x7fa0140acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53198/0 (socket says 172.21.15.64:53198) 2023-10-14T12:30:28.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 -- 172.21.15.64:0/1700295934 learned_addr learned my addr 172.21.15.64:0/1700295934 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:28.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 -- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ceb40 msgr2=0x7fa0140af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ceb40 0x7fa0140af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 -- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0140b2e90 msgr2=0x7fa014155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa0137fe640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0140b2e90 0x7fa014155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0140b2e90 0x7fa014155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.018+0000 7fa013fff640 1 -- 172.21.15.64:0/1700295934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa00800b770 con 0x7fa0140ad970 2023-10-14T12:30:28.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.019+0000 7fa013fff640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140ad970 0x7fa0140acf20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa004007e10 tx=0x7fa00400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:28.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.019+0000 7fa010ff9640 1 -- 172.21.15.64:0/1700295934 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004014620 con 0x7fa0140ad970 2023-10-14T12:30:28.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.019+0000 7fa010ff9640 1 -- 172.21.15.64:0/1700295934 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa004014780 con 0x7fa0140ad970 2023-10-14T12:30:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.019+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa014154dc0 con 0x7fa0140ad970 2023-10-14T12:30:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.019+0000 7fa010ff9640 1 -- 172.21.15.64:0/1700295934 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004014b30 con 0x7fa0140ad970 2023-10-14T12:30:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.019+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa014155380 con 0x7fa0140ad970 2023-10-14T12:30:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.020+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01404e9b0 con 0x7fa0140ad970 2023-10-14T12:30:28.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.021+0000 7fa010ff9640 1 -- 172.21.15.64:0/1700295934 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa004014c90 con 0x7fa0140ad970 2023-10-14T12:30:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.022+0000 7fa010ff9640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa00006ae70 0x7fa00006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.022+0000 7fa010ff9640 1 -- 172.21.15.64:0/1700295934 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa004089cd0 con 0x7fa0140ad970 2023-10-14T12:30:28.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.023+0000 7fa0137fe640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa00006ae70 0x7fa00006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.024+0000 7fa0137fe640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa00006ae70 0x7fa00006d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa008038000 tx=0x7fa008008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:28.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.027+0000 7fa010ff9640 1 -- 172.21.15.64:0/1700295934 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa004054f80 con 0x7fa0140ad970 2023-10-14T12:30:28.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.282+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fa01406dc00 con 0x7fa0140ad970 2023-10-14T12:30:28.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.286+0000 7fa010ff9640 1 -- 172.21.15.64:0/1700295934 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa0040585a0 con 0x7fa0140ad970 2023-10-14T12:30:28.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa00006ae70 msgr2=0x7fa00006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.290 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa00006ae70 0x7fa00006d330 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa008038000 tx=0x7fa008008040 comp rx=0 tx=0).stop 2023-10-14T12:30:28.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140ad970 msgr2=0x7fa0140acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140ad970 0x7fa0140acf20 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fa004007e10 tx=0x7fa00400e4b0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 shutdown_connections 2023-10-14T12:30:28.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa00006ae70 0x7fa00006d330 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.291 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa0140ceb40 0x7fa0140af1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa0140b2e90 0x7fa014155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 --2- 172.21.15.64:0/1700295934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa0140ad970 0x7fa0140acf20 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.289+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 >> 172.21.15.64:0/1700295934 conn(0x7fa014069fc0 msgr2=0x7fa0140c8c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:28.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.290+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 shutdown_connections 2023-10-14T12:30:28.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.290+0000 7fa019264640 1 -- 172.21.15.64:0/1700295934 wait complete. 2023-10-14T12:30:28.308 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-14T12:30:28.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.530+0000 7ff393fff640 1 Processor -- start 2023-10-14T12:30:28.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.530+0000 7ff393fff640 1 -- start start 2023-10-14T12:30:28.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.531+0000 7ff393fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.531+0000 7ff393fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff3940cfe70 0x7ff3940cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.531+0000 7ff393fff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3940d3760 con 0x7ff39415cc90 2023-10-14T12:30:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff393fff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3940cf9e0 con 0x7ff3940cfe70 2023-10-14T12:30:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff393fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff39415d070 con 0x7ff3940d14d0 2023-10-14T12:30:28.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3937fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff3940cfe70 0x7ff3940cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3937fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff3940cfe70 0x7ff3940cd830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53204/0 (socket says 172.21.15.64:53204) 2023-10-14T12:30:28.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3937fe640 1 -- 172.21.15.64:0/78055855 learned_addr learned my addr 172.21.15.64:0/78055855 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:28.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3927fc640 1 --2- 172.21.15.64:0/78055855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3937fe640 1 -- 172.21.15.64:0/78055855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 msgr2=0x7ff3940cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:28.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3937fe640 1 --2- 172.21.15.64:0/78055855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3937fe640 1 -- 172.21.15.64:0/78055855 >> v1:172.21.15.177:6789/0 conn(0x7ff39415cc90 legacy=0x7ff3940d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3937fe640 1 -- 172.21.15.64:0/78055855 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3940b1870 con 0x7ff3940cfe70 2023-10-14T12:30:28.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.532+0000 7ff3927fc640 1 --2- 172.21.15.64:0/78055855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:28.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.534+0000 7ff3937fe640 1 --2- 172.21.15.64:0/78055855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3940cfe70 0x7ff3940cd830 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009870 tx=0x7ff38c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0c256768a71367 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:28.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.534+0000 7ff391ffb640 1 -- 172.21.15.64:0/78055855 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c031860 con 0x7ff3940cfe70 2023-10-14T12:30:28.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.534+0000 7ff391ffb640 1 -- 172.21.15.64:0/78055855 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c0319c0 con 0x7ff3940cfe70 2023-10-14T12:30:28.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.534+0000 7ff391ffb640 1 -- 172.21.15.64:0/78055855 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c031d50 con 0x7ff3940cfe70 2023-10-14T12:30:28.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.534+0000 7ff393fff640 1 -- 172.21.15.64:0/78055855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3940cfe70 msgr2=0x7ff3940cd830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.534+0000 7ff393fff640 1 --2- 172.21.15.64:0/78055855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3940cfe70 0x7ff3940cd830 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009870 tx=0x7ff38c02b900 comp rx=0 tx=0).stop 2023-10-14T12:30:28.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.535+0000 7ff393fff640 1 -- 172.21.15.64:0/78055855 shutdown_connections 2023-10-14T12:30:28.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.535+0000 7ff393fff640 1 --2- 172.21.15.64:0/78055855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff3940cfe70 0x7ff3940cd830 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.535+0000 7ff393fff640 1 --2- 172.21.15.64:0/78055855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940cd2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.535+0000 7ff393fff640 1 -- 172.21.15.64:0/78055855 >> 172.21.15.64:0/78055855 conn(0x7ff3940d27e0 msgr2=0x7ff3940d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:28.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.535+0000 7ff393fff640 1 -- 172.21.15.64:0/78055855 shutdown_connections 2023-10-14T12:30:28.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.535+0000 7ff393fff640 1 -- 172.21.15.64:0/78055855 wait complete. 2023-10-14T12:30:28.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.536+0000 7ff393fff640 1 Processor -- start 2023-10-14T12:30:28.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.537+0000 7ff393fff640 1 -- start start 2023-10-14T12:30:28.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.537+0000 7ff393fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3940cfe70 0x7ff394155b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.537+0000 7ff393fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940b4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.537+0000 7ff393fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff39415cc90 0x7ff3940b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.537+0000 7ff393fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3941560c0 con 0x7ff39415cc90 2023-10-14T12:30:28.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.537+0000 7ff393fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940b2570 con 0x7ff3940cfe70 2023-10-14T12:30:28.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.537+0000 7ff393fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3940b2850 con 0x7ff3940d14d0 2023-10-14T12:30:28.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff39415cc90 0x7ff3940b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff39415cc90 0x7ff3940b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53212/0 (socket says 172.21.15.64:53212) 2023-10-14T12:30:28.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 -- 172.21.15.64:0/3529635494 learned_addr learned my addr 172.21.15.64:0/3529635494 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:28.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3927fc640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940b4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff392ffd640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3940cfe70 0x7ff394155b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 -- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 msgr2=0x7ff3940b4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940b4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 -- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3940cfe70 msgr2=0x7ff394155b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3940cfe70 0x7ff394155b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3937fe640 1 -- 172.21.15.64:0/3529635494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c0094d0 con 0x7ff39415cc90 2023-10-14T12:30:28.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff3927fc640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:28.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.538+0000 7ff392ffd640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3940cfe70 0x7ff394155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:28.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.539+0000 7ff3937fe640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff39415cc90 0x7ff3940b4d80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009870 tx=0x7ff38c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:28.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.539+0000 7ff38b7fe640 1 -- 172.21.15.64:0/3529635494 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c03ac60 con 0x7ff39415cc90 2023-10-14T12:30:28.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.539+0000 7ff38b7fe640 1 -- 172.21.15.64:0/3529635494 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38c03ade0 con 0x7ff39415cc90 2023-10-14T12:30:28.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.539+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3940b2b30 con 0x7ff39415cc90 2023-10-14T12:30:28.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.539+0000 7ff38b7fe640 1 -- 172.21.15.64:0/3529635494 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38c044630 con 0x7ff39415cc90 2023-10-14T12:30:28.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.539+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3940b30f0 con 0x7ff39415cc90 2023-10-14T12:30:28.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.540+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3940b32e0 con 0x7ff39415cc90 2023-10-14T12:30:28.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.541+0000 7ff38b7fe640 1 -- 172.21.15.64:0/3529635494 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff38c04d450 con 0x7ff39415cc90 2023-10-14T12:30:28.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.542+0000 7ff38b7fe640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff37406ae70 0x7ff37406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:28.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.542+0000 7ff38b7fe640 1 -- 172.21.15.64:0/3529635494 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff38c0ab960 con 0x7ff39415cc90 2023-10-14T12:30:28.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.543+0000 7ff392ffd640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff37406ae70 0x7ff37406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:28.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.544+0000 7ff392ffd640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff37406ae70 0x7ff37406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff3840012e0 tx=0x7ff384009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:28.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.546+0000 7ff38b7fe640 1 -- 172.21.15.64:0/3529635494 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff38c076c20 con 0x7ff39415cc90 2023-10-14T12:30:28.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.812+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7ff39404e9b0 con 0x7ff39415cc90 2023-10-14T12:30:28.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.816+0000 7ff38b7fe640 1 -- 172.21.15.64:0/3529635494 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff38c035070 con 0x7ff39415cc90 2023-10-14T12:30:28.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff37406ae70 msgr2=0x7ff37406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff37406ae70 0x7ff37406d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff3840012e0 tx=0x7ff384009040 comp rx=0 tx=0).stop 2023-10-14T12:30:28.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff39415cc90 msgr2=0x7ff3940b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:28.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff39415cc90 0x7ff3940b4d80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7ff38c009870 tx=0x7ff38c0046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 shutdown_connections 2023-10-14T12:30:28.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff37406ae70 0x7ff37406d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff39415cc90 0x7ff3940b4d80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff3940d14d0 0x7ff3940b4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 --2- 172.21.15.64:0/3529635494 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff3940cfe70 0x7ff394155b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:28.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 >> 172.21.15.64:0/3529635494 conn(0x7ff3940d27e0 msgr2=0x7ff39415a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:28.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 shutdown_connections 2023-10-14T12:30:28.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:28.819+0000 7ff393fff640 1 -- 172.21.15.64:0/3529635494 wait complete. 2023-10-14T12:30:28.838 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-14T12:30:29.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.066+0000 7eff74aad640 1 Processor -- start 2023-10-14T12:30:29.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.067+0000 7eff74aad640 1 -- start start 2023-10-14T12:30:29.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.068+0000 7eff74aad640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7eff7015cc90 0x7eff700d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.068+0000 7eff74aad640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7eff700cfe70 0x7eff700d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.068+0000 7eff74aad640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff700d05c0 0x7eff7006af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.068+0000 7eff74aad640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700d3760 con 0x7eff700cfe70 2023-10-14T12:30:29.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.068+0000 7eff74aad640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff700cf9e0 con 0x7eff7015cc90 2023-10-14T12:30:29.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.068+0000 7eff74aad640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff7015d070 con 0x7eff700d05c0 2023-10-14T12:30:29.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.068+0000 7eff6effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7eff700cfe70 0x7eff700d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7eff700cfe70 0x7eff700d1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53218/0 (socket says 172.21.15.64:53218) 2023-10-14T12:30:29.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6effd640 1 -- 172.21.15.64:0/1803546330 learned_addr learned my addr 172.21.15.64:0/1803546330 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:29.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6f7fe640 1 --2- 172.21.15.64:0/1803546330 >> v2:172.21.15.177:3300/0 conn(0x7eff7015cc90 0x7eff700d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6ffff640 1 --2- 172.21.15.64:0/1803546330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff700d05c0 0x7eff7006af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6effd640 1 -- 172.21.15.64:0/1803546330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff700d05c0 msgr2=0x7eff7006af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:29.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6effd640 1 --2- 172.21.15.64:0/1803546330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff700d05c0 0x7eff7006af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.074 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6effd640 1 -- 172.21.15.64:0/1803546330 >> v2:172.21.15.177:3300/0 conn(0x7eff7015cc90 msgr2=0x7eff700d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:29.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6effd640 1 --2- 172.21.15.64:0/1803546330 >> v2:172.21.15.177:3300/0 conn(0x7eff7015cc90 0x7eff700d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.075 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.069+0000 7eff6effd640 1 -- 172.21.15.64:0/1803546330 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff700b1870 con 0x7eff700cfe70 2023-10-14T12:30:29.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.070+0000 7eff6effd640 1 --2- 172.21.15.64:0/1803546330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700cfe70 0x7eff700d1300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7eff700ce890 tx=0x7eff6402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4bb366b0afa4919 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:29.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff6e7fc640 1 -- 172.21.15.64:0/1803546330 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff640317e0 con 0x7eff700cfe70 2023-10-14T12:30:29.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff6e7fc640 1 -- 172.21.15.64:0/1803546330 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64031940 con 0x7eff700cfe70 2023-10-14T12:30:29.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff6e7fc640 1 -- 172.21.15.64:0/1803546330 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64031cd0 con 0x7eff700cfe70 2023-10-14T12:30:29.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff74aad640 1 -- 172.21.15.64:0/1803546330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700cfe70 msgr2=0x7eff700d1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff74aad640 1 --2- 172.21.15.64:0/1803546330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700cfe70 0x7eff700d1300 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7eff700ce890 tx=0x7eff6402b880 comp rx=0 tx=0).stop 2023-10-14T12:30:29.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff74aad640 1 -- 172.21.15.64:0/1803546330 shutdown_connections 2023-10-14T12:30:29.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff74aad640 1 --2- 172.21.15.64:0/1803546330 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff700d05c0 0x7eff7006af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff74aad640 1 --2- 172.21.15.64:0/1803546330 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700cfe70 0x7eff700d1300 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff74aad640 1 --2- 172.21.15.64:0/1803546330 >> v2:172.21.15.177:3300/0 conn(0x7eff7015cc90 0x7eff700d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.071+0000 7eff74aad640 1 -- 172.21.15.64:0/1803546330 >> 172.21.15.64:0/1803546330 conn(0x7eff700d27e0 msgr2=0x7eff700d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:29.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.072+0000 7eff74aad640 1 -- 172.21.15.64:0/1803546330 shutdown_connections 2023-10-14T12:30:29.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.072+0000 7eff74aad640 1 -- 172.21.15.64:0/1803546330 wait complete. 2023-10-14T12:30:29.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.073+0000 7eff74aad640 1 Processor -- start 2023-10-14T12:30:29.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.074+0000 7eff74aad640 1 -- start start 2023-10-14T12:30:29.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.074+0000 7eff74aad640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff700cfe70 0x7eff700cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.074+0000 7eff74aad640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700d05c0 0x7eff70156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff74aad640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff7015cc90 0x7eff7014b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff74aad640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff70157940 con 0x7eff700d05c0 2023-10-14T12:30:29.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff74aad640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff701570a0 con 0x7eff700cfe70 2023-10-14T12:30:29.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff74aad640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff70157380 con 0x7eff7015cc90 2023-10-14T12:30:29.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700d05c0 0x7eff70156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700d05c0 0x7eff70156650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53226/0 (socket says 172.21.15.64:53226) 2023-10-14T12:30:29.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 -- 172.21.15.64:0/2710358617 learned_addr learned my addr 172.21.15.64:0/2710358617 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:29.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6f7fe640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff700cfe70 0x7eff700cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6ffff640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff7015cc90 0x7eff7014b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 -- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff7015cc90 msgr2=0x7eff7014b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff7015cc90 0x7eff7014b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 -- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff700cfe70 msgr2=0x7eff700cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff700cfe70 0x7eff700cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.075+0000 7eff6effd640 1 -- 172.21.15.64:0/2710358617 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640094d0 con 0x7eff700d05c0 2023-10-14T12:30:29.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.076+0000 7eff6effd640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700d05c0 0x7eff70156650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7eff64000c00 tx=0x7eff640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:29.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.076+0000 7eff57fff640 1 -- 172.21.15.64:0/2710358617 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64032880 con 0x7eff700d05c0 2023-10-14T12:30:29.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.076+0000 7eff57fff640 1 -- 172.21.15.64:0/2710358617 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff64032a20 con 0x7eff700d05c0 2023-10-14T12:30:29.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.076+0000 7eff57fff640 1 -- 172.21.15.64:0/2710358617 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff64032dd0 con 0x7eff700d05c0 2023-10-14T12:30:29.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.076+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff70157660 con 0x7eff700d05c0 2023-10-14T12:30:29.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.076+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff70157d70 con 0x7eff700d05c0 2023-10-14T12:30:29.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.077+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff700c9b90 con 0x7eff700d05c0 2023-10-14T12:30:29.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.078+0000 7eff57fff640 1 -- 172.21.15.64:0/2710358617 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7eff6404e450 con 0x7eff700d05c0 2023-10-14T12:30:29.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.080+0000 7eff57fff640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7eff5c06ae70 0x7eff5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.080+0000 7eff57fff640 1 -- 172.21.15.64:0/2710358617 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7eff640ab550 con 0x7eff700d05c0 2023-10-14T12:30:29.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.080+0000 7eff6f7fe640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7eff5c06ae70 0x7eff5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.081+0000 7eff6f7fe640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7eff5c06ae70 0x7eff5c06d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff60006fd0 tx=0x7eff60008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:29.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.084+0000 7eff57fff640 1 -- 172.21.15.64:0/2710358617 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7eff700c9b90 con 0x7eff700d05c0 2023-10-14T12:30:29.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.352+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7eff700c9b90 con 0x7eff700d05c0 2023-10-14T12:30:29.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.357+0000 7eff57fff640 1 -- 172.21.15.64:0/2710358617 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7eff700c9b90 con 0x7eff700d05c0 2023-10-14T12:30:29.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.359+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7eff5c06ae70 msgr2=0x7eff5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7eff5c06ae70 0x7eff5c06d330 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7eff60006fd0 tx=0x7eff60008040 comp rx=0 tx=0).stop 2023-10-14T12:30:29.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700d05c0 msgr2=0x7eff70156650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700d05c0 0x7eff70156650 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7eff64000c00 tx=0x7eff640046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.361 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 shutdown_connections 2023-10-14T12:30:29.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7eff5c06ae70 0x7eff5c06d330 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7eff7015cc90 0x7eff7014b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7eff700d05c0 0x7eff70156650 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 --2- 172.21.15.64:0/2710358617 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7eff700cfe70 0x7eff700cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 >> 172.21.15.64:0/2710358617 conn(0x7eff700d27e0 msgr2=0x7eff701597c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:29.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 shutdown_connections 2023-10-14T12:30:29.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.360+0000 7eff74aad640 1 -- 172.21.15.64:0/2710358617 wait complete. 2023-10-14T12:30:29.380 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-14T12:30:29.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.604+0000 7f2c6359e640 1 Processor -- start 2023-10-14T12:30:29.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.604+0000 7f2c6359e640 1 -- start start 2023-10-14T12:30:29.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.606+0000 7f2c6359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 0x7f2c6406d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.606+0000 7f2c6359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6415f0d0 con 0x7f2c6406dc20 2023-10-14T12:30:29.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.606+0000 7f2c6359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c6415ab50 con 0x7f2c640ced10 2023-10-14T12:30:29.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.606+0000 7f2c6359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6415e2b0 con 0x7f2c640b2dd0 2023-10-14T12:30:29.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.606+0000 7f2c5bfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2c6406dc20 0x7f2c640ce600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34244/0 (socket says 172.21.15.64:34244) 2023-10-14T12:30:29.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.606+0000 7f2c5bfff640 1 -- 172.21.15.64:0/3271889685 learned_addr learned my addr 172.21.15.64:0/3271889685 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:29.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.607+0000 7f2c6259c640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 0x7f2c6406d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.607+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527843373 0 0) 0x7f2c6415f0d0 con 0x7f2c6406dc20 2023-10-14T12:30:29.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.607+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c50003520 con 0x7f2c6406dc20 2023-10-14T12:30:29.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.607+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2667964390 0 0) 0x7f2c50003520 con 0x7f2c6406dc20 2023-10-14T12:30:29.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.607+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 msgr2=0x7f2c6406d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:29.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.607+0000 7f2c61d9b640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 0x7f2c6406d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.607+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 >> v1:172.21.15.177:6789/0 conn(0x7f2c640ced10 legacy=0x7f2c640ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c6406d3a0 con 0x7f2c6406dc20 2023-10-14T12:30:29.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f2c4c001670 con 0x7f2c6406dc20 2023-10-14T12:30:29.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 >> v1:172.21.15.64:6789/0 conn(0x7f2c6406dc20 legacy=0x7f2c640ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c500039a0 0x7f2c50003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 0x7f2c500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6415e2b0 con 0x7f2c50004d00 2023-10-14T12:30:29.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5000b980 con 0x7f2c500039a0 2023-10-14T12:30:29.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c5000bb40 con 0x7f2c640b2dd0 2023-10-14T12:30:29.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c62d9d640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c6259c640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c500039a0 0x7f2c50003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.608+0000 7f2c5bfff640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 0x7f2c500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.609+0000 7f2c62d9d640 1 -- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 msgr2=0x7f2c500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:29.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.609+0000 7f2c62d9d640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 0x7f2c500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.609+0000 7f2c62d9d640 1 -- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c500039a0 msgr2=0x7f2c50003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:29.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.609+0000 7f2c62d9d640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c500039a0 0x7f2c50003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.609+0000 7f2c62d9d640 1 -- 172.21.15.64:0/3271889685 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c50003520 con 0x7f2c50004d00 2023-10-14T12:30:29.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.609+0000 7f2c5bfff640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640b2dd0 0x7f2c500047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:29.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.610+0000 7f2c62d9d640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c50005180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c001f60 tx=0x7f2c500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e840af3d3c629f00 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:29.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.610+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c02d6f0 con 0x7f2c50004d00 2023-10-14T12:30:29.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.610+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c5c02d870 con 0x7f2c50004d00 2023-10-14T12:30:29.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.610+0000 7f2c61d9b640 1 -- 172.21.15.64:0/3271889685 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c02dc20 con 0x7f2c50004d00 2023-10-14T12:30:29.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.610+0000 7f2c6359e640 1 -- 172.21.15.64:0/3271889685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 msgr2=0x7f2c50005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.610+0000 7f2c6359e640 1 --2- 172.21.15.64:0/3271889685 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c50005180 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c001f60 tx=0x7f2c500057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.610+0000 7f2c62d9d640 1 -- 172.21.15.64:0/3271889685 reap_dead start 2023-10-14T12:30:29.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.611+0000 7f2c6359e640 1 -- 172.21.15.64:0/3271889685 shutdown_connections 2023-10-14T12:30:29.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.611+0000 7f2c6359e640 1 -- 172.21.15.64:0/3271889685 >> 172.21.15.64:0/3271889685 conn(0x7f2c64069fc0 msgr2=0x7f2c6406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:29.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.611+0000 7f2c6359e640 1 -- 172.21.15.64:0/3271889685 shutdown_connections 2023-10-14T12:30:29.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.611+0000 7f2c6359e640 1 -- 172.21.15.64:0/3271889685 wait complete. 2023-10-14T12:30:29.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.612+0000 7f2c6359e640 1 Processor -- start 2023-10-14T12:30:29.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.613+0000 7f2c6359e640 1 -- start start 2023-10-14T12:30:29.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c641f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640c6160 0x7f2c640b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c64159ee0 0x7f2c6415a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6415bee0 con 0x7f2c50004d00 2023-10-14T12:30:29.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6415a8d0 con 0x7f2c64159ee0 2023-10-14T12:30:29.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c641f66c0 con 0x7f2c640c6160 2023-10-14T12:30:29.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c641f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c641f57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53246/0 (socket says 172.21.15.64:53246) 2023-10-14T12:30:29.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 -- 172.21.15.64:0/2908154169 learned_addr learned my addr 172.21.15.64:0/2908154169 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c62d9d640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c64159ee0 0x7f2c6415a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c5bfff640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640c6160 0x7f2c640b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 -- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640c6160 msgr2=0x7f2c640b11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640c6160 0x7f2c640b11b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 -- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c64159ee0 msgr2=0x7f2c6415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c64159ee0 0x7f2c6415a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c6259c640 1 -- 172.21.15.64:0/2908154169 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c641f5e20 con 0x7f2c50004d00 2023-10-14T12:30:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.614+0000 7f2c62d9d640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c64159ee0 0x7f2c6415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.615+0000 7f2c6259c640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c641f57d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2c540115e0 tx=0x7f2c54011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:29.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.615+0000 7f2c5affd640 1 -- 172.21.15.64:0/2908154169 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c54005da0 con 0x7f2c50004d00 2023-10-14T12:30:29.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.615+0000 7f2c5affd640 1 -- 172.21.15.64:0/2908154169 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c54006050 con 0x7f2c50004d00 2023-10-14T12:30:29.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.615+0000 7f2c5affd640 1 -- 172.21.15.64:0/2908154169 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c540063c0 con 0x7f2c50004d00 2023-10-14T12:30:29.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.615+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c641f6100 con 0x7f2c50004d00 2023-10-14T12:30:29.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.615+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c640c65e0 con 0x7f2c50004d00 2023-10-14T12:30:29.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.616+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c6404e9b0 con 0x7f2c50004d00 2023-10-14T12:30:29.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.617+0000 7f2c5affd640 1 -- 172.21.15.64:0/2908154169 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2c54006520 con 0x7f2c50004d00 2023-10-14T12:30:29.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.618+0000 7f2c5affd640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2c4406aea0 0x7f2c4406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:29.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.618+0000 7f2c5affd640 1 -- 172.21.15.64:0/2908154169 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2c54089a90 con 0x7f2c50004d00 2023-10-14T12:30:29.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.619+0000 7f2c5bfff640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2c4406aea0 0x7f2c4406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:29.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.620+0000 7f2c5bfff640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2c4406aea0 0x7f2c4406d360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c6415bbc0 tx=0x7f2c4c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:29.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.623+0000 7f2c5affd640 1 -- 172.21.15.64:0/2908154169 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2c54054d40 con 0x7f2c50004d00 2023-10-14T12:30:29.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.884+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f2c6406c940 con 0x7f2c50004d00 2023-10-14T12:30:29.890 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.890+0000 7f2c5affd640 1 -- 172.21.15.64:0/2908154169 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f2c54023020 con 0x7f2c50004d00 2023-10-14T12:30:29.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2c4406aea0 msgr2=0x7f2c4406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2c4406aea0 0x7f2c4406d360 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c6415bbc0 tx=0x7f2c4c009040 comp rx=0 tx=0).stop 2023-10-14T12:30:29.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 msgr2=0x7f2c641f57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c641f57d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f2c540115e0 tx=0x7f2c54011aa0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 shutdown_connections 2023-10-14T12:30:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2c4406aea0 0x7f2c4406d360 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2c64159ee0 0x7f2c6415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2c640c6160 0x7f2c640b11b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 --2- 172.21.15.64:0/2908154169 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2c50004d00 0x7f2c641f57d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 >> 172.21.15.64:0/2908154169 conn(0x7f2c64069fc0 msgr2=0x7f2c640af1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 shutdown_connections 2023-10-14T12:30:29.895 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:29.892+0000 7f2c6359e640 1 -- 172.21.15.64:0/2908154169 wait complete. 2023-10-14T12:30:29.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:30.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.130+0000 7f892b305640 1 Processor -- start 2023-10-14T12:30:30.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.130+0000 7f892b305640 1 -- start start 2023-10-14T12:30:30.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f892b305640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f892415ca80 0x7f89240cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f892b305640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f892415ce60 0x7f89240b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f892b305640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89240b0960 con 0x7f89240b0550 2023-10-14T12:30:30.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f892b305640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89240cd500 con 0x7f892415ca80 2023-10-14T12:30:30.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f892b305640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8924161620 con 0x7f892415ce60 2023-10-14T12:30:30.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f89290a1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f892415ca80 0x7f89240cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f89290a1640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f892415ca80 0x7f89240cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53252/0 (socket says 172.21.15.64:53252) 2023-10-14T12:30:30.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f89290a1640 1 -- 172.21.15.64:0/3885832196 learned_addr learned my addr 172.21.15.64:0/3885832196 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:30.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.132+0000 7f89288a0640 1 --2- 172.21.15.64:0/3885832196 >> v2:172.21.15.177:3300/0 conn(0x7f892415ce60 0x7f89240b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.133+0000 7f89290a1640 1 -- 172.21.15.64:0/3885832196 >> v2:172.21.15.177:3300/0 conn(0x7f892415ce60 msgr2=0x7f89240b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:30.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.133+0000 7f89290a1640 1 --2- 172.21.15.64:0/3885832196 >> v2:172.21.15.177:3300/0 conn(0x7f892415ce60 0x7f89240b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.133+0000 7f89290a1640 1 -- 172.21.15.64:0/3885832196 >> v1:172.21.15.177:6789/0 conn(0x7f89240b0550 legacy=0x7f89240c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.133+0000 7f89290a1640 1 -- 172.21.15.64:0/3885832196 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89240cafa0 con 0x7f892415ca80 2023-10-14T12:30:30.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.134+0000 7f89290a1640 1 --2- 172.21.15.64:0/3885832196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892415ca80 0x7f89240cddf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f89240b10e0 tx=0x7f892002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd32730121722442 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:30.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.135+0000 7f891bfff640 1 -- 172.21.15.64:0/3885832196 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920030860 con 0x7f892415ca80 2023-10-14T12:30:30.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.135+0000 7f891bfff640 1 -- 172.21.15.64:0/3885832196 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89200309c0 con 0x7f892415ca80 2023-10-14T12:30:30.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.135+0000 7f891bfff640 1 -- 172.21.15.64:0/3885832196 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920030d50 con 0x7f892415ca80 2023-10-14T12:30:30.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.135+0000 7f892b305640 1 -- 172.21.15.64:0/3885832196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892415ca80 msgr2=0x7f89240cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.135+0000 7f892b305640 1 --2- 172.21.15.64:0/3885832196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892415ca80 0x7f89240cddf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f89240b10e0 tx=0x7f892002b9a0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.136+0000 7f892b305640 1 -- 172.21.15.64:0/3885832196 shutdown_connections 2023-10-14T12:30:30.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.136+0000 7f892b305640 1 --2- 172.21.15.64:0/3885832196 >> v2:172.21.15.177:3300/0 conn(0x7f892415ce60 0x7f89240b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.136+0000 7f892b305640 1 --2- 172.21.15.64:0/3885832196 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f892415ca80 0x7f89240cddf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.136+0000 7f892b305640 1 -- 172.21.15.64:0/3885832196 >> 172.21.15.64:0/3885832196 conn(0x7f892406c1c0 msgr2=0x7f892406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:30.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.136+0000 7f892b305640 1 -- 172.21.15.64:0/3885832196 shutdown_connections 2023-10-14T12:30:30.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.136+0000 7f892b305640 1 -- 172.21.15.64:0/3885832196 wait complete. 2023-10-14T12:30:30.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.138+0000 7f892b305640 1 Processor -- start 2023-10-14T12:30:30.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.138+0000 7f892b305640 1 -- start start 2023-10-14T12:30:30.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f892b305640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89240b0550 0x7f89241f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f892b305640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f892415ca80 0x7f892415dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f892b305640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892415ce60 0x7f89240c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f892b305640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892415e690 con 0x7f89240b0550 2023-10-14T12:30:30.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f892b305640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f892415e970 con 0x7f892415ce60 2023-10-14T12:30:30.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f892b305640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f892415ec50 con 0x7f892415ca80 2023-10-14T12:30:30.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f89290a1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89240b0550 0x7f89241f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.147 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f89290a1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89240b0550 0x7f89241f1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53258/0 (socket says 172.21.15.64:53258) 2023-10-14T12:30:30.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.139+0000 7f89290a1640 1 -- 172.21.15.64:0/4124847032 learned_addr learned my addr 172.21.15.64:0/4124847032 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:30.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89288a0640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f892415ca80 0x7f892415dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.148 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89298a2640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892415ce60 0x7f89240c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89290a1640 1 -- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f892415ca80 msgr2=0x7f892415dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89290a1640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f892415ca80 0x7f892415dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89290a1640 1 -- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892415ce60 msgr2=0x7f89240c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89290a1640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892415ce60 0x7f89240c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89290a1640 1 -- 172.21.15.64:0/4124847032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89200094d0 con 0x7f89240b0550 2023-10-14T12:30:30.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.140+0000 7f89290a1640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89240b0550 0x7f89241f1b00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f892002b9e0 tx=0x7f8920004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:30.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.141+0000 7f8919ffb640 1 -- 172.21.15.64:0/4124847032 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920039a90 con 0x7f89240b0550 2023-10-14T12:30:30.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.141+0000 7f8919ffb640 1 -- 172.21.15.64:0/4124847032 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8920039c10 con 0x7f89240b0550 2023-10-14T12:30:30.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.141+0000 7f8919ffb640 1 -- 172.21.15.64:0/4124847032 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8920043410 con 0x7f89240b0550 2023-10-14T12:30:30.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.141+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f892415ef30 con 0x7f89240b0550 2023-10-14T12:30:30.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.141+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89241f2040 con 0x7f89240b0550 2023-10-14T12:30:30.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.142+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f892415f450 con 0x7f89240b0550 2023-10-14T12:30:30.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.143+0000 7f8919ffb640 1 -- 172.21.15.64:0/4124847032 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f892002f3b0 con 0x7f89240b0550 2023-10-14T12:30:30.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.144+0000 7f8919ffb640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f890806ae70 0x7f890806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.144+0000 7f8919ffb640 1 -- 172.21.15.64:0/4124847032 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f89200ab5e0 con 0x7f89240b0550 2023-10-14T12:30:30.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.144+0000 7f89288a0640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f890806ae70 0x7f890806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.154 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.146+0000 7f89288a0640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f890806ae70 0x7f890806d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f89241f5780 tx=0x7f8914008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:30.155 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.148+0000 7f8919ffb640 1 -- 172.21.15.64:0/4124847032 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f89200768a0 con 0x7f89240b0550 2023-10-14T12:30:30.346 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.346+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89240cb250 con 0x7f89240b0550 2023-10-14T12:30:30.348 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.348+0000 7f8919ffb640 1 -- 172.21.15.64:0/4124847032 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+13050 (secure 0 0 0) 0x7f8920034090 con 0x7f89240b0550 2023-10-14T12:30:30.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:30.349 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":37,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:30:26.163483+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:30.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f890806ae70 msgr2=0x7f890806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f890806ae70 0x7f890806d330 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f89241f5780 tx=0x7f8914008040 comp rx=0 tx=0).stop 2023-10-14T12:30:30.351 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89240b0550 msgr2=0x7f89241f1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89240b0550 0x7f89241f1b00 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f892002b9e0 tx=0x7f8920004730 comp rx=0 tx=0).stop 2023-10-14T12:30:30.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 shutdown_connections 2023-10-14T12:30:30.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f890806ae70 0x7f890806d330 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f892415ce60 0x7f89240c1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.352 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f892415ca80 0x7f892415dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 --2- 172.21.15.64:0/4124847032 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f89240b0550 0x7f89241f1b00 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.350+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 >> 172.21.15.64:0/4124847032 conn(0x7f892406c1c0 msgr2=0x7f89240cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:30.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.351+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 shutdown_connections 2023-10-14T12:30:30.353 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.351+0000 7f892b305640 1 -- 172.21.15.64:0/4124847032 wait complete. 2023-10-14T12:30:30.372 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T12:30:30.372 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T12:30:30.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.600+0000 7f39e359e640 1 Processor -- start 2023-10-14T12:30:30.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.601+0000 7f39e359e640 1 -- start start 2023-10-14T12:30:30.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.602+0000 7f39e359e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f39e40cdc20 0x7f39e40cc470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.602+0000 7f39e359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e40cc1e0 con 0x7f39e415cb80 2023-10-14T12:30:30.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.602+0000 7f39e359e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e40ccac0 con 0x7f39e40cacf0 2023-10-14T12:30:30.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.602+0000 7f39e359e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e4070170 con 0x7f39e40cdc20 2023-10-14T12:30:30.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.603+0000 7f39e1d9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f39e415cb80 0x7f39e4070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34260/0 (socket says 172.21.15.64:34260) 2023-10-14T12:30:30.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.603+0000 7f39e1d9b640 1 -- 172.21.15.64:0/3317988890 learned_addr learned my addr 172.21.15.64:0/3317988890 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:30.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.603+0000 7f39e2d9d640 1 --2- 172.21.15.64:0/3317988890 >> v2:172.21.15.177:3300/0 conn(0x7f39e40cdc20 0x7f39e40cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.603+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 123729470 0 0) 0x7f39e40cc1e0 con 0x7f39e415cb80 2023-10-14T12:30:30.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.603+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39cc003520 con 0x7f39e415cb80 2023-10-14T12:30:30.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3933614748 0 0) 0x7f39cc003520 con 0x7f39e415cb80 2023-10-14T12:30:30.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 >> v2:172.21.15.177:3300/0 conn(0x7f39e40cdc20 msgr2=0x7f39e40cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:30.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 --2- 172.21.15.64:0/3317988890 >> v2:172.21.15.177:3300/0 conn(0x7f39e40cdc20 0x7f39e40cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 >> v1:172.21.15.177:6789/0 conn(0x7f39e40cacf0 legacy=0x7f39e40cb0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e40ccda0 con 0x7f39e415cb80 2023-10-14T12:30:30.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f39d80019f0 con 0x7f39e415cb80 2023-10-14T12:30:30.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 >> v1:172.21.15.64:6789/0 conn(0x7f39e415cb80 legacy=0x7f39e4070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39cc003970 0x7f39cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39cc0047c0 0x7f39cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39cc005180 0x7f39cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4070170 con 0x7f39cc003970 2023-10-14T12:30:30.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc00c020 con 0x7f39cc0047c0 2023-10-14T12:30:30.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39cc00c1e0 con 0x7f39cc005180 2023-10-14T12:30:30.612 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.604+0000 7f39e259c640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39cc003970 0x7f39cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.605+0000 7f39e1d9b640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39cc0047c0 0x7f39cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.605+0000 7f39e259c640 1 -- 172.21.15.64:0/3317988890 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39cc005180 msgr2=0x7f39cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:30.613 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.605+0000 7f39e259c640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39cc005180 0x7f39cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.605+0000 7f39e259c640 1 -- 172.21.15.64:0/3317988890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39cc0047c0 msgr2=0x7f39cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:30.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.605+0000 7f39e259c640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39cc0047c0 0x7f39cc004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.605+0000 7f39e259c640 1 -- 172.21.15.64:0/3317988890 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39cc003520 con 0x7f39cc003970 2023-10-14T12:30:30.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.605+0000 7f39e2d9d640 1 -- 172.21.15.64:0/3317988890 reap_dead start 2023-10-14T12:30:30.614 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.606+0000 7f39e259c640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39cc003970 0x7f39cc003d90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f39d4001750 tx=0x7f39cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2265d9b01001352 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:30.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.606+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d40052d0 con 0x7f39cc003970 2023-10-14T12:30:30.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.606+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d402e050 con 0x7f39cc003970 2023-10-14T12:30:30.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.606+0000 7f39e159a640 1 -- 172.21.15.64:0/3317988890 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4003830 con 0x7f39cc003970 2023-10-14T12:30:30.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.607+0000 7f39e359e640 1 -- 172.21.15.64:0/3317988890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39cc003970 msgr2=0x7f39cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.607+0000 7f39e359e640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39cc003970 0x7f39cc003d90 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f39d4001750 tx=0x7f39cc0057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.607+0000 7f39e359e640 1 -- 172.21.15.64:0/3317988890 shutdown_connections 2023-10-14T12:30:30.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.607+0000 7f39e359e640 1 --2- 172.21.15.64:0/3317988890 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39cc003970 0x7f39cc003d90 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.607+0000 7f39e359e640 1 -- 172.21.15.64:0/3317988890 >> 172.21.15.64:0/3317988890 conn(0x7f39e406a470 msgr2=0x7f39e40afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:30.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.607+0000 7f39e359e640 1 -- 172.21.15.64:0/3317988890 shutdown_connections 2023-10-14T12:30:30.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.607+0000 7f39e359e640 1 -- 172.21.15.64:0/3317988890 wait complete. 2023-10-14T12:30:30.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.609+0000 7f39e359e640 1 Processor -- start 2023-10-14T12:30:30.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.609+0000 7f39e359e640 1 -- start start 2023-10-14T12:30:30.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39cc003970 0x7f39e40c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e40c53b0 0x7f39e40c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e415d070 0x7f39e415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e415e9b0 con 0x7f39e40c53b0 2023-10-14T12:30:30.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40c5d70 con 0x7f39e415d070 2023-10-14T12:30:30.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e414b220 con 0x7f39cc003970 2023-10-14T12:30:30.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e40c53b0 0x7f39e40c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e1d9b640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e40c53b0 0x7f39e40c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53270/0 (socket says 172.21.15.64:53270) 2023-10-14T12:30:30.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.610+0000 7f39e1d9b640 1 -- 172.21.15.64:0/354966219 learned_addr learned my addr 172.21.15.64:0/354966219 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:30.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e1d9b640 1 -- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39cc003970 msgr2=0x7f39e40c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e1d9b640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39cc003970 0x7f39e40c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e1d9b640 1 -- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e415d070 msgr2=0x7f39e415d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e1d9b640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e415d070 0x7f39e415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e1d9b640 1 -- 172.21.15.64:0/354966219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e415dd30 con 0x7f39e40c53b0 2023-10-14T12:30:30.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e1d9b640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e40c53b0 0x7f39e40c5830 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f39d8007c40 tx=0x7f39d800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:30.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39d2ffd640 1 -- 172.21.15.64:0/354966219 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8004b60 con 0x7f39e40c53b0 2023-10-14T12:30:30.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39d2ffd640 1 -- 172.21.15.64:0/354966219 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d8004cc0 con 0x7f39e40c53b0 2023-10-14T12:30:30.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39d2ffd640 1 -- 172.21.15.64:0/354966219 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d80072d0 con 0x7f39e40c53b0 2023-10-14T12:30:30.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e415e010 con 0x7f39e40c53b0 2023-10-14T12:30:30.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.611+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e415e5d0 con 0x7f39e40c53b0 2023-10-14T12:30:30.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.613+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e404e9b0 con 0x7f39e40c53b0 2023-10-14T12:30:30.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.614+0000 7f39d2ffd640 1 -- 172.21.15.64:0/354966219 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f39d8007430 con 0x7f39e40c53b0 2023-10-14T12:30:30.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.614+0000 7f39d2ffd640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39c406ae70 0x7f39c406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:30.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.615+0000 7f39d2ffd640 1 -- 172.21.15.64:0/354966219 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f39d8089290 con 0x7f39e40c53b0 2023-10-14T12:30:30.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.615+0000 7f39e259c640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39c406ae70 0x7f39c406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:30.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.617+0000 7f39e259c640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39c406ae70 0x7f39c406d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39d4033000 tx=0x7f39d402f000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:30.625 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.619+0000 7f39d2ffd640 1 -- 172.21.15.64:0/354966219 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f39d8054560 con 0x7f39e40c53b0 2023-10-14T12:30:30.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.811+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39e40c4c00 con 0x7f39e40c53b0 2023-10-14T12:30:30.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.812+0000 7f39d2ffd640 1 -- 172.21.15.64:0/354966219 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39d8057b80 con 0x7f39e40c53b0 2023-10-14T12:30:30.813 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T12:30:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.815+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39c406ae70 msgr2=0x7f39c406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.815+0000 7f39e359e640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39c406ae70 0x7f39c406d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f39d4033000 tx=0x7f39d402f000 comp rx=0 tx=0).stop 2023-10-14T12:30:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.815+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e40c53b0 msgr2=0x7f39e40c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.815+0000 7f39e359e640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e40c53b0 0x7f39e40c5830 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f39d8007c40 tx=0x7f39d800b4a0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 shutdown_connections 2023-10-14T12:30:30.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f39c406ae70 0x7f39c406d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f39e415d070 0x7f39e415d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f39e40c53b0 0x7f39e40c5830 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 --2- 172.21.15.64:0/354966219 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f39cc003970 0x7f39e40c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:30.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 >> 172.21.15.64:0/354966219 conn(0x7f39e406a470 msgr2=0x7f39e40cb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:30.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 shutdown_connections 2023-10-14T12:30:30.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:30.816+0000 7f39e359e640 1 -- 172.21.15.64:0/354966219 wait complete. 2023-10-14T12:30:30.836 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-14T12:30:31.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.061+0000 7f02d2267640 1 Processor -- start 2023-10-14T12:30:31.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.061+0000 7f02d2267640 1 -- start start 2023-10-14T12:30:31.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.063+0000 7f02d2267640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f02cc15a8d0 0x7f02cc0cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.063+0000 7f02d2267640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 0x7f02cc0cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.063+0000 7f02d2267640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02cc15acb0 con 0x7f02cc0ca660 2023-10-14T12:30:31.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.063+0000 7f02d2267640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02cc0c1c60 con 0x7f02cc15a8d0 2023-10-14T12:30:31.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.063+0000 7f02d2267640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc15e350 con 0x7f02cc06ff40 2023-10-14T12:30:31.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.063+0000 7f02d0a64640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f02cc0ca660 0x7f02cc06bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34262/0 (socket says 172.21.15.64:34262) 2023-10-14T12:30:31.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.063+0000 7f02d0a64640 1 -- 172.21.15.64:0/2732513700 learned_addr learned my addr 172.21.15.64:0/2732513700 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02d1265640 1 --2- 172.21.15.64:0/2732513700 >> v2:172.21.15.177:3300/0 conn(0x7f02cc15a8d0 0x7f02cc0cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02d1a66640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 0x7f02cc0cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3677147031 0 0) 0x7f02bc001110 con 0x7f02cc0ca660 2023-10-14T12:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f02b8003520 con 0x7f02cc0ca660 2023-10-14T12:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3519677382 0 0) 0x7f02b8003520 con 0x7f02cc0ca660 2023-10-14T12:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 msgr2=0x7f02cc0cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:31.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 0x7f02cc0cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 >> v2:172.21.15.177:3300/0 conn(0x7f02cc15a8d0 msgr2=0x7f02cc0cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 --2- 172.21.15.64:0/2732513700 >> v2:172.21.15.177:3300/0 conn(0x7f02cc15a8d0 0x7f02cc0cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc15e630 con 0x7f02cc0ca660 2023-10-14T12:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f02bc001800 con 0x7f02cc0ca660 2023-10-14T12:30:31.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.064+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 >> v1:172.21.15.64:6789/0 conn(0x7f02cc0ca660 legacy=0x7f02cc06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02c3fff640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02b8003970 0x7f02b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02c3fff640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 0x7f02b80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02c3fff640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8004d00 0x7f02b8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0c1c60 con 0x7f02b8003970 2023-10-14T12:30:31.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc15e350 con 0x7f02b8004d00 2023-10-14T12:30:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02b800b980 con 0x7f02cc06ff40 2023-10-14T12:30:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1265640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02b8003970 0x7f02b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d0a64640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 0x7f02b80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1a66640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8004d00 0x7f02b8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1265640 1 -- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 msgr2=0x7f02b80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:31.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1265640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc06ff40 0x7f02b80047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1265640 1 -- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8004d00 msgr2=0x7f02b8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:31.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1265640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8004d00 0x7f02b8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1265640 1 -- 172.21.15.64:0/2732513700 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02b8003520 con 0x7f02b8003970 2023-10-14T12:30:31.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.065+0000 7f02d1a66640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8004d00 0x7f02b8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:31.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.066+0000 7f02d1265640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02b8003970 0x7f02b8003d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009ae0 tx=0x7f02b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500ce3cc3c4c95ad server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:31.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8005990 con 0x7f02b8003970 2023-10-14T12:30:31.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c8005af0 con 0x7f02b8003970 2023-10-14T12:30:31.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02c3fff640 1 -- 172.21.15.64:0/2732513700 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c8005ea0 con 0x7f02b8003970 2023-10-14T12:30:31.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02d2267640 1 -- 172.21.15.64:0/2732513700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02b8003970 msgr2=0x7f02b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02d2267640 1 --2- 172.21.15.64:0/2732513700 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02b8003970 0x7f02b8003d90 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f02c8009ae0 tx=0x7f02b80057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02d1a66640 1 -- 172.21.15.64:0/2732513700 reap_dead start 2023-10-14T12:30:31.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02d2267640 1 -- 172.21.15.64:0/2732513700 shutdown_connections 2023-10-14T12:30:31.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02d2267640 1 -- 172.21.15.64:0/2732513700 >> 172.21.15.64:0/2732513700 conn(0x7f02cc06a470 msgr2=0x7f02cc0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:31.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02d2267640 1 -- 172.21.15.64:0/2732513700 shutdown_connections 2023-10-14T12:30:31.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.067+0000 7f02d2267640 1 -- 172.21.15.64:0/2732513700 wait complete. 2023-10-14T12:30:31.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.069+0000 7f02d2267640 1 Processor -- start 2023-10-14T12:30:31.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.069+0000 7f02d2267640 1 -- start start 2023-10-14T12:30:31.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.070+0000 7f02d2267640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8003970 0x7f02cc0cd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.070+0000 7f02d2267640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc15c370 0x7f02cc0c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.070+0000 7f02d2267640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02cc1556a0 0x7f02cc155b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d2267640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc15dad0 con 0x7f02cc1556a0 2023-10-14T12:30:31.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d2267640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc15c7f0 con 0x7f02b8003970 2023-10-14T12:30:31.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d2267640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02cc0c3d20 con 0x7f02cc15c370 2023-10-14T12:30:31.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02cc1556a0 0x7f02cc155b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02cc1556a0 0x7f02cc155b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53294/0 (socket says 172.21.15.64:53294) 2023-10-14T12:30:31.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 -- 172.21.15.64:0/814291061 learned_addr learned my addr 172.21.15.64:0/814291061 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:31.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d0a64640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc15c370 0x7f02cc0c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1265640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8003970 0x7f02cc0cd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 -- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc15c370 msgr2=0x7f02cc0c3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc15c370 0x7f02cc0c3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 -- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8003970 msgr2=0x7f02cc0cd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8003970 0x7f02cc0cd1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.071+0000 7f02d1a66640 1 -- 172.21.15.64:0/814291061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02cc15ca30 con 0x7f02cc1556a0 2023-10-14T12:30:31.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.072+0000 7f02d1a66640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02cc1556a0 0x7f02cc155b20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0cbed0 tx=0x7f02c400f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:31.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.072+0000 7f02c1ffb640 1 -- 172.21.15.64:0/814291061 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c4017400 con 0x7f02cc1556a0 2023-10-14T12:30:31.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.072+0000 7f02c1ffb640 1 -- 172.21.15.64:0/814291061 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02c4011040 con 0x7f02cc1556a0 2023-10-14T12:30:31.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.072+0000 7f02c1ffb640 1 -- 172.21.15.64:0/814291061 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02c40177c0 con 0x7f02cc1556a0 2023-10-14T12:30:31.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.072+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02cc15cd10 con 0x7f02cc1556a0 2023-10-14T12:30:31.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.072+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02cc15d2d0 con 0x7f02cc1556a0 2023-10-14T12:30:31.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.073+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02cc04e9b0 con 0x7f02cc1556a0 2023-10-14T12:30:31.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.074+0000 7f02c1ffb640 1 -- 172.21.15.64:0/814291061 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f02c40203b0 con 0x7f02cc1556a0 2023-10-14T12:30:31.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.075+0000 7f02c1ffb640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f02b006aec0 0x7f02b006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.075+0000 7f02c1ffb640 1 -- 172.21.15.64:0/814291061 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f02c40895d0 con 0x7f02cc1556a0 2023-10-14T12:30:31.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.076+0000 7f02d1265640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f02b006aec0 0x7f02b006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.077+0000 7f02d1265640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f02b006aec0 0x7f02b006d380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f02c8035000 tx=0x7f02c8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:31.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.079+0000 7f02c1ffb640 1 -- 172.21.15.64:0/814291061 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f02c4054970 con 0x7f02cc1556a0 2023-10-14T12:30:31.277 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.276+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f02cc0b0d70 con 0x7f02cc1556a0 2023-10-14T12:30:31.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.277+0000 7f02c1ffb640 1 -- 172.21.15.64:0/814291061 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7f02c4057f90 con 0x7f02cc1556a0 2023-10-14T12:30:31.278 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:31.278 INFO:teuthology.orchestra.run.smithi064.stdout:[ 2023-10-14T12:30:31.279 INFO:teuthology.orchestra.run.smithi064.stdout: { 2023-10-14T12:30:31.279 INFO:teuthology.orchestra.run.smithi064.stdout: "poolnum": 1, 2023-10-14T12:30:31.279 INFO:teuthology.orchestra.run.smithi064.stdout: "poolname": ".mgr" 2023-10-14T12:30:31.279 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:31.280 INFO:teuthology.orchestra.run.smithi064.stdout:] 2023-10-14T12:30:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.280+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f02b006aec0 msgr2=0x7f02b006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.281 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.280+0000 7f02d2267640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f02b006aec0 0x7f02b006d380 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f02c8035000 tx=0x7f02c8030000 comp rx=0 tx=0).stop 2023-10-14T12:30:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02cc1556a0 msgr2=0x7f02cc155b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02cc1556a0 0x7f02cc155b20 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0cbed0 tx=0x7f02c400f4a0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 shutdown_connections 2023-10-14T12:30:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f02b006aec0 0x7f02b006d380 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f02cc1556a0 0x7f02cc155b20 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f02cc15c370 0x7f02cc0c3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 --2- 172.21.15.64:0/814291061 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f02b8003970 0x7f02cc0cd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 >> 172.21.15.64:0/814291061 conn(0x7f02cc06a470 msgr2=0x7f02cc0cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:31.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 shutdown_connections 2023-10-14T12:30:31.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.281+0000 7f02d2267640 1 -- 172.21.15.64:0/814291061 wait complete. 2023-10-14T12:30:31.301 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'testcephfs1' 2023-10-14T12:30:31.301 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_metadata --pg_num_min 64 2023-10-14T12:30:31.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.529+0000 7f2fb1bf4640 1 Processor -- start 2023-10-14T12:30:31.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.529+0000 7f2fb1bf4640 1 -- start start 2023-10-14T12:30:31.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.530+0000 7f2fb1bf4640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2fac070400 0x7f2fac15e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fb1bf4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac0c8930 0x7f2fac0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fb1bf4640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fac0c8e40 con 0x7f2fac0ca640 2023-10-14T12:30:31.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fb1bf4640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fac0c9090 con 0x7f2fac070400 2023-10-14T12:30:31.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fb1bf4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0c9370 con 0x7f2fac0c8930 2023-10-14T12:30:31.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fb13f3640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2fac0ca640 0x7f2fac0cacf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34278/0 (socket says 172.21.15.64:34278) 2023-10-14T12:30:31.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fb13f3640 1 -- 172.21.15.64:0/1574000627 learned_addr learned my addr 172.21.15.64:0/1574000627 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:31.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fb0bf2640 1 --2- 172.21.15.64:0/1574000627 >> v2:172.21.15.177:3300/0 conn(0x7f2fac070400 0x7f2fac15e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.531+0000 7f2fa3fff640 1 --2- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac0c8930 0x7f2fac0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.532+0000 7f2fa37fe640 1 -- 172.21.15.64:0/1574000627 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3647223055 0 0) 0x7f2fac0c8e40 con 0x7f2fac0ca640 2023-10-14T12:30:31.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.532+0000 7f2fa37fe640 1 -- 172.21.15.64:0/1574000627 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2f94003520 con 0x7f2fac0ca640 2023-10-14T12:30:31.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.532+0000 7f2fb0bf2640 1 -- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac0c8930 msgr2=0x7f2fac0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:31.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.532+0000 7f2fb0bf2640 1 --2- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac0c8930 0x7f2fac0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.532+0000 7f2fb0bf2640 1 -- 172.21.15.64:0/1574000627 >> v1:172.21.15.64:6789/0 conn(0x7f2fac0ca640 legacy=0x7f2fac0cacf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.532+0000 7f2fa37fe640 1 -- 172.21.15.64:0/1574000627 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2919271743 0 0) 0x7f2f94003520 con 0x7f2fac0ca640 2023-10-14T12:30:31.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.532+0000 7f2fb0bf2640 1 -- 172.21.15.64:0/1574000627 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fac0c9650 con 0x7f2fac070400 2023-10-14T12:30:31.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.534+0000 7f2fb0bf2640 1 --2- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac070400 0x7f2fac15e210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009d90 tx=0x7f2fa802bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9220ad67f630b97f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:31.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.534+0000 7f2fa37fe640 1 -- 172.21.15.64:0/1574000627 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4001670 con 0x7f2fac070400 2023-10-14T12:30:31.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.534+0000 7f2fa37fe640 1 -- 172.21.15.64:0/1574000627 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa802c8a0 con 0x7f2fac070400 2023-10-14T12:30:31.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.534+0000 7f2fa37fe640 1 -- 172.21.15.64:0/1574000627 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa802cc30 con 0x7f2fac070400 2023-10-14T12:30:31.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.534+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac070400 msgr2=0x7f2fac15e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.534+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac070400 0x7f2fac15e210 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8009d90 tx=0x7f2fa802bd70 comp rx=0 tx=0).stop 2023-10-14T12:30:31.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.535+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/1574000627 shutdown_connections 2023-10-14T12:30:31.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.535+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac0c8930 0x7f2fac0707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.535+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/1574000627 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac070400 0x7f2fac15e210 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.535+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/1574000627 >> 172.21.15.64:0/1574000627 conn(0x7f2fac06a470 msgr2=0x7f2fac0afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:31.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.535+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/1574000627 shutdown_connections 2023-10-14T12:30:31.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.535+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/1574000627 wait complete. 2023-10-14T12:30:31.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.536+0000 7f2fb1bf4640 1 Processor -- start 2023-10-14T12:30:31.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.537+0000 7f2fb1bf4640 1 -- start start 2023-10-14T12:30:31.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb1bf4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac070400 0x7f2fac1503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb1bf4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac0c8930 0x7f2fac0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb1bf4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fac0ca640 0x7f2fac0b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb1bf4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac151c10 con 0x7f2fac0ca640 2023-10-14T12:30:31.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb1bf4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0c38a0 con 0x7f2fac0c8930 2023-10-14T12:30:31.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb1bf4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac0c2c90 con 0x7f2fac070400 2023-10-14T12:30:31.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fac0ca640 0x7f2fac0b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fac0ca640 0x7f2fac0b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53302/0 (socket says 172.21.15.64:53302) 2023-10-14T12:30:31.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 -- 172.21.15.64:0/2885071471 learned_addr learned my addr 172.21.15.64:0/2885071471 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:31.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fa3fff640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac0c8930 0x7f2fac0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb0bf2640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac070400 0x7f2fac1503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 -- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac070400 msgr2=0x7f2fac1503c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac070400 0x7f2fac1503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 -- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac0c8930 msgr2=0x7f2fac0c45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:31.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac0c8930 0x7f2fac0c45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:31.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.538+0000 7f2fb13f3640 1 -- 172.21.15.64:0/2885071471 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8009a70 con 0x7f2fac0ca640 2023-10-14T12:30:31.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.539+0000 7f2fa3fff640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac0c8930 0x7f2fac0c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:31.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.539+0000 7f2fb13f3640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fac0ca640 0x7f2fac0b2dd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c750 tx=0x7f2fa400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:31.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.539+0000 7f2fa17fa640 1 -- 172.21.15.64:0/2885071471 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4005ad0 con 0x7f2fac0ca640 2023-10-14T12:30:31.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.539+0000 7f2fa17fa640 1 -- 172.21.15.64:0/2885071471 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa4005c30 con 0x7f2fac0ca640 2023-10-14T12:30:31.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.539+0000 7f2fa17fa640 1 -- 172.21.15.64:0/2885071471 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4007070 con 0x7f2fac0ca640 2023-10-14T12:30:31.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.539+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac0c2f70 con 0x7f2fac0ca640 2023-10-14T12:30:31.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.539+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac0c3530 con 0x7f2fac0ca640 2023-10-14T12:30:31.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.540+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fac0c3a30 con 0x7f2fac0ca640 2023-10-14T12:30:31.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.541+0000 7f2fa17fa640 1 -- 172.21.15.64:0/2885071471 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2fa40071d0 con 0x7f2fac0ca640 2023-10-14T12:30:31.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.542+0000 7f2fa17fa640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f9806ae70 0x7f2f9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:31.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.542+0000 7f2fa17fa640 1 -- 172.21.15.64:0/2885071471 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2fa4088b50 con 0x7f2fac0ca640 2023-10-14T12:30:31.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.543+0000 7f2fb0bf2640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f9806ae70 0x7f2f9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:31.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.544+0000 7f2fb0bf2640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f9806ae70 0x7f2f9806d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8036000 tx=0x7f2fa8030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:31.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.547+0000 7f2fa17fa640 1 -- 172.21.15.64:0/2885071471 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2fa4053e00 con 0x7f2fac0ca640 2023-10-14T12:30:31.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:31.739+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2fac04e9b0 con 0x7f2fac0ca640 2023-10-14T12:30:32.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-14T12:30:32.278 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.277+0000 7f2fa17fa640 1 -- 172.21.15.64:0/2885071471 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_metadata", "pg_num_min": 64}]=0 pool 'testcephfs1_metadata' created v38) v1 ==== 148+0+0 (secure 0 0 0) 0x7f2fa4017020 con 0x7f2fac0ca640 2023-10-14T12:30:32.279 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'testcephfs1_metadata' created 2023-10-14T12:30:32.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.281+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f9806ae70 msgr2=0x7f2f9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.281+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f9806ae70 0x7f2f9806d330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2fa8036000 tx=0x7f2fa8030000 comp rx=0 tx=0).stop 2023-10-14T12:30:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.281+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fac0ca640 msgr2=0x7f2fac0b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.281+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fac0ca640 0x7f2fac0b2dd0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c750 tx=0x7f2fa400cc10 comp rx=0 tx=0).stop 2023-10-14T12:30:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 shutdown_connections 2023-10-14T12:30:32.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f9806ae70 0x7f2f9806d330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2fac0ca640 0x7f2fac0b2dd0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2fac0c8930 0x7f2fac0c45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 --2- 172.21.15.64:0/2885071471 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2fac070400 0x7f2fac1503c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 >> 172.21.15.64:0/2885071471 conn(0x7f2fac06a470 msgr2=0x7f2fac1594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:32.284 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 shutdown_connections 2023-10-14T12:30:32.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.282+0000 7f2fb1bf4640 1 -- 172.21.15.64:0/2885071471 wait complete. 2023-10-14T12:30:32.310 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create testcephfs1_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-14T12:30:32.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.530+0000 7f5a1241a640 1 Processor -- start 2023-10-14T12:30:32.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.530+0000 7f5a1241a640 1 -- start start 2023-10-14T12:30:32.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.531+0000 7f5a1241a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5a0c0cc7e0 0x7f5a0c06c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:32.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a1241a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0c9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:32.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a1241a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a0c159e10 con 0x7f5a0c0ccbc0 2023-10-14T12:30:32.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a1241a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c8b40 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a1241a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c8cd0 con 0x7f5a0c0ced90 2023-10-14T12:30:32.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11418640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5a0c0cc7e0 0x7f5a0c06c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:32.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11418640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f5a0c0cc7e0 0x7f5a0c06c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53316/0 (socket says 172.21.15.64:53316) 2023-10-14T12:30:32.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11418640 1 -- 172.21.15.64:0/3885607904 learned_addr learned my addr 172.21.15.64:0/3885607904 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:32.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11c19640 1 --2- 172.21.15.64:0/3885607904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:32.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11418640 1 -- 172.21.15.64:0/3885607904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 msgr2=0x7f5a0c0c9120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:32.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11418640 1 --2- 172.21.15.64:0/3885607904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0c9120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11418640 1 -- 172.21.15.64:0/3885607904 >> v1:172.21.15.177:6789/0 conn(0x7f5a0c0ccbc0 legacy=0x7f5a0c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:32.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.532+0000 7f5a11418640 1 -- 172.21.15.64:0/3885607904 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c06c8a0 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.534+0000 7f5a11418640 1 --2- 172.21.15.64:0/3885607904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c06c150 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009860 tx=0x7f5a0802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a8bca3b9513e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:32.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.534+0000 7f5a03fff640 1 -- 172.21.15.64:0/3885607904 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08030840 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.534+0000 7f5a03fff640 1 -- 172.21.15.64:0/3885607904 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a080309a0 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.534+0000 7f5a03fff640 1 -- 172.21.15.64:0/3885607904 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08030d30 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 -- 172.21.15.64:0/3885607904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 msgr2=0x7f5a0c06c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:32.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 --2- 172.21.15.64:0/3885607904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c06c150 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009860 tx=0x7f5a0802b980 comp rx=0 tx=0).stop 2023-10-14T12:30:32.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 -- 172.21.15.64:0/3885607904 shutdown_connections 2023-10-14T12:30:32.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 --2- 172.21.15.64:0/3885607904 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0c9120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 --2- 172.21.15.64:0/3885607904 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c06c150 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 -- 172.21.15.64:0/3885607904 >> 172.21.15.64:0/3885607904 conn(0x7f5a0c069fc0 msgr2=0x7f5a0c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:32.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 -- 172.21.15.64:0/3885607904 shutdown_connections 2023-10-14T12:30:32.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.535+0000 7f5a1241a640 1 -- 172.21.15.64:0/3885607904 wait complete. 2023-10-14T12:30:32.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.537+0000 7f5a1241a640 1 Processor -- start 2023-10-14T12:30:32.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.537+0000 7f5a1241a640 1 -- start start 2023-10-14T12:30:32.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a1241a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c071be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:32.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a1241a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a0c0ccbc0 0x7f5a0c0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:32.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a1241a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:32.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a1241a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c27c0 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a1241a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c2c50 con 0x7f5a0c0ccbc0 2023-10-14T12:30:32.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a1241a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a0c0c1ed0 con 0x7f5a0c0ced90 2023-10-14T12:30:32.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a11418640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c071be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:32.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a11418640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c071be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53328/0 (socket says 172.21.15.64:53328) 2023-10-14T12:30:32.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a11418640 1 -- 172.21.15.64:0/1914283912 learned_addr learned my addr 172.21.15.64:0/1914283912 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:32.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a11c19640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:32.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a10c17640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a0c0ccbc0 0x7f5a0c0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:32.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a11418640 1 -- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 msgr2=0x7f5a0c0ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:32.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.538+0000 7f5a11418640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a11418640 1 -- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a0c0ccbc0 msgr2=0x7f5a0c0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:32.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a11418640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a0c0ccbc0 0x7f5a0c0add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:32.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a11418640 1 -- 172.21.15.64:0/1914283912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a08009470 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a11418640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c071be0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009860 tx=0x7f5a08004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:32.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a01ffb640 1 -- 172.21.15.64:0/1914283912 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a08039a90 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a01ffb640 1 -- 172.21.15.64:0/1914283912 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a08039bf0 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a01ffb640 1 -- 172.21.15.64:0/1914283912 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a080433f0 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a0c097c60 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.539+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a0c0c2450 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.541+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a0c066880 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.542+0000 7f5a01ffb640 1 -- 172.21.15.64:0/1914283912 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5a08042390 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.543+0000 7f5a01ffb640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f59f006ae70 0x7f59f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:32.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.543+0000 7f5a01ffb640 1 -- 172.21.15.64:0/1914283912 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5552+0+0 (secure 0 0 0) 0x7f5a080abb50 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.544+0000 7f5a10c17640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f59f006ae70 0x7f59f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:32.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.545+0000 7f5a10c17640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f59f006ae70 0x7f59f006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c071730 tx=0x7f59fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:32.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.548+0000 7f5a01ffb640 1 -- 172.21.15.64:0/1914283912 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5a08076da0 con 0x7f5a0c0cc7e0 2023-10-14T12:30:32.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:32.741+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5a0c067440 con 0x7f5a0c0cc7e0 2023-10-14T12:30:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.292+0000 7f5a01ffb640 1 -- 172.21.15.64:0/1914283912 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testcephfs1_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'testcephfs1_data' created v39) v1 ==== 180+0+0 (secure 0 0 0) 0x7f5a080480d0 con 0x7f5a0c0cc7e0 2023-10-14T12:30:33.295 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'testcephfs1_data' created 2023-10-14T12:30:33.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f59f006ae70 msgr2=0x7f59f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:33.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f59f006ae70 0x7f59f006d330 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c071730 tx=0x7f59fc009040 comp rx=0 tx=0).stop 2023-10-14T12:30:33.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 msgr2=0x7f5a0c071be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:33.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c071be0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009860 tx=0x7f5a08004730 comp rx=0 tx=0).stop 2023-10-14T12:30:33.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 shutdown_connections 2023-10-14T12:30:33.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f59f006ae70 0x7f59f006d330 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5a0c0ced90 0x7f5a0c0ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5a0c0ccbc0 0x7f5a0c0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 --2- 172.21.15.64:0/1914283912 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5a0c0cc7e0 0x7f5a0c071be0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.301+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 >> 172.21.15.64:0/1914283912 conn(0x7f5a0c069fc0 msgr2=0x7f5a0c1503b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:33.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.302+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 shutdown_connections 2023-10-14T12:30:33.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.302+0000 7f5a1241a640 1 -- 172.21.15.64:0/1914283912 wait complete. 2023-10-14T12:30:33.338 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new testcephfs1 testcephfs1_metadata testcephfs1_data 2023-10-14T12:30:33.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.528+0000 7f34685d0640 1 Processor -- start 2023-10-14T12:30:33.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.528+0000 7f34685d0640 1 -- start start 2023-10-14T12:30:33.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f34685d0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f34600cb640 0x7f34600ca550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f34685d0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34600cf040 con 0x7f3460070a30 2023-10-14T12:30:33.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f34685d0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34600ce430 con 0x7f346015a830 2023-10-14T12:30:33.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f34685d0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34600caa90 con 0x7f34600cb640 2023-10-14T12:30:33.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f3465b6b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f3460070a30 0x7f34600c8b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34286/0 (socket says 172.21.15.64:34286) 2023-10-14T12:30:33.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f3465b6b640 1 -- 172.21.15.64:0/3460698401 learned_addr learned my addr 172.21.15.64:0/3460698401 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:33.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f3466b6d640 1 --2- 172.21.15.64:0/3460698401 >> v2:172.21.15.177:3300/0 conn(0x7f34600cb640 0x7f34600ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 598217036 0 0) 0x7f34600cf040 con 0x7f3460070a30 2023-10-14T12:30:33.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.530+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f344c003520 con 0x7f3460070a30 2023-10-14T12:30:33.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3403254802 0 0) 0x7f344c003520 con 0x7f3460070a30 2023-10-14T12:30:33.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 >> v2:172.21.15.177:3300/0 conn(0x7f34600cb640 msgr2=0x7f34600ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:33.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 --2- 172.21.15.64:0/3460698401 >> v2:172.21.15.177:3300/0 conn(0x7f34600cb640 0x7f34600ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 >> v1:172.21.15.177:6789/0 conn(0x7f346015a830 legacy=0x7f3460070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:33.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600ce710 con 0x7f3460070a30 2023-10-14T12:30:33.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f3450001670 con 0x7f3460070a30 2023-10-14T12:30:33.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 >> v1:172.21.15.64:6789/0 conn(0x7f3460070a30 legacy=0x7f34600c8b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:33.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f344c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f344c0047c0 0x7f344c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f344c005180 0x7f344c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600caa90 con 0x7f344c0039c0 2023-10-14T12:30:33.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f344c00c080 con 0x7f344c0047c0 2023-10-14T12:30:33.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f344c00c240 con 0x7f344c005180 2023-10-14T12:30:33.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.531+0000 7f346636c640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f344c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f3465b6b640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f344c0047c0 0x7f344c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f3466b6d640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f344c005180 0x7f344c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f346636c640 1 -- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f344c005180 msgr2=0x7f344c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:33.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f346636c640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f344c005180 0x7f344c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f346636c640 1 -- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f344c0047c0 msgr2=0x7f344c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:33.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f346636c640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f344c0047c0 0x7f344c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f346636c640 1 -- 172.21.15.64:0/3460698401 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f344c003520 con 0x7f344c0039c0 2023-10-14T12:30:33.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.532+0000 7f3466b6d640 1 -- 172.21.15.64:0/3460698401 reap_dead start 2023-10-14T12:30:33.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.533+0000 7f346636c640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f344c003de0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f345c001750 tx=0x7f344c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa8ba00b3f44a04e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:33.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.533+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0052d0 con 0x7f344c0039c0 2023-10-14T12:30:33.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.533+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c02e050 con 0x7f344c0039c0 2023-10-14T12:30:33.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.533+0000 7f346536a640 1 -- 172.21.15.64:0/3460698401 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c003830 con 0x7f344c0039c0 2023-10-14T12:30:33.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.534+0000 7f34685d0640 1 -- 172.21.15.64:0/3460698401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 msgr2=0x7f344c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:33.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.534+0000 7f34685d0640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f344c003de0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f345c001750 tx=0x7f344c0057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.534+0000 7f34685d0640 1 -- 172.21.15.64:0/3460698401 shutdown_connections 2023-10-14T12:30:33.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.534+0000 7f34685d0640 1 --2- 172.21.15.64:0/3460698401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f344c003de0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.534+0000 7f34685d0640 1 -- 172.21.15.64:0/3460698401 >> 172.21.15.64:0/3460698401 conn(0x7f34600b0030 msgr2=0x7f34600b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:33.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.534+0000 7f34685d0640 1 -- 172.21.15.64:0/3460698401 shutdown_connections 2023-10-14T12:30:33.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.534+0000 7f34685d0640 1 -- 172.21.15.64:0/3460698401 wait complete. 2023-10-14T12:30:33.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.536+0000 7f34685d0640 1 Processor -- start 2023-10-14T12:30:33.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.536+0000 7f34685d0640 1 -- start start 2023-10-14T12:30:33.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f34685d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f3460157e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f34685d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f346014b710 0x7f34600c55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f34685d0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34600adfa0 0x7f34600ae420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f34685d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600ae960 con 0x7f344c0039c0 2023-10-14T12:30:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f34685d0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34600c5b10 con 0x7f34600adfa0 2023-10-14T12:30:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f34685d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f346014bb90 con 0x7f346014b710 2023-10-14T12:30:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f346636c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f3460157e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f346636c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f3460157e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53344/0 (socket says 172.21.15.64:53344) 2023-10-14T12:30:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.537+0000 7f346636c640 1 -- 172.21.15.64:0/3761077263 learned_addr learned my addr 172.21.15.64:0/3761077263 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f3466b6d640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34600adfa0 0x7f34600ae420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f3465b6b640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f346014b710 0x7f34600c55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f346636c640 1 -- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f346014b710 msgr2=0x7f34600c55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f346636c640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f346014b710 0x7f34600c55d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f346636c640 1 -- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34600adfa0 msgr2=0x7f34600ae420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:33.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f346636c640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34600adfa0 0x7f34600ae420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:33.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f346636c640 1 -- 172.21.15.64:0/3761077263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34600c5d70 con 0x7f344c0039c0 2023-10-14T12:30:33.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.538+0000 7f346636c640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f3460157e00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f345c02bc30 tx=0x7f345c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:33.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.539+0000 7f3456ffd640 1 -- 172.21.15.64:0/3761077263 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c0076c0 con 0x7f344c0039c0 2023-10-14T12:30:33.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.539+0000 7f3456ffd640 1 -- 172.21.15.64:0/3761077263 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f345c007a30 con 0x7f344c0039c0 2023-10-14T12:30:33.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.539+0000 7f3456ffd640 1 -- 172.21.15.64:0/3761077263 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f345c006be0 con 0x7f344c0039c0 2023-10-14T12:30:33.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.539+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34600c6050 con 0x7f344c0039c0 2023-10-14T12:30:33.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.539+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3460149680 con 0x7f344c0039c0 2023-10-14T12:30:33.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.540+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3460073ef0 con 0x7f344c0039c0 2023-10-14T12:30:33.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.542+0000 7f3456ffd640 1 -- 172.21.15.64:0/3761077263 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f345c006d40 con 0x7f344c0039c0 2023-10-14T12:30:33.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.543+0000 7f3456ffd640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f344406ae70 0x7f344406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:33.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.543+0000 7f3456ffd640 1 -- 172.21.15.64:0/3761077263 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f345c0ab7c0 con 0x7f344c0039c0 2023-10-14T12:30:33.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.544+0000 7f3465b6b640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f344406ae70 0x7f344406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:33.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.545+0000 7f3465b6b640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f344406ae70 0x7f344406d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3450001050 tx=0x7f3450009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:33.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.547+0000 7f3456ffd640 1 -- 172.21.15.64:0/3761077263 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f345c0767f0 con 0x7f344c0039c0 2023-10-14T12:30:33.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:33.783+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"} v 0) v1 -- 0x7f34601e01b0 con 0x7f344c0039c0 2023-10-14T12:30:34.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.326+0000 7f3456ffd640 1 -- 172.21.15.64:0/3761077263 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "testcephfs1", "metadata": "testcephfs1_metadata", "data": "testcephfs1_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 187+0+0 (secure 0 0 0) 0x7f345c079e10 con 0x7f344c0039c0 2023-10-14T12:30:34.332 INFO:teuthology.orchestra.run.smithi064.stderr:new fs with metadata pool 5 and data pool 6 2023-10-14T12:30:34.336 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.334+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f344406ae70 msgr2=0x7f344406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.334+0000 7f34685d0640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f344406ae70 0x7f344406d330 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3450001050 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-10-14T12:30:34.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.334+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 msgr2=0x7f3460157e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.334+0000 7f34685d0640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f3460157e00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f345c02bc30 tx=0x7f345c001120 comp rx=0 tx=0).stop 2023-10-14T12:30:34.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.335+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 shutdown_connections 2023-10-14T12:30:34.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.335+0000 7f34685d0640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f344406ae70 0x7f344406d330 secure :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3450001050 tx=0x7f3450009040 comp rx=0 tx=0).stop 2023-10-14T12:30:34.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.335+0000 7f34685d0640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f34600adfa0 0x7f34600ae420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.335+0000 7f34685d0640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f346014b710 0x7f34600c55d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.335+0000 7f34685d0640 1 --2- 172.21.15.64:0/3761077263 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f344c0039c0 0x7f3460157e00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.335+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 >> 172.21.15.64:0/3761077263 conn(0x7f34600b0030 msgr2=0x7f34601599d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:34.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.339+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 shutdown_connections 2023-10-14T12:30:34.341 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.340+0000 7f34685d0640 1 -- 172.21.15.64:0/3761077263 wait complete. 2023-10-14T12:30:34.370 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:34.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.555+0000 7f9c0d1f0640 1 Processor -- start 2023-10-14T12:30:34.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.555+0000 7f9c0d1f0640 1 -- start start 2023-10-14T12:30:34.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.556+0000 7f9c0d1f0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9c0815ad00 0x7f9c080701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:34.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.556+0000 7f9c0d1f0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c080707f0 con 0x7f9c0815f040 2023-10-14T12:30:34.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0d1f0640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c08070ad0 con 0x7f9c080b0010 2023-10-14T12:30:34.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0d1f0640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c0815b1d0 con 0x7f9c0815ad00 2023-10-14T12:30:34.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0759e640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f9c0815f040 0x7f9c0815b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34290/0 (socket says 172.21.15.64:34290) 2023-10-14T12:30:34.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0659c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f9c0815ad00 0x7f9c080701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:34.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0759e640 1 -- 172.21.15.64:0/42297442 learned_addr learned my addr 172.21.15.64:0/42297442 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:34.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0659c640 1 -- 172.21.15.64:0/42297442 >> v1:172.21.15.177:6789/0 conn(0x7f9c080b0010 legacy=0x7f9c080b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0659c640 1 -- 172.21.15.64:0/42297442 >> v1:172.21.15.64:6789/0 conn(0x7f9c0815f040 legacy=0x7f9c0815b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.557+0000 7f9c0659c640 1 -- 172.21.15.64:0/42297442 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0815b4b0 con 0x7f9c0815ad00 2023-10-14T12:30:34.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.559+0000 7f9c0659c640 1 --2- 172.21.15.64:0/42297442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c0815ad00 0x7f9c080701a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0097a0 tx=0x7f9bfc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d5d924b1eeab52a server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:34.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.559+0000 7f9c05d9b640 1 -- 172.21.15.64:0/42297442 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc030610 con 0x7f9c0815ad00 2023-10-14T12:30:34.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.559+0000 7f9c05d9b640 1 -- 172.21.15.64:0/42297442 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bfc030770 con 0x7f9c0815ad00 2023-10-14T12:30:34.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.559+0000 7f9c05d9b640 1 -- 172.21.15.64:0/42297442 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc030b00 con 0x7f9c0815ad00 2023-10-14T12:30:34.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.560+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/42297442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c0815ad00 msgr2=0x7f9c080701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.560+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/42297442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c0815ad00 0x7f9c080701a0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0097a0 tx=0x7f9bfc02b960 comp rx=0 tx=0).stop 2023-10-14T12:30:34.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.560+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/42297442 shutdown_connections 2023-10-14T12:30:34.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.560+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/42297442 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c0815ad00 0x7f9c080701a0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.560+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/42297442 >> 172.21.15.64:0/42297442 conn(0x7f9c0806c1c0 msgr2=0x7f9c0806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:34.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.560+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/42297442 shutdown_connections 2023-10-14T12:30:34.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.560+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/42297442 wait complete. 2023-10-14T12:30:34.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.562+0000 7f9c0d1f0640 1 Processor -- start 2023-10-14T12:30:34.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.562+0000 7f9c0d1f0640 1 -- start start 2023-10-14T12:30:34.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0d1f0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c080b0010 0x7f9c08159710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:34.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0d1f0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c0815ad00 0x7f9c080b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:34.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0d1f0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c0815f040 0x7f9c080b3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:34.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0d1f0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c5700 con 0x7f9c080b0010 2023-10-14T12:30:34.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0d1f0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c59a0 con 0x7f9c0815f040 2023-10-14T12:30:34.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0d1f0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c080c5c80 con 0x7f9c0815ad00 2023-10-14T12:30:34.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c06d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c080b0010 0x7f9c08159710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:34.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c06d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c080b0010 0x7f9c08159710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53360/0 (socket says 172.21.15.64:53360) 2023-10-14T12:30:34.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c06d9d640 1 -- 172.21.15.64:0/3247873867 learned_addr learned my addr 172.21.15.64:0/3247873867 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:34.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0659c640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c0815ad00 0x7f9c080b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:34.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c0759e640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c0815f040 0x7f9c080b3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:34.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c06d9d640 1 -- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c0815ad00 msgr2=0x7f9c080b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c06d9d640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c0815ad00 0x7f9c080b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c06d9d640 1 -- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c0815f040 msgr2=0x7f9c080b3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.563+0000 7f9c06d9d640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c0815f040 0x7f9c080b3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9c06d9d640 1 -- 172.21.15.64:0/3247873867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc009400 con 0x7f9c080b0010 2023-10-14T12:30:34.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9c0759e640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c0815f040 0x7f9c080b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:34.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9c0659c640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c0815ad00 0x7f9c080b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:34.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9c06d9d640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c080b0010 0x7f9c08159710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c450 tx=0x7f9bf800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:34.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9bef7fe640 1 -- 172.21.15.64:0/3247873867 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf80052d0 con 0x7f9c080b0010 2023-10-14T12:30:34.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9bef7fe640 1 -- 172.21.15.64:0/3247873867 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf8005430 con 0x7f9c080b0010 2023-10-14T12:30:34.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9bef7fe640 1 -- 172.21.15.64:0/3247873867 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8012870 con 0x7f9c080b0010 2023-10-14T12:30:34.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c080c5f60 con 0x7f9c080b0010 2023-10-14T12:30:34.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.564+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c08159c50 con 0x7f9c080b0010 2023-10-14T12:30:34.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.566+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c080c6480 con 0x7f9c080b0010 2023-10-14T12:30:34.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.567+0000 7f9bef7fe640 1 -- 172.21.15.64:0/3247873867 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9bf80129d0 con 0x7f9c080b0010 2023-10-14T12:30:34.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.568+0000 7f9bef7fe640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9bf406aea0 0x7f9bf406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:34.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.568+0000 7f9bef7fe640 1 -- 172.21.15.64:0/3247873867 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9bf8089310 con 0x7f9c080b0010 2023-10-14T12:30:34.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.568+0000 7f9c0659c640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9bf406aea0 0x7f9bf406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:34.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.569+0000 7f9c0659c640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9bf406aea0 0x7f9bf406d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc036000 tx=0x7f9bfc03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:34.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.572+0000 7f9bef7fe640 1 -- 172.21.15.64:0/3247873867 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9c080c6480 con 0x7f9c080b0010 2023-10-14T12:30:34.769 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.768+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c080c6480 con 0x7f9c080b0010 2023-10-14T12:30:34.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.771+0000 7f9bef7fe640 1 -- 172.21.15.64:0/3247873867 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16795 (secure 0 0 0) 0x7f9c080c6480 con 0x7f9c080b0010 2023-10-14T12:30:34.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:34.773 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":40,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:30:33.785396+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:30:31.794557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:30:32.797876+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:34.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9bf406aea0 msgr2=0x7f9bf406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9bf406aea0 0x7f9bf406d360 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc036000 tx=0x7f9bfc03b040 comp rx=0 tx=0).stop 2023-10-14T12:30:34.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c080b0010 msgr2=0x7f9c08159710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:34.775 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c080b0010 0x7f9c08159710 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c450 tx=0x7f9bf800c910 comp rx=0 tx=0).stop 2023-10-14T12:30:34.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 shutdown_connections 2023-10-14T12:30:34.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f9bf406aea0 0x7f9bf406d360 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f9c0815f040 0x7f9c080b3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f9c0815ad00 0x7f9c080b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 --2- 172.21.15.64:0/3247873867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f9c080b0010 0x7f9c08159710 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:34.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 >> 172.21.15.64:0/3247873867 conn(0x7f9c0806c1c0 msgr2=0x7f9c080b03f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:34.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 shutdown_connections 2023-10-14T12:30:34.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:34.773+0000 7f9c0d1f0640 1 -- 172.21.15.64:0/3247873867 wait complete. 2023-10-14T12:30:34.793 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:35.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.001+0000 7fb26dc72640 1 Processor -- start 2023-10-14T12:30:35.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.001+0000 7fb26dc72640 1 -- start start 2023-10-14T12:30:35.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.003+0000 7fb26dc72640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb2680cad30 0x7fb2680cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.003+0000 7fb26dc72640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 0x7fb268070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.003+0000 7fb26dc72640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb268164a20 con 0x7fb2680c8d40 2023-10-14T12:30:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.003+0000 7fb26dc72640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2680721e0 con 0x7fb2680cad30 2023-10-14T12:30:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.003+0000 7fb26dc72640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c9270 con 0x7fb2681651e0 2023-10-14T12:30:35.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.003+0000 7fb267fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fb2680c8d40 0x7fb2680cb110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34296/0 (socket says 172.21.15.64:34296) 2023-10-14T12:30:35.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.003+0000 7fb267fff640 1 -- 172.21.15.64:0/3651682842 learned_addr learned my addr 172.21.15.64:0/3651682842 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:35.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb26d471640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 0x7fb268070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb26cc70640 1 --2- 172.21.15.64:0/3651682842 >> v2:172.21.15.177:3300/0 conn(0x7fb2680cad30 0x7fb2680cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2321202538 0 0) 0x7fb268164a20 con 0x7fb2680c8d40 2023-10-14T12:30:35.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb258003520 con 0x7fb2680c8d40 2023-10-14T12:30:35.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 626291191 0 0) 0x7fb258003520 con 0x7fb2680c8d40 2023-10-14T12:30:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 msgr2=0x7fb268070080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 0x7fb268070080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 >> v2:172.21.15.177:3300/0 conn(0x7fb2680cad30 msgr2=0x7fb2680cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 --2- 172.21.15.64:0/3651682842 >> v2:172.21.15.177:3300/0 conn(0x7fb2680cad30 0x7fb2680cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680c9550 con 0x7fb2680c8d40 2023-10-14T12:30:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fb254001670 con 0x7fb2680c8d40 2023-10-14T12:30:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 >> v1:172.21.15.64:6789/0 conn(0x7fb2680c8d40 legacy=0x7fb2680cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb258003970 0x7fb258003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 0x7fb2580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb258004d00 0x7fb258005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680721e0 con 0x7fb258003970 2023-10-14T12:30:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c9270 con 0x7fb258004d00 2023-10-14T12:30:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb25800ba30 con 0x7fb2681651e0 2023-10-14T12:30:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.004+0000 7fb26cc70640 1 --2- 172.21.15.64:0/3651682842 >> v2:172.21.15.177:3300/0 conn(0x7fb2680cad30 0x7fb2680cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:35.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.005+0000 7fb26cc70640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb258003970 0x7fb258003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.005+0000 7fb26d471640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb258004d00 0x7fb258005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.005+0000 7fb267fff640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 0x7fb2580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.006+0000 7fb26cc70640 1 -- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 msgr2=0x7fb2580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.006+0000 7fb26cc70640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2681651e0 0x7fb2580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.006+0000 7fb26cc70640 1 -- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb258004d00 msgr2=0x7fb258005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:35.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.006+0000 7fb26cc70640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb258004d00 0x7fb258005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.006+0000 7fb26cc70640 1 -- 172.21.15.64:0/3651682842 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb258003520 con 0x7fb258003970 2023-10-14T12:30:35.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.006+0000 7fb26d471640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb258004d00 0x7fb258005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:35.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.007+0000 7fb26cc70640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb258003970 0x7fb258003d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098a0 tx=0x7fb2580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d8af6c5e67369a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:35.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.008+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c037600 con 0x7fb258003970 2023-10-14T12:30:35.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.008+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c037760 con 0x7fb258003970 2023-10-14T12:30:35.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.008+0000 7fb2677fe640 1 -- 172.21.15.64:0/3651682842 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c037ad0 con 0x7fb258003970 2023-10-14T12:30:35.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.008+0000 7fb26dc72640 1 -- 172.21.15.64:0/3651682842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb258003970 msgr2=0x7fb258003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.008+0000 7fb26dc72640 1 --2- 172.21.15.64:0/3651682842 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb258003970 0x7fb258003d90 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098a0 tx=0x7fb2580057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.008+0000 7fb26d471640 1 -- 172.21.15.64:0/3651682842 reap_dead start 2023-10-14T12:30:35.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.009+0000 7fb26dc72640 1 -- 172.21.15.64:0/3651682842 shutdown_connections 2023-10-14T12:30:35.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.009+0000 7fb26dc72640 1 -- 172.21.15.64:0/3651682842 >> 172.21.15.64:0/3651682842 conn(0x7fb26806a470 msgr2=0x7fb2680afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:35.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.009+0000 7fb26dc72640 1 -- 172.21.15.64:0/3651682842 shutdown_connections 2023-10-14T12:30:35.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.009+0000 7fb26dc72640 1 -- 172.21.15.64:0/3651682842 wait complete. 2023-10-14T12:30:35.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.010+0000 7fb26dc72640 1 Processor -- start 2023-10-14T12:30:35.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.011+0000 7fb26dc72640 1 -- start start 2023-10-14T12:30:35.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.011+0000 7fb26dc72640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2681f66e0 0x7fb2681f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.011+0000 7fb26dc72640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2681f7000 0x7fb2680c2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.011+0000 7fb26dc72640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2680c2580 0x7fb2680b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.011+0000 7fb26dc72640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c2d70 con 0x7fb2681f66e0 2023-10-14T12:30:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.011+0000 7fb26dc72640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c3050 con 0x7fb2681f7000 2023-10-14T12:30:35.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26dc72640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2680c3330 con 0x7fb2680c2580 2023-10-14T12:30:35.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2681f66e0 0x7fb2681f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2681f66e0 0x7fb2681f6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53392/0 (socket says 172.21.15.64:53392) 2023-10-14T12:30:35.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 -- 172.21.15.64:0/2874711895 learned_addr learned my addr 172.21.15.64:0/2874711895 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:35.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26d471640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2680c2580 0x7fb2680b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb267fff640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2681f7000 0x7fb2680c2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 -- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2680c2580 msgr2=0x7fb2680b1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2680c2580 0x7fb2680b1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 -- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2681f7000 msgr2=0x7fb2680c2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2681f7000 0x7fb2680c2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.012+0000 7fb26cc70640 1 -- 172.21.15.64:0/2874711895 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2680c3610 con 0x7fb2681f66e0 2023-10-14T12:30:35.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.013+0000 7fb26cc70640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2681f66e0 0x7fb2681f6ac0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098a0 tx=0x7fb25c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:35.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.013+0000 7fb2657fa640 1 -- 172.21.15.64:0/2874711895 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c03e040 con 0x7fb2681f66e0 2023-10-14T12:30:35.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.013+0000 7fb2657fa640 1 -- 172.21.15.64:0/2874711895 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb25c006240 con 0x7fb2681f66e0 2023-10-14T12:30:35.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.013+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2681f7460 con 0x7fb2681f66e0 2023-10-14T12:30:35.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.013+0000 7fb2657fa640 1 -- 172.21.15.64:0/2874711895 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25c006d70 con 0x7fb2681f66e0 2023-10-14T12:30:35.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.013+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2680c4cb0 con 0x7fb2681f66e0 2023-10-14T12:30:35.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.014+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb26804e9b0 con 0x7fb2681f66e0 2023-10-14T12:30:35.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.015+0000 7fb2657fa640 1 -- 172.21.15.64:0/2874711895 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb25c0065f0 con 0x7fb2681f66e0 2023-10-14T12:30:35.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.016+0000 7fb2657fa640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb24c06ae70 0x7fb24c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.016+0000 7fb2657fa640 1 -- 172.21.15.64:0/2874711895 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fb25c0ab2f0 con 0x7fb2681f66e0 2023-10-14T12:30:35.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.017+0000 7fb267fff640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb24c06ae70 0x7fb24c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.018+0000 7fb267fff640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb24c06ae70 0x7fb24c06d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb254004840 tx=0x7fb254009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:35.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.021+0000 7fb2657fa640 1 -- 172.21.15.64:0/2874711895 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb25c0762d0 con 0x7fb2681f66e0 2023-10-14T12:30:35.209 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.208+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2680b0f90 con 0x7fb2681f66e0 2023-10-14T12:30:35.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.211+0000 7fb2657fa640 1 -- 172.21.15.64:0/2874711895 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16795 (secure 0 0 0) 0x7fb25c00f040 con 0x7fb2681f66e0 2023-10-14T12:30:35.213 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:35.213 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":40,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:30:33.785396+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:30:31.794557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:30:32.797876+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:35.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb24c06ae70 msgr2=0x7fb24c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb24c06ae70 0x7fb24c06d330 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb254004840 tx=0x7fb254009040 comp rx=0 tx=0).stop 2023-10-14T12:30:35.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2681f66e0 msgr2=0x7fb2681f6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2681f66e0 0x7fb2681f6ac0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fb25c0098a0 tx=0x7fb25c0046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 shutdown_connections 2023-10-14T12:30:35.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb24c06ae70 0x7fb24c06d330 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb2680c2580 0x7fb2680b1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb2681f7000 0x7fb2680c2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 --2- 172.21.15.64:0/2874711895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb2681f66e0 0x7fb2681f6ac0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 >> 172.21.15.64:0/2874711895 conn(0x7fb26806a470 msgr2=0x7fb2680cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:35.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 shutdown_connections 2023-10-14T12:30:35.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.213+0000 7fb26dc72640 1 -- 172.21.15.64:0/2874711895 wait complete. 2023-10-14T12:30:35.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 standby_count_wanted 0 2023-10-14T12:30:35.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.450+0000 7f7746925640 1 Processor -- start 2023-10-14T12:30:35.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.450+0000 7f7746925640 1 -- start start 2023-10-14T12:30:35.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f7746925640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f7740070a30 0x7f77400cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f7746925640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f77400ca550 0x7f77400c8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f7746925640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77400cf040 con 0x7f774015a830 2023-10-14T12:30:35.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f7746925640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77400ca9e0 con 0x7f77400ca550 2023-10-14T12:30:35.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f7746925640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77400ce430 con 0x7f7740070a30 2023-10-14T12:30:35.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f773ffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f774015a830 0x7f7740070320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34312/0 (socket says 172.21.15.64:34312) 2023-10-14T12:30:35.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f773ffff640 1 -- 172.21.15.64:0/3529078119 learned_addr learned my addr 172.21.15.64:0/3529078119 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:35.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f7744ec2640 1 --2- 172.21.15.64:0/3529078119 >> v2:172.21.15.64:3300/0 conn(0x7f77400ca550 0x7f77400c8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f773f7fe640 1 --2- 172.21.15.64:0/3529078119 >> v2:172.21.15.177:3300/0 conn(0x7f7740070a30 0x7f77400cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f773effd640 1 -- 172.21.15.64:0/3529078119 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1693082156 0 0) 0x7f77400cf040 con 0x7f774015a830 2023-10-14T12:30:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.452+0000 7f773effd640 1 -- 172.21.15.64:0/3529078119 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7728003520 con 0x7f774015a830 2023-10-14T12:30:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.453+0000 7f7744ec2640 1 -- 172.21.15.64:0/3529078119 >> v2:172.21.15.177:3300/0 conn(0x7f7740070a30 msgr2=0x7f77400cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.453+0000 7f7744ec2640 1 --2- 172.21.15.64:0/3529078119 >> v2:172.21.15.177:3300/0 conn(0x7f7740070a30 0x7f77400cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.453+0000 7f7744ec2640 1 -- 172.21.15.64:0/3529078119 >> v1:172.21.15.64:6789/0 conn(0x7f774015a830 legacy=0x7f7740070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.453+0000 7f7744ec2640 1 -- 172.21.15.64:0/3529078119 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77400ce710 con 0x7f77400ca550 2023-10-14T12:30:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.454+0000 7f7744ec2640 1 --2- 172.21.15.64:0/3529078119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f77400c8b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f77400b0b40 tx=0x7f773802bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87634d4ef37a2af server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.454+0000 7f773effd640 1 -- 172.21.15.64:0/3529078119 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773802cc70 con 0x7f77400ca550 2023-10-14T12:30:35.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.454+0000 7f773effd640 1 -- 172.21.15.64:0/3529078119 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773802cdd0 con 0x7f77400ca550 2023-10-14T12:30:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.454+0000 7f773effd640 1 -- 172.21.15.64:0/3529078119 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7738034660 con 0x7f77400ca550 2023-10-14T12:30:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.454+0000 7f7746925640 1 -- 172.21.15.64:0/3529078119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 msgr2=0x7f77400c8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.454+0000 7f7746925640 1 --2- 172.21.15.64:0/3529078119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f77400c8b50 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f77400b0b40 tx=0x7f773802bec0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.455+0000 7f7746925640 1 -- 172.21.15.64:0/3529078119 shutdown_connections 2023-10-14T12:30:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.455+0000 7f7746925640 1 --2- 172.21.15.64:0/3529078119 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f77400c8b50 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.459 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.455+0000 7f7746925640 1 --2- 172.21.15.64:0/3529078119 >> v2:172.21.15.177:3300/0 conn(0x7f7740070a30 0x7f77400cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.455+0000 7f7746925640 1 -- 172.21.15.64:0/3529078119 >> 172.21.15.64:0/3529078119 conn(0x7f77400b0030 msgr2=0x7f77400b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:35.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.455+0000 7f7746925640 1 -- 172.21.15.64:0/3529078119 shutdown_connections 2023-10-14T12:30:35.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.455+0000 7f7746925640 1 -- 172.21.15.64:0/3529078119 wait complete. 2023-10-14T12:30:35.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.456+0000 7f7746925640 1 Processor -- start 2023-10-14T12:30:35.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.457+0000 7f7746925640 1 -- start start 2023-10-14T12:30:35.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.457+0000 7f7746925640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7740070a30 0x7f77401f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.457+0000 7f7746925640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f7740158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.457+0000 7f7746925640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f774015a830 0x7f77400cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f7746925640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77401f5fd0 con 0x7f77400ca550 2023-10-14T12:30:35.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f7746925640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77400c67a0 con 0x7f7740070a30 2023-10-14T12:30:35.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f7746925640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77400c6a40 con 0x7f774015a830 2023-10-14T12:30:35.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f7740158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f7740158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:53416/0 (socket says 172.21.15.64:53416) 2023-10-14T12:30:35.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 -- 172.21.15.64:0/147643065 learned_addr learned my addr 172.21.15.64:0/147643065 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:35.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773ffff640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7740070a30 0x7f77401f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f7744ec2640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f774015a830 0x7f77400cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 -- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f774015a830 msgr2=0x7f77400cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f774015a830 0x7f77400cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 -- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7740070a30 msgr2=0x7f77401f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:35.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7740070a30 0x7f77401f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:35.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.458+0000 7f773f7fe640 1 -- 172.21.15.64:0/147643065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738009a70 con 0x7f77400ca550 2023-10-14T12:30:35.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.459+0000 7f773f7fe640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f7740158080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f773400d800 tx=0x7f773400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:35.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.459+0000 7f773cff9640 1 -- 172.21.15.64:0/147643065 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400b6c0 con 0x7f77400ca550 2023-10-14T12:30:35.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.459+0000 7f773cff9640 1 -- 172.21.15.64:0/147643065 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f773400b820 con 0x7f77400ca550 2023-10-14T12:30:35.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.459+0000 7f773cff9640 1 -- 172.21.15.64:0/147643065 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f773400bbb0 con 0x7f77400ca550 2023-10-14T12:30:35.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.459+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77400c6d20 con 0x7f77400ca550 2023-10-14T12:30:35.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.459+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77401585c0 con 0x7f77400ca550 2023-10-14T12:30:35.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.460+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7740073ef0 con 0x7f77400ca550 2023-10-14T12:30:35.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.461+0000 7f773cff9640 1 -- 172.21.15.64:0/147643065 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f773400bd10 con 0x7f77400ca550 2023-10-14T12:30:35.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.463+0000 7f773cff9640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f772c06ae70 0x7f772c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:35.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.463+0000 7f773cff9640 1 -- 172.21.15.64:0/147643065 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f7734089c40 con 0x7f77400ca550 2023-10-14T12:30:35.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.464+0000 7f773ffff640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f772c06ae70 0x7f772c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:35.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.465+0000 7f773ffff640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f772c06ae70 0x7f772c06d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77300011e0 tx=0x7f7730009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:35.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.467+0000 7f773cff9640 1 -- 172.21.15.64:0/147643065 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7734054c20 con 0x7f77400ca550 2023-10-14T12:30:35.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:35.694+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7740158a90 con 0x7f77400ca550 2023-10-14T12:30:36.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.332+0000 7f773cff9640 1 -- 172.21.15.64:0/147643065 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7734058240 con 0x7f77400ca550 2023-10-14T12:30:36.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f772c06ae70 msgr2=0x7f772c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:36.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f772c06ae70 0x7f772c06d330 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f77300011e0 tx=0x7f7730009040 comp rx=0 tx=0).stop 2023-10-14T12:30:36.337 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 msgr2=0x7f7740158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:36.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f7740158080 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f773400d800 tx=0x7f773400dcc0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 shutdown_connections 2023-10-14T12:30:36.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f772c06ae70 0x7f772c06d330 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f774015a830 0x7f77400cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.338 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f77400ca550 0x7f7740158080 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 --2- 172.21.15.64:0/147643065 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7740070a30 0x7f77401f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.335+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 >> 172.21.15.64:0/147643065 conn(0x7f77400b0030 msgr2=0x7f77400b32e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:36.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.336+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 shutdown_connections 2023-10-14T12:30:36.339 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.336+0000 7f7746925640 1 -- 172.21.15.64:0/147643065 wait complete. 2023-10-14T12:30:36.358 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-10-14T12:30:36.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set testcephfs1 allow_standby_replay false 2023-10-14T12:30:36.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.590+0000 7f4df896e640 1 Processor -- start 2023-10-14T12:30:36.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.590+0000 7f4df896e640 1 -- start start 2023-10-14T12:30:36.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df896e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df40ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:36.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df896e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4df40cee60 0x7f4df406ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:36.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df896e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4df406d360 0x7f4df40ac1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:36.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df896e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df40cf2e0 con 0x7f4df406d360 2023-10-14T12:30:36.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df896e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df41550f0 con 0x7f4df40cee60 2023-10-14T12:30:36.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df896e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df406db50 con 0x7f4df4154d10 2023-10-14T12:30:36.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4df406d360 0x7f4df40ac1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:36.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4df406d360 0x7f4df40ac1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52008/0 (socket says 172.21.15.64:52008) 2023-10-14T12:30:36.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.592+0000 7f4df3fff640 1 -- 172.21.15.64:0/1857179053 learned_addr learned my addr 172.21.15.64:0/1857179053 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:36.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4debfff640 1 --2- 172.21.15.64:0/1857179053 >> v2:172.21.15.177:3300/0 conn(0x7f4df40cee60 0x7f4df406ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:36.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4df3fff640 1 -- 172.21.15.64:0/1857179053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 msgr2=0x7f4df40ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:36.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4df37fe640 1 --2- 172.21.15.64:0/1857179053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df40ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:36.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4df3fff640 1 --2- 172.21.15.64:0/1857179053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df40ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4df3fff640 1 -- 172.21.15.64:0/1857179053 >> v2:172.21.15.177:3300/0 conn(0x7f4df40cee60 msgr2=0x7f4df406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:36.597 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4df3fff640 1 --2- 172.21.15.64:0/1857179053 >> v2:172.21.15.177:3300/0 conn(0x7f4df40cee60 0x7f4df406ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4df3fff640 1 -- 172.21.15.64:0/1857179053 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df40b13f0 con 0x7f4df406d360 2023-10-14T12:30:36.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4debfff640 1 --2- 172.21.15.64:0/1857179053 >> v2:172.21.15.177:3300/0 conn(0x7f4df40cee60 0x7f4df406ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:36.598 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.593+0000 7f4df37fe640 1 --2- 172.21.15.64:0/1857179053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df40ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:36.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.594+0000 7f4df3fff640 1 --2- 172.21.15.64:0/1857179053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40ac1d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4df40b1080 tx=0x7f4dec02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5f177ac6843e87 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:36.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df2ffd640 1 -- 172.21.15.64:0/1857179053 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec02ca80 con 0x7f4df406d360 2023-10-14T12:30:36.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df2ffd640 1 -- 172.21.15.64:0/1857179053 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dec02cbe0 con 0x7f4df406d360 2023-10-14T12:30:36.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df2ffd640 1 -- 172.21.15.64:0/1857179053 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dec0343f0 con 0x7f4df406d360 2023-10-14T12:30:36.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df896e640 1 -- 172.21.15.64:0/1857179053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 msgr2=0x7f4df40ac1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:36.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df896e640 1 --2- 172.21.15.64:0/1857179053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40ac1d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4df40b1080 tx=0x7f4dec02bee0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df896e640 1 -- 172.21.15.64:0/1857179053 shutdown_connections 2023-10-14T12:30:36.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df896e640 1 --2- 172.21.15.64:0/1857179053 >> v2:172.21.15.177:3300/0 conn(0x7f4df40cee60 0x7f4df406ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df896e640 1 --2- 172.21.15.64:0/1857179053 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40ac1d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df896e640 1 --2- 172.21.15.64:0/1857179053 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df40ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.595+0000 7f4df896e640 1 -- 172.21.15.64:0/1857179053 >> 172.21.15.64:0/1857179053 conn(0x7f4df406a200 msgr2=0x7f4df406a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:36.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.596+0000 7f4df896e640 1 -- 172.21.15.64:0/1857179053 shutdown_connections 2023-10-14T12:30:36.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.596+0000 7f4df896e640 1 -- 172.21.15.64:0/1857179053 wait complete. 2023-10-14T12:30:36.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.597+0000 7f4df896e640 1 Processor -- start 2023-10-14T12:30:36.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.597+0000 7f4df896e640 1 -- start start 2023-10-14T12:30:36.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.598+0000 7f4df896e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:36.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.598+0000 7f4df896e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4df40cee60 0x7f4df4153370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:36.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.598+0000 7f4df896e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df415bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:36.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.598+0000 7f4df896e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4159c30 con 0x7f4df406d360 2023-10-14T12:30:36.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.598+0000 7f4df896e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df40c84a0 con 0x7f4df40cee60 2023-10-14T12:30:36.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.598+0000 7f4df896e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df4159290 con 0x7f4df4154d10 2023-10-14T12:30:36.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.598+0000 7f4df37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:36.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52014/0 (socket says 172.21.15.64:52014) 2023-10-14T12:30:36.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 -- 172.21.15.64:0/2967504273 learned_addr learned my addr 172.21.15.64:0/2967504273 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:36.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4debfff640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4df40cee60 0x7f4df4153370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:36.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df3fff640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df415bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:36.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 -- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 msgr2=0x7f4df415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:36.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df415bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.607 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 -- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4df40cee60 msgr2=0x7f4df4153370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:36.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4df40cee60 0x7f4df4153370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:36.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 -- 172.21.15.64:0/2967504273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dec009b30 con 0x7f4df406d360 2023-10-14T12:30:36.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.599+0000 7f4df37fe640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40c7e50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c7f0 tx=0x7f4de400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:36.608 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.600+0000 7f4df0ff9640 1 -- 172.21.15.64:0/2967504273 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de4007a30 con 0x7f4df406d360 2023-10-14T12:30:36.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.600+0000 7f4df0ff9640 1 -- 172.21.15.64:0/2967504273 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de4007b90 con 0x7f4df406d360 2023-10-14T12:30:36.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.600+0000 7f4df0ff9640 1 -- 172.21.15.64:0/2967504273 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de400ce40 con 0x7f4df406d360 2023-10-14T12:30:36.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.600+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df4159570 con 0x7f4df406d360 2023-10-14T12:30:36.609 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.600+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df41538b0 con 0x7f4df406d360 2023-10-14T12:30:36.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.601+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df404e9b0 con 0x7f4df406d360 2023-10-14T12:30:36.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.602+0000 7f4df0ff9640 1 -- 172.21.15.64:0/2967504273 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4de40113f0 con 0x7f4df406d360 2023-10-14T12:30:36.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.603+0000 7f4df0ff9640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4dd406ae70 0x7f4dd406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:36.610 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.603+0000 7f4df0ff9640 1 -- 172.21.15.64:0/2967504273 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f4de4089a40 con 0x7f4df406d360 2023-10-14T12:30:36.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.604+0000 7f4debfff640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4dd406ae70 0x7f4dd406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:36.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.605+0000 7f4debfff640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4dd406ae70 0x7f4dd406d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4df40ce2b0 tx=0x7f4ddc008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:36.611 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.607+0000 7f4df0ff9640 1 -- 172.21.15.64:0/2967504273 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4de4054860 con 0x7f4df406d360 2023-10-14T12:30:36.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:36.841+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4df406c9d0 con 0x7f4df406d360 2023-10-14T12:30:37.158 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T12:30:37.156+0000 7f90056d5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-14T12:30:37.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.803+0000 7f4df0ff9640 1 -- 172.21.15.64:0/2967504273 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "testcephfs1", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 127+0+0 (secure 0 0 0) 0x7f4de401f020 con 0x7f4df406d360 2023-10-14T12:30:37.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4dd406ae70 msgr2=0x7f4dd406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4dd406ae70 0x7f4dd406d330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f4df40ce2b0 tx=0x7f4ddc008040 comp rx=0 tx=0).stop 2023-10-14T12:30:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 msgr2=0x7f4df40c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40c7e50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4de400c7f0 tx=0x7f4de400cbf0 comp rx=0 tx=0).stop 2023-10-14T12:30:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 shutdown_connections 2023-10-14T12:30:37.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4dd406ae70 0x7f4dd406d330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4df4154d10 0x7f4df415bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4df40cee60 0x7f4df4153370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 --2- 172.21.15.64:0/2967504273 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4df406d360 0x7f4df40c7e50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:37.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 >> 172.21.15.64:0/2967504273 conn(0x7f4df406a200 msgr2=0x7f4df40ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:37.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 shutdown_connections 2023-10-14T12:30:37.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:37.807+0000 7f4df896e640 1 -- 172.21.15.64:0/2967504273 wait complete. 2023-10-14T12:30:37.831 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'testcephfs1' 2023-10-14T12:30:37.832 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:30:38.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.040+0000 7f44a9b1a640 1 Processor -- start 2023-10-14T12:30:38.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.040+0000 7f44a9b1a640 1 -- start start 2023-10-14T12:30:38.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.041+0000 7f44a9b1a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f44a415c990 0x7f44a4065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a9b1a640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a406b460 con 0x7f44a40ce2c0 2023-10-14T12:30:38.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a9b1a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a406a890 con 0x7f44a40cb0f0 2023-10-14T12:30:38.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a9b1a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a40ce9a0 con 0x7f44a415c990 2023-10-14T12:30:38.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a9319640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f44a40ce2c0 0x7f44a40c9210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:55956/0 (socket says 172.21.15.64:55956) 2023-10-14T12:30:38.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a8b18640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f44a415c990 0x7f44a4065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a9319640 1 -- 172.21.15.64:0/1584740564 learned_addr learned my addr 172.21.15.64:0/1584740564 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:38.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a37fe640 1 -- 172.21.15.64:0/1584740564 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2828616989 0 0) 0x7f44a406b460 con 0x7f44a40ce2c0 2023-10-14T12:30:38.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.042+0000 7f44a37fe640 1 -- 172.21.15.64:0/1584740564 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4494003520 con 0x7f44a40ce2c0 2023-10-14T12:30:38.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.043+0000 7f44a8b18640 1 -- 172.21.15.64:0/1584740564 >> v1:172.21.15.177:6789/0 conn(0x7f44a40cb0f0 legacy=0x7f44a40cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:38.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.043+0000 7f44a8b18640 1 -- 172.21.15.64:0/1584740564 >> v1:172.21.15.64:6789/0 conn(0x7f44a40ce2c0 legacy=0x7f44a40c9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.043+0000 7f44a8b18640 1 -- 172.21.15.64:0/1584740564 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a406ab30 con 0x7f44a415c990 2023-10-14T12:30:38.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.044+0000 7f44a8b18640 1 --2- 172.21.15.64:0/1584740564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a415c990 0x7f44a4065ab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44980097a0 tx=0x7f449802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=788a81073811e68f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.044+0000 7f44a37fe640 1 -- 172.21.15.64:0/1584740564 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449802e070 con 0x7f44a415c990 2023-10-14T12:30:38.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.044+0000 7f44a37fe640 1 -- 172.21.15.64:0/1584740564 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44980315a0 con 0x7f44a415c990 2023-10-14T12:30:38.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.044+0000 7f44a37fe640 1 -- 172.21.15.64:0/1584740564 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498031930 con 0x7f44a415c990 2023-10-14T12:30:38.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.045+0000 7f44a9b1a640 1 -- 172.21.15.64:0/1584740564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a415c990 msgr2=0x7f44a4065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.045+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/1584740564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a415c990 0x7f44a4065ab0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f44980097a0 tx=0x7f449802b840 comp rx=0 tx=0).stop 2023-10-14T12:30:38.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.045+0000 7f44a9b1a640 1 -- 172.21.15.64:0/1584740564 shutdown_connections 2023-10-14T12:30:38.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.045+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/1584740564 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a415c990 0x7f44a4065ab0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.045+0000 7f44a9b1a640 1 -- 172.21.15.64:0/1584740564 >> 172.21.15.64:0/1584740564 conn(0x7f44a40b06b0 msgr2=0x7f44a40b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:38.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.045+0000 7f44a9b1a640 1 -- 172.21.15.64:0/1584740564 shutdown_connections 2023-10-14T12:30:38.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.045+0000 7f44a9b1a640 1 -- 172.21.15.64:0/1584740564 wait complete. 2023-10-14T12:30:38.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.047+0000 7f44a9b1a640 1 Processor -- start 2023-10-14T12:30:38.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.047+0000 7f44a9b1a640 1 -- start start 2023-10-14T12:30:38.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a9b1a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a40cb0f0 0x7f44a40c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a9b1a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44a40ce2c0 0x7f44a40c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a9b1a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a415c990 0x7f44a40c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a9b1a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a41e67b0 con 0x7f44a40cb0f0 2023-10-14T12:30:38.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a9b1a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40c61d0 con 0x7f44a415c990 2023-10-14T12:30:38.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a9b1a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a40c8e70 con 0x7f44a40ce2c0 2023-10-14T12:30:38.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a8b18640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a40cb0f0 0x7f44a40c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a8b18640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a40cb0f0 0x7f44a40c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52028/0 (socket says 172.21.15.64:52028) 2023-10-14T12:30:38.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a8b18640 1 -- 172.21.15.64:0/938113934 learned_addr learned my addr 172.21.15.64:0/938113934 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:38.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a9319640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a415c990 0x7f44a40c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a8b18640 1 -- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44a40ce2c0 msgr2=0x7f44a40c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a8b18640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44a40ce2c0 0x7f44a40c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.048+0000 7f44a8b18640 1 -- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a415c990 msgr2=0x7f44a40c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a8b18640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a415c990 0x7f44a40c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a8b18640 1 -- 172.21.15.64:0/938113934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4498009400 con 0x7f44a40cb0f0 2023-10-14T12:30:38.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a9319640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a415c990 0x7f44a40c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:38.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a8b18640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a40cb0f0 0x7f44a40c5c90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f44980098c0 tx=0x7f44980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a17fa640 1 -- 172.21.15.64:0/938113934 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498032840 con 0x7f44a40cb0f0 2023-10-14T12:30:38.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a17fa640 1 -- 172.21.15.64:0/938113934 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4498031f00 con 0x7f44a40cb0f0 2023-10-14T12:30:38.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a17fa640 1 -- 172.21.15.64:0/938113934 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4498032be0 con 0x7f44a40cb0f0 2023-10-14T12:30:38.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a40c88b0 con 0x7f44a40cb0f0 2023-10-14T12:30:38.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.049+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a41e63d0 con 0x7f44a40cb0f0 2023-10-14T12:30:38.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.051+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a40cccc0 con 0x7f44a40cb0f0 2023-10-14T12:30:38.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.051+0000 7f44a17fa640 1 -- 172.21.15.64:0/938113934 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4498032d40 con 0x7f44a40cb0f0 2023-10-14T12:30:38.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.052+0000 7f44a17fa640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f448806ae70 0x7f448806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.052+0000 7f44a17fa640 1 -- 172.21.15.64:0/938113934 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f44980ab680 con 0x7f44a40cb0f0 2023-10-14T12:30:38.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.053+0000 7f44a3fff640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f448806ae70 0x7f448806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.054+0000 7f44a3fff640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f448806ae70 0x7f448806d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4490000f60 tx=0x7f44900079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.057+0000 7f44a17fa640 1 -- 172.21.15.64:0/938113934 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4498076660 con 0x7f44a40cb0f0 2023-10-14T12:30:38.280 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.279+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44a41e68f0 con 0x7f44a40cb0f0 2023-10-14T12:30:38.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.280+0000 7f44a17fa640 1 -- 172.21.15.64:0/938113934 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f44a41e68f0 con 0x7f44a40cb0f0 2023-10-14T12:30:38.282 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:38.282 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2123710189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2123710189},{"type":"v1","addr":"172.21.15.177:6837","nonce":2123710189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1971405270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1971405270},{"type":"v1","addr":"172.21.15.177:6836","nonce":1971405270}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/47775465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":47775465},{"type":"v1","addr":"172.21.15.64:6833","nonce":47775465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:30:33.786154+0000","modified":"2023-10-14T12:30:36.843227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5457":{"gid":5457,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3900287009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3900287009},{"type":"v1","addr":"172.21.15.64:6835","nonce":3900287009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:30:38.283 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2023-10-14T12:30:38.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f448806ae70 msgr2=0x7f448806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f448806ae70 0x7f448806d330 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f4490000f60 tx=0x7f44900079b0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a40cb0f0 msgr2=0x7f44a40c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a40cb0f0 0x7f44a40c5c90 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f44980098c0 tx=0x7f44980046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 shutdown_connections 2023-10-14T12:30:38.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f448806ae70 0x7f448806d330 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f44a415c990 0x7f44a40c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f44a40ce2c0 0x7f44a40c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 --2- 172.21.15.64:0/938113934 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f44a40cb0f0 0x7f44a40c5c90 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 >> 172.21.15.64:0/938113934 conn(0x7f44a40b06b0 msgr2=0x7f44a40ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:38.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 shutdown_connections 2023-10-14T12:30:38.287 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.283+0000 7f44a9b1a640 1 -- 172.21.15.64:0/938113934 wait complete. 2023-10-14T12:30:38.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T12:30:38.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.509+0000 7f654ce02640 1 Processor -- start 2023-10-14T12:30:38.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.509+0000 7f654ce02640 1 -- start start 2023-10-14T12:30:38.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.511+0000 7f654ce02640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 0x7f654815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.511+0000 7f654ce02640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f654815def0 0x7f654806bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.511+0000 7f654ce02640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6548154110 con 0x7f65480cd980 2023-10-14T12:30:38.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.511+0000 7f654ce02640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654815d1f0 con 0x7f654815def0 2023-10-14T12:30:38.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.511+0000 7f654ce02640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654815a4c0 con 0x7f65480cdd60 2023-10-14T12:30:38.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.511+0000 7f65477fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f65480cd980 0x7f6548159c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:55966/0 (socket says 172.21.15.64:55966) 2023-10-14T12:30:38.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.511+0000 7f65477fe640 1 -- 172.21.15.64:0/1847262713 learned_addr learned my addr 172.21.15.64:0/1847262713 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:38.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 630470351 0 0) 0x7f6548154110 con 0x7f65480cd980 2023-10-14T12:30:38.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f653ffff640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 0x7f654815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6534003520 con 0x7f65480cd980 2023-10-14T12:30:38.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6547fff640 1 --2- 172.21.15.64:0/1847262713 >> v2:172.21.15.177:3300/0 conn(0x7f654815def0 0x7f654806bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3529667884 0 0) 0x7f6534003520 con 0x7f65480cd980 2023-10-14T12:30:38.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 msgr2=0x7f654815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:38.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 0x7f654815d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 >> v2:172.21.15.177:3300/0 conn(0x7f654815def0 msgr2=0x7f654806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:38.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 --2- 172.21.15.64:0/1847262713 >> v2:172.21.15.177:3300/0 conn(0x7f654815def0 0x7f654806bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654815a7a0 con 0x7f65480cd980 2023-10-14T12:30:38.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f65380017f0 con 0x7f65480cd980 2023-10-14T12:30:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 >> v1:172.21.15.64:6789/0 conn(0x7f65480cd980 legacy=0x7f6548159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 0x7f65340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6534004020 0x7f65340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6534004d00 0x7f6534005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654815d1f0 con 0x7f6534004020 2023-10-14T12:30:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654815a4c0 con 0x7f6534004d00 2023-10-14T12:30:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.512+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653400bb10 con 0x7f65480cdd60 2023-10-14T12:30:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f653ffff640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6534004020 0x7f65340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f65477fe640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 0x7f65340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f6547fff640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6534004d00 0x7f6534005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f653ffff640 1 -- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 msgr2=0x7f65340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f653ffff640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 0x7f65340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f653ffff640 1 -- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6534004d00 msgr2=0x7f6534005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f653ffff640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6534004d00 0x7f6534005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f653ffff640 1 -- 172.21.15.64:0/1847262713 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534003520 con 0x7f6534004020 2023-10-14T12:30:38.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.513+0000 7f65477fe640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f65480cdd60 0x7f65340039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:38.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.515+0000 7f653ffff640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6534004020 0x7f65340047c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f653000ba00 tx=0x7f65340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6d20e813626ec98 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.515+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530032620 con 0x7f6534004020 2023-10-14T12:30:38.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.515+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6530032780 con 0x7f6534004020 2023-10-14T12:30:38.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.515+0000 7f6546ffd640 1 -- 172.21.15.64:0/1847262713 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6530032b10 con 0x7f6534004020 2023-10-14T12:30:38.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.515+0000 7f654ce02640 1 -- 172.21.15.64:0/1847262713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6534004020 msgr2=0x7f65340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.515+0000 7f654ce02640 1 --2- 172.21.15.64:0/1847262713 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6534004020 0x7f65340047c0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f653000ba00 tx=0x7f65340057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.515+0000 7f6547fff640 1 -- 172.21.15.64:0/1847262713 reap_dead start 2023-10-14T12:30:38.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.516+0000 7f654ce02640 1 -- 172.21.15.64:0/1847262713 shutdown_connections 2023-10-14T12:30:38.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.516+0000 7f654ce02640 1 -- 172.21.15.64:0/1847262713 >> 172.21.15.64:0/1847262713 conn(0x7f654806a470 msgr2=0x7f65480afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:38.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.516+0000 7f654ce02640 1 -- 172.21.15.64:0/1847262713 shutdown_connections 2023-10-14T12:30:38.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.516+0000 7f654ce02640 1 -- 172.21.15.64:0/1847262713 wait complete. 2023-10-14T12:30:38.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.517+0000 7f654ce02640 1 Processor -- start 2023-10-14T12:30:38.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.518+0000 7f654ce02640 1 -- start start 2023-10-14T12:30:38.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f654ce02640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6534004020 0x7f65481ed6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f654ce02640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6548152050 0x7f65481524b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f654ce02640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f654814d8b0 0x7f654814dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f654ce02640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654814e270 con 0x7f654814d8b0 2023-10-14T12:30:38.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f654ce02640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654814cea0 con 0x7f6548152050 2023-10-14T12:30:38.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f654ce02640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654814bbb0 con 0x7f6534004020 2023-10-14T12:30:38.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f654814d8b0 0x7f654814dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f654814d8b0 0x7f654814dd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52048/0 (socket says 172.21.15.64:52048) 2023-10-14T12:30:38.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 -- 172.21.15.64:0/3987365356 learned_addr learned my addr 172.21.15.64:0/3987365356 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:38.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f65477fe640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6534004020 0x7f65481ed6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 -- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6534004020 msgr2=0x7f65481ed6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6534004020 0x7f65481ed6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 -- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6548152050 msgr2=0x7f65481524b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-14T12:30:38.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6548152050 0x7f65481524b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.519+0000 7f6547fff640 1 -- 172.21.15.64:0/3987365356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654814be00 con 0x7f654814d8b0 2023-10-14T12:30:38.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.520+0000 7f6547fff640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f654814d8b0 0x7f654814dd30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f65481577f0 tx=0x7f6540007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.520+0000 7f6544ff9640 1 -- 172.21.15.64:0/3987365356 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540003ea0 con 0x7f654814d8b0 2023-10-14T12:30:38.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.520+0000 7f6544ff9640 1 -- 172.21.15.64:0/3987365356 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f654000f050 con 0x7f654814d8b0 2023-10-14T12:30:38.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.520+0000 7f6544ff9640 1 -- 172.21.15.64:0/3987365356 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6540014650 con 0x7f654814d8b0 2023-10-14T12:30:38.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.520+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654814c0e0 con 0x7f654814d8b0 2023-10-14T12:30:38.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.520+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654814c6a0 con 0x7f654814d8b0 2023-10-14T12:30:38.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.521+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654804e9b0 con 0x7f654814d8b0 2023-10-14T12:30:38.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.522+0000 7f6544ff9640 1 -- 172.21.15.64:0/3987365356 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f65400147b0 con 0x7f654814d8b0 2023-10-14T12:30:38.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.523+0000 7f6544ff9640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f652806ae60 0x7f652806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.523+0000 7f6544ff9640 1 -- 172.21.15.64:0/3987365356 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f6540089ca0 con 0x7f654814d8b0 2023-10-14T12:30:38.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.524+0000 7f65477fe640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f652806ae60 0x7f652806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.525+0000 7f65477fe640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f652806ae60 0x7f652806d320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65380011b0 tx=0x7f6538009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.527+0000 7f6544ff9640 1 -- 172.21.15.64:0/3987365356 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6540054be0 con 0x7f654814d8b0 2023-10-14T12:30:38.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.724+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65480cd020 con 0x7f654814d8b0 2023-10-14T12:30:38.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.727+0000 7f6544ff9640 1 -- 172.21.15.64:0/3987365356 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16782 (secure 0 0 0) 0x7f6540058200 con 0x7f654814d8b0 2023-10-14T12:30:38.729 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:38.729 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":41,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:30:35.321488+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:30:31.794557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:30:32.797876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T12:30:38.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.729+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f652806ae60 msgr2=0x7f652806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.729+0000 7f654ce02640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f652806ae60 0x7f652806d320 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f65380011b0 tx=0x7f6538009040 comp rx=0 tx=0).stop 2023-10-14T12:30:38.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.729+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f654814d8b0 msgr2=0x7f654814dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.729+0000 7f654ce02640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f654814d8b0 0x7f654814dd30 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f65481577f0 tx=0x7f6540007700 comp rx=0 tx=0).stop 2023-10-14T12:30:38.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 shutdown_connections 2023-10-14T12:30:38.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f652806ae60 0x7f652806d320 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f654814d8b0 0x7f654814dd30 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6548152050 0x7f65481524b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 --2- 172.21.15.64:0/3987365356 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6534004020 0x7f65481ed6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 >> 172.21.15.64:0/3987365356 conn(0x7f654806a470 msgr2=0x7f6548157d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:38.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 shutdown_connections 2023-10-14T12:30:38.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.730+0000 7f654ce02640 1 -- 172.21.15.64:0/3987365356 wait complete. 2023-10-14T12:30:38.749 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-14T12:30:38.749 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:30:38.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.956+0000 7f691759e640 1 Processor -- start 2023-10-14T12:30:38.958 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.956+0000 7f691759e640 1 -- start start 2023-10-14T12:30:38.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.958+0000 7f691759e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f691815c9d0 0x7f69180cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.959 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.958+0000 7f691759e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69180d0320 con 0x7f69180cf850 2023-10-14T12:30:38.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.958+0000 7f691759e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69180d0600 con 0x7f69180d16a0 2023-10-14T12:30:38.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.958+0000 7f691759e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69180d08e0 con 0x7f691815c9d0 2023-10-14T12:30:38.960 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.958+0000 7f6916d9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f69180cf850 0x7f69180b1f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:55974/0 (socket says 172.21.15.64:55974) 2023-10-14T12:30:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.958+0000 7f691659c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f691815c9d0 0x7f69180cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.958+0000 7f6916d9d640 1 -- 172.21.15.64:0/161538895 learned_addr learned my addr 172.21.15.64:0/161538895 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.959+0000 7f691659c640 1 -- 172.21.15.64:0/161538895 >> v1:172.21.15.177:6789/0 conn(0x7f69180d16a0 legacy=0x7f69180cf140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:38.961 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.959+0000 7f691659c640 1 -- 172.21.15.64:0/161538895 >> v1:172.21.15.64:6789/0 conn(0x7f69180cf850 legacy=0x7f69180b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.962 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.959+0000 7f691659c640 1 -- 172.21.15.64:0/161538895 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69180d0bc0 con 0x7f691815c9d0 2023-10-14T12:30:38.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.960+0000 7f691659c640 1 --2- 172.21.15.64:0/161538895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f691815c9d0 0x7f69180cdf90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f69080097a0 tx=0x7f690802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa4ea67c9a1cbd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.960+0000 7f6915d9b640 1 -- 172.21.15.64:0/161538895 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908031830 con 0x7f691815c9d0 2023-10-14T12:30:38.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.960+0000 7f6915d9b640 1 -- 172.21.15.64:0/161538895 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6908031990 con 0x7f691815c9d0 2023-10-14T12:30:38.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.960+0000 7f6915d9b640 1 -- 172.21.15.64:0/161538895 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908031d20 con 0x7f691815c9d0 2023-10-14T12:30:38.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.961+0000 7f691759e640 1 -- 172.21.15.64:0/161538895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f691815c9d0 msgr2=0x7f69180cdf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.961+0000 7f691759e640 1 --2- 172.21.15.64:0/161538895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f691815c9d0 0x7f69180cdf90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f69080097a0 tx=0x7f690802b8d0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.961+0000 7f691759e640 1 -- 172.21.15.64:0/161538895 shutdown_connections 2023-10-14T12:30:38.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.961+0000 7f691759e640 1 --2- 172.21.15.64:0/161538895 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f691815c9d0 0x7f69180cdf90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.961+0000 7f691759e640 1 -- 172.21.15.64:0/161538895 >> 172.21.15.64:0/161538895 conn(0x7f691809bad0 msgr2=0x7f69180d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:38.964 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.961+0000 7f691759e640 1 -- 172.21.15.64:0/161538895 shutdown_connections 2023-10-14T12:30:38.965 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.961+0000 7f691759e640 1 -- 172.21.15.64:0/161538895 wait complete. 2023-10-14T12:30:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.963+0000 7f691759e640 1 Processor -- start 2023-10-14T12:30:38.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.963+0000 7f691759e640 1 -- start start 2023-10-14T12:30:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f691759e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69180cf850 0x7f6918157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f691759e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69180d16a0 0x7f69180c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f691759e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f691815c9d0 0x7f69181e7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f691759e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6918157b80 con 0x7f69180d16a0 2023-10-14T12:30:38.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f691759e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69181e6760 con 0x7f69180cf850 2023-10-14T12:30:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f691759e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69181e6a40 con 0x7f691815c9d0 2023-10-14T12:30:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f690ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69180d16a0 0x7f69180c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f690ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69180d16a0 0x7f69180c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52068/0 (socket says 172.21.15.64:52068) 2023-10-14T12:30:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.964+0000 7f690ffff640 1 -- 172.21.15.64:0/2154047957 learned_addr learned my addr 172.21.15.64:0/2154047957 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:38.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690ffff640 1 -- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f691815c9d0 msgr2=0x7f69181e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f691659c640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69180cf850 0x7f6918157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690ffff640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f691815c9d0 0x7f69181e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690ffff640 1 -- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69180cf850 msgr2=0x7f6918157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690ffff640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69180cf850 0x7f6918157640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:38.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690ffff640 1 -- 172.21.15.64:0/2154047957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009400 con 0x7f69180d16a0 2023-10-14T12:30:38.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690ffff640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69180d16a0 0x7f69180c6840 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f690000c430 tx=0x7f690000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690effd640 1 -- 172.21.15.64:0/2154047957 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900011790 con 0x7f69180d16a0 2023-10-14T12:30:38.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690effd640 1 -- 172.21.15.64:0/2154047957 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69000118f0 con 0x7f69180d16a0 2023-10-14T12:30:38.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f690effd640 1 -- 172.21.15.64:0/2154047957 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900011ce0 con 0x7f69180d16a0 2023-10-14T12:30:38.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.965+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69181e6d20 con 0x7f69180d16a0 2023-10-14T12:30:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.966+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69181e72e0 con 0x7f69180d16a0 2023-10-14T12:30:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.967+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f691804e9b0 con 0x7f69180d16a0 2023-10-14T12:30:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.968+0000 7f690effd640 1 -- 172.21.15.64:0/2154047957 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f690001c460 con 0x7f69180d16a0 2023-10-14T12:30:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.968+0000 7f690effd640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f68f806ae70 0x7f68f806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:38.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.969+0000 7f690effd640 1 -- 172.21.15.64:0/2154047957 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f69000896a0 con 0x7f69180d16a0 2023-10-14T12:30:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.969+0000 7f691659c640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f68f806ae70 0x7f68f806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:38.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.971+0000 7f691659c640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f68f806ae70 0x7f68f806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6908036000 tx=0x7f690803c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:38.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:38.973+0000 7f690effd640 1 -- 172.21.15.64:0/2154047957 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6900054680 con 0x7f69180d16a0 2023-10-14T12:30:39.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.156+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f69180d1180 con 0x7f68f806ae70 2023-10-14T12:30:39.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.184+0000 7f690effd640 1 -- 172.21.15.64:0/2154047957 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281844 (secure 0 0 0) 0x7f690803a420 con 0x7f68f806ae70 2023-10-14T12:30:39.190 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:39.192 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:30:39.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f68f806ae70 msgr2=0x7f68f806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f68f806ae70 0x7f68f806d330 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6908036000 tx=0x7f690803c040 comp rx=0 tx=0).stop 2023-10-14T12:30:39.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69180d16a0 msgr2=0x7f69180c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69180d16a0 0x7f69180c6840 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f690000c430 tx=0x7f690000c8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 shutdown_connections 2023-10-14T12:30:39.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f68f806ae70 0x7f68f806d330 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f691815c9d0 0x7f69181e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f69180d16a0 0x7f69180c6840 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 --2- 172.21.15.64:0/2154047957 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f69180cf850 0x7f6918157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.196 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 >> 172.21.15.64:0/2154047957 conn(0x7f691809bad0 msgr2=0x7f69180afb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:39.196 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 shutdown_connections 2023-10-14T12:30:39.196 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.190+0000 7f691759e640 1 -- 172.21.15.64:0/2154047957 wait complete. 2023-10-14T12:30:39.211 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-14T12:30:37.767211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220820,"kb_used_data":4636,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753900,"statfs":{"total":773094113280,"available":772867993600,"internally_reserved":0,"allocated":4747264,"data_stored":2697670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.487726"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.311081+0000","last_change":"2023-10-14T12:30:33.311081+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.311081+0000","last_undegraded":"2023-10-14T12:30:33.311081+0000","last_fullsized":"2023-10-14T12:30:33.311081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.310267+0000","last_change":"2023-10-14T12:30:33.310267+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.310267+0000","last_undegraded":"2023-10-14T12:30:33.310267+0000","last_fullsized":"2023-10-14T12:30:33.310267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.316195+0000","last_change":"2023-10-14T12:30:33.316195+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.316195+0000","last_undegraded":"2023-10-14T12:30:33.316195+0000","last_fullsized":"2023-10-14T12:30:33.316195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.301687+0000","last_change":"2023-10-14T12:30:33.301687+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.301687+0000","last_undegraded":"2023-10-14T12:30:33.301687+0000","last_fullsized":"2023-10-14T12:30:33.301687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.301452+0000","last_change":"2023-10-14T12:30:33.301452+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.301452+0000","last_undegraded":"2023-10-14T12:30:33.301452+0000","last_fullsized":"2023-10-14T12:30:33.301452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312478+0000","last_change":"2023-10-14T12:30:33.312478+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312478+0000","last_undegraded":"2023-10-14T12:30:33.312478+0000","last_fullsized":"2023-10-14T12:30:33.312478+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.326590+0000","last_change":"2023-10-14T12:30:33.326590+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.326590+0000","last_undegraded":"2023-10-14T12:30:33.326590+0000","last_fullsized":"2023-10-14T12:30:33.326590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.309626+0000","last_change":"2023-10-14T12:30:33.309626+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.309626+0000","last_undegraded":"2023-10-14T12:30:33.309626+0000","last_fullsized":"2023-10-14T12:30:33.309626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317969+0000","last_change":"2023-10-14T12:30:33.317969+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317969+0000","last_undegraded":"2023-10-14T12:30:33.317969+0000","last_fullsized":"2023-10-14T12:30:33.317969+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.325918+0000","last_change":"2023-10-14T12:30:33.325918+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.325918+0000","last_undegraded":"2023-10-14T12:30:33.325918+0000","last_fullsized":"2023-10-14T12:30:33.325918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323716+0000","last_change":"2023-10-14T12:30:33.323716+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323716+0000","last_undegraded":"2023-10-14T12:30:33.323716+0000","last_fullsized":"2023-10-14T12:30:33.323716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320995+0000","last_change":"2023-10-14T12:30:33.320995+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320995+0000","last_undegraded":"2023-10-14T12:30:33.320995+0000","last_fullsized":"2023-10-14T12:30:33.320995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.322143+0000","last_change":"2023-10-14T12:30:33.322143+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.322143+0000","last_undegraded":"2023-10-14T12:30:33.322143+0000","last_fullsized":"2023-10-14T12:30:33.322143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320916+0000","last_change":"2023-10-14T12:30:33.320916+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320916+0000","last_undegraded":"2023-10-14T12:30:33.320916+0000","last_fullsized":"2023-10-14T12:30:33.320916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.324296+0000","last_change":"2023-10-14T12:30:33.324296+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.324296+0000","last_undegraded":"2023-10-14T12:30:33.324296+0000","last_fullsized":"2023-10-14T12:30:33.324296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.313418+0000","last_change":"2023-10-14T12:30:33.313418+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.313418+0000","last_undegraded":"2023-10-14T12:30:33.313418+0000","last_fullsized":"2023-10-14T12:30:33.313418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.318129+0000","last_change":"2023-10-14T12:30:33.318129+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.318129+0000","last_undegraded":"2023-10-14T12:30:33.318129+0000","last_fullsized":"2023-10-14T12:30:33.318129+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307753+0000","last_change":"2023-10-14T12:30:33.307753+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307753+0000","last_undegraded":"2023-10-14T12:30:33.307753+0000","last_fullsized":"2023-10-14T12:30:33.307753+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300782+0000","last_change":"2023-10-14T12:30:33.300782+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300782+0000","last_undegraded":"2023-10-14T12:30:33.300782+0000","last_fullsized":"2023-10-14T12:30:33.300782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.305733+0000","last_change":"2023-10-14T12:30:33.305733+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.305733+0000","last_undegraded":"2023-10-14T12:30:33.305733+0000","last_fullsized":"2023-10-14T12:30:33.305733+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.321669+0000","last_change":"2023-10-14T12:30:33.321669+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.321669+0000","last_undegraded":"2023-10-14T12:30:33.321669+0000","last_fullsized":"2023-10-14T12:30:33.321669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317532+0000","last_change":"2023-10-14T12:30:33.317532+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317532+0000","last_undegraded":"2023-10-14T12:30:33.317532+0000","last_fullsized":"2023-10-14T12:30:33.317532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.313613+0000","last_change":"2023-10-14T12:30:33.313613+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.313613+0000","last_undegraded":"2023-10-14T12:30:33.313613+0000","last_fullsized":"2023-10-14T12:30:33.313613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300836+0000","last_change":"2023-10-14T12:30:33.300836+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300836+0000","last_undegraded":"2023-10-14T12:30:33.300836+0000","last_fullsized":"2023-10-14T12:30:33.300836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.304799+0000","last_change":"2023-10-14T12:30:33.304799+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.304799+0000","last_undegraded":"2023-10-14T12:30:33.304799+0000","last_fullsized":"2023-10-14T12:30:33.304799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314720+0000","last_change":"2023-10-14T12:30:33.314720+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314720+0000","last_undegraded":"2023-10-14T12:30:33.314720+0000","last_fullsized":"2023-10-14T12:30:33.314720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307638+0000","last_change":"2023-10-14T12:30:33.307638+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307638+0000","last_undegraded":"2023-10-14T12:30:33.307638+0000","last_fullsized":"2023-10-14T12:30:33.307638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320666+0000","last_change":"2023-10-14T12:30:33.320666+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320666+0000","last_undegraded":"2023-10-14T12:30:33.320666+0000","last_fullsized":"2023-10-14T12:30:33.320666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307625+0000","last_change":"2023-10-14T12:30:33.307625+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307625+0000","last_undegraded":"2023-10-14T12:30:33.307625+0000","last_fullsized":"2023-10-14T12:30:33.307625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307009+0000","last_change":"2023-10-14T12:30:33.307009+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307009+0000","last_undegraded":"2023-10-14T12:30:33.307009+0000","last_fullsized":"2023-10-14T12:30:33.307009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312569+0000","last_change":"2023-10-14T12:30:33.312569+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312569+0000","last_undegraded":"2023-10-14T12:30:33.312569+0000","last_fullsized":"2023-10-14T12:30:33.312569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312884+0000","last_change":"2023-10-14T12:30:33.312884+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312884+0000","last_undegraded":"2023-10-14T12:30:33.312884+0000","last_fullsized":"2023-10-14T12:30:33.312884+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320236+0000","last_change":"2023-10-14T12:30:33.320236+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320236+0000","last_undegraded":"2023-10-14T12:30:33.320236+0000","last_fullsized":"2023-10-14T12:30:33.320236+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.333763+0000","last_change":"2023-10-14T12:30:33.332554+0000","last_active":"2023-10-14T12:30:33.333763+0000","last_peered":"2023-10-14T12:30:33.333763+0000","last_clean":"2023-10-14T12:30:33.333763+0000","last_became_active":"2023-10-14T12:30:33.332275+0000","last_became_peered":"2023-10-14T12:30:33.332275+0000","last_unstale":"2023-10-14T12:30:33.333763+0000","last_undegraded":"2023-10-14T12:30:33.333763+0000","last_fullsized":"2023-10-14T12:30:33.333763+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:06.646348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317969+0000","last_change":"2023-10-14T12:30:33.317969+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317969+0000","last_undegraded":"2023-10-14T12:30:33.317969+0000","last_fullsized":"2023-10-14T12:30:33.317969+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.332388+0000","last_change":"2023-10-14T12:30:33.326883+0000","last_active":"2023-10-14T12:30:33.332388+0000","last_peered":"2023-10-14T12:30:33.332388+0000","last_clean":"2023-10-14T12:30:33.332388+0000","last_became_active":"2023-10-14T12:30:33.326581+0000","last_became_peered":"2023-10-14T12:30:33.326581+0000","last_unstale":"2023-10-14T12:30:33.332388+0000","last_undegraded":"2023-10-14T12:30:33.332388+0000","last_fullsized":"2023-10-14T12:30:33.332388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:13.991919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.313213+0000","last_change":"2023-10-14T12:30:33.313213+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.313213+0000","last_undegraded":"2023-10-14T12:30:33.313213+0000","last_fullsized":"2023-10-14T12:30:33.313213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337829+0000","last_change":"2023-10-14T12:30:33.335259+0000","last_active":"2023-10-14T12:30:33.337829+0000","last_peered":"2023-10-14T12:30:33.337829+0000","last_clean":"2023-10-14T12:30:33.337829+0000","last_became_active":"2023-10-14T12:30:33.334954+0000","last_became_peered":"2023-10-14T12:30:33.334954+0000","last_unstale":"2023-10-14T12:30:33.337829+0000","last_undegraded":"2023-10-14T12:30:33.337829+0000","last_fullsized":"2023-10-14T12:30:33.337829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:04.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.310663+0000","last_change":"2023-10-14T12:30:33.310663+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.310663+0000","last_undegraded":"2023-10-14T12:30:33.310663+0000","last_fullsized":"2023-10-14T12:30:33.310663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.335172+0000","last_change":"2023-10-14T12:30:33.331342+0000","last_active":"2023-10-14T12:30:33.335172+0000","last_peered":"2023-10-14T12:30:33.335172+0000","last_clean":"2023-10-14T12:30:33.335172+0000","last_became_active":"2023-10-14T12:30:33.331033+0000","last_became_peered":"2023-10-14T12:30:33.331033+0000","last_unstale":"2023-10-14T12:30:33.335172+0000","last_undegraded":"2023-10-14T12:30:33.335172+0000","last_fullsized":"2023-10-14T12:30:33.335172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314678+0000","last_change":"2023-10-14T12:30:33.314678+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314678+0000","last_undegraded":"2023-10-14T12:30:33.314678+0000","last_fullsized":"2023-10-14T12:30:33.314678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334493+0000","last_change":"2023-10-14T12:30:33.332976+0000","last_active":"2023-10-14T12:30:33.334493+0000","last_peered":"2023-10-14T12:30:33.334493+0000","last_clean":"2023-10-14T12:30:33.334493+0000","last_became_active":"2023-10-14T12:30:33.332092+0000","last_became_peered":"2023-10-14T12:30:33.332092+0000","last_unstale":"2023-10-14T12:30:33.334493+0000","last_undegraded":"2023-10-14T12:30:33.334493+0000","last_fullsized":"2023-10-14T12:30:33.334493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:41.928245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323736+0000","last_change":"2023-10-14T12:30:33.323736+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323736+0000","last_undegraded":"2023-10-14T12:30:33.323736+0000","last_fullsized":"2023-10-14T12:30:33.323736+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.338118+0000","last_change":"2023-10-14T12:30:33.336252+0000","last_active":"2023-10-14T12:30:33.338118+0000","last_peered":"2023-10-14T12:30:33.338118+0000","last_clean":"2023-10-14T12:30:33.338118+0000","last_became_active":"2023-10-14T12:30:33.335909+0000","last_became_peered":"2023-10-14T12:30:33.335909+0000","last_unstale":"2023-10-14T12:30:33.338118+0000","last_undegraded":"2023-10-14T12:30:33.338118+0000","last_fullsized":"2023-10-14T12:30:33.338118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314656+0000","last_change":"2023-10-14T12:30:33.314656+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314656+0000","last_undegraded":"2023-10-14T12:30:33.314656+0000","last_fullsized":"2023-10-14T12:30:33.314656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337273+0000","last_change":"2023-10-14T12:30:33.332689+0000","last_active":"2023-10-14T12:30:33.337273+0000","last_peered":"2023-10-14T12:30:33.337273+0000","last_clean":"2023-10-14T12:30:33.337273+0000","last_became_active":"2023-10-14T12:30:33.332347+0000","last_became_peered":"2023-10-14T12:30:33.332347+0000","last_unstale":"2023-10-14T12:30:33.337273+0000","last_undegraded":"2023-10-14T12:30:33.337273+0000","last_fullsized":"2023-10-14T12:30:33.337273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.309116+0000","last_change":"2023-10-14T12:30:33.309116+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.309116+0000","last_undegraded":"2023-10-14T12:30:33.309116+0000","last_fullsized":"2023-10-14T12:30:33.309116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.333976+0000","last_change":"2023-10-14T12:30:33.321473+0000","last_active":"2023-10-14T12:30:33.333976+0000","last_peered":"2023-10-14T12:30:33.333976+0000","last_clean":"2023-10-14T12:30:33.333976+0000","last_became_active":"2023-10-14T12:30:33.321139+0000","last_became_peered":"2023-10-14T12:30:33.321139+0000","last_unstale":"2023-10-14T12:30:33.333976+0000","last_undegraded":"2023-10-14T12:30:33.333976+0000","last_fullsized":"2023-10-14T12:30:33.333976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300590+0000","last_change":"2023-10-14T12:30:33.300590+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300590+0000","last_undegraded":"2023-10-14T12:30:33.300590+0000","last_fullsized":"2023-10-14T12:30:33.300590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.323970+0000","last_change":"2023-10-14T12:30:33.320132+0000","last_active":"2023-10-14T12:30:33.323970+0000","last_peered":"2023-10-14T12:30:33.323970+0000","last_clean":"2023-10-14T12:30:33.323970+0000","last_became_active":"2023-10-14T12:30:33.319838+0000","last_became_peered":"2023-10-14T12:30:33.319838+0000","last_unstale":"2023-10-14T12:30:33.323970+0000","last_undegraded":"2023-10-14T12:30:33.323970+0000","last_fullsized":"2023-10-14T12:30:33.323970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.321330+0000","last_change":"2023-10-14T12:30:33.321330+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.321330+0000","last_undegraded":"2023-10-14T12:30:33.321330+0000","last_fullsized":"2023-10-14T12:30:33.321330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337942+0000","last_change":"2023-10-14T12:30:33.333797+0000","last_active":"2023-10-14T12:30:33.337942+0000","last_peered":"2023-10-14T12:30:33.337942+0000","last_clean":"2023-10-14T12:30:33.337942+0000","last_became_active":"2023-10-14T12:30:33.332493+0000","last_became_peered":"2023-10-14T12:30:33.332493+0000","last_unstale":"2023-10-14T12:30:33.337942+0000","last_undegraded":"2023-10-14T12:30:33.337942+0000","last_fullsized":"2023-10-14T12:30:33.337942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.309845+0000","last_change":"2023-10-14T12:30:33.309845+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.309845+0000","last_undegraded":"2023-10-14T12:30:33.309845+0000","last_fullsized":"2023-10-14T12:30:33.309845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.339680+0000","last_change":"2023-10-14T12:30:33.336933+0000","last_active":"2023-10-14T12:30:33.339680+0000","last_peered":"2023-10-14T12:30:33.339680+0000","last_clean":"2023-10-14T12:30:33.339680+0000","last_became_active":"2023-10-14T12:30:33.336490+0000","last_became_peered":"2023-10-14T12:30:33.336490+0000","last_unstale":"2023-10-14T12:30:33.339680+0000","last_undegraded":"2023-10-14T12:30:33.339680+0000","last_fullsized":"2023-10-14T12:30:33.339680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.316190+0000","last_change":"2023-10-14T12:30:33.316190+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.316190+0000","last_undegraded":"2023-10-14T12:30:33.316190+0000","last_fullsized":"2023-10-14T12:30:33.316190+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.331615+0000","last_change":"2023-10-14T12:30:33.328447+0000","last_active":"2023-10-14T12:30:33.331615+0000","last_peered":"2023-10-14T12:30:33.331615+0000","last_clean":"2023-10-14T12:30:33.331615+0000","last_became_active":"2023-10-14T12:30:33.327737+0000","last_became_peered":"2023-10-14T12:30:33.327737+0000","last_unstale":"2023-10-14T12:30:33.331615+0000","last_undegraded":"2023-10-14T12:30:33.331615+0000","last_fullsized":"2023-10-14T12:30:33.331615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312505+0000","last_change":"2023-10-14T12:30:33.312505+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312505+0000","last_undegraded":"2023-10-14T12:30:33.312505+0000","last_fullsized":"2023-10-14T12:30:33.312505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.331565+0000","last_change":"2023-10-14T12:30:33.328766+0000","last_active":"2023-10-14T12:30:33.331565+0000","last_peered":"2023-10-14T12:30:33.331565+0000","last_clean":"2023-10-14T12:30:33.331565+0000","last_became_active":"2023-10-14T12:30:33.328489+0000","last_became_peered":"2023-10-14T12:30:33.328489+0000","last_unstale":"2023-10-14T12:30:33.331565+0000","last_undegraded":"2023-10-14T12:30:33.331565+0000","last_fullsized":"2023-10-14T12:30:33.331565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:56.928965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.308538+0000","last_change":"2023-10-14T12:30:33.308538+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.308538+0000","last_undegraded":"2023-10-14T12:30:33.308538+0000","last_fullsized":"2023-10-14T12:30:33.308538+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337294+0000","last_change":"2023-10-14T12:30:33.332659+0000","last_active":"2023-10-14T12:30:33.337294+0000","last_peered":"2023-10-14T12:30:33.337294+0000","last_clean":"2023-10-14T12:30:33.337294+0000","last_became_active":"2023-10-14T12:30:33.332041+0000","last_became_peered":"2023-10-14T12:30:33.332041+0000","last_unstale":"2023-10-14T12:30:33.337294+0000","last_undegraded":"2023-10-14T12:30:33.337294+0000","last_fullsized":"2023-10-14T12:30:33.337294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314953+0000","last_change":"2023-10-14T12:30:33.314953+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314953+0000","last_undegraded":"2023-10-14T12:30:33.314953+0000","last_fullsized":"2023-10-14T12:30:33.314953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.333114+0000","last_change":"2023-10-14T12:30:33.329100+0000","last_active":"2023-10-14T12:30:33.333114+0000","last_peered":"2023-10-14T12:30:33.333114+0000","last_clean":"2023-10-14T12:30:33.333114+0000","last_became_active":"2023-10-14T12:30:33.328823+0000","last_became_peered":"2023-10-14T12:30:33.328823+0000","last_unstale":"2023-10-14T12:30:33.333114+0000","last_undegraded":"2023-10-14T12:30:33.333114+0000","last_fullsized":"2023-10-14T12:30:33.333114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:36:47.348199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.308675+0000","last_change":"2023-10-14T12:30:33.308675+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.308675+0000","last_undegraded":"2023-10-14T12:30:33.308675+0000","last_fullsized":"2023-10-14T12:30:33.308675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337974+0000","last_change":"2023-10-14T12:30:33.335192+0000","last_active":"2023-10-14T12:30:33.337974+0000","last_peered":"2023-10-14T12:30:33.337974+0000","last_clean":"2023-10-14T12:30:33.337974+0000","last_became_active":"2023-10-14T12:30:33.334783+0000","last_became_peered":"2023-10-14T12:30:33.334783+0000","last_unstale":"2023-10-14T12:30:33.337974+0000","last_undegraded":"2023-10-14T12:30:33.337974+0000","last_fullsized":"2023-10-14T12:30:33.337974+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:41.928245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.306735+0000","last_change":"2023-10-14T12:30:33.306735+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.306735+0000","last_undegraded":"2023-10-14T12:30:33.306735+0000","last_fullsized":"2023-10-14T12:30:33.306735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.342141+0000","last_change":"2023-10-14T12:30:33.337568+0000","last_active":"2023-10-14T12:30:33.342141+0000","last_peered":"2023-10-14T12:30:33.342141+0000","last_clean":"2023-10-14T12:30:33.342141+0000","last_became_active":"2023-10-14T12:30:33.337246+0000","last_became_peered":"2023-10-14T12:30:33.337246+0000","last_unstale":"2023-10-14T12:30:33.342141+0000","last_undegraded":"2023-10-14T12:30:33.342141+0000","last_fullsized":"2023-10-14T12:30:33.342141+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:04.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323274+0000","last_change":"2023-10-14T12:30:33.323274+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323274+0000","last_undegraded":"2023-10-14T12:30:33.323274+0000","last_fullsized":"2023-10-14T12:30:33.323274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337789+0000","last_change":"2023-10-14T12:30:33.332639+0000","last_active":"2023-10-14T12:30:33.337789+0000","last_peered":"2023-10-14T12:30:33.337789+0000","last_clean":"2023-10-14T12:30:33.337789+0000","last_became_active":"2023-10-14T12:30:33.332366+0000","last_became_peered":"2023-10-14T12:30:33.332366+0000","last_unstale":"2023-10-14T12:30:33.337789+0000","last_undegraded":"2023-10-14T12:30:33.337789+0000","last_fullsized":"2023-10-14T12:30:33.337789+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:04.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.315406+0000","last_change":"2023-10-14T12:30:33.315406+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.315406+0000","last_undegraded":"2023-10-14T12:30:33.315406+0000","last_fullsized":"2023-10-14T12:30:33.315406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.330897+0000","last_change":"2023-10-14T12:30:33.326267+0000","last_active":"2023-10-14T12:30:33.330897+0000","last_peered":"2023-10-14T12:30:33.330897+0000","last_clean":"2023-10-14T12:30:33.330897+0000","last_became_active":"2023-10-14T12:30:33.326020+0000","last_became_peered":"2023-10-14T12:30:33.326020+0000","last_unstale":"2023-10-14T12:30:33.330897+0000","last_undegraded":"2023-10-14T12:30:33.330897+0000","last_fullsized":"2023-10-14T12:30:33.330897+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:20.859809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300880+0000","last_change":"2023-10-14T12:30:33.300880+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300880+0000","last_undegraded":"2023-10-14T12:30:33.300880+0000","last_fullsized":"2023-10-14T12:30:33.300880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337856+0000","last_change":"2023-10-14T12:30:33.336624+0000","last_active":"2023-10-14T12:30:33.337856+0000","last_peered":"2023-10-14T12:30:33.337856+0000","last_clean":"2023-10-14T12:30:33.337856+0000","last_became_active":"2023-10-14T12:30:33.336299+0000","last_became_peered":"2023-10-14T12:30:33.336299+0000","last_unstale":"2023-10-14T12:30:33.337856+0000","last_undegraded":"2023-10-14T12:30:33.337856+0000","last_fullsized":"2023-10-14T12:30:33.337856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312124+0000","last_change":"2023-10-14T12:30:33.312124+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312124+0000","last_undegraded":"2023-10-14T12:30:33.312124+0000","last_fullsized":"2023-10-14T12:30:33.312124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.328045+0000","last_change":"2023-10-14T12:30:33.323532+0000","last_active":"2023-10-14T12:30:33.328045+0000","last_peered":"2023-10-14T12:30:33.328045+0000","last_clean":"2023-10-14T12:30:33.328045+0000","last_became_active":"2023-10-14T12:30:33.323244+0000","last_became_peered":"2023-10-14T12:30:33.323244+0000","last_unstale":"2023-10-14T12:30:33.328045+0000","last_undegraded":"2023-10-14T12:30:33.328045+0000","last_fullsized":"2023-10-14T12:30:33.328045+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:14.980722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314744+0000","last_change":"2023-10-14T12:30:33.314744+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314744+0000","last_undegraded":"2023-10-14T12:30:33.314744+0000","last_fullsized":"2023-10-14T12:30:33.314744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334785+0000","last_change":"2023-10-14T12:30:33.330930+0000","last_active":"2023-10-14T12:30:33.334785+0000","last_peered":"2023-10-14T12:30:33.334785+0000","last_clean":"2023-10-14T12:30:33.334785+0000","last_became_active":"2023-10-14T12:30:33.330353+0000","last_became_peered":"2023-10-14T12:30:33.330353+0000","last_unstale":"2023-10-14T12:30:33.334785+0000","last_undegraded":"2023-10-14T12:30:33.334785+0000","last_fullsized":"2023-10-14T12:30:33.334785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:48.639700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320072+0000","last_change":"2023-10-14T12:30:33.320072+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320072+0000","last_undegraded":"2023-10-14T12:30:33.320072+0000","last_fullsized":"2023-10-14T12:30:33.320072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.327629+0000","last_change":"2023-10-14T12:30:33.326069+0000","last_active":"2023-10-14T12:30:33.327629+0000","last_peered":"2023-10-14T12:30:33.327629+0000","last_clean":"2023-10-14T12:30:33.327629+0000","last_became_active":"2023-10-14T12:30:33.325772+0000","last_became_peered":"2023-10-14T12:30:33.325772+0000","last_unstale":"2023-10-14T12:30:33.327629+0000","last_undegraded":"2023-10-14T12:30:33.327629+0000","last_fullsized":"2023-10-14T12:30:33.327629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.305756+0000","last_change":"2023-10-14T12:30:33.305756+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.305756+0000","last_undegraded":"2023-10-14T12:30:33.305756+0000","last_fullsized":"2023-10-14T12:30:33.305756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334752+0000","last_change":"2023-10-14T12:30:33.329870+0000","last_active":"2023-10-14T12:30:33.334752+0000","last_peered":"2023-10-14T12:30:33.334752+0000","last_clean":"2023-10-14T12:30:33.334752+0000","last_became_active":"2023-10-14T12:30:33.328179+0000","last_became_peered":"2023-10-14T12:30:33.328179+0000","last_unstale":"2023-10-14T12:30:33.334752+0000","last_undegraded":"2023-10-14T12:30:33.334752+0000","last_fullsized":"2023-10-14T12:30:33.334752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:29:24.885499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314141+0000","last_change":"2023-10-14T12:30:33.314141+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314141+0000","last_undegraded":"2023-10-14T12:30:33.314141+0000","last_fullsized":"2023-10-14T12:30:33.314141+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.339655+0000","last_change":"2023-10-14T12:30:33.335354+0000","last_active":"2023-10-14T12:30:33.339655+0000","last_peered":"2023-10-14T12:30:33.339655+0000","last_clean":"2023-10-14T12:30:33.339655+0000","last_became_active":"2023-10-14T12:30:33.334729+0000","last_became_peered":"2023-10-14T12:30:33.334729+0000","last_unstale":"2023-10-14T12:30:33.339655+0000","last_undegraded":"2023-10-14T12:30:33.339655+0000","last_fullsized":"2023-10-14T12:30:33.339655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320901+0000","last_change":"2023-10-14T12:30:33.320901+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320901+0000","last_undegraded":"2023-10-14T12:30:33.320901+0000","last_fullsized":"2023-10-14T12:30:33.320901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337306+0000","last_change":"2023-10-14T12:30:33.332845+0000","last_active":"2023-10-14T12:30:33.337306+0000","last_peered":"2023-10-14T12:30:33.337306+0000","last_clean":"2023-10-14T12:30:33.337306+0000","last_became_active":"2023-10-14T12:30:33.332542+0000","last_became_peered":"2023-10-14T12:30:33.332542+0000","last_unstale":"2023-10-14T12:30:33.337306+0000","last_undegraded":"2023-10-14T12:30:33.337306+0000","last_fullsized":"2023-10-14T12:30:33.337306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:04:40.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.305695+0000","last_change":"2023-10-14T12:30:33.305695+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.305695+0000","last_undegraded":"2023-10-14T12:30:33.305695+0000","last_fullsized":"2023-10-14T12:30:33.305695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.330490+0000","last_change":"2023-10-14T12:30:33.324071+0000","last_active":"2023-10-14T12:30:33.330490+0000","last_peered":"2023-10-14T12:30:33.330490+0000","last_clean":"2023-10-14T12:30:33.330490+0000","last_became_active":"2023-10-14T12:30:33.323094+0000","last_became_peered":"2023-10-14T12:30:33.323094+0000","last_unstale":"2023-10-14T12:30:33.330490+0000","last_undegraded":"2023-10-14T12:30:33.330490+0000","last_fullsized":"2023-10-14T12:30:33.330490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:45.479409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307287+0000","last_change":"2023-10-14T12:30:33.307287+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307287+0000","last_undegraded":"2023-10-14T12:30:33.307287+0000","last_fullsized":"2023-10-14T12:30:33.307287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.332766+0000","last_change":"2023-10-14T12:30:33.326955+0000","last_active":"2023-10-14T12:30:33.332766+0000","last_peered":"2023-10-14T12:30:33.332766+0000","last_clean":"2023-10-14T12:30:33.332766+0000","last_became_active":"2023-10-14T12:30:33.326641+0000","last_became_peered":"2023-10-14T12:30:33.326641+0000","last_unstale":"2023-10-14T12:30:33.332766+0000","last_undegraded":"2023-10-14T12:30:33.332766+0000","last_fullsized":"2023-10-14T12:30:33.332766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:01:35.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312000+0000","last_change":"2023-10-14T12:30:33.312000+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312000+0000","last_undegraded":"2023-10-14T12:30:33.312000+0000","last_fullsized":"2023-10-14T12:30:33.312000+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.328341+0000","last_change":"2023-10-14T12:30:33.324592+0000","last_active":"2023-10-14T12:30:33.328341+0000","last_peered":"2023-10-14T12:30:33.328341+0000","last_clean":"2023-10-14T12:30:33.328341+0000","last_became_active":"2023-10-14T12:30:33.324291+0000","last_became_peered":"2023-10-14T12:30:33.324291+0000","last_unstale":"2023-10-14T12:30:33.328341+0000","last_undegraded":"2023-10-14T12:30:33.328341+0000","last_fullsized":"2023-10-14T12:30:33.328341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:35.072306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.318110+0000","last_change":"2023-10-14T12:30:33.318110+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.318110+0000","last_undegraded":"2023-10-14T12:30:33.318110+0000","last_fullsized":"2023-10-14T12:30:33.318110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334778+0000","last_change":"2023-10-14T12:30:33.327237+0000","last_active":"2023-10-14T12:30:33.334778+0000","last_peered":"2023-10-14T12:30:33.334778+0000","last_clean":"2023-10-14T12:30:33.334778+0000","last_became_active":"2023-10-14T12:30:33.324300+0000","last_became_peered":"2023-10-14T12:30:33.324300+0000","last_unstale":"2023-10-14T12:30:33.334778+0000","last_undegraded":"2023-10-14T12:30:33.334778+0000","last_fullsized":"2023-10-14T12:30:33.334778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317430+0000","last_change":"2023-10-14T12:30:33.317430+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317430+0000","last_undegraded":"2023-10-14T12:30:33.317430+0000","last_fullsized":"2023-10-14T12:30:33.317430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.329713+0000","last_change":"2023-10-14T12:30:33.320974+0000","last_active":"2023-10-14T12:30:33.329713+0000","last_peered":"2023-10-14T12:30:33.329713+0000","last_clean":"2023-10-14T12:30:33.329713+0000","last_became_active":"2023-10-14T12:30:33.320705+0000","last_became_peered":"2023-10-14T12:30:33.320705+0000","last_unstale":"2023-10-14T12:30:33.329713+0000","last_undegraded":"2023-10-14T12:30:33.329713+0000","last_fullsized":"2023-10-14T12:30:33.329713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:02.880217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323704+0000","last_change":"2023-10-14T12:30:33.323704+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323704+0000","last_undegraded":"2023-10-14T12:30:33.323704+0000","last_fullsized":"2023-10-14T12:30:33.323704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.331975+0000","last_change":"2023-10-14T12:30:33.329384+0000","last_active":"2023-10-14T12:30:33.331975+0000","last_peered":"2023-10-14T12:30:33.331975+0000","last_clean":"2023-10-14T12:30:33.331975+0000","last_became_active":"2023-10-14T12:30:33.328937+0000","last_became_peered":"2023-10-14T12:30:33.328937+0000","last_unstale":"2023-10-14T12:30:33.331975+0000","last_undegraded":"2023-10-14T12:30:33.331975+0000","last_fullsized":"2023-10-14T12:30:33.331975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:30:32.299912+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:30:32.299912+0000","last_peered":"2023-10-14T12:30:32.299912+0000","last_clean":"2023-10-14T12:30:32.299912+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:30:32.299912+0000","last_undegraded":"2023-10-14T12:30:32.299912+0000","last_fullsized":"2023-10-14T12:30:32.299912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1040384,"data_stored":780811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.371},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.5289999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.238}]},{"osd":3,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.1719999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.413},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.0309999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.276},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.321}]},{"osd":6,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.85099999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":183833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.4450000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.80500000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.357},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.5960000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.4019999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.151}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.252}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3129999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.3640000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.913},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.9610000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":2.0019999999999998},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.92700000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":2.1030000000000002},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.6360000000000001,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":2.1230000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":2.6240000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.6639999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.484},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.885}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0289999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.171}]},{"osd":2,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.385}]},{"osd":3,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.444}]},{"osd":6,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.635}]},{"osd":7,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.548}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.876},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.054},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.391}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.337},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.1220000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.226}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":1.706},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.901}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":2.0649999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.5649999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.006}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.2569999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.3069999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.609}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.1759999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.5129999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.3280000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.94099999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.575},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.411}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.663},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.4900000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":1.7170000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.7549999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.839}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1040384,"data_stored":780811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.4199999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.2930000000000001,"5min":5.2930000000000001,"15min":5.2930000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.3049999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.246},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.997}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.90000000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.5409999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.569},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.5009999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:30:39.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:30:39.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.475+0000 7fd920cd7640 1 Processor -- start 2023-10-14T12:30:39.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.476+0000 7fd920cd7640 1 -- start start 2023-10-14T12:30:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.477+0000 7fd920cd7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd91c0b0010 0x7fd91c0701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.477+0000 7fd920cd7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c15ad00 0x7fd91c15f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd920cd7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd91c0b03f0 0x7fd91c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd920cd7640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c15f580 con 0x7fd91c0b0010 2023-10-14T12:30:39.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd920cd7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd91c0707f0 con 0x7fd91c0b03f0 2023-10-14T12:30:39.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd920cd7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c070ad0 con 0x7fd91c15ad00 2023-10-14T12:30:39.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd91c0b0010 0x7fd91c0701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd91c0b0010 0x7fd91c0701a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52074/0 (socket says 172.21.15.64:52074) 2023-10-14T12:30:39.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 -- 172.21.15.64:0/3111001860 learned_addr learned my addr 172.21.15.64:0/3111001860 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:39.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd913fff640 1 --2- 172.21.15.64:0/3111001860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c15ad00 0x7fd91c15f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 -- 172.21.15.64:0/3111001860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c15ad00 msgr2=0x7fd91c15f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:39.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 --2- 172.21.15.64:0/3111001860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c15ad00 0x7fd91c15f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 -- 172.21.15.64:0/3111001860 >> v2:172.21.15.177:3300/0 conn(0x7fd91c0b03f0 msgr2=0x7fd91c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:39.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91ad9d640 1 --2- 172.21.15.64:0/3111001860 >> v2:172.21.15.177:3300/0 conn(0x7fd91c0b03f0 0x7fd91c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 --2- 172.21.15.64:0/3111001860 >> v2:172.21.15.177:3300/0 conn(0x7fd91c0b03f0 0x7fd91c15b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91a59c640 1 -- 172.21.15.64:0/3111001860 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c15b1d0 con 0x7fd91c0b0010 2023-10-14T12:30:39.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.478+0000 7fd91ad9d640 1 --2- 172.21.15.64:0/3111001860 >> v2:172.21.15.177:3300/0 conn(0x7fd91c0b03f0 0x7fd91c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:39.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.479+0000 7fd91a59c640 1 --2- 172.21.15.64:0/3111001860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0701a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd91c06fbd0 tx=0x7fd90c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1144b5fb26fc5eeb server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd919d9b640 1 -- 172.21.15.64:0/3111001860 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c031860 con 0x7fd91c0b0010 2023-10-14T12:30:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd919d9b640 1 -- 172.21.15.64:0/3111001860 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0319c0 con 0x7fd91c0b0010 2023-10-14T12:30:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd919d9b640 1 -- 172.21.15.64:0/3111001860 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c031d50 con 0x7fd91c0b0010 2023-10-14T12:30:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 -- 172.21.15.64:0/3111001860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 msgr2=0x7fd91c0701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 --2- 172.21.15.64:0/3111001860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0701a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd91c06fbd0 tx=0x7fd90c02b900 comp rx=0 tx=0).stop 2023-10-14T12:30:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 -- 172.21.15.64:0/3111001860 shutdown_connections 2023-10-14T12:30:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 --2- 172.21.15.64:0/3111001860 >> v2:172.21.15.177:3300/0 conn(0x7fd91c0b03f0 0x7fd91c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 --2- 172.21.15.64:0/3111001860 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c15ad00 0x7fd91c15f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 --2- 172.21.15.64:0/3111001860 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0701a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 -- 172.21.15.64:0/3111001860 >> 172.21.15.64:0/3111001860 conn(0x7fd91c06c1c0 msgr2=0x7fd91c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:39.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.480+0000 7fd920cd7640 1 -- 172.21.15.64:0/3111001860 shutdown_connections 2023-10-14T12:30:39.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.481+0000 7fd920cd7640 1 -- 172.21.15.64:0/3111001860 wait complete. 2023-10-14T12:30:39.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.482+0000 7fd920cd7640 1 Processor -- start 2023-10-14T12:30:39.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.482+0000 7fd920cd7640 1 -- start start 2023-10-14T12:30:39.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.483+0000 7fd920cd7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.483+0000 7fd920cd7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c0b03f0 0x7fd91c155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.483+0000 7fd920cd7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd91c15ad00 0x7fd91c0ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.483+0000 7fd920cd7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c4f10 con 0x7fd91c0b0010 2023-10-14T12:30:39.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.483+0000 7fd920cd7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c8480 con 0x7fd91c15ad00 2023-10-14T12:30:39.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.483+0000 7fd920cd7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd91c0c4670 con 0x7fd91c0b03f0 2023-10-14T12:30:39.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52076/0 (socket says 172.21.15.64:52076) 2023-10-14T12:30:39.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 -- 172.21.15.64:0/1732910578 learned_addr learned my addr 172.21.15.64:0/1732910578 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:39.491 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd913fff640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c0b03f0 0x7fd91c155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91ad9d640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd91c15ad00 0x7fd91c0ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 -- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c0b03f0 msgr2=0x7fd91c155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c0b03f0 0x7fd91c155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 -- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd91c15ad00 msgr2=0x7fd91c0ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.492 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd91c15ad00 0x7fd91c0ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91a59c640 1 -- 172.21.15.64:0/1732910578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90c0094d0 con 0x7fd91c0b0010 2023-10-14T12:30:39.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.484+0000 7fd91ad9d640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd91c15ad00 0x7fd91c0ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:39.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.485+0000 7fd91a59c640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0c7f40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd90c02b940 tx=0x7fd90c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:39.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.485+0000 7fd912ffd640 1 -- 172.21.15.64:0/1732910578 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c031850 con 0x7fd91c0b0010 2023-10-14T12:30:39.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.485+0000 7fd912ffd640 1 -- 172.21.15.64:0/1732910578 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c0443f0 con 0x7fd91c0b0010 2023-10-14T12:30:39.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.485+0000 7fd912ffd640 1 -- 172.21.15.64:0/1732910578 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c0447a0 con 0x7fd91c0b0010 2023-10-14T12:30:39.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.485+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd91c0c4950 con 0x7fd91c0b0010 2023-10-14T12:30:39.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.485+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd91c0c5ea0 con 0x7fd91c0b0010 2023-10-14T12:30:39.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.486+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd91c0c6090 con 0x7fd91c0b0010 2023-10-14T12:30:39.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.487+0000 7fd912ffd640 1 -- 172.21.15.64:0/1732910578 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd90c04d450 con 0x7fd91c0b0010 2023-10-14T12:30:39.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.488+0000 7fd912ffd640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8fc06aea0 0x7fd8fc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.488+0000 7fd912ffd640 1 -- 172.21.15.64:0/1732910578 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fd90c0abec0 con 0x7fd91c0b0010 2023-10-14T12:30:39.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.489+0000 7fd913fff640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8fc06aea0 0x7fd8fc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.490+0000 7fd913fff640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8fc06aea0 0x7fd8fc06d360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd904006fd0 tx=0x7fd904008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:39.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.494+0000 7fd912ffd640 1 -- 172.21.15.64:0/1732910578 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd90c076e00 con 0x7fd91c0b0010 2023-10-14T12:30:39.675 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.674+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd91c070db0 con 0x7fd8fc06aea0 2023-10-14T12:30:39.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.696+0000 7fd912ffd640 1 -- 172.21.15.64:0/1732910578 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+281844 (secure 0 0 0) 0x7fd90400c050 con 0x7fd8fc06aea0 2023-10-14T12:30:39.701 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:39.703 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:30:39.704 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.700+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8fc06aea0 msgr2=0x7fd8fc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.700+0000 7fd920cd7640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8fc06aea0 0x7fd8fc06d360 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd904006fd0 tx=0x7fd904008040 comp rx=0 tx=0).stop 2023-10-14T12:30:39.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.700+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 msgr2=0x7fd91c0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.700+0000 7fd920cd7640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0c7f40 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd90c02b940 tx=0x7fd90c0046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 shutdown_connections 2023-10-14T12:30:39.705 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8fc06aea0 0x7fd8fc06d360 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd91c15ad00 0x7fd91c0ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd91c0b03f0 0x7fd91c155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 --2- 172.21.15.64:0/1732910578 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd91c0b0010 0x7fd91c0c7f40 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 >> 172.21.15.64:0/1732910578 conn(0x7fd91c06c1c0 msgr2=0x7fd91c0af360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:39.706 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 shutdown_connections 2023-10-14T12:30:39.707 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.701+0000 7fd920cd7640 1 -- 172.21.15.64:0/1732910578 wait complete. 2023-10-14T12:30:39.721 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":94,"stamp":"2023-10-14T12:30:37.767211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220820,"kb_used_data":4636,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753900,"statfs":{"total":773094113280,"available":772867993600,"internally_reserved":0,"allocated":4747264,"data_stored":2697670,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.487726"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.311081+0000","last_change":"2023-10-14T12:30:33.311081+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.311081+0000","last_undegraded":"2023-10-14T12:30:33.311081+0000","last_fullsized":"2023-10-14T12:30:33.311081+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.310267+0000","last_change":"2023-10-14T12:30:33.310267+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.310267+0000","last_undegraded":"2023-10-14T12:30:33.310267+0000","last_fullsized":"2023-10-14T12:30:33.310267+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.316195+0000","last_change":"2023-10-14T12:30:33.316195+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.316195+0000","last_undegraded":"2023-10-14T12:30:33.316195+0000","last_fullsized":"2023-10-14T12:30:33.316195+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.301687+0000","last_change":"2023-10-14T12:30:33.301687+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.301687+0000","last_undegraded":"2023-10-14T12:30:33.301687+0000","last_fullsized":"2023-10-14T12:30:33.301687+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.301452+0000","last_change":"2023-10-14T12:30:33.301452+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.301452+0000","last_undegraded":"2023-10-14T12:30:33.301452+0000","last_fullsized":"2023-10-14T12:30:33.301452+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312478+0000","last_change":"2023-10-14T12:30:33.312478+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312478+0000","last_undegraded":"2023-10-14T12:30:33.312478+0000","last_fullsized":"2023-10-14T12:30:33.312478+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.326590+0000","last_change":"2023-10-14T12:30:33.326590+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.326590+0000","last_undegraded":"2023-10-14T12:30:33.326590+0000","last_fullsized":"2023-10-14T12:30:33.326590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.309626+0000","last_change":"2023-10-14T12:30:33.309626+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.309626+0000","last_undegraded":"2023-10-14T12:30:33.309626+0000","last_fullsized":"2023-10-14T12:30:33.309626+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317969+0000","last_change":"2023-10-14T12:30:33.317969+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317969+0000","last_undegraded":"2023-10-14T12:30:33.317969+0000","last_fullsized":"2023-10-14T12:30:33.317969+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.325918+0000","last_change":"2023-10-14T12:30:33.325918+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.325918+0000","last_undegraded":"2023-10-14T12:30:33.325918+0000","last_fullsized":"2023-10-14T12:30:33.325918+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323716+0000","last_change":"2023-10-14T12:30:33.323716+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323716+0000","last_undegraded":"2023-10-14T12:30:33.323716+0000","last_fullsized":"2023-10-14T12:30:33.323716+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320995+0000","last_change":"2023-10-14T12:30:33.320995+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320995+0000","last_undegraded":"2023-10-14T12:30:33.320995+0000","last_fullsized":"2023-10-14T12:30:33.320995+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.322143+0000","last_change":"2023-10-14T12:30:33.322143+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.322143+0000","last_undegraded":"2023-10-14T12:30:33.322143+0000","last_fullsized":"2023-10-14T12:30:33.322143+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320916+0000","last_change":"2023-10-14T12:30:33.320916+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320916+0000","last_undegraded":"2023-10-14T12:30:33.320916+0000","last_fullsized":"2023-10-14T12:30:33.320916+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.324296+0000","last_change":"2023-10-14T12:30:33.324296+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.324296+0000","last_undegraded":"2023-10-14T12:30:33.324296+0000","last_fullsized":"2023-10-14T12:30:33.324296+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.313418+0000","last_change":"2023-10-14T12:30:33.313418+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.313418+0000","last_undegraded":"2023-10-14T12:30:33.313418+0000","last_fullsized":"2023-10-14T12:30:33.313418+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.318129+0000","last_change":"2023-10-14T12:30:33.318129+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.318129+0000","last_undegraded":"2023-10-14T12:30:33.318129+0000","last_fullsized":"2023-10-14T12:30:33.318129+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307753+0000","last_change":"2023-10-14T12:30:33.307753+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307753+0000","last_undegraded":"2023-10-14T12:30:33.307753+0000","last_fullsized":"2023-10-14T12:30:33.307753+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300782+0000","last_change":"2023-10-14T12:30:33.300782+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300782+0000","last_undegraded":"2023-10-14T12:30:33.300782+0000","last_fullsized":"2023-10-14T12:30:33.300782+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.305733+0000","last_change":"2023-10-14T12:30:33.305733+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.305733+0000","last_undegraded":"2023-10-14T12:30:33.305733+0000","last_fullsized":"2023-10-14T12:30:33.305733+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.321669+0000","last_change":"2023-10-14T12:30:33.321669+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.321669+0000","last_undegraded":"2023-10-14T12:30:33.321669+0000","last_fullsized":"2023-10-14T12:30:33.321669+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317532+0000","last_change":"2023-10-14T12:30:33.317532+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317532+0000","last_undegraded":"2023-10-14T12:30:33.317532+0000","last_fullsized":"2023-10-14T12:30:33.317532+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.313613+0000","last_change":"2023-10-14T12:30:33.313613+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.313613+0000","last_undegraded":"2023-10-14T12:30:33.313613+0000","last_fullsized":"2023-10-14T12:30:33.313613+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300836+0000","last_change":"2023-10-14T12:30:33.300836+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300836+0000","last_undegraded":"2023-10-14T12:30:33.300836+0000","last_fullsized":"2023-10-14T12:30:33.300836+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.304799+0000","last_change":"2023-10-14T12:30:33.304799+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.304799+0000","last_undegraded":"2023-10-14T12:30:33.304799+0000","last_fullsized":"2023-10-14T12:30:33.304799+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314720+0000","last_change":"2023-10-14T12:30:33.314720+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314720+0000","last_undegraded":"2023-10-14T12:30:33.314720+0000","last_fullsized":"2023-10-14T12:30:33.314720+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307638+0000","last_change":"2023-10-14T12:30:33.307638+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307638+0000","last_undegraded":"2023-10-14T12:30:33.307638+0000","last_fullsized":"2023-10-14T12:30:33.307638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320666+0000","last_change":"2023-10-14T12:30:33.320666+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320666+0000","last_undegraded":"2023-10-14T12:30:33.320666+0000","last_fullsized":"2023-10-14T12:30:33.320666+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307625+0000","last_change":"2023-10-14T12:30:33.307625+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307625+0000","last_undegraded":"2023-10-14T12:30:33.307625+0000","last_fullsized":"2023-10-14T12:30:33.307625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307009+0000","last_change":"2023-10-14T12:30:33.307009+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307009+0000","last_undegraded":"2023-10-14T12:30:33.307009+0000","last_fullsized":"2023-10-14T12:30:33.307009+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312569+0000","last_change":"2023-10-14T12:30:33.312569+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312569+0000","last_undegraded":"2023-10-14T12:30:33.312569+0000","last_fullsized":"2023-10-14T12:30:33.312569+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312884+0000","last_change":"2023-10-14T12:30:33.312884+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312884+0000","last_undegraded":"2023-10-14T12:30:33.312884+0000","last_fullsized":"2023-10-14T12:30:33.312884+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320236+0000","last_change":"2023-10-14T12:30:33.320236+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320236+0000","last_undegraded":"2023-10-14T12:30:33.320236+0000","last_fullsized":"2023-10-14T12:30:33.320236+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.333763+0000","last_change":"2023-10-14T12:30:33.332554+0000","last_active":"2023-10-14T12:30:33.333763+0000","last_peered":"2023-10-14T12:30:33.333763+0000","last_clean":"2023-10-14T12:30:33.333763+0000","last_became_active":"2023-10-14T12:30:33.332275+0000","last_became_peered":"2023-10-14T12:30:33.332275+0000","last_unstale":"2023-10-14T12:30:33.333763+0000","last_undegraded":"2023-10-14T12:30:33.333763+0000","last_fullsized":"2023-10-14T12:30:33.333763+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:51:06.646348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317969+0000","last_change":"2023-10-14T12:30:33.317969+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317969+0000","last_undegraded":"2023-10-14T12:30:33.317969+0000","last_fullsized":"2023-10-14T12:30:33.317969+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.332388+0000","last_change":"2023-10-14T12:30:33.326883+0000","last_active":"2023-10-14T12:30:33.332388+0000","last_peered":"2023-10-14T12:30:33.332388+0000","last_clean":"2023-10-14T12:30:33.332388+0000","last_became_active":"2023-10-14T12:30:33.326581+0000","last_became_peered":"2023-10-14T12:30:33.326581+0000","last_unstale":"2023-10-14T12:30:33.332388+0000","last_undegraded":"2023-10-14T12:30:33.332388+0000","last_fullsized":"2023-10-14T12:30:33.332388+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:13.991919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.313213+0000","last_change":"2023-10-14T12:30:33.313213+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.313213+0000","last_undegraded":"2023-10-14T12:30:33.313213+0000","last_fullsized":"2023-10-14T12:30:33.313213+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337829+0000","last_change":"2023-10-14T12:30:33.335259+0000","last_active":"2023-10-14T12:30:33.337829+0000","last_peered":"2023-10-14T12:30:33.337829+0000","last_clean":"2023-10-14T12:30:33.337829+0000","last_became_active":"2023-10-14T12:30:33.334954+0000","last_became_peered":"2023-10-14T12:30:33.334954+0000","last_unstale":"2023-10-14T12:30:33.337829+0000","last_undegraded":"2023-10-14T12:30:33.337829+0000","last_fullsized":"2023-10-14T12:30:33.337829+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:04.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.310663+0000","last_change":"2023-10-14T12:30:33.310663+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.310663+0000","last_undegraded":"2023-10-14T12:30:33.310663+0000","last_fullsized":"2023-10-14T12:30:33.310663+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.335172+0000","last_change":"2023-10-14T12:30:33.331342+0000","last_active":"2023-10-14T12:30:33.335172+0000","last_peered":"2023-10-14T12:30:33.335172+0000","last_clean":"2023-10-14T12:30:33.335172+0000","last_became_active":"2023-10-14T12:30:33.331033+0000","last_became_peered":"2023-10-14T12:30:33.331033+0000","last_unstale":"2023-10-14T12:30:33.335172+0000","last_undegraded":"2023-10-14T12:30:33.335172+0000","last_fullsized":"2023-10-14T12:30:33.335172+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314678+0000","last_change":"2023-10-14T12:30:33.314678+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314678+0000","last_undegraded":"2023-10-14T12:30:33.314678+0000","last_fullsized":"2023-10-14T12:30:33.314678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334493+0000","last_change":"2023-10-14T12:30:33.332976+0000","last_active":"2023-10-14T12:30:33.334493+0000","last_peered":"2023-10-14T12:30:33.334493+0000","last_clean":"2023-10-14T12:30:33.334493+0000","last_became_active":"2023-10-14T12:30:33.332092+0000","last_became_peered":"2023-10-14T12:30:33.332092+0000","last_unstale":"2023-10-14T12:30:33.334493+0000","last_undegraded":"2023-10-14T12:30:33.334493+0000","last_fullsized":"2023-10-14T12:30:33.334493+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:41.928245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323736+0000","last_change":"2023-10-14T12:30:33.323736+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323736+0000","last_undegraded":"2023-10-14T12:30:33.323736+0000","last_fullsized":"2023-10-14T12:30:33.323736+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.338118+0000","last_change":"2023-10-14T12:30:33.336252+0000","last_active":"2023-10-14T12:30:33.338118+0000","last_peered":"2023-10-14T12:30:33.338118+0000","last_clean":"2023-10-14T12:30:33.338118+0000","last_became_active":"2023-10-14T12:30:33.335909+0000","last_became_peered":"2023-10-14T12:30:33.335909+0000","last_unstale":"2023-10-14T12:30:33.338118+0000","last_undegraded":"2023-10-14T12:30:33.338118+0000","last_fullsized":"2023-10-14T12:30:33.338118+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314656+0000","last_change":"2023-10-14T12:30:33.314656+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314656+0000","last_undegraded":"2023-10-14T12:30:33.314656+0000","last_fullsized":"2023-10-14T12:30:33.314656+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337273+0000","last_change":"2023-10-14T12:30:33.332689+0000","last_active":"2023-10-14T12:30:33.337273+0000","last_peered":"2023-10-14T12:30:33.337273+0000","last_clean":"2023-10-14T12:30:33.337273+0000","last_became_active":"2023-10-14T12:30:33.332347+0000","last_became_peered":"2023-10-14T12:30:33.332347+0000","last_unstale":"2023-10-14T12:30:33.337273+0000","last_undegraded":"2023-10-14T12:30:33.337273+0000","last_fullsized":"2023-10-14T12:30:33.337273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.309116+0000","last_change":"2023-10-14T12:30:33.309116+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.309116+0000","last_undegraded":"2023-10-14T12:30:33.309116+0000","last_fullsized":"2023-10-14T12:30:33.309116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.333976+0000","last_change":"2023-10-14T12:30:33.321473+0000","last_active":"2023-10-14T12:30:33.333976+0000","last_peered":"2023-10-14T12:30:33.333976+0000","last_clean":"2023-10-14T12:30:33.333976+0000","last_became_active":"2023-10-14T12:30:33.321139+0000","last_became_peered":"2023-10-14T12:30:33.321139+0000","last_unstale":"2023-10-14T12:30:33.333976+0000","last_undegraded":"2023-10-14T12:30:33.333976+0000","last_fullsized":"2023-10-14T12:30:33.333976+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300590+0000","last_change":"2023-10-14T12:30:33.300590+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300590+0000","last_undegraded":"2023-10-14T12:30:33.300590+0000","last_fullsized":"2023-10-14T12:30:33.300590+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.323970+0000","last_change":"2023-10-14T12:30:33.320132+0000","last_active":"2023-10-14T12:30:33.323970+0000","last_peered":"2023-10-14T12:30:33.323970+0000","last_clean":"2023-10-14T12:30:33.323970+0000","last_became_active":"2023-10-14T12:30:33.319838+0000","last_became_peered":"2023-10-14T12:30:33.319838+0000","last_unstale":"2023-10-14T12:30:33.323970+0000","last_undegraded":"2023-10-14T12:30:33.323970+0000","last_fullsized":"2023-10-14T12:30:33.323970+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.321330+0000","last_change":"2023-10-14T12:30:33.321330+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.321330+0000","last_undegraded":"2023-10-14T12:30:33.321330+0000","last_fullsized":"2023-10-14T12:30:33.321330+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337942+0000","last_change":"2023-10-14T12:30:33.333797+0000","last_active":"2023-10-14T12:30:33.337942+0000","last_peered":"2023-10-14T12:30:33.337942+0000","last_clean":"2023-10-14T12:30:33.337942+0000","last_became_active":"2023-10-14T12:30:33.332493+0000","last_became_peered":"2023-10-14T12:30:33.332493+0000","last_unstale":"2023-10-14T12:30:33.337942+0000","last_undegraded":"2023-10-14T12:30:33.337942+0000","last_fullsized":"2023-10-14T12:30:33.337942+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.309845+0000","last_change":"2023-10-14T12:30:33.309845+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.309845+0000","last_undegraded":"2023-10-14T12:30:33.309845+0000","last_fullsized":"2023-10-14T12:30:33.309845+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.339680+0000","last_change":"2023-10-14T12:30:33.336933+0000","last_active":"2023-10-14T12:30:33.339680+0000","last_peered":"2023-10-14T12:30:33.339680+0000","last_clean":"2023-10-14T12:30:33.339680+0000","last_became_active":"2023-10-14T12:30:33.336490+0000","last_became_peered":"2023-10-14T12:30:33.336490+0000","last_unstale":"2023-10-14T12:30:33.339680+0000","last_undegraded":"2023-10-14T12:30:33.339680+0000","last_fullsized":"2023-10-14T12:30:33.339680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:53:52.536676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.316190+0000","last_change":"2023-10-14T12:30:33.316190+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.316190+0000","last_undegraded":"2023-10-14T12:30:33.316190+0000","last_fullsized":"2023-10-14T12:30:33.316190+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.331615+0000","last_change":"2023-10-14T12:30:33.328447+0000","last_active":"2023-10-14T12:30:33.331615+0000","last_peered":"2023-10-14T12:30:33.331615+0000","last_clean":"2023-10-14T12:30:33.331615+0000","last_became_active":"2023-10-14T12:30:33.327737+0000","last_became_peered":"2023-10-14T12:30:33.327737+0000","last_unstale":"2023-10-14T12:30:33.331615+0000","last_undegraded":"2023-10-14T12:30:33.331615+0000","last_fullsized":"2023-10-14T12:30:33.331615+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312505+0000","last_change":"2023-10-14T12:30:33.312505+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312505+0000","last_undegraded":"2023-10-14T12:30:33.312505+0000","last_fullsized":"2023-10-14T12:30:33.312505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.331565+0000","last_change":"2023-10-14T12:30:33.328766+0000","last_active":"2023-10-14T12:30:33.331565+0000","last_peered":"2023-10-14T12:30:33.331565+0000","last_clean":"2023-10-14T12:30:33.331565+0000","last_became_active":"2023-10-14T12:30:33.328489+0000","last_became_peered":"2023-10-14T12:30:33.328489+0000","last_unstale":"2023-10-14T12:30:33.331565+0000","last_undegraded":"2023-10-14T12:30:33.331565+0000","last_fullsized":"2023-10-14T12:30:33.331565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:56.928965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.308538+0000","last_change":"2023-10-14T12:30:33.308538+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.308538+0000","last_undegraded":"2023-10-14T12:30:33.308538+0000","last_fullsized":"2023-10-14T12:30:33.308538+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337294+0000","last_change":"2023-10-14T12:30:33.332659+0000","last_active":"2023-10-14T12:30:33.337294+0000","last_peered":"2023-10-14T12:30:33.337294+0000","last_clean":"2023-10-14T12:30:33.337294+0000","last_became_active":"2023-10-14T12:30:33.332041+0000","last_became_peered":"2023-10-14T12:30:33.332041+0000","last_unstale":"2023-10-14T12:30:33.337294+0000","last_undegraded":"2023-10-14T12:30:33.337294+0000","last_fullsized":"2023-10-14T12:30:33.337294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314953+0000","last_change":"2023-10-14T12:30:33.314953+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314953+0000","last_undegraded":"2023-10-14T12:30:33.314953+0000","last_fullsized":"2023-10-14T12:30:33.314953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.333114+0000","last_change":"2023-10-14T12:30:33.329100+0000","last_active":"2023-10-14T12:30:33.333114+0000","last_peered":"2023-10-14T12:30:33.333114+0000","last_clean":"2023-10-14T12:30:33.333114+0000","last_became_active":"2023-10-14T12:30:33.328823+0000","last_became_peered":"2023-10-14T12:30:33.328823+0000","last_unstale":"2023-10-14T12:30:33.333114+0000","last_undegraded":"2023-10-14T12:30:33.333114+0000","last_fullsized":"2023-10-14T12:30:33.333114+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:36:47.348199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.308675+0000","last_change":"2023-10-14T12:30:33.308675+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.308675+0000","last_undegraded":"2023-10-14T12:30:33.308675+0000","last_fullsized":"2023-10-14T12:30:33.308675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337974+0000","last_change":"2023-10-14T12:30:33.335192+0000","last_active":"2023-10-14T12:30:33.337974+0000","last_peered":"2023-10-14T12:30:33.337974+0000","last_clean":"2023-10-14T12:30:33.337974+0000","last_became_active":"2023-10-14T12:30:33.334783+0000","last_became_peered":"2023-10-14T12:30:33.334783+0000","last_unstale":"2023-10-14T12:30:33.337974+0000","last_undegraded":"2023-10-14T12:30:33.337974+0000","last_fullsized":"2023-10-14T12:30:33.337974+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:31:41.928245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.306735+0000","last_change":"2023-10-14T12:30:33.306735+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.306735+0000","last_undegraded":"2023-10-14T12:30:33.306735+0000","last_fullsized":"2023-10-14T12:30:33.306735+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.342141+0000","last_change":"2023-10-14T12:30:33.337568+0000","last_active":"2023-10-14T12:30:33.342141+0000","last_peered":"2023-10-14T12:30:33.342141+0000","last_clean":"2023-10-14T12:30:33.342141+0000","last_became_active":"2023-10-14T12:30:33.337246+0000","last_became_peered":"2023-10-14T12:30:33.337246+0000","last_unstale":"2023-10-14T12:30:33.342141+0000","last_undegraded":"2023-10-14T12:30:33.342141+0000","last_fullsized":"2023-10-14T12:30:33.342141+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:04.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323274+0000","last_change":"2023-10-14T12:30:33.323274+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323274+0000","last_undegraded":"2023-10-14T12:30:33.323274+0000","last_fullsized":"2023-10-14T12:30:33.323274+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337789+0000","last_change":"2023-10-14T12:30:33.332639+0000","last_active":"2023-10-14T12:30:33.337789+0000","last_peered":"2023-10-14T12:30:33.337789+0000","last_clean":"2023-10-14T12:30:33.337789+0000","last_became_active":"2023-10-14T12:30:33.332366+0000","last_became_peered":"2023-10-14T12:30:33.332366+0000","last_unstale":"2023-10-14T12:30:33.337789+0000","last_undegraded":"2023-10-14T12:30:33.337789+0000","last_fullsized":"2023-10-14T12:30:33.337789+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:10:04.322596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.315406+0000","last_change":"2023-10-14T12:30:33.315406+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.315406+0000","last_undegraded":"2023-10-14T12:30:33.315406+0000","last_fullsized":"2023-10-14T12:30:33.315406+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.330897+0000","last_change":"2023-10-14T12:30:33.326267+0000","last_active":"2023-10-14T12:30:33.330897+0000","last_peered":"2023-10-14T12:30:33.330897+0000","last_clean":"2023-10-14T12:30:33.330897+0000","last_became_active":"2023-10-14T12:30:33.326020+0000","last_became_peered":"2023-10-14T12:30:33.326020+0000","last_unstale":"2023-10-14T12:30:33.330897+0000","last_undegraded":"2023-10-14T12:30:33.330897+0000","last_fullsized":"2023-10-14T12:30:33.330897+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:38:20.859809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.300880+0000","last_change":"2023-10-14T12:30:33.300880+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.300880+0000","last_undegraded":"2023-10-14T12:30:33.300880+0000","last_fullsized":"2023-10-14T12:30:33.300880+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337856+0000","last_change":"2023-10-14T12:30:33.336624+0000","last_active":"2023-10-14T12:30:33.337856+0000","last_peered":"2023-10-14T12:30:33.337856+0000","last_clean":"2023-10-14T12:30:33.337856+0000","last_became_active":"2023-10-14T12:30:33.336299+0000","last_became_peered":"2023-10-14T12:30:33.336299+0000","last_unstale":"2023-10-14T12:30:33.337856+0000","last_undegraded":"2023-10-14T12:30:33.337856+0000","last_fullsized":"2023-10-14T12:30:33.337856+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312124+0000","last_change":"2023-10-14T12:30:33.312124+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312124+0000","last_undegraded":"2023-10-14T12:30:33.312124+0000","last_fullsized":"2023-10-14T12:30:33.312124+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.328045+0000","last_change":"2023-10-14T12:30:33.323532+0000","last_active":"2023-10-14T12:30:33.328045+0000","last_peered":"2023-10-14T12:30:33.328045+0000","last_clean":"2023-10-14T12:30:33.328045+0000","last_became_active":"2023-10-14T12:30:33.323244+0000","last_became_peered":"2023-10-14T12:30:33.323244+0000","last_unstale":"2023-10-14T12:30:33.328045+0000","last_undegraded":"2023-10-14T12:30:33.328045+0000","last_fullsized":"2023-10-14T12:30:33.328045+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:43:14.980722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314744+0000","last_change":"2023-10-14T12:30:33.314744+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314744+0000","last_undegraded":"2023-10-14T12:30:33.314744+0000","last_fullsized":"2023-10-14T12:30:33.314744+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334785+0000","last_change":"2023-10-14T12:30:33.330930+0000","last_active":"2023-10-14T12:30:33.334785+0000","last_peered":"2023-10-14T12:30:33.334785+0000","last_clean":"2023-10-14T12:30:33.334785+0000","last_became_active":"2023-10-14T12:30:33.330353+0000","last_became_peered":"2023-10-14T12:30:33.330353+0000","last_unstale":"2023-10-14T12:30:33.334785+0000","last_undegraded":"2023-10-14T12:30:33.334785+0000","last_fullsized":"2023-10-14T12:30:33.334785+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:32:48.639700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320072+0000","last_change":"2023-10-14T12:30:33.320072+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320072+0000","last_undegraded":"2023-10-14T12:30:33.320072+0000","last_fullsized":"2023-10-14T12:30:33.320072+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.327629+0000","last_change":"2023-10-14T12:30:33.326069+0000","last_active":"2023-10-14T12:30:33.327629+0000","last_peered":"2023-10-14T12:30:33.327629+0000","last_clean":"2023-10-14T12:30:33.327629+0000","last_became_active":"2023-10-14T12:30:33.325772+0000","last_became_peered":"2023-10-14T12:30:33.325772+0000","last_unstale":"2023-10-14T12:30:33.327629+0000","last_undegraded":"2023-10-14T12:30:33.327629+0000","last_fullsized":"2023-10-14T12:30:33.327629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.305756+0000","last_change":"2023-10-14T12:30:33.305756+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.305756+0000","last_undegraded":"2023-10-14T12:30:33.305756+0000","last_fullsized":"2023-10-14T12:30:33.305756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334752+0000","last_change":"2023-10-14T12:30:33.329870+0000","last_active":"2023-10-14T12:30:33.334752+0000","last_peered":"2023-10-14T12:30:33.334752+0000","last_clean":"2023-10-14T12:30:33.334752+0000","last_became_active":"2023-10-14T12:30:33.328179+0000","last_became_peered":"2023-10-14T12:30:33.328179+0000","last_unstale":"2023-10-14T12:30:33.334752+0000","last_undegraded":"2023-10-14T12:30:33.334752+0000","last_fullsized":"2023-10-14T12:30:33.334752+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:29:24.885499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.314141+0000","last_change":"2023-10-14T12:30:33.314141+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.314141+0000","last_undegraded":"2023-10-14T12:30:33.314141+0000","last_fullsized":"2023-10-14T12:30:33.314141+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.339655+0000","last_change":"2023-10-14T12:30:33.335354+0000","last_active":"2023-10-14T12:30:33.339655+0000","last_peered":"2023-10-14T12:30:33.339655+0000","last_clean":"2023-10-14T12:30:33.339655+0000","last_became_active":"2023-10-14T12:30:33.334729+0000","last_became_peered":"2023-10-14T12:30:33.334729+0000","last_unstale":"2023-10-14T12:30:33.339655+0000","last_undegraded":"2023-10-14T12:30:33.339655+0000","last_fullsized":"2023-10-14T12:30:33.339655+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.320901+0000","last_change":"2023-10-14T12:30:33.320901+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.320901+0000","last_undegraded":"2023-10-14T12:30:33.320901+0000","last_fullsized":"2023-10-14T12:30:33.320901+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.337306+0000","last_change":"2023-10-14T12:30:33.332845+0000","last_active":"2023-10-14T12:30:33.337306+0000","last_peered":"2023-10-14T12:30:33.337306+0000","last_clean":"2023-10-14T12:30:33.337306+0000","last_became_active":"2023-10-14T12:30:33.332542+0000","last_became_peered":"2023-10-14T12:30:33.332542+0000","last_unstale":"2023-10-14T12:30:33.337306+0000","last_undegraded":"2023-10-14T12:30:33.337306+0000","last_fullsized":"2023-10-14T12:30:33.337306+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T21:04:40.983987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.305695+0000","last_change":"2023-10-14T12:30:33.305695+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.305695+0000","last_undegraded":"2023-10-14T12:30:33.305695+0000","last_fullsized":"2023-10-14T12:30:33.305695+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.330490+0000","last_change":"2023-10-14T12:30:33.324071+0000","last_active":"2023-10-14T12:30:33.330490+0000","last_peered":"2023-10-14T12:30:33.330490+0000","last_clean":"2023-10-14T12:30:33.330490+0000","last_became_active":"2023-10-14T12:30:33.323094+0000","last_became_peered":"2023-10-14T12:30:33.323094+0000","last_unstale":"2023-10-14T12:30:33.330490+0000","last_undegraded":"2023-10-14T12:30:33.330490+0000","last_fullsized":"2023-10-14T12:30:33.330490+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:45.479409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.307287+0000","last_change":"2023-10-14T12:30:33.307287+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.307287+0000","last_undegraded":"2023-10-14T12:30:33.307287+0000","last_fullsized":"2023-10-14T12:30:33.307287+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.332766+0000","last_change":"2023-10-14T12:30:33.326955+0000","last_active":"2023-10-14T12:30:33.332766+0000","last_peered":"2023-10-14T12:30:33.332766+0000","last_clean":"2023-10-14T12:30:33.332766+0000","last_became_active":"2023-10-14T12:30:33.326641+0000","last_became_peered":"2023-10-14T12:30:33.326641+0000","last_unstale":"2023-10-14T12:30:33.332766+0000","last_undegraded":"2023-10-14T12:30:33.332766+0000","last_fullsized":"2023-10-14T12:30:33.332766+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:01:35.777180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.312000+0000","last_change":"2023-10-14T12:30:33.312000+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.312000+0000","last_undegraded":"2023-10-14T12:30:33.312000+0000","last_fullsized":"2023-10-14T12:30:33.312000+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.328341+0000","last_change":"2023-10-14T12:30:33.324592+0000","last_active":"2023-10-14T12:30:33.328341+0000","last_peered":"2023-10-14T12:30:33.328341+0000","last_clean":"2023-10-14T12:30:33.328341+0000","last_became_active":"2023-10-14T12:30:33.324291+0000","last_became_peered":"2023-10-14T12:30:33.324291+0000","last_unstale":"2023-10-14T12:30:33.328341+0000","last_undegraded":"2023-10-14T12:30:33.328341+0000","last_fullsized":"2023-10-14T12:30:33.328341+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:29:35.072306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.318110+0000","last_change":"2023-10-14T12:30:33.318110+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.318110+0000","last_undegraded":"2023-10-14T12:30:33.318110+0000","last_fullsized":"2023-10-14T12:30:33.318110+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.334778+0000","last_change":"2023-10-14T12:30:33.327237+0000","last_active":"2023-10-14T12:30:33.334778+0000","last_peered":"2023-10-14T12:30:33.334778+0000","last_clean":"2023-10-14T12:30:33.334778+0000","last_became_active":"2023-10-14T12:30:33.324300+0000","last_became_peered":"2023-10-14T12:30:33.324300+0000","last_unstale":"2023-10-14T12:30:33.334778+0000","last_undegraded":"2023-10-14T12:30:33.334778+0000","last_fullsized":"2023-10-14T12:30:33.334778+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:13:25.623040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.317430+0000","last_change":"2023-10-14T12:30:33.317430+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.317430+0000","last_undegraded":"2023-10-14T12:30:33.317430+0000","last_fullsized":"2023-10-14T12:30:33.317430+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.329713+0000","last_change":"2023-10-14T12:30:33.320974+0000","last_active":"2023-10-14T12:30:33.329713+0000","last_peered":"2023-10-14T12:30:33.329713+0000","last_clean":"2023-10-14T12:30:33.329713+0000","last_became_active":"2023-10-14T12:30:33.320705+0000","last_became_peered":"2023-10-14T12:30:33.320705+0000","last_unstale":"2023-10-14T12:30:33.329713+0000","last_undegraded":"2023-10-14T12:30:33.329713+0000","last_fullsized":"2023-10-14T12:30:33.329713+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:02.880217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":39,"state":"creating+peering","last_fresh":"2023-10-14T12:30:33.323704+0000","last_change":"2023-10-14T12:30:33.323704+0000","last_active":"2023-10-14T12:30:33.278433+0000","last_peered":"2023-10-14T12:30:33.278433+0000","last_clean":"2023-10-14T12:30:33.278433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-14T12:30:33.323704+0000","last_undegraded":"2023-10-14T12:30:33.323704+0000","last_fullsized":"2023-10-14T12:30:33.323704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-10-14T12:30:33.331975+0000","last_change":"2023-10-14T12:30:33.329384+0000","last_active":"2023-10-14T12:30:33.331975+0000","last_peered":"2023-10-14T12:30:33.331975+0000","last_clean":"2023-10-14T12:30:33.331975+0000","last_became_active":"2023-10-14T12:30:33.328937+0000","last_became_peered":"2023-10-14T12:30:33.328937+0000","last_unstale":"2023-10-14T12:30:33.331975+0000","last_undegraded":"2023-10-14T12:30:33.331975+0000","last_fullsized":"2023-10-14T12:30:33.331975+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":180,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-14T12:30:32.299912+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:30:32.299912+0000","last_peered":"2023-10-14T12:30:32.299912+0000","last_clean":"2023-10-14T12:30:32.299912+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:30:32.299912+0000","last_undegraded":"2023-10-14T12:30:32.299912+0000","last_fullsized":"2023-10-14T12:30:32.299912+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542170,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1040384,"data_stored":780811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.371},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":1.5289999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.92500000000000004},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":0.70299999999999996}]},{"osd":2,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":0.97699999999999998},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":1.238}]},{"osd":3,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":1.1259999999999999},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.1719999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.413},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.0309999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.276},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.321}]},{"osd":6,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.4690000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":0.85099999999999998}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":434176,"data_stored":183833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":1.4450000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.80500000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.357},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":1.5960000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":1.5349999999999999},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.4019999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.151}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.0609999999999999},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.252}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.6439999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3129999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.88200000000000001},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.3640000000000001}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.913},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":1.9610000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":2.0019999999999998},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.92700000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":2.1030000000000002},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.6360000000000001,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":2.1230000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":0.83399999999999996},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":2.6240000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.7869999999999999},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.6639999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.484},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.885}]}]},{"osd":4,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":1.5800000000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.0289999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0960000000000001},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.171}]},{"osd":2,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":1.4059999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.385}]},{"osd":3,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.91700000000000004},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.2470000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.4930000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.444}]},{"osd":6,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.635}]},{"osd":7,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.5209999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.548}]}]},{"osd":3,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":0.876},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.96099999999999997}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.054},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":1.391}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.337},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.1220000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.5009999999999999},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.226}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":1.706},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.901}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":2.0649999999999999},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.5649999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27456,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344384,"statfs":{"total":96636764160,"available":96608649216,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.006}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.70199999999999996},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.2569999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":0.52500000000000002}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.4670000000000001},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.3069999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.609}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.5700000000000001},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.1759999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.7490000000000001},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.5129999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":436,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":446464,"data_stored":190443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":1.3280000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.94099999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":1.2869999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.0449999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.575},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.411}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.663},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.4900000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":1.7170000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.5429999999999999},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.7549999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.9099999999999999},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.839}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28040,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343800,"statfs":{"total":96636764160,"available":96608051200,"internally_reserved":0,"allocated":1040384,"data_stored":780811,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":1.4199999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.2930000000000001,"5min":5.2930000000000001,"15min":5.2930000000000001},"last":1.0840000000000001},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.60899999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":1.1399999999999999},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":1.3049999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.246},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.997}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":0.90000000000000002}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":1.3620000000000001},{"interface":"front","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":1.5409999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.569},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.5009999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:30:39.726 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:30:39.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.991+0000 7f94121ed640 1 Processor -- start 2023-10-14T12:30:39.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.991+0000 7f94121ed640 1 -- start start 2023-10-14T12:30:39.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94121ed640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f940c0cdd60 0x7f940c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94121ed640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f940c15def0 0x7f940c06bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94121ed640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f940c154110 con 0x7f940c0cd980 2023-10-14T12:30:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94121ed640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c15d1f0 con 0x7f940c0cdd60 2023-10-14T12:30:39.995 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94121ed640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f940c15a4c0 con 0x7f940c15def0 2023-10-14T12:30:39.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94111eb640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f940c0cd980 0x7f940c159c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:55984/0 (socket says 172.21.15.64:55984) 2023-10-14T12:30:39.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94111eb640 1 -- 172.21.15.64:0/3074429813 learned_addr learned my addr 172.21.15.64:0/3074429813 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:39.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.993+0000 7f94109ea640 1 --2- 172.21.15.64:0/3074429813 >> v2:172.21.15.64:3300/0 conn(0x7f940c0cdd60 0x7f940c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f9403fff640 1 -- 172.21.15.64:0/3074429813 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000693082 0 0) 0x7f940c154110 con 0x7f940c0cd980 2023-10-14T12:30:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f9403fff640 1 -- 172.21.15.64:0/3074429813 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93f8003520 con 0x7f940c0cd980 2023-10-14T12:30:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f94119ec640 1 --2- 172.21.15.64:0/3074429813 >> v2:172.21.15.177:3300/0 conn(0x7f940c15def0 0x7f940c06bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f94109ea640 1 -- 172.21.15.64:0/3074429813 >> v2:172.21.15.177:3300/0 conn(0x7f940c15def0 msgr2=0x7f940c06bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:39.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f9403fff640 1 -- 172.21.15.64:0/3074429813 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 605035835 0 0) 0x7f93f8003520 con 0x7f940c0cd980 2023-10-14T12:30:39.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f94109ea640 1 --2- 172.21.15.64:0/3074429813 >> v2:172.21.15.177:3300/0 conn(0x7f940c15def0 0x7f940c06bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:39.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f94109ea640 1 -- 172.21.15.64:0/3074429813 >> v1:172.21.15.64:6789/0 conn(0x7f940c0cd980 legacy=0x7f940c159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:39.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.994+0000 7f94109ea640 1 -- 172.21.15.64:0/3074429813 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c15a7a0 con 0x7f940c0cdd60 2023-10-14T12:30:39.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.995+0000 7f94109ea640 1 --2- 172.21.15.64:0/3074429813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cdd60 0x7f940c15d9b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f940c0b44c0 tx=0x7f93fc02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83090f78838b7449 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:39.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.995+0000 7f9403fff640 1 -- 172.21.15.64:0/3074429813 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94080017f0 con 0x7f940c0cdd60 2023-10-14T12:30:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.995+0000 7f9403fff640 1 -- 172.21.15.64:0/3074429813 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93fc033440 con 0x7f940c0cdd60 2023-10-14T12:30:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.995+0000 7f9403fff640 1 -- 172.21.15.64:0/3074429813 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93fc0337d0 con 0x7f940c0cdd60 2023-10-14T12:30:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 -- 172.21.15.64:0/3074429813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cdd60 msgr2=0x7f940c15d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 --2- 172.21.15.64:0/3074429813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cdd60 0x7f940c15d9b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f940c0b44c0 tx=0x7f93fc02b7a0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 -- 172.21.15.64:0/3074429813 shutdown_connections 2023-10-14T12:30:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 --2- 172.21.15.64:0/3074429813 >> v2:172.21.15.177:3300/0 conn(0x7f940c15def0 0x7f940c06bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 --2- 172.21.15.64:0/3074429813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cdd60 0x7f940c15d9b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 -- 172.21.15.64:0/3074429813 >> 172.21.15.64:0/3074429813 conn(0x7f940c06a470 msgr2=0x7f940c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 -- 172.21.15.64:0/3074429813 shutdown_connections 2023-10-14T12:30:40.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.996+0000 7f94121ed640 1 -- 172.21.15.64:0/3074429813 wait complete. 2023-10-14T12:30:40.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.998+0000 7f94121ed640 1 Processor -- start 2023-10-14T12:30:40.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.998+0000 7f94121ed640 1 -- start start 2023-10-14T12:30:40.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94121ed640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cd980 0x7f940c0c4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94121ed640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940c0cdd60 0x7f940c0adb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94121ed640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f940c0c9ac0 0x7f940c0af400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94121ed640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c0ae090 con 0x7f940c0cd980 2023-10-14T12:30:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94121ed640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f940c0ae360 con 0x7f940c0c9ac0 2023-10-14T12:30:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94121ed640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940c0ae640 con 0x7f940c0cdd60 2023-10-14T12:30:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cd980 0x7f940c0c4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cd980 0x7f940c0c4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52100/0 (socket says 172.21.15.64:52100) 2023-10-14T12:30:40.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 -- 172.21.15.64:0/179961122 learned_addr learned my addr 172.21.15.64:0/179961122 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 -- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940c0cdd60 msgr2=0x7f940c0adb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940c0cdd60 0x7f940c0adb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 -- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f940c0c9ac0 msgr2=0x7f940c0af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f940c0c9ac0 0x7f940c0af400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:39.999+0000 7f94111eb640 1 -- 172.21.15.64:0/179961122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93fc009400 con 0x7f940c0cd980 2023-10-14T12:30:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.000+0000 7f94111eb640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cd980 0x7f940c0c4570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f940800c780 tx=0x7f940800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.000+0000 7f9401ffb640 1 -- 172.21.15.64:0/179961122 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9408007480 con 0x7f940c0cd980 2023-10-14T12:30:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.000+0000 7f9401ffb640 1 -- 172.21.15.64:0/179961122 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94080075e0 con 0x7f940c0cd980 2023-10-14T12:30:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.000+0000 7f9401ffb640 1 -- 172.21.15.64:0/179961122 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94080059e0 con 0x7f940c0cd980 2023-10-14T12:30:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.000+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f940c0ae920 con 0x7f940c0cd980 2023-10-14T12:30:40.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.000+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f940c0aeee0 con 0x7f940c0cd980 2023-10-14T12:30:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.001+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f940c0af0d0 con 0x7f940c0cd980 2023-10-14T12:30:40.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.002+0000 7f9401ffb640 1 -- 172.21.15.64:0/179961122 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f9408005b40 con 0x7f940c0cd980 2023-10-14T12:30:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.003+0000 7f9401ffb640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f93f006ae70 0x7f93f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.003+0000 7f9401ffb640 1 -- 172.21.15.64:0/179961122 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f94080895d0 con 0x7f940c0cd980 2023-10-14T12:30:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.004+0000 7f94109ea640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f93f006ae70 0x7f93f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.005+0000 7f94109ea640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f93f006ae70 0x7f93f006d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93fc035000 tx=0x7f93fc02d000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:40.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.007+0000 7f9401ffb640 1 -- 172.21.15.64:0/179961122 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9408054480 con 0x7f940c0cd980 2023-10-14T12:30:40.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.198+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f940c15d490 con 0x7f93f006ae70 2023-10-14T12:30:40.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.220+0000 7f9401ffb640 1 -- 172.21.15.64:0/179961122 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286966 (secure 0 0 0) 0x7f93fc0304b0 con 0x7f93f006ae70 2023-10-14T12:30:40.225 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:40.227 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:30:40.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.226+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f93f006ae70 msgr2=0x7f93f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.226+0000 7f94121ed640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f93f006ae70 0x7f93f006d330 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f93fc035000 tx=0x7f93fc02d000 comp rx=0 tx=0).stop 2023-10-14T12:30:40.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.226+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cd980 msgr2=0x7f940c0c4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.226+0000 7f94121ed640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cd980 0x7f940c0c4570 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f940800c780 tx=0x7f940800cc40 comp rx=0 tx=0).stop 2023-10-14T12:30:40.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 shutdown_connections 2023-10-14T12:30:40.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f93f006ae70 0x7f93f006d330 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f940c0c9ac0 0x7f940c0af400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f940c0cdd60 0x7f940c0adb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 --2- 172.21.15.64:0/179961122 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f940c0cd980 0x7f940c0c4570 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 >> 172.21.15.64:0/179961122 conn(0x7f940c06a470 msgr2=0x7f940c0b3610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:40.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 shutdown_connections 2023-10-14T12:30:40.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.227+0000 7f94121ed640 1 -- 172.21.15.64:0/179961122 wait complete. 2023-10-14T12:30:40.249 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-14T12:30:39.767794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221088,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5021696,"data_stored":2819260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.472375"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336705+0000","last_change":"2023-10-14T12:30:34.349268+0000","last_active":"2023-10-14T12:30:35.336705+0000","last_peered":"2023-10-14T12:30:35.336705+0000","last_clean":"2023-10-14T12:30:35.336705+0000","last_became_active":"2023-10-14T12:30:34.348914+0000","last_became_peered":"2023-10-14T12:30:34.348914+0000","last_unstale":"2023-10-14T12:30:35.336705+0000","last_undegraded":"2023-10-14T12:30:35.336705+0000","last_fullsized":"2023-10-14T12:30:35.336705+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:42:50.006654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336576+0000","last_change":"2023-10-14T12:30:34.344887+0000","last_active":"2023-10-14T12:30:35.336576+0000","last_peered":"2023-10-14T12:30:35.336576+0000","last_clean":"2023-10-14T12:30:35.336576+0000","last_became_active":"2023-10-14T12:30:34.344581+0000","last_became_peered":"2023-10-14T12:30:34.344581+0000","last_unstale":"2023-10-14T12:30:35.336576+0000","last_undegraded":"2023-10-14T12:30:35.336576+0000","last_fullsized":"2023-10-14T12:30:35.336576+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:28.730425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640947+0000","last_change":"2023-10-14T12:30:34.343503+0000","last_active":"2023-10-14T12:30:35.640947+0000","last_peered":"2023-10-14T12:30:35.640947+0000","last_clean":"2023-10-14T12:30:35.640947+0000","last_became_active":"2023-10-14T12:30:34.343221+0000","last_became_peered":"2023-10-14T12:30:34.343221+0000","last_unstale":"2023-10-14T12:30:35.640947+0000","last_undegraded":"2023-10-14T12:30:35.640947+0000","last_fullsized":"2023-10-14T12:30:35.640947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:37.840864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410105+0000","last_change":"2023-10-14T12:30:34.343025+0000","last_active":"2023-10-14T12:30:35.410105+0000","last_peered":"2023-10-14T12:30:35.410105+0000","last_clean":"2023-10-14T12:30:35.410105+0000","last_became_active":"2023-10-14T12:30:34.342733+0000","last_became_peered":"2023-10-14T12:30:34.342733+0000","last_unstale":"2023-10-14T12:30:35.410105+0000","last_undegraded":"2023-10-14T12:30:35.410105+0000","last_fullsized":"2023-10-14T12:30:35.410105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:15.005093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.409587+0000","last_change":"2023-10-14T12:30:34.332160+0000","last_active":"2023-10-14T12:30:35.409587+0000","last_peered":"2023-10-14T12:30:35.409587+0000","last_clean":"2023-10-14T12:30:35.409587+0000","last_became_active":"2023-10-14T12:30:34.331843+0000","last_became_peered":"2023-10-14T12:30:34.331843+0000","last_unstale":"2023-10-14T12:30:35.409587+0000","last_undegraded":"2023-10-14T12:30:35.409587+0000","last_fullsized":"2023-10-14T12:30:35.409587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:46.492583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642095+0000","last_change":"2023-10-14T12:30:34.345669+0000","last_active":"2023-10-14T12:30:35.642095+0000","last_peered":"2023-10-14T12:30:35.642095+0000","last_clean":"2023-10-14T12:30:35.642095+0000","last_became_active":"2023-10-14T12:30:34.345165+0000","last_became_peered":"2023-10-14T12:30:34.345165+0000","last_unstale":"2023-10-14T12:30:35.642095+0000","last_undegraded":"2023-10-14T12:30:35.642095+0000","last_fullsized":"2023-10-14T12:30:35.642095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:53.997776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338165+0000","last_change":"2023-10-14T12:30:34.341127+0000","last_active":"2023-10-14T12:30:35.338165+0000","last_peered":"2023-10-14T12:30:35.338165+0000","last_clean":"2023-10-14T12:30:35.338165+0000","last_became_active":"2023-10-14T12:30:34.338798+0000","last_became_peered":"2023-10-14T12:30:34.338798+0000","last_unstale":"2023-10-14T12:30:35.338165+0000","last_undegraded":"2023-10-14T12:30:35.338165+0000","last_fullsized":"2023-10-14T12:30:35.338165+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:10:19.127848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.335883+0000","last_change":"2023-10-14T12:30:34.334706+0000","last_active":"2023-10-14T12:30:35.335883+0000","last_peered":"2023-10-14T12:30:35.335883+0000","last_clean":"2023-10-14T12:30:35.335883+0000","last_became_active":"2023-10-14T12:30:34.333742+0000","last_became_peered":"2023-10-14T12:30:34.333742+0000","last_unstale":"2023-10-14T12:30:35.335883+0000","last_undegraded":"2023-10-14T12:30:35.335883+0000","last_fullsized":"2023-10-14T12:30:35.335883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641307+0000","last_change":"2023-10-14T12:30:34.347717+0000","last_active":"2023-10-14T12:30:35.641307+0000","last_peered":"2023-10-14T12:30:35.641307+0000","last_clean":"2023-10-14T12:30:35.641307+0000","last_became_active":"2023-10-14T12:30:34.347287+0000","last_became_peered":"2023-10-14T12:30:34.347287+0000","last_unstale":"2023-10-14T12:30:35.641307+0000","last_undegraded":"2023-10-14T12:30:35.641307+0000","last_fullsized":"2023-10-14T12:30:35.641307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:16:40.404130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340931+0000","last_change":"2023-10-14T12:30:34.342074+0000","last_active":"2023-10-14T12:30:35.340931+0000","last_peered":"2023-10-14T12:30:35.340931+0000","last_clean":"2023-10-14T12:30:35.340931+0000","last_became_active":"2023-10-14T12:30:34.341599+0000","last_became_peered":"2023-10-14T12:30:34.341599+0000","last_unstale":"2023-10-14T12:30:35.340931+0000","last_undegraded":"2023-10-14T12:30:35.340931+0000","last_fullsized":"2023-10-14T12:30:35.340931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:32.399607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340290+0000","last_change":"2023-10-14T12:30:34.347356+0000","last_active":"2023-10-14T12:30:35.340290+0000","last_peered":"2023-10-14T12:30:35.340290+0000","last_clean":"2023-10-14T12:30:35.340290+0000","last_became_active":"2023-10-14T12:30:34.346962+0000","last_became_peered":"2023-10-14T12:30:34.346962+0000","last_unstale":"2023-10-14T12:30:35.340290+0000","last_undegraded":"2023-10-14T12:30:35.340290+0000","last_fullsized":"2023-10-14T12:30:35.340290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:08.458987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640987+0000","last_change":"2023-10-14T12:30:34.336929+0000","last_active":"2023-10-14T12:30:35.640987+0000","last_peered":"2023-10-14T12:30:35.640987+0000","last_clean":"2023-10-14T12:30:35.640987+0000","last_became_active":"2023-10-14T12:30:34.336490+0000","last_became_peered":"2023-10-14T12:30:34.336490+0000","last_unstale":"2023-10-14T12:30:35.640987+0000","last_undegraded":"2023-10-14T12:30:35.640987+0000","last_fullsized":"2023-10-14T12:30:35.640987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:08.803544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338763+0000","last_change":"2023-10-14T12:30:34.336286+0000","last_active":"2023-10-14T12:30:35.338763+0000","last_peered":"2023-10-14T12:30:35.338763+0000","last_clean":"2023-10-14T12:30:35.338763+0000","last_became_active":"2023-10-14T12:30:34.335211+0000","last_became_peered":"2023-10-14T12:30:34.335211+0000","last_unstale":"2023-10-14T12:30:35.338763+0000","last_undegraded":"2023-10-14T12:30:35.338763+0000","last_fullsized":"2023-10-14T12:30:35.338763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339098+0000","last_change":"2023-10-14T12:30:34.333675+0000","last_active":"2023-10-14T12:30:35.339098+0000","last_peered":"2023-10-14T12:30:35.339098+0000","last_clean":"2023-10-14T12:30:35.339098+0000","last_became_active":"2023-10-14T12:30:34.332753+0000","last_became_peered":"2023-10-14T12:30:34.332753+0000","last_unstale":"2023-10-14T12:30:35.339098+0000","last_undegraded":"2023-10-14T12:30:35.339098+0000","last_fullsized":"2023-10-14T12:30:35.339098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:50.421016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.337542+0000","last_change":"2023-10-14T12:30:34.344954+0000","last_active":"2023-10-14T12:30:35.337542+0000","last_peered":"2023-10-14T12:30:35.337542+0000","last_clean":"2023-10-14T12:30:35.337542+0000","last_became_active":"2023-10-14T12:30:34.344639+0000","last_became_peered":"2023-10-14T12:30:34.344639+0000","last_unstale":"2023-10-14T12:30:35.337542+0000","last_undegraded":"2023-10-14T12:30:35.337542+0000","last_fullsized":"2023-10-14T12:30:35.337542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642014+0000","last_change":"2023-10-14T12:30:34.333857+0000","last_active":"2023-10-14T12:30:35.642014+0000","last_peered":"2023-10-14T12:30:35.642014+0000","last_clean":"2023-10-14T12:30:35.642014+0000","last_became_active":"2023-10-14T12:30:34.333436+0000","last_became_peered":"2023-10-14T12:30:34.333436+0000","last_unstale":"2023-10-14T12:30:35.642014+0000","last_undegraded":"2023-10-14T12:30:35.642014+0000","last_fullsized":"2023-10-14T12:30:35.642014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.643013+0000","last_change":"2023-10-14T12:30:34.342238+0000","last_active":"2023-10-14T12:30:35.643013+0000","last_peered":"2023-10-14T12:30:35.643013+0000","last_clean":"2023-10-14T12:30:35.643013+0000","last_became_active":"2023-10-14T12:30:34.341929+0000","last_became_peered":"2023-10-14T12:30:34.341929+0000","last_unstale":"2023-10-14T12:30:35.643013+0000","last_undegraded":"2023-10-14T12:30:35.643013+0000","last_fullsized":"2023-10-14T12:30:35.643013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.343109+0000","last_change":"2023-10-14T12:30:34.324627+0000","last_active":"2023-10-14T12:30:35.343109+0000","last_peered":"2023-10-14T12:30:35.343109+0000","last_clean":"2023-10-14T12:30:35.343109+0000","last_became_active":"2023-10-14T12:30:34.323870+0000","last_became_peered":"2023-10-14T12:30:34.323870+0000","last_unstale":"2023-10-14T12:30:35.343109+0000","last_undegraded":"2023-10-14T12:30:35.343109+0000","last_fullsized":"2023-10-14T12:30:35.343109+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:23.313808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410445+0000","last_change":"2023-10-14T12:30:34.342657+0000","last_active":"2023-10-14T12:30:35.410445+0000","last_peered":"2023-10-14T12:30:35.410445+0000","last_clean":"2023-10-14T12:30:35.410445+0000","last_became_active":"2023-10-14T12:30:34.342316+0000","last_became_peered":"2023-10-14T12:30:34.342316+0000","last_unstale":"2023-10-14T12:30:35.410445+0000","last_undegraded":"2023-10-14T12:30:35.410445+0000","last_fullsized":"2023-10-14T12:30:35.410445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:53.909707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.341857+0000","last_change":"2023-10-14T12:30:34.321736+0000","last_active":"2023-10-14T12:30:35.341857+0000","last_peered":"2023-10-14T12:30:35.341857+0000","last_clean":"2023-10-14T12:30:35.341857+0000","last_became_active":"2023-10-14T12:30:34.321292+0000","last_became_peered":"2023-10-14T12:30:34.321292+0000","last_unstale":"2023-10-14T12:30:35.341857+0000","last_undegraded":"2023-10-14T12:30:35.341857+0000","last_fullsized":"2023-10-14T12:30:35.341857+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:32.309700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338754+0000","last_change":"2023-10-14T12:30:34.340531+0000","last_active":"2023-10-14T12:30:35.338754+0000","last_peered":"2023-10-14T12:30:35.338754+0000","last_clean":"2023-10-14T12:30:35.338754+0000","last_became_active":"2023-10-14T12:30:34.340192+0000","last_became_peered":"2023-10-14T12:30:34.340192+0000","last_unstale":"2023-10-14T12:30:35.338754+0000","last_undegraded":"2023-10-14T12:30:35.338754+0000","last_fullsized":"2023-10-14T12:30:35.338754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339946+0000","last_change":"2023-10-14T12:30:34.344178+0000","last_active":"2023-10-14T12:30:35.339946+0000","last_peered":"2023-10-14T12:30:35.339946+0000","last_clean":"2023-10-14T12:30:35.339946+0000","last_became_active":"2023-10-14T12:30:34.343864+0000","last_became_peered":"2023-10-14T12:30:34.343864+0000","last_unstale":"2023-10-14T12:30:35.339946+0000","last_undegraded":"2023-10-14T12:30:35.339946+0000","last_fullsized":"2023-10-14T12:30:35.339946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642013+0000","last_change":"2023-10-14T12:30:34.333294+0000","last_active":"2023-10-14T12:30:35.642013+0000","last_peered":"2023-10-14T12:30:35.642013+0000","last_clean":"2023-10-14T12:30:35.642013+0000","last_became_active":"2023-10-14T12:30:34.333013+0000","last_became_peered":"2023-10-14T12:30:34.333013+0000","last_unstale":"2023-10-14T12:30:35.642013+0000","last_undegraded":"2023-10-14T12:30:35.642013+0000","last_fullsized":"2023-10-14T12:30:35.642013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.409280+0000","last_change":"2023-10-14T12:30:34.328544+0000","last_active":"2023-10-14T12:30:35.409280+0000","last_peered":"2023-10-14T12:30:35.409280+0000","last_clean":"2023-10-14T12:30:35.409280+0000","last_became_active":"2023-10-14T12:30:34.328152+0000","last_became_peered":"2023-10-14T12:30:34.328152+0000","last_unstale":"2023-10-14T12:30:35.409280+0000","last_undegraded":"2023-10-14T12:30:35.409280+0000","last_fullsized":"2023-10-14T12:30:35.409280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:27.435308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.343131+0000","last_change":"2023-10-14T12:30:34.337418+0000","last_active":"2023-10-14T12:30:35.343131+0000","last_peered":"2023-10-14T12:30:35.343131+0000","last_clean":"2023-10-14T12:30:35.343131+0000","last_became_active":"2023-10-14T12:30:34.337024+0000","last_became_peered":"2023-10-14T12:30:34.337024+0000","last_unstale":"2023-10-14T12:30:35.343131+0000","last_undegraded":"2023-10-14T12:30:35.343131+0000","last_fullsized":"2023-10-14T12:30:35.343131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:16:49.094700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642634+0000","last_change":"2023-10-14T12:30:34.334473+0000","last_active":"2023-10-14T12:30:35.642634+0000","last_peered":"2023-10-14T12:30:35.642634+0000","last_clean":"2023-10-14T12:30:35.642634+0000","last_became_active":"2023-10-14T12:30:34.334145+0000","last_became_peered":"2023-10-14T12:30:34.334145+0000","last_unstale":"2023-10-14T12:30:35.642634+0000","last_undegraded":"2023-10-14T12:30:35.642634+0000","last_fullsized":"2023-10-14T12:30:35.642634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.342938+0000","last_change":"2023-10-14T12:30:34.337611+0000","last_active":"2023-10-14T12:30:35.342938+0000","last_peered":"2023-10-14T12:30:35.342938+0000","last_clean":"2023-10-14T12:30:35.342938+0000","last_became_active":"2023-10-14T12:30:34.336829+0000","last_became_peered":"2023-10-14T12:30:34.336829+0000","last_unstale":"2023-10-14T12:30:35.342938+0000","last_undegraded":"2023-10-14T12:30:35.342938+0000","last_fullsized":"2023-10-14T12:30:35.342938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:18.001820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339787+0000","last_change":"2023-10-14T12:30:34.339603+0000","last_active":"2023-10-14T12:30:35.339787+0000","last_peered":"2023-10-14T12:30:35.339787+0000","last_clean":"2023-10-14T12:30:35.339787+0000","last_became_active":"2023-10-14T12:30:34.339299+0000","last_became_peered":"2023-10-14T12:30:34.339299+0000","last_unstale":"2023-10-14T12:30:35.339787+0000","last_undegraded":"2023-10-14T12:30:35.339787+0000","last_fullsized":"2023-10-14T12:30:35.339787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:55:22.736621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.342499+0000","last_change":"2023-10-14T12:30:34.340774+0000","last_active":"2023-10-14T12:30:35.342499+0000","last_peered":"2023-10-14T12:30:35.342499+0000","last_clean":"2023-10-14T12:30:35.342499+0000","last_became_active":"2023-10-14T12:30:34.338070+0000","last_became_peered":"2023-10-14T12:30:34.338070+0000","last_unstale":"2023-10-14T12:30:35.342499+0000","last_undegraded":"2023-10-14T12:30:35.342499+0000","last_fullsized":"2023-10-14T12:30:35.342499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:18.794987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338246+0000","last_change":"2023-10-14T12:30:34.325514+0000","last_active":"2023-10-14T12:30:35.338246+0000","last_peered":"2023-10-14T12:30:35.338246+0000","last_clean":"2023-10-14T12:30:35.338246+0000","last_became_active":"2023-10-14T12:30:34.325040+0000","last_became_peered":"2023-10-14T12:30:34.325040+0000","last_unstale":"2023-10-14T12:30:35.338246+0000","last_undegraded":"2023-10-14T12:30:35.338246+0000","last_fullsized":"2023-10-14T12:30:35.338246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:57.942140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642219+0000","last_change":"2023-10-14T12:30:34.347217+0000","last_active":"2023-10-14T12:30:35.642219+0000","last_peered":"2023-10-14T12:30:35.642219+0000","last_clean":"2023-10-14T12:30:35.642219+0000","last_became_active":"2023-10-14T12:30:34.346911+0000","last_became_peered":"2023-10-14T12:30:34.346911+0000","last_unstale":"2023-10-14T12:30:35.642219+0000","last_undegraded":"2023-10-14T12:30:35.642219+0000","last_fullsized":"2023-10-14T12:30:35.642219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642955+0000","last_change":"2023-10-14T12:30:34.346749+0000","last_active":"2023-10-14T12:30:35.642955+0000","last_peered":"2023-10-14T12:30:35.642955+0000","last_clean":"2023-10-14T12:30:35.642955+0000","last_became_active":"2023-10-14T12:30:34.346457+0000","last_became_peered":"2023-10-14T12:30:34.346457+0000","last_unstale":"2023-10-14T12:30:35.642955+0000","last_undegraded":"2023-10-14T12:30:35.642955+0000","last_fullsized":"2023-10-14T12:30:35.642955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642953+0000","last_change":"2023-10-14T12:30:34.341761+0000","last_active":"2023-10-14T12:30:35.642953+0000","last_peered":"2023-10-14T12:30:35.642953+0000","last_clean":"2023-10-14T12:30:35.642953+0000","last_became_active":"2023-10-14T12:30:34.341455+0000","last_became_peered":"2023-10-14T12:30:34.341455+0000","last_unstale":"2023-10-14T12:30:35.642953+0000","last_undegraded":"2023-10-14T12:30:35.642953+0000","last_fullsized":"2023-10-14T12:30:35.642953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:10:19.127848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366288+0000","last_change":"2023-10-14T12:30:33.332554+0000","last_active":"2023-10-14T12:30:34.366288+0000","last_peered":"2023-10-14T12:30:34.366288+0000","last_clean":"2023-10-14T12:30:34.366288+0000","last_became_active":"2023-10-14T12:30:33.332275+0000","last_became_peered":"2023-10-14T12:30:33.332275+0000","last_unstale":"2023-10-14T12:30:34.366288+0000","last_undegraded":"2023-10-14T12:30:34.366288+0000","last_fullsized":"2023-10-14T12:30:34.366288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.033968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642514+0000","last_change":"2023-10-14T12:30:34.338766+0000","last_active":"2023-10-14T12:30:35.642514+0000","last_peered":"2023-10-14T12:30:35.642514+0000","last_clean":"2023-10-14T12:30:35.642514+0000","last_became_active":"2023-10-14T12:30:34.338433+0000","last_became_peered":"2023-10-14T12:30:34.338433+0000","last_unstale":"2023-10-14T12:30:35.642514+0000","last_undegraded":"2023-10-14T12:30:35.642514+0000","last_fullsized":"2023-10-14T12:30:35.642514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.354004+0000","last_change":"2023-10-14T12:30:33.326883+0000","last_active":"2023-10-14T12:30:34.354004+0000","last_peered":"2023-10-14T12:30:34.354004+0000","last_clean":"2023-10-14T12:30:34.354004+0000","last_became_active":"2023-10-14T12:30:33.326581+0000","last_became_peered":"2023-10-14T12:30:33.326581+0000","last_unstale":"2023-10-14T12:30:34.354004+0000","last_undegraded":"2023-10-14T12:30:34.354004+0000","last_fullsized":"2023-10-14T12:30:34.354004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:44.567204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340216+0000","last_change":"2023-10-14T12:30:34.336344+0000","last_active":"2023-10-14T12:30:35.340216+0000","last_peered":"2023-10-14T12:30:35.340216+0000","last_clean":"2023-10-14T12:30:35.340216+0000","last_became_active":"2023-10-14T12:30:34.334996+0000","last_became_peered":"2023-10-14T12:30:34.334996+0000","last_unstale":"2023-10-14T12:30:35.340216+0000","last_undegraded":"2023-10-14T12:30:35.340216+0000","last_fullsized":"2023-10-14T12:30:35.340216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.359680+0000","last_change":"2023-10-14T12:30:33.335259+0000","last_active":"2023-10-14T12:30:34.359680+0000","last_peered":"2023-10-14T12:30:34.359680+0000","last_clean":"2023-10-14T12:30:34.359680+0000","last_became_active":"2023-10-14T12:30:33.334954+0000","last_became_peered":"2023-10-14T12:30:33.334954+0000","last_unstale":"2023-10-14T12:30:34.359680+0000","last_undegraded":"2023-10-14T12:30:34.359680+0000","last_fullsized":"2023-10-14T12:30:34.359680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336704+0000","last_change":"2023-10-14T12:30:34.335691+0000","last_active":"2023-10-14T12:30:35.336704+0000","last_peered":"2023-10-14T12:30:35.336704+0000","last_clean":"2023-10-14T12:30:35.336704+0000","last_became_active":"2023-10-14T12:30:34.331967+0000","last_became_peered":"2023-10-14T12:30:34.331967+0000","last_unstale":"2023-10-14T12:30:35.336704+0000","last_undegraded":"2023-10-14T12:30:35.336704+0000","last_fullsized":"2023-10-14T12:30:35.336704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:51:00.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.352499+0000","last_change":"2023-10-14T12:30:33.331342+0000","last_active":"2023-10-14T12:30:34.352499+0000","last_peered":"2023-10-14T12:30:34.352499+0000","last_clean":"2023-10-14T12:30:34.352499+0000","last_became_active":"2023-10-14T12:30:33.331033+0000","last_became_peered":"2023-10-14T12:30:33.331033+0000","last_unstale":"2023-10-14T12:30:34.352499+0000","last_undegraded":"2023-10-14T12:30:34.352499+0000","last_fullsized":"2023-10-14T12:30:34.352499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:22.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640612+0000","last_change":"2023-10-14T12:30:34.340044+0000","last_active":"2023-10-14T12:30:35.640612+0000","last_peered":"2023-10-14T12:30:35.640612+0000","last_clean":"2023-10-14T12:30:35.640612+0000","last_became_active":"2023-10-14T12:30:34.339781+0000","last_became_peered":"2023-10-14T12:30:34.339781+0000","last_unstale":"2023-10-14T12:30:35.640612+0000","last_undegraded":"2023-10-14T12:30:35.640612+0000","last_fullsized":"2023-10-14T12:30:35.640612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:40.303123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.353622+0000","last_change":"2023-10-14T12:30:33.332976+0000","last_active":"2023-10-14T12:30:34.353622+0000","last_peered":"2023-10-14T12:30:34.353622+0000","last_clean":"2023-10-14T12:30:34.353622+0000","last_became_active":"2023-10-14T12:30:33.332092+0000","last_became_peered":"2023-10-14T12:30:33.332092+0000","last_unstale":"2023-10-14T12:30:34.353622+0000","last_undegraded":"2023-10-14T12:30:34.353622+0000","last_fullsized":"2023-10-14T12:30:34.353622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:16.163772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.337912+0000","last_change":"2023-10-14T12:30:34.342322+0000","last_active":"2023-10-14T12:30:35.337912+0000","last_peered":"2023-10-14T12:30:35.337912+0000","last_clean":"2023-10-14T12:30:35.337912+0000","last_became_active":"2023-10-14T12:30:34.341523+0000","last_became_peered":"2023-10-14T12:30:34.341523+0000","last_unstale":"2023-10-14T12:30:35.337912+0000","last_undegraded":"2023-10-14T12:30:35.337912+0000","last_fullsized":"2023-10-14T12:30:35.337912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361072+0000","last_change":"2023-10-14T12:30:33.336252+0000","last_active":"2023-10-14T12:30:34.361072+0000","last_peered":"2023-10-14T12:30:34.361072+0000","last_clean":"2023-10-14T12:30:34.361072+0000","last_became_active":"2023-10-14T12:30:33.335909+0000","last_became_peered":"2023-10-14T12:30:33.335909+0000","last_unstale":"2023-10-14T12:30:34.361072+0000","last_undegraded":"2023-10-14T12:30:34.361072+0000","last_fullsized":"2023-10-14T12:30:34.361072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340309+0000","last_change":"2023-10-14T12:30:34.335844+0000","last_active":"2023-10-14T12:30:35.340309+0000","last_peered":"2023-10-14T12:30:35.340309+0000","last_clean":"2023-10-14T12:30:35.340309+0000","last_became_active":"2023-10-14T12:30:34.335171+0000","last_became_peered":"2023-10-14T12:30:34.335171+0000","last_unstale":"2023-10-14T12:30:35.340309+0000","last_undegraded":"2023-10-14T12:30:35.340309+0000","last_fullsized":"2023-10-14T12:30:35.340309+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.322898+0000","last_change":"2023-10-14T12:30:33.332689+0000","last_active":"2023-10-14T12:30:34.322898+0000","last_peered":"2023-10-14T12:30:34.322898+0000","last_clean":"2023-10-14T12:30:34.322898+0000","last_became_active":"2023-10-14T12:30:33.332347+0000","last_became_peered":"2023-10-14T12:30:33.332347+0000","last_unstale":"2023-10-14T12:30:34.322898+0000","last_undegraded":"2023-10-14T12:30:34.322898+0000","last_fullsized":"2023-10-14T12:30:34.322898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:16.988646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336152+0000","last_change":"2023-10-14T12:30:34.332500+0000","last_active":"2023-10-14T12:30:35.336152+0000","last_peered":"2023-10-14T12:30:35.336152+0000","last_clean":"2023-10-14T12:30:35.336152+0000","last_became_active":"2023-10-14T12:30:34.331109+0000","last_became_peered":"2023-10-14T12:30:34.331109+0000","last_unstale":"2023-10-14T12:30:35.336152+0000","last_undegraded":"2023-10-14T12:30:35.336152+0000","last_fullsized":"2023-10-14T12:30:35.336152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:55:22.736621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.314725+0000","last_change":"2023-10-14T12:30:33.321473+0000","last_active":"2023-10-14T12:30:34.314725+0000","last_peered":"2023-10-14T12:30:34.314725+0000","last_clean":"2023-10-14T12:30:34.314725+0000","last_became_active":"2023-10-14T12:30:33.321139+0000","last_became_peered":"2023-10-14T12:30:33.321139+0000","last_unstale":"2023-10-14T12:30:34.314725+0000","last_undegraded":"2023-10-14T12:30:34.314725+0000","last_fullsized":"2023-10-14T12:30:34.314725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:16.988646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410318+0000","last_change":"2023-10-14T12:30:34.338583+0000","last_active":"2023-10-14T12:30:35.410318+0000","last_peered":"2023-10-14T12:30:35.410318+0000","last_clean":"2023-10-14T12:30:35.410318+0000","last_became_active":"2023-10-14T12:30:34.338189+0000","last_became_peered":"2023-10-14T12:30:34.338189+0000","last_unstale":"2023-10-14T12:30:35.410318+0000","last_undegraded":"2023-10-14T12:30:35.410318+0000","last_fullsized":"2023-10-14T12:30:35.410318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:01:36.790354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.306900+0000","last_change":"2023-10-14T12:30:33.320132+0000","last_active":"2023-10-14T12:30:34.306900+0000","last_peered":"2023-10-14T12:30:34.306900+0000","last_clean":"2023-10-14T12:30:34.306900+0000","last_became_active":"2023-10-14T12:30:33.319838+0000","last_became_peered":"2023-10-14T12:30:33.319838+0000","last_unstale":"2023-10-14T12:30:34.306900+0000","last_undegraded":"2023-10-14T12:30:34.306900+0000","last_fullsized":"2023-10-14T12:30:34.306900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:55.316034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642979+0000","last_change":"2023-10-14T12:30:34.344050+0000","last_active":"2023-10-14T12:30:35.642979+0000","last_peered":"2023-10-14T12:30:35.642979+0000","last_clean":"2023-10-14T12:30:35.642979+0000","last_became_active":"2023-10-14T12:30:34.343785+0000","last_became_peered":"2023-10-14T12:30:34.343785+0000","last_unstale":"2023-10-14T12:30:35.642979+0000","last_undegraded":"2023-10-14T12:30:35.642979+0000","last_fullsized":"2023-10-14T12:30:35.642979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:07.653661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.328033+0000","last_change":"2023-10-14T12:30:33.333797+0000","last_active":"2023-10-14T12:30:34.328033+0000","last_peered":"2023-10-14T12:30:34.328033+0000","last_clean":"2023-10-14T12:30:34.328033+0000","last_became_active":"2023-10-14T12:30:33.332493+0000","last_became_peered":"2023-10-14T12:30:33.332493+0000","last_unstale":"2023-10-14T12:30:34.328033+0000","last_undegraded":"2023-10-14T12:30:34.328033+0000","last_fullsized":"2023-10-14T12:30:34.328033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:55.316034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641670+0000","last_change":"2023-10-14T12:30:34.334615+0000","last_active":"2023-10-14T12:30:35.641670+0000","last_peered":"2023-10-14T12:30:35.641670+0000","last_clean":"2023-10-14T12:30:35.641670+0000","last_became_active":"2023-10-14T12:30:34.334350+0000","last_became_peered":"2023-10-14T12:30:34.334350+0000","last_unstale":"2023-10-14T12:30:35.641670+0000","last_undegraded":"2023-10-14T12:30:35.641670+0000","last_fullsized":"2023-10-14T12:30:35.641670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:06.867919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361709+0000","last_change":"2023-10-14T12:30:33.336933+0000","last_active":"2023-10-14T12:30:34.361709+0000","last_peered":"2023-10-14T12:30:34.361709+0000","last_clean":"2023-10-14T12:30:34.361709+0000","last_became_active":"2023-10-14T12:30:33.336490+0000","last_became_peered":"2023-10-14T12:30:33.336490+0000","last_unstale":"2023-10-14T12:30:34.361709+0000","last_undegraded":"2023-10-14T12:30:34.361709+0000","last_fullsized":"2023-10-14T12:30:34.361709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:49.407842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340595+0000","last_change":"2023-10-14T12:30:34.338293+0000","last_active":"2023-10-14T12:30:35.340595+0000","last_peered":"2023-10-14T12:30:35.340595+0000","last_clean":"2023-10-14T12:30:35.340595+0000","last_became_active":"2023-10-14T12:30:34.337931+0000","last_became_peered":"2023-10-14T12:30:34.337931+0000","last_unstale":"2023-10-14T12:30:35.340595+0000","last_undegraded":"2023-10-14T12:30:35.340595+0000","last_fullsized":"2023-10-14T12:30:35.340595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366483+0000","last_change":"2023-10-14T12:30:33.328447+0000","last_active":"2023-10-14T12:30:34.366483+0000","last_peered":"2023-10-14T12:30:34.366483+0000","last_clean":"2023-10-14T12:30:34.366483+0000","last_became_active":"2023-10-14T12:30:33.327737+0000","last_became_peered":"2023-10-14T12:30:33.327737+0000","last_unstale":"2023-10-14T12:30:34.366483+0000","last_undegraded":"2023-10-14T12:30:34.366483+0000","last_fullsized":"2023-10-14T12:30:34.366483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640594+0000","last_change":"2023-10-14T12:30:34.344171+0000","last_active":"2023-10-14T12:30:35.640594+0000","last_peered":"2023-10-14T12:30:35.640594+0000","last_clean":"2023-10-14T12:30:35.640594+0000","last_became_active":"2023-10-14T12:30:34.343500+0000","last_became_peered":"2023-10-14T12:30:34.343500+0000","last_unstale":"2023-10-14T12:30:35.640594+0000","last_undegraded":"2023-10-14T12:30:35.640594+0000","last_fullsized":"2023-10-14T12:30:35.640594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:16.183323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361264+0000","last_change":"2023-10-14T12:30:33.328766+0000","last_active":"2023-10-14T12:30:34.361264+0000","last_peered":"2023-10-14T12:30:34.361264+0000","last_clean":"2023-10-14T12:30:34.361264+0000","last_became_active":"2023-10-14T12:30:33.328489+0000","last_became_peered":"2023-10-14T12:30:33.328489+0000","last_unstale":"2023-10-14T12:30:34.361264+0000","last_undegraded":"2023-10-14T12:30:34.361264+0000","last_fullsized":"2023-10-14T12:30:34.361264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:06.640486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336014+0000","last_change":"2023-10-14T12:30:34.352227+0000","last_active":"2023-10-14T12:30:35.336014+0000","last_peered":"2023-10-14T12:30:35.336014+0000","last_clean":"2023-10-14T12:30:35.336014+0000","last_became_active":"2023-10-14T12:30:34.349317+0000","last_became_peered":"2023-10-14T12:30:34.349317+0000","last_unstale":"2023-10-14T12:30:35.336014+0000","last_undegraded":"2023-10-14T12:30:35.336014+0000","last_fullsized":"2023-10-14T12:30:35.336014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.325066+0000","last_change":"2023-10-14T12:30:33.332659+0000","last_active":"2023-10-14T12:30:34.325066+0000","last_peered":"2023-10-14T12:30:34.325066+0000","last_clean":"2023-10-14T12:30:34.325066+0000","last_became_active":"2023-10-14T12:30:33.332041+0000","last_became_peered":"2023-10-14T12:30:33.332041+0000","last_unstale":"2023-10-14T12:30:34.325066+0000","last_undegraded":"2023-10-14T12:30:34.325066+0000","last_fullsized":"2023-10-14T12:30:34.325066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642391+0000","last_change":"2023-10-14T12:30:34.348353+0000","last_active":"2023-10-14T12:30:35.642391+0000","last_peered":"2023-10-14T12:30:35.642391+0000","last_clean":"2023-10-14T12:30:35.642391+0000","last_became_active":"2023-10-14T12:30:34.348025+0000","last_became_peered":"2023-10-14T12:30:34.348025+0000","last_unstale":"2023-10-14T12:30:35.642391+0000","last_undegraded":"2023-10-14T12:30:35.642391+0000","last_fullsized":"2023-10-14T12:30:35.642391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.311069+0000","last_change":"2023-10-14T12:30:33.329100+0000","last_active":"2023-10-14T12:30:34.311069+0000","last_peered":"2023-10-14T12:30:34.311069+0000","last_clean":"2023-10-14T12:30:34.311069+0000","last_became_active":"2023-10-14T12:30:33.328823+0000","last_became_peered":"2023-10-14T12:30:33.328823+0000","last_unstale":"2023-10-14T12:30:34.311069+0000","last_undegraded":"2023-10-14T12:30:34.311069+0000","last_fullsized":"2023-10-14T12:30:34.311069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:02.880217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336381+0000","last_change":"2023-10-14T12:30:34.333464+0000","last_active":"2023-10-14T12:30:35.336381+0000","last_peered":"2023-10-14T12:30:35.336381+0000","last_clean":"2023-10-14T12:30:35.336381+0000","last_became_active":"2023-10-14T12:30:34.333191+0000","last_became_peered":"2023-10-14T12:30:34.333191+0000","last_unstale":"2023-10-14T12:30:35.336381+0000","last_undegraded":"2023-10-14T12:30:35.336381+0000","last_fullsized":"2023-10-14T12:30:35.336381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:32.399607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366273+0000","last_change":"2023-10-14T12:30:33.335192+0000","last_active":"2023-10-14T12:30:34.366273+0000","last_peered":"2023-10-14T12:30:34.366273+0000","last_clean":"2023-10-14T12:30:34.366273+0000","last_became_active":"2023-10-14T12:30:33.334783+0000","last_became_peered":"2023-10-14T12:30:33.334783+0000","last_unstale":"2023-10-14T12:30:34.366273+0000","last_undegraded":"2023-10-14T12:30:34.366273+0000","last_fullsized":"2023-10-14T12:30:34.366273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.033968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336275+0000","last_change":"2023-10-14T12:30:34.332683+0000","last_active":"2023-10-14T12:30:35.336275+0000","last_peered":"2023-10-14T12:30:35.336275+0000","last_clean":"2023-10-14T12:30:35.336275+0000","last_became_active":"2023-10-14T12:30:34.332353+0000","last_became_peered":"2023-10-14T12:30:34.332353+0000","last_unstale":"2023-10-14T12:30:35.336275+0000","last_undegraded":"2023-10-14T12:30:35.336275+0000","last_fullsized":"2023-10-14T12:30:35.336275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:08.458987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.356295+0000","last_change":"2023-10-14T12:30:33.337568+0000","last_active":"2023-10-14T12:30:34.356295+0000","last_peered":"2023-10-14T12:30:34.356295+0000","last_clean":"2023-10-14T12:30:34.356295+0000","last_became_active":"2023-10-14T12:30:33.337246+0000","last_became_peered":"2023-10-14T12:30:33.337246+0000","last_unstale":"2023-10-14T12:30:34.356295+0000","last_undegraded":"2023-10-14T12:30:34.356295+0000","last_fullsized":"2023-10-14T12:30:34.356295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:05.932464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340625+0000","last_change":"2023-10-14T12:30:34.341921+0000","last_active":"2023-10-14T12:30:35.340625+0000","last_peered":"2023-10-14T12:30:35.340625+0000","last_clean":"2023-10-14T12:30:35.340625+0000","last_became_active":"2023-10-14T12:30:34.340210+0000","last_became_peered":"2023-10-14T12:30:34.340210+0000","last_unstale":"2023-10-14T12:30:35.340625+0000","last_undegraded":"2023-10-14T12:30:35.340625+0000","last_fullsized":"2023-10-14T12:30:35.340625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:06.829396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.354127+0000","last_change":"2023-10-14T12:30:33.332639+0000","last_active":"2023-10-14T12:30:34.354127+0000","last_peered":"2023-10-14T12:30:34.354127+0000","last_clean":"2023-10-14T12:30:34.354127+0000","last_became_active":"2023-10-14T12:30:33.332366+0000","last_became_peered":"2023-10-14T12:30:33.332366+0000","last_unstale":"2023-10-14T12:30:34.354127+0000","last_undegraded":"2023-10-14T12:30:34.354127+0000","last_fullsized":"2023-10-14T12:30:34.354127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339756+0000","last_change":"2023-10-14T12:30:34.337511+0000","last_active":"2023-10-14T12:30:35.339756+0000","last_peered":"2023-10-14T12:30:35.339756+0000","last_clean":"2023-10-14T12:30:35.339756+0000","last_became_active":"2023-10-14T12:30:34.337096+0000","last_became_peered":"2023-10-14T12:30:34.337096+0000","last_unstale":"2023-10-14T12:30:35.339756+0000","last_undegraded":"2023-10-14T12:30:35.339756+0000","last_fullsized":"2023-10-14T12:30:35.339756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.363671+0000","last_change":"2023-10-14T12:30:33.326267+0000","last_active":"2023-10-14T12:30:34.363671+0000","last_peered":"2023-10-14T12:30:34.363671+0000","last_clean":"2023-10-14T12:30:34.363671+0000","last_became_active":"2023-10-14T12:30:33.326020+0000","last_became_peered":"2023-10-14T12:30:33.326020+0000","last_unstale":"2023-10-14T12:30:34.363671+0000","last_undegraded":"2023-10-14T12:30:34.363671+0000","last_fullsized":"2023-10-14T12:30:34.363671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:07.819706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410505+0000","last_change":"2023-10-14T12:30:34.348057+0000","last_active":"2023-10-14T12:30:35.410505+0000","last_peered":"2023-10-14T12:30:35.410505+0000","last_clean":"2023-10-14T12:30:35.410505+0000","last_became_active":"2023-10-14T12:30:34.347721+0000","last_became_peered":"2023-10-14T12:30:34.347721+0000","last_unstale":"2023-10-14T12:30:35.410505+0000","last_undegraded":"2023-10-14T12:30:35.410505+0000","last_fullsized":"2023-10-14T12:30:35.410505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:34:32.333549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.323960+0000","last_change":"2023-10-14T12:30:33.336624+0000","last_active":"2023-10-14T12:30:34.323960+0000","last_peered":"2023-10-14T12:30:34.323960+0000","last_clean":"2023-10-14T12:30:34.323960+0000","last_became_active":"2023-10-14T12:30:33.336299+0000","last_became_peered":"2023-10-14T12:30:33.336299+0000","last_unstale":"2023-10-14T12:30:34.323960+0000","last_undegraded":"2023-10-14T12:30:34.323960+0000","last_fullsized":"2023-10-14T12:30:34.323960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:22.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642505+0000","last_change":"2023-10-14T12:30:34.349582+0000","last_active":"2023-10-14T12:30:35.642505+0000","last_peered":"2023-10-14T12:30:35.642505+0000","last_clean":"2023-10-14T12:30:35.642505+0000","last_became_active":"2023-10-14T12:30:34.349281+0000","last_became_peered":"2023-10-14T12:30:34.349281+0000","last_unstale":"2023-10-14T12:30:35.642505+0000","last_undegraded":"2023-10-14T12:30:35.642505+0000","last_fullsized":"2023-10-14T12:30:35.642505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.362637+0000","last_change":"2023-10-14T12:30:33.323532+0000","last_active":"2023-10-14T12:30:34.362637+0000","last_peered":"2023-10-14T12:30:34.362637+0000","last_clean":"2023-10-14T12:30:34.362637+0000","last_became_active":"2023-10-14T12:30:33.323244+0000","last_became_peered":"2023-10-14T12:30:33.323244+0000","last_unstale":"2023-10-14T12:30:34.362637+0000","last_undegraded":"2023-10-14T12:30:34.362637+0000","last_fullsized":"2023-10-14T12:30:34.362637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:31.227443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640826+0000","last_change":"2023-10-14T12:30:34.339001+0000","last_active":"2023-10-14T12:30:35.640826+0000","last_peered":"2023-10-14T12:30:35.640826+0000","last_clean":"2023-10-14T12:30:35.640826+0000","last_became_active":"2023-10-14T12:30:34.338728+0000","last_became_peered":"2023-10-14T12:30:34.338728+0000","last_unstale":"2023-10-14T12:30:35.640826+0000","last_undegraded":"2023-10-14T12:30:35.640826+0000","last_fullsized":"2023-10-14T12:30:35.640826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:34.174928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.324150+0000","last_change":"2023-10-14T12:30:33.330930+0000","last_active":"2023-10-14T12:30:34.324150+0000","last_peered":"2023-10-14T12:30:34.324150+0000","last_clean":"2023-10-14T12:30:34.324150+0000","last_became_active":"2023-10-14T12:30:33.330353+0000","last_became_peered":"2023-10-14T12:30:33.330353+0000","last_unstale":"2023-10-14T12:30:34.324150+0000","last_undegraded":"2023-10-14T12:30:34.324150+0000","last_fullsized":"2023-10-14T12:30:34.324150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:22:49.880635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338674+0000","last_change":"2023-10-14T12:30:34.340027+0000","last_active":"2023-10-14T12:30:35.338674+0000","last_peered":"2023-10-14T12:30:35.338674+0000","last_clean":"2023-10-14T12:30:35.338674+0000","last_became_active":"2023-10-14T12:30:34.339704+0000","last_became_peered":"2023-10-14T12:30:34.339704+0000","last_unstale":"2023-10-14T12:30:35.338674+0000","last_undegraded":"2023-10-14T12:30:35.338674+0000","last_fullsized":"2023-10-14T12:30:35.338674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:07.653661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.316170+0000","last_change":"2023-10-14T12:30:33.326069+0000","last_active":"2023-10-14T12:30:34.316170+0000","last_peered":"2023-10-14T12:30:34.316170+0000","last_clean":"2023-10-14T12:30:34.316170+0000","last_became_active":"2023-10-14T12:30:33.325772+0000","last_became_peered":"2023-10-14T12:30:33.325772+0000","last_unstale":"2023-10-14T12:30:34.316170+0000","last_undegraded":"2023-10-14T12:30:34.316170+0000","last_fullsized":"2023-10-14T12:30:34.316170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336347+0000","last_change":"2023-10-14T12:30:34.334158+0000","last_active":"2023-10-14T12:30:35.336347+0000","last_peered":"2023-10-14T12:30:35.336347+0000","last_clean":"2023-10-14T12:30:35.336347+0000","last_became_active":"2023-10-14T12:30:34.333849+0000","last_became_peered":"2023-10-14T12:30:34.333849+0000","last_unstale":"2023-10-14T12:30:35.336347+0000","last_undegraded":"2023-10-14T12:30:35.336347+0000","last_fullsized":"2023-10-14T12:30:35.336347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:06.829396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.323148+0000","last_change":"2023-10-14T12:30:33.329870+0000","last_active":"2023-10-14T12:30:34.323148+0000","last_peered":"2023-10-14T12:30:34.323148+0000","last_clean":"2023-10-14T12:30:34.323148+0000","last_became_active":"2023-10-14T12:30:33.328179+0000","last_became_peered":"2023-10-14T12:30:33.328179+0000","last_unstale":"2023-10-14T12:30:34.323148+0000","last_undegraded":"2023-10-14T12:30:34.323148+0000","last_fullsized":"2023-10-14T12:30:34.323148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:31.238402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642638+0000","last_change":"2023-10-14T12:30:34.341041+0000","last_active":"2023-10-14T12:30:35.642638+0000","last_peered":"2023-10-14T12:30:35.642638+0000","last_clean":"2023-10-14T12:30:35.642638+0000","last_became_active":"2023-10-14T12:30:34.340754+0000","last_became_peered":"2023-10-14T12:30:34.340754+0000","last_unstale":"2023-10-14T12:30:35.642638+0000","last_undegraded":"2023-10-14T12:30:35.642638+0000","last_fullsized":"2023-10-14T12:30:35.642638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.360564+0000","last_change":"2023-10-14T12:30:33.335354+0000","last_active":"2023-10-14T12:30:34.360564+0000","last_peered":"2023-10-14T12:30:34.360564+0000","last_clean":"2023-10-14T12:30:34.360564+0000","last_became_active":"2023-10-14T12:30:33.334729+0000","last_became_peered":"2023-10-14T12:30:33.334729+0000","last_unstale":"2023-10-14T12:30:34.360564+0000","last_undegraded":"2023-10-14T12:30:34.360564+0000","last_fullsized":"2023-10-14T12:30:34.360564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:42.015187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642514+0000","last_change":"2023-10-14T12:30:34.344478+0000","last_active":"2023-10-14T12:30:35.642514+0000","last_peered":"2023-10-14T12:30:35.642514+0000","last_clean":"2023-10-14T12:30:35.642514+0000","last_became_active":"2023-10-14T12:30:34.344186+0000","last_became_peered":"2023-10-14T12:30:34.344186+0000","last_unstale":"2023-10-14T12:30:35.642514+0000","last_undegraded":"2023-10-14T12:30:35.642514+0000","last_fullsized":"2023-10-14T12:30:35.642514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410290+0000","last_change":"2023-10-14T12:30:33.332845+0000","last_active":"2023-10-14T12:30:35.410290+0000","last_peered":"2023-10-14T12:30:35.410290+0000","last_clean":"2023-10-14T12:30:35.410290+0000","last_became_active":"2023-10-14T12:30:33.332542+0000","last_became_peered":"2023-10-14T12:30:33.332542+0000","last_unstale":"2023-10-14T12:30:35.410290+0000","last_undegraded":"2023-10-14T12:30:35.410290+0000","last_fullsized":"2023-10-14T12:30:35.410290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:31.735498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336653+0000","last_change":"2023-10-14T12:30:34.326040+0000","last_active":"2023-10-14T12:30:35.336653+0000","last_peered":"2023-10-14T12:30:35.336653+0000","last_clean":"2023-10-14T12:30:35.336653+0000","last_became_active":"2023-10-14T12:30:34.325727+0000","last_became_peered":"2023-10-14T12:30:34.325727+0000","last_unstale":"2023-10-14T12:30:35.336653+0000","last_undegraded":"2023-10-14T12:30:35.336653+0000","last_fullsized":"2023-10-14T12:30:35.336653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:00.187156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.328527+0000","last_change":"2023-10-14T12:30:33.324071+0000","last_active":"2023-10-14T12:30:34.328527+0000","last_peered":"2023-10-14T12:30:34.328527+0000","last_clean":"2023-10-14T12:30:34.328527+0000","last_became_active":"2023-10-14T12:30:33.323094+0000","last_became_peered":"2023-10-14T12:30:33.323094+0000","last_unstale":"2023-10-14T12:30:34.328527+0000","last_undegraded":"2023-10-14T12:30:34.328527+0000","last_fullsized":"2023-10-14T12:30:34.328527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:37.737804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641010+0000","last_change":"2023-10-14T12:30:34.332515+0000","last_active":"2023-10-14T12:30:35.641010+0000","last_peered":"2023-10-14T12:30:35.641010+0000","last_clean":"2023-10-14T12:30:35.641010+0000","last_became_active":"2023-10-14T12:30:34.332238+0000","last_became_peered":"2023-10-14T12:30:34.332238+0000","last_unstale":"2023-10-14T12:30:35.641010+0000","last_undegraded":"2023-10-14T12:30:35.641010+0000","last_fullsized":"2023-10-14T12:30:35.641010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:47.296104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.330083+0000","last_change":"2023-10-14T12:30:33.326955+0000","last_active":"2023-10-14T12:30:34.330083+0000","last_peered":"2023-10-14T12:30:34.330083+0000","last_clean":"2023-10-14T12:30:34.330083+0000","last_became_active":"2023-10-14T12:30:33.326641+0000","last_became_peered":"2023-10-14T12:30:33.326641+0000","last_unstale":"2023-10-14T12:30:34.330083+0000","last_undegraded":"2023-10-14T12:30:34.330083+0000","last_fullsized":"2023-10-14T12:30:34.330083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:06.451441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642148+0000","last_change":"2023-10-14T12:30:34.337150+0000","last_active":"2023-10-14T12:30:35.642148+0000","last_peered":"2023-10-14T12:30:35.642148+0000","last_clean":"2023-10-14T12:30:35.642148+0000","last_became_active":"2023-10-14T12:30:34.336587+0000","last_became_peered":"2023-10-14T12:30:34.336587+0000","last_unstale":"2023-10-14T12:30:35.642148+0000","last_undegraded":"2023-10-14T12:30:35.642148+0000","last_fullsized":"2023-10-14T12:30:35.642148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:50.421016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.307375+0000","last_change":"2023-10-14T12:30:33.324592+0000","last_active":"2023-10-14T12:30:34.307375+0000","last_peered":"2023-10-14T12:30:34.307375+0000","last_clean":"2023-10-14T12:30:34.307375+0000","last_became_active":"2023-10-14T12:30:33.324291+0000","last_became_peered":"2023-10-14T12:30:33.324291+0000","last_unstale":"2023-10-14T12:30:34.307375+0000","last_undegraded":"2023-10-14T12:30:34.307375+0000","last_fullsized":"2023-10-14T12:30:34.307375+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339476+0000","last_change":"2023-10-14T12:30:34.336051+0000","last_active":"2023-10-14T12:30:35.339476+0000","last_peered":"2023-10-14T12:30:35.339476+0000","last_clean":"2023-10-14T12:30:35.339476+0000","last_became_active":"2023-10-14T12:30:34.335577+0000","last_became_peered":"2023-10-14T12:30:34.335577+0000","last_unstale":"2023-10-14T12:30:35.339476+0000","last_undegraded":"2023-10-14T12:30:35.339476+0000","last_fullsized":"2023-10-14T12:30:35.339476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.314696+0000","last_change":"2023-10-14T12:30:33.327237+0000","last_active":"2023-10-14T12:30:34.314696+0000","last_peered":"2023-10-14T12:30:34.314696+0000","last_clean":"2023-10-14T12:30:34.314696+0000","last_became_active":"2023-10-14T12:30:33.324300+0000","last_became_peered":"2023-10-14T12:30:33.324300+0000","last_unstale":"2023-10-14T12:30:34.314696+0000","last_undegraded":"2023-10-14T12:30:34.314696+0000","last_fullsized":"2023-10-14T12:30:34.314696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.643321+0000","last_change":"2023-10-14T12:30:34.348604+0000","last_active":"2023-10-14T12:30:35.643321+0000","last_peered":"2023-10-14T12:30:35.643321+0000","last_clean":"2023-10-14T12:30:35.643321+0000","last_became_active":"2023-10-14T12:30:34.348038+0000","last_became_peered":"2023-10-14T12:30:34.348038+0000","last_unstale":"2023-10-14T12:30:35.643321+0000","last_undegraded":"2023-10-14T12:30:35.643321+0000","last_fullsized":"2023-10-14T12:30:35.643321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.305160+0000","last_change":"2023-10-14T12:30:33.320974+0000","last_active":"2023-10-14T12:30:34.305160+0000","last_peered":"2023-10-14T12:30:34.305160+0000","last_clean":"2023-10-14T12:30:34.305160+0000","last_became_active":"2023-10-14T12:30:33.320705+0000","last_became_peered":"2023-10-14T12:30:33.320705+0000","last_unstale":"2023-10-14T12:30:34.305160+0000","last_undegraded":"2023-10-14T12:30:34.305160+0000","last_fullsized":"2023-10-14T12:30:34.305160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:52.984601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.341685+0000","last_change":"2023-10-14T12:30:34.352591+0000","last_active":"2023-10-14T12:30:35.341685+0000","last_peered":"2023-10-14T12:30:35.341685+0000","last_clean":"2023-10-14T12:30:35.341685+0000","last_became_active":"2023-10-14T12:30:34.352190+0000","last_became_peered":"2023-10-14T12:30:34.352190+0000","last_unstale":"2023-10-14T12:30:35.341685+0000","last_undegraded":"2023-10-14T12:30:35.341685+0000","last_fullsized":"2023-10-14T12:30:35.341685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:28.730425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.326107+0000","last_change":"2023-10-14T12:30:33.329384+0000","last_active":"2023-10-14T12:30:34.326107+0000","last_peered":"2023-10-14T12:30:34.326107+0000","last_clean":"2023-10-14T12:30:34.326107+0000","last_became_active":"2023-10-14T12:30:33.328937+0000","last_became_peered":"2023-10-14T12:30:33.328937+0000","last_unstale":"2023-10-14T12:30:34.326107+0000","last_undegraded":"2023-10-14T12:30:34.326107+0000","last_fullsized":"2023-10-14T12:30:34.326107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.319081+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:30:34.319081+0000","last_peered":"2023-10-14T12:30:34.319081+0000","last_clean":"2023-10-14T12:30:34.319081+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:30:34.319081+0000","last_undegraded":"2023-10-14T12:30:34.319081+0000","last_fullsized":"2023-10-14T12:30:34.319081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":796263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.264},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.91100000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1040000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.2210000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.651},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.498}]},{"osd":6,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.3540000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":204795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.474},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.77200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.234},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.1539999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.04}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.085},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.597}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3440000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":204325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1819999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.997}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.107},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.141}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.6360000000000001,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":1.367},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.325}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.53},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.494}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.571},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.7350000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":204817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.6599999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.387}]},{"osd":2,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.23}]},{"osd":3,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.995},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.28}]},{"osd":5,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.4339999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.605},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.629}]},{"osd":7,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.77},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.716}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":205859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.266},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.94599999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1339999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.218},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.84699999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.2030000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.419},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3109999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.7390000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.657},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.5469999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":204283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.306}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.1160000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.357},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.206}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.583},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.2529999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.825},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.5429999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.8},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.921}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":204303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.755}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1890000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.4900000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":1.3420000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.27},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.595}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.659},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.4279999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":794615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.379},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.496}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.2930000000000001,"5min":5.2930000000000001,"15min":5.2930000000000001},"last":0.442},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.363},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.94599999999999995}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.147}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.998}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.018}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:30:40.255 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-14T12:30:40.432 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:30:40.440 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:30:40.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.516+0000 7f2918221640 1 Processor -- start 2023-10-14T12:30:40.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.516+0000 7f2918221640 1 -- start start 2023-10-14T12:30:40.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f2918221640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29100af960 0x7f29100d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f2918221640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29100cfee0 con 0x7f291015ce00 2023-10-14T12:30:40.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f2918221640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29100cf680 con 0x7f29100cd730 2023-10-14T12:30:40.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f2918221640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29100cf920 con 0x7f29100af960 2023-10-14T12:30:40.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f2915fbd640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f291015ce00 0x7f29100cd020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:55994/0 (socket says 172.21.15.64:55994) 2023-10-14T12:30:40.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f2915fbd640 1 -- 172.21.15.64:0/2604762889 learned_addr learned my addr 172.21.15.64:0/2604762889 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:40.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f29167be640 1 --2- 172.21.15.64:0/2604762889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29100af960 0x7f29100d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:40.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.518+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2323080825 0 0) 0x7f29100cfee0 con 0x7f291015ce00 2023-10-14T12:30:40.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.519+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28fc003520 con 0x7f291015ce00 2023-10-14T12:30:40.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.519+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3205509216 0 0) 0x7f29100cf680 con 0x7f29100cd730 2023-10-14T12:30:40.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.519+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29100cfee0 con 0x7f29100cd730 2023-10-14T12:30:40.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.519+0000 7f29167be640 1 -- 172.21.15.64:0/2604762889 >> v1:172.21.15.177:6789/0 conn(0x7f29100cd730 legacy=0x7f29100cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.519+0000 7f29167be640 1 -- 172.21.15.64:0/2604762889 >> v1:172.21.15.64:6789/0 conn(0x7f291015ce00 legacy=0x7f29100cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.519+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 82703443 0 0) 0x7f28fc003520 con 0x7f291015ce00 2023-10-14T12:30:40.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.519+0000 7f29167be640 1 -- 172.21.15.64:0/2604762889 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100cfc00 con 0x7f29100af960 2023-10-14T12:30:40.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.520+0000 7f29167be640 1 --2- 172.21.15.64:0/2604762889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29100af960 0x7f29100d12c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2908009dc0 tx=0x7f290802bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a28cd1b50c27410 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:40.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c001670 con 0x7f29100af960 2023-10-14T12:30:40.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290802c880 con 0x7f29100af960 2023-10-14T12:30:40.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2914fbb640 1 -- 172.21.15.64:0/2604762889 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290802cc10 con 0x7f29100af960 2023-10-14T12:30:40.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2918221640 1 -- 172.21.15.64:0/2604762889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29100af960 msgr2=0x7f29100d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2918221640 1 --2- 172.21.15.64:0/2604762889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29100af960 0x7f29100d12c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2908009dc0 tx=0x7f290802bd50 comp rx=0 tx=0).stop 2023-10-14T12:30:40.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2918221640 1 -- 172.21.15.64:0/2604762889 shutdown_connections 2023-10-14T12:30:40.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2918221640 1 --2- 172.21.15.64:0/2604762889 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f29100af960 0x7f29100d12c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.521+0000 7f2918221640 1 -- 172.21.15.64:0/2604762889 >> 172.21.15.64:0/2604762889 conn(0x7f29100d07a0 msgr2=0x7f29100d0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:40.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.522+0000 7f2918221640 1 -- 172.21.15.64:0/2604762889 shutdown_connections 2023-10-14T12:30:40.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.522+0000 7f2918221640 1 -- 172.21.15.64:0/2604762889 wait complete. 2023-10-14T12:30:40.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.523+0000 7f2918221640 1 Processor -- start 2023-10-14T12:30:40.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.523+0000 7f2918221640 1 -- start start 2023-10-14T12:30:40.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.524+0000 7f2918221640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29100af960 0x7f29100c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.524+0000 7f2918221640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29100cd730 0x7f29100ca3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.524+0000 7f2918221640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f291015ce00 0x7f29101f5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.524+0000 7f2918221640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29100b3ae0 con 0x7f29100af960 2023-10-14T12:30:40.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.524+0000 7f2918221640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29100c8ea0 con 0x7f29100cd730 2023-10-14T12:30:40.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.524+0000 7f2918221640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29100c9870 con 0x7f291015ce00 2023-10-14T12:30:40.530 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29100af960 0x7f29100c9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:40.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29100af960 0x7f29100c9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52104/0 (socket says 172.21.15.64:52104) 2023-10-14T12:30:40.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 -- 172.21.15.64:0/871955807 learned_addr learned my addr 172.21.15.64:0/871955807 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:40.531 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f29167be640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f291015ce00 0x7f29101f5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:40.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f29157bc640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29100cd730 0x7f29100ca3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:40.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 -- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f291015ce00 msgr2=0x7f29101f5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f291015ce00 0x7f29101f5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 -- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29100cd730 msgr2=0x7f29100ca3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.532 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29100cd730 0x7f29100ca3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f2915fbd640 1 -- 172.21.15.64:0/871955807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908009a70 con 0x7f29100af960 2023-10-14T12:30:40.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.525+0000 7f29157bc640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29100cd730 0x7f29100ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:40.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.526+0000 7f2915fbd640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29100af960 0x7f29100c9330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c780 tx=0x7f290c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:40.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.526+0000 7f29067fc640 1 -- 172.21.15.64:0/871955807 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c005ce0 con 0x7f29100af960 2023-10-14T12:30:40.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.526+0000 7f29067fc640 1 -- 172.21.15.64:0/871955807 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f290c005e40 con 0x7f29100af960 2023-10-14T12:30:40.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.526+0000 7f29067fc640 1 -- 172.21.15.64:0/871955807 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f290c0072b0 con 0x7f29100af960 2023-10-14T12:30:40.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.526+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29100b3520 con 0x7f29100af960 2023-10-14T12:30:40.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.526+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29100c8b30 con 0x7f29100af960 2023-10-14T12:30:40.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.527+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29100c8990 con 0x7f29100af960 2023-10-14T12:30:40.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.528+0000 7f29067fc640 1 -- 172.21.15.64:0/871955807 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f290c007410 con 0x7f29100af960 2023-10-14T12:30:40.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.530+0000 7f29067fc640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28f406ae70 0x7f28f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:40.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.530+0000 7f29067fc640 1 -- 172.21.15.64:0/871955807 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f290c089510 con 0x7f29100af960 2023-10-14T12:30:40.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.530+0000 7f29157bc640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28f406ae70 0x7f28f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:40.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.531+0000 7f29157bc640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28f406ae70 0x7f28f406d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29100d14e0 tx=0x7f2900009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:40.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.534+0000 7f29067fc640 1 -- 172.21.15.64:0/871955807 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f29100c8990 con 0x7f29100af960 2023-10-14T12:30:40.799 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.797+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f29100c8990 con 0x7f29100af960 2023-10-14T12:30:40.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.798+0000 7f29067fc640 1 -- 172.21.15.64:0/871955807 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1012 (secure 0 0 0) 0x7f29100c8990 con 0x7f29100af960 2023-10-14T12:30:40.800 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:40.800 INFO:teuthology.orchestra.run.smithi064.stdout:{"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":134,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":41,"num_osds":8,"num_up_osds":8,"osd_up_since":1697286518,"num_in_osds":8,"osd_in_since":1697286510,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":226394112,"bytes_avail":772867719168,"bytes_total":773094113280,"write_bytes_sec":2214,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":18,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5457}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-14T12:29:51.750687+0000","services":{}},"progress_events":{}} 2023-10-14T12:30:40.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28f406ae70 msgr2=0x7f28f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28f406ae70 0x7f28f406d330 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f29100d14e0 tx=0x7f2900009040 comp rx=0 tx=0).stop 2023-10-14T12:30:40.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29100af960 msgr2=0x7f29100c9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:40.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29100af960 0x7f29100c9330 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f290c00c780 tx=0x7f290c00cc40 comp rx=0 tx=0).stop 2023-10-14T12:30:40.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 shutdown_connections 2023-10-14T12:30:40.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f28f406ae70 0x7f28f406d330 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f291015ce00 0x7f29101f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f29100cd730 0x7f29100ca3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 --2- 172.21.15.64:0/871955807 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f29100af960 0x7f29100c9330 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:40.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 >> 172.21.15.64:0/871955807 conn(0x7f29100d07a0 msgr2=0x7f291015bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:40.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 shutdown_connections 2023-10-14T12:30:40.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:40.802+0000 7f2918221640 1 -- 172.21.15.64:0/871955807 wait complete. 2023-10-14T12:30:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-14T12:30:40.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:30:41.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.046+0000 7fdcf4d6e640 1 Processor -- start 2023-10-14T12:30:41.048 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.047+0000 7fdcf4d6e640 1 -- start start 2023-10-14T12:30:41.049 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.048+0000 7fdcf4d6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 0x7fdcf00c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.048+0000 7fdcf4d6e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf015acb0 con 0x7fdcf00ca660 2023-10-14T12:30:41.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.048+0000 7fdcf4d6e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcf00c1c60 con 0x7fdcf015a8d0 2023-10-14T12:30:41.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.048+0000 7fdcf4d6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf015e350 con 0x7fdcf00cb250 2023-10-14T12:30:41.050 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.048+0000 7fdceffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdcf00ca660 0x7fdcf00c9350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:56002/0 (socket says 172.21.15.64:56002) 2023-10-14T12:30:41.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.048+0000 7fdceffff640 1 -- 172.21.15.64:0/1740729233 learned_addr learned my addr 172.21.15.64:0/1740729233 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:41.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdceeffd640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 0x7fdcf00c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3006156624 0 0) 0x7fdce8001110 con 0x7fdcf00ca660 2023-10-14T12:30:41.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcdc003520 con 0x7fdcf00ca660 2023-10-14T12:30:41.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2611069609 0 0) 0x7fdcdc003520 con 0x7fdcf00ca660 2023-10-14T12:30:41.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 msgr2=0x7fdcf00c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:41.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 0x7fdcf00c8e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 >> v1:172.21.15.177:6789/0 conn(0x7fdcf015a8d0 legacy=0x7fdcf00cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:41.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf015e630 con 0x7fdcf00ca660 2023-10-14T12:30:41.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fdce8001800 con 0x7fdcf00ca660 2023-10-14T12:30:41.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 >> v1:172.21.15.64:6789/0 conn(0x7fdcf00ca660 legacy=0x7fdcf00c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:41.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 0x7fdcdc0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcdc003f70 0x7fdcdc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcdc004d00 0x7fdcdc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf015e350 con 0x7fdcdc004d00 2023-10-14T12:30:41.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc00bac0 con 0x7fdcdc003f70 2023-10-14T12:30:41.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.049+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc00bc80 con 0x7fdcf00cb250 2023-10-14T12:30:41.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdceffff640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcdc004d00 0x7fdcdc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdcef7fe640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 0x7fdcdc0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdceeffd640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcdc003f70 0x7fdcdc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdceffff640 1 -- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 msgr2=0x7fdcdc0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:41.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdceffff640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcf00cb250 0x7fdcdc0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdceffff640 1 -- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcdc003f70 msgr2=0x7fdcdc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:41.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdceffff640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcdc003f70 0x7fdcdc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.050+0000 7fdceffff640 1 -- 172.21.15.64:0/1740729233 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc003520 con 0x7fdcdc004d00 2023-10-14T12:30:41.059 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.051+0000 7fdceffff640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcdc004d00 0x7fdcdc005180 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00caaf0 tx=0x7fdcdc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f106a354118236c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:41.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.051+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce8005ad0 con 0x7fdcdc004d00 2023-10-14T12:30:41.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.051+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdce8005c50 con 0x7fdcdc004d00 2023-10-14T12:30:41.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.051+0000 7fdcee7fc640 1 -- 172.21.15.64:0/1740729233 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce802c7c0 con 0x7fdcdc004d00 2023-10-14T12:30:41.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.052+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/1740729233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcdc004d00 msgr2=0x7fdcdc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:41.060 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.052+0000 7fdcf4d6e640 1 --2- 172.21.15.64:0/1740729233 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcdc004d00 0x7fdcdc005180 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fdcf00caaf0 tx=0x7fdcdc0057f0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.052+0000 7fdceffff640 1 -- 172.21.15.64:0/1740729233 reap_dead start 2023-10-14T12:30:41.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.052+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/1740729233 shutdown_connections 2023-10-14T12:30:41.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.052+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/1740729233 >> 172.21.15.64:0/1740729233 conn(0x7fdcf006a470 msgr2=0x7fdcf00afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:41.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.052+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/1740729233 shutdown_connections 2023-10-14T12:30:41.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.052+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/1740729233 wait complete. 2023-10-14T12:30:41.061 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.054+0000 7fdcf4d6e640 1 Processor -- start 2023-10-14T12:30:41.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.054+0000 7fdcf4d6e640 1 -- start start 2023-10-14T12:30:41.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdcf4d6e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcdc004d00 0x7fdcf00c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdcf4d6e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcf01f3340 0x7fdcf015cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdcf4d6e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf00af8a0 0x7fdcf00afd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.062 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdcf4d6e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00c2280 con 0x7fdcf01f3340 2023-10-14T12:30:41.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdcf4d6e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf00c6390 con 0x7fdcf00af8a0 2023-10-14T12:30:41.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdcf4d6e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf01f5c50 con 0x7fdcdc004d00 2023-10-14T12:30:41.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdceeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcf01f3340 0x7fdcf015cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdceeffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcf01f3340 0x7fdcf015cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52118/0 (socket says 172.21.15.64:52118) 2023-10-14T12:30:41.063 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.055+0000 7fdceeffd640 1 -- 172.21.15.64:0/953627532 learned_addr learned my addr 172.21.15.64:0/953627532 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:41.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdceffff640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf00af8a0 0x7fdcf00afd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdcef7fe640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcdc004d00 0x7fdcf00c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdceeffd640 1 -- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcdc004d00 msgr2=0x7fdcf00c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:41.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdceeffd640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcdc004d00 0x7fdcf00c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdceeffd640 1 -- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf00af8a0 msgr2=0x7fdcf00afd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:41.064 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdceeffd640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf00af8a0 0x7fdcf00afd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdceeffd640 1 -- 172.21.15.64:0/953627532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf01f5f30 con 0x7fdcf01f3340 2023-10-14T12:30:41.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.056+0000 7fdceeffd640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcf01f3340 0x7fdcf015cbd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8011630 tx=0x7fdcd8011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:41.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.057+0000 7fdce7fff640 1 -- 172.21.15.64:0/953627532 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800f920 con 0x7fdcf01f3340 2023-10-14T12:30:41.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.057+0000 7fdce7fff640 1 -- 172.21.15.64:0/953627532 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd800fa80 con 0x7fdcf01f3340 2023-10-14T12:30:41.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.057+0000 7fdce7fff640 1 -- 172.21.15.64:0/953627532 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcd800fdf0 con 0x7fdcf01f3340 2023-10-14T12:30:41.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.057+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf01f6210 con 0x7fdcf01f3340 2023-10-14T12:30:41.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.057+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf00c4070 con 0x7fdcf01f3340 2023-10-14T12:30:41.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.058+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf015ebd0 con 0x7fdcf01f3340 2023-10-14T12:30:41.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.059+0000 7fdce7fff640 1 -- 172.21.15.64:0/953627532 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdcd8015460 con 0x7fdcf01f3340 2023-10-14T12:30:41.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.060+0000 7fdce7fff640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdcd006aea0 0x7fdcd006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:41.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.060+0000 7fdce7fff640 1 -- 172.21.15.64:0/953627532 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fdcd8089ca0 con 0x7fdcf01f3340 2023-10-14T12:30:41.067 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.060+0000 7fdcef7fe640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdcd006aea0 0x7fdcd006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:41.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.061+0000 7fdcef7fe640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdcd006aea0 0x7fdcd006d360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdce0005290 tx=0x7fdce0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:41.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.064+0000 7fdce7fff640 1 -- 172.21.15.64:0/953627532 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdcf015ebd0 con 0x7fdcf01f3340 2023-10-14T12:30:41.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.250+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcf015e910 con 0x7fdcd006aea0 2023-10-14T12:30:41.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.261+0000 7fdce7fff640 1 -- 172.21.15.64:0/953627532 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286966 (secure 0 0 0) 0x7fdce0005870 con 0x7fdcd006aea0 2023-10-14T12:30:41.265 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:41.269 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:30:41.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdcd006aea0 msgr2=0x7fdcd006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:41.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdcd006aea0 0x7fdcd006d360 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fdce0005290 tx=0x7fdce0009040 comp rx=0 tx=0).stop 2023-10-14T12:30:41.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcf01f3340 msgr2=0x7fdcf015cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:41.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcf01f3340 0x7fdcf015cbd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8011630 tx=0x7fdcd8011af0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 shutdown_connections 2023-10-14T12:30:41.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdcd006aea0 0x7fdcd006d360 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.271 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdcf00af8a0 0x7fdcf00afd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdcf01f3340 0x7fdcf015cbd0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 --2- 172.21.15.64:0/953627532 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdcdc004d00 0x7fdcf00c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:41.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 >> 172.21.15.64:0/953627532 conn(0x7fdcf006a470 msgr2=0x7fdcf006bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:41.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 shutdown_connections 2023-10-14T12:30:41.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:41.268+0000 7fdcf4d6e640 1 -- 172.21.15.64:0/953627532 wait complete. 2023-10-14T12:30:41.289 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2023-10-14T12:30:39.767794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221088,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5021696,"data_stored":2819260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.472375"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336705+0000","last_change":"2023-10-14T12:30:34.349268+0000","last_active":"2023-10-14T12:30:35.336705+0000","last_peered":"2023-10-14T12:30:35.336705+0000","last_clean":"2023-10-14T12:30:35.336705+0000","last_became_active":"2023-10-14T12:30:34.348914+0000","last_became_peered":"2023-10-14T12:30:34.348914+0000","last_unstale":"2023-10-14T12:30:35.336705+0000","last_undegraded":"2023-10-14T12:30:35.336705+0000","last_fullsized":"2023-10-14T12:30:35.336705+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:42:50.006654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336576+0000","last_change":"2023-10-14T12:30:34.344887+0000","last_active":"2023-10-14T12:30:35.336576+0000","last_peered":"2023-10-14T12:30:35.336576+0000","last_clean":"2023-10-14T12:30:35.336576+0000","last_became_active":"2023-10-14T12:30:34.344581+0000","last_became_peered":"2023-10-14T12:30:34.344581+0000","last_unstale":"2023-10-14T12:30:35.336576+0000","last_undegraded":"2023-10-14T12:30:35.336576+0000","last_fullsized":"2023-10-14T12:30:35.336576+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:28.730425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640947+0000","last_change":"2023-10-14T12:30:34.343503+0000","last_active":"2023-10-14T12:30:35.640947+0000","last_peered":"2023-10-14T12:30:35.640947+0000","last_clean":"2023-10-14T12:30:35.640947+0000","last_became_active":"2023-10-14T12:30:34.343221+0000","last_became_peered":"2023-10-14T12:30:34.343221+0000","last_unstale":"2023-10-14T12:30:35.640947+0000","last_undegraded":"2023-10-14T12:30:35.640947+0000","last_fullsized":"2023-10-14T12:30:35.640947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:37.840864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410105+0000","last_change":"2023-10-14T12:30:34.343025+0000","last_active":"2023-10-14T12:30:35.410105+0000","last_peered":"2023-10-14T12:30:35.410105+0000","last_clean":"2023-10-14T12:30:35.410105+0000","last_became_active":"2023-10-14T12:30:34.342733+0000","last_became_peered":"2023-10-14T12:30:34.342733+0000","last_unstale":"2023-10-14T12:30:35.410105+0000","last_undegraded":"2023-10-14T12:30:35.410105+0000","last_fullsized":"2023-10-14T12:30:35.410105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:15.005093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.409587+0000","last_change":"2023-10-14T12:30:34.332160+0000","last_active":"2023-10-14T12:30:35.409587+0000","last_peered":"2023-10-14T12:30:35.409587+0000","last_clean":"2023-10-14T12:30:35.409587+0000","last_became_active":"2023-10-14T12:30:34.331843+0000","last_became_peered":"2023-10-14T12:30:34.331843+0000","last_unstale":"2023-10-14T12:30:35.409587+0000","last_undegraded":"2023-10-14T12:30:35.409587+0000","last_fullsized":"2023-10-14T12:30:35.409587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:46.492583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642095+0000","last_change":"2023-10-14T12:30:34.345669+0000","last_active":"2023-10-14T12:30:35.642095+0000","last_peered":"2023-10-14T12:30:35.642095+0000","last_clean":"2023-10-14T12:30:35.642095+0000","last_became_active":"2023-10-14T12:30:34.345165+0000","last_became_peered":"2023-10-14T12:30:34.345165+0000","last_unstale":"2023-10-14T12:30:35.642095+0000","last_undegraded":"2023-10-14T12:30:35.642095+0000","last_fullsized":"2023-10-14T12:30:35.642095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:53.997776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338165+0000","last_change":"2023-10-14T12:30:34.341127+0000","last_active":"2023-10-14T12:30:35.338165+0000","last_peered":"2023-10-14T12:30:35.338165+0000","last_clean":"2023-10-14T12:30:35.338165+0000","last_became_active":"2023-10-14T12:30:34.338798+0000","last_became_peered":"2023-10-14T12:30:34.338798+0000","last_unstale":"2023-10-14T12:30:35.338165+0000","last_undegraded":"2023-10-14T12:30:35.338165+0000","last_fullsized":"2023-10-14T12:30:35.338165+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:10:19.127848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.335883+0000","last_change":"2023-10-14T12:30:34.334706+0000","last_active":"2023-10-14T12:30:35.335883+0000","last_peered":"2023-10-14T12:30:35.335883+0000","last_clean":"2023-10-14T12:30:35.335883+0000","last_became_active":"2023-10-14T12:30:34.333742+0000","last_became_peered":"2023-10-14T12:30:34.333742+0000","last_unstale":"2023-10-14T12:30:35.335883+0000","last_undegraded":"2023-10-14T12:30:35.335883+0000","last_fullsized":"2023-10-14T12:30:35.335883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641307+0000","last_change":"2023-10-14T12:30:34.347717+0000","last_active":"2023-10-14T12:30:35.641307+0000","last_peered":"2023-10-14T12:30:35.641307+0000","last_clean":"2023-10-14T12:30:35.641307+0000","last_became_active":"2023-10-14T12:30:34.347287+0000","last_became_peered":"2023-10-14T12:30:34.347287+0000","last_unstale":"2023-10-14T12:30:35.641307+0000","last_undegraded":"2023-10-14T12:30:35.641307+0000","last_fullsized":"2023-10-14T12:30:35.641307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:16:40.404130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340931+0000","last_change":"2023-10-14T12:30:34.342074+0000","last_active":"2023-10-14T12:30:35.340931+0000","last_peered":"2023-10-14T12:30:35.340931+0000","last_clean":"2023-10-14T12:30:35.340931+0000","last_became_active":"2023-10-14T12:30:34.341599+0000","last_became_peered":"2023-10-14T12:30:34.341599+0000","last_unstale":"2023-10-14T12:30:35.340931+0000","last_undegraded":"2023-10-14T12:30:35.340931+0000","last_fullsized":"2023-10-14T12:30:35.340931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:32.399607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340290+0000","last_change":"2023-10-14T12:30:34.347356+0000","last_active":"2023-10-14T12:30:35.340290+0000","last_peered":"2023-10-14T12:30:35.340290+0000","last_clean":"2023-10-14T12:30:35.340290+0000","last_became_active":"2023-10-14T12:30:34.346962+0000","last_became_peered":"2023-10-14T12:30:34.346962+0000","last_unstale":"2023-10-14T12:30:35.340290+0000","last_undegraded":"2023-10-14T12:30:35.340290+0000","last_fullsized":"2023-10-14T12:30:35.340290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:08.458987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640987+0000","last_change":"2023-10-14T12:30:34.336929+0000","last_active":"2023-10-14T12:30:35.640987+0000","last_peered":"2023-10-14T12:30:35.640987+0000","last_clean":"2023-10-14T12:30:35.640987+0000","last_became_active":"2023-10-14T12:30:34.336490+0000","last_became_peered":"2023-10-14T12:30:34.336490+0000","last_unstale":"2023-10-14T12:30:35.640987+0000","last_undegraded":"2023-10-14T12:30:35.640987+0000","last_fullsized":"2023-10-14T12:30:35.640987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:08.803544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338763+0000","last_change":"2023-10-14T12:30:34.336286+0000","last_active":"2023-10-14T12:30:35.338763+0000","last_peered":"2023-10-14T12:30:35.338763+0000","last_clean":"2023-10-14T12:30:35.338763+0000","last_became_active":"2023-10-14T12:30:34.335211+0000","last_became_peered":"2023-10-14T12:30:34.335211+0000","last_unstale":"2023-10-14T12:30:35.338763+0000","last_undegraded":"2023-10-14T12:30:35.338763+0000","last_fullsized":"2023-10-14T12:30:35.338763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339098+0000","last_change":"2023-10-14T12:30:34.333675+0000","last_active":"2023-10-14T12:30:35.339098+0000","last_peered":"2023-10-14T12:30:35.339098+0000","last_clean":"2023-10-14T12:30:35.339098+0000","last_became_active":"2023-10-14T12:30:34.332753+0000","last_became_peered":"2023-10-14T12:30:34.332753+0000","last_unstale":"2023-10-14T12:30:35.339098+0000","last_undegraded":"2023-10-14T12:30:35.339098+0000","last_fullsized":"2023-10-14T12:30:35.339098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:50.421016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.337542+0000","last_change":"2023-10-14T12:30:34.344954+0000","last_active":"2023-10-14T12:30:35.337542+0000","last_peered":"2023-10-14T12:30:35.337542+0000","last_clean":"2023-10-14T12:30:35.337542+0000","last_became_active":"2023-10-14T12:30:34.344639+0000","last_became_peered":"2023-10-14T12:30:34.344639+0000","last_unstale":"2023-10-14T12:30:35.337542+0000","last_undegraded":"2023-10-14T12:30:35.337542+0000","last_fullsized":"2023-10-14T12:30:35.337542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642014+0000","last_change":"2023-10-14T12:30:34.333857+0000","last_active":"2023-10-14T12:30:35.642014+0000","last_peered":"2023-10-14T12:30:35.642014+0000","last_clean":"2023-10-14T12:30:35.642014+0000","last_became_active":"2023-10-14T12:30:34.333436+0000","last_became_peered":"2023-10-14T12:30:34.333436+0000","last_unstale":"2023-10-14T12:30:35.642014+0000","last_undegraded":"2023-10-14T12:30:35.642014+0000","last_fullsized":"2023-10-14T12:30:35.642014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.643013+0000","last_change":"2023-10-14T12:30:34.342238+0000","last_active":"2023-10-14T12:30:35.643013+0000","last_peered":"2023-10-14T12:30:35.643013+0000","last_clean":"2023-10-14T12:30:35.643013+0000","last_became_active":"2023-10-14T12:30:34.341929+0000","last_became_peered":"2023-10-14T12:30:34.341929+0000","last_unstale":"2023-10-14T12:30:35.643013+0000","last_undegraded":"2023-10-14T12:30:35.643013+0000","last_fullsized":"2023-10-14T12:30:35.643013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.343109+0000","last_change":"2023-10-14T12:30:34.324627+0000","last_active":"2023-10-14T12:30:35.343109+0000","last_peered":"2023-10-14T12:30:35.343109+0000","last_clean":"2023-10-14T12:30:35.343109+0000","last_became_active":"2023-10-14T12:30:34.323870+0000","last_became_peered":"2023-10-14T12:30:34.323870+0000","last_unstale":"2023-10-14T12:30:35.343109+0000","last_undegraded":"2023-10-14T12:30:35.343109+0000","last_fullsized":"2023-10-14T12:30:35.343109+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:23.313808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410445+0000","last_change":"2023-10-14T12:30:34.342657+0000","last_active":"2023-10-14T12:30:35.410445+0000","last_peered":"2023-10-14T12:30:35.410445+0000","last_clean":"2023-10-14T12:30:35.410445+0000","last_became_active":"2023-10-14T12:30:34.342316+0000","last_became_peered":"2023-10-14T12:30:34.342316+0000","last_unstale":"2023-10-14T12:30:35.410445+0000","last_undegraded":"2023-10-14T12:30:35.410445+0000","last_fullsized":"2023-10-14T12:30:35.410445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:53.909707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.341857+0000","last_change":"2023-10-14T12:30:34.321736+0000","last_active":"2023-10-14T12:30:35.341857+0000","last_peered":"2023-10-14T12:30:35.341857+0000","last_clean":"2023-10-14T12:30:35.341857+0000","last_became_active":"2023-10-14T12:30:34.321292+0000","last_became_peered":"2023-10-14T12:30:34.321292+0000","last_unstale":"2023-10-14T12:30:35.341857+0000","last_undegraded":"2023-10-14T12:30:35.341857+0000","last_fullsized":"2023-10-14T12:30:35.341857+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:32.309700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338754+0000","last_change":"2023-10-14T12:30:34.340531+0000","last_active":"2023-10-14T12:30:35.338754+0000","last_peered":"2023-10-14T12:30:35.338754+0000","last_clean":"2023-10-14T12:30:35.338754+0000","last_became_active":"2023-10-14T12:30:34.340192+0000","last_became_peered":"2023-10-14T12:30:34.340192+0000","last_unstale":"2023-10-14T12:30:35.338754+0000","last_undegraded":"2023-10-14T12:30:35.338754+0000","last_fullsized":"2023-10-14T12:30:35.338754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339946+0000","last_change":"2023-10-14T12:30:34.344178+0000","last_active":"2023-10-14T12:30:35.339946+0000","last_peered":"2023-10-14T12:30:35.339946+0000","last_clean":"2023-10-14T12:30:35.339946+0000","last_became_active":"2023-10-14T12:30:34.343864+0000","last_became_peered":"2023-10-14T12:30:34.343864+0000","last_unstale":"2023-10-14T12:30:35.339946+0000","last_undegraded":"2023-10-14T12:30:35.339946+0000","last_fullsized":"2023-10-14T12:30:35.339946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642013+0000","last_change":"2023-10-14T12:30:34.333294+0000","last_active":"2023-10-14T12:30:35.642013+0000","last_peered":"2023-10-14T12:30:35.642013+0000","last_clean":"2023-10-14T12:30:35.642013+0000","last_became_active":"2023-10-14T12:30:34.333013+0000","last_became_peered":"2023-10-14T12:30:34.333013+0000","last_unstale":"2023-10-14T12:30:35.642013+0000","last_undegraded":"2023-10-14T12:30:35.642013+0000","last_fullsized":"2023-10-14T12:30:35.642013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.409280+0000","last_change":"2023-10-14T12:30:34.328544+0000","last_active":"2023-10-14T12:30:35.409280+0000","last_peered":"2023-10-14T12:30:35.409280+0000","last_clean":"2023-10-14T12:30:35.409280+0000","last_became_active":"2023-10-14T12:30:34.328152+0000","last_became_peered":"2023-10-14T12:30:34.328152+0000","last_unstale":"2023-10-14T12:30:35.409280+0000","last_undegraded":"2023-10-14T12:30:35.409280+0000","last_fullsized":"2023-10-14T12:30:35.409280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:27.435308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.343131+0000","last_change":"2023-10-14T12:30:34.337418+0000","last_active":"2023-10-14T12:30:35.343131+0000","last_peered":"2023-10-14T12:30:35.343131+0000","last_clean":"2023-10-14T12:30:35.343131+0000","last_became_active":"2023-10-14T12:30:34.337024+0000","last_became_peered":"2023-10-14T12:30:34.337024+0000","last_unstale":"2023-10-14T12:30:35.343131+0000","last_undegraded":"2023-10-14T12:30:35.343131+0000","last_fullsized":"2023-10-14T12:30:35.343131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:16:49.094700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642634+0000","last_change":"2023-10-14T12:30:34.334473+0000","last_active":"2023-10-14T12:30:35.642634+0000","last_peered":"2023-10-14T12:30:35.642634+0000","last_clean":"2023-10-14T12:30:35.642634+0000","last_became_active":"2023-10-14T12:30:34.334145+0000","last_became_peered":"2023-10-14T12:30:34.334145+0000","last_unstale":"2023-10-14T12:30:35.642634+0000","last_undegraded":"2023-10-14T12:30:35.642634+0000","last_fullsized":"2023-10-14T12:30:35.642634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.342938+0000","last_change":"2023-10-14T12:30:34.337611+0000","last_active":"2023-10-14T12:30:35.342938+0000","last_peered":"2023-10-14T12:30:35.342938+0000","last_clean":"2023-10-14T12:30:35.342938+0000","last_became_active":"2023-10-14T12:30:34.336829+0000","last_became_peered":"2023-10-14T12:30:34.336829+0000","last_unstale":"2023-10-14T12:30:35.342938+0000","last_undegraded":"2023-10-14T12:30:35.342938+0000","last_fullsized":"2023-10-14T12:30:35.342938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:18.001820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339787+0000","last_change":"2023-10-14T12:30:34.339603+0000","last_active":"2023-10-14T12:30:35.339787+0000","last_peered":"2023-10-14T12:30:35.339787+0000","last_clean":"2023-10-14T12:30:35.339787+0000","last_became_active":"2023-10-14T12:30:34.339299+0000","last_became_peered":"2023-10-14T12:30:34.339299+0000","last_unstale":"2023-10-14T12:30:35.339787+0000","last_undegraded":"2023-10-14T12:30:35.339787+0000","last_fullsized":"2023-10-14T12:30:35.339787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:55:22.736621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.342499+0000","last_change":"2023-10-14T12:30:34.340774+0000","last_active":"2023-10-14T12:30:35.342499+0000","last_peered":"2023-10-14T12:30:35.342499+0000","last_clean":"2023-10-14T12:30:35.342499+0000","last_became_active":"2023-10-14T12:30:34.338070+0000","last_became_peered":"2023-10-14T12:30:34.338070+0000","last_unstale":"2023-10-14T12:30:35.342499+0000","last_undegraded":"2023-10-14T12:30:35.342499+0000","last_fullsized":"2023-10-14T12:30:35.342499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:18.794987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338246+0000","last_change":"2023-10-14T12:30:34.325514+0000","last_active":"2023-10-14T12:30:35.338246+0000","last_peered":"2023-10-14T12:30:35.338246+0000","last_clean":"2023-10-14T12:30:35.338246+0000","last_became_active":"2023-10-14T12:30:34.325040+0000","last_became_peered":"2023-10-14T12:30:34.325040+0000","last_unstale":"2023-10-14T12:30:35.338246+0000","last_undegraded":"2023-10-14T12:30:35.338246+0000","last_fullsized":"2023-10-14T12:30:35.338246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:57.942140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642219+0000","last_change":"2023-10-14T12:30:34.347217+0000","last_active":"2023-10-14T12:30:35.642219+0000","last_peered":"2023-10-14T12:30:35.642219+0000","last_clean":"2023-10-14T12:30:35.642219+0000","last_became_active":"2023-10-14T12:30:34.346911+0000","last_became_peered":"2023-10-14T12:30:34.346911+0000","last_unstale":"2023-10-14T12:30:35.642219+0000","last_undegraded":"2023-10-14T12:30:35.642219+0000","last_fullsized":"2023-10-14T12:30:35.642219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642955+0000","last_change":"2023-10-14T12:30:34.346749+0000","last_active":"2023-10-14T12:30:35.642955+0000","last_peered":"2023-10-14T12:30:35.642955+0000","last_clean":"2023-10-14T12:30:35.642955+0000","last_became_active":"2023-10-14T12:30:34.346457+0000","last_became_peered":"2023-10-14T12:30:34.346457+0000","last_unstale":"2023-10-14T12:30:35.642955+0000","last_undegraded":"2023-10-14T12:30:35.642955+0000","last_fullsized":"2023-10-14T12:30:35.642955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642953+0000","last_change":"2023-10-14T12:30:34.341761+0000","last_active":"2023-10-14T12:30:35.642953+0000","last_peered":"2023-10-14T12:30:35.642953+0000","last_clean":"2023-10-14T12:30:35.642953+0000","last_became_active":"2023-10-14T12:30:34.341455+0000","last_became_peered":"2023-10-14T12:30:34.341455+0000","last_unstale":"2023-10-14T12:30:35.642953+0000","last_undegraded":"2023-10-14T12:30:35.642953+0000","last_fullsized":"2023-10-14T12:30:35.642953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:10:19.127848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366288+0000","last_change":"2023-10-14T12:30:33.332554+0000","last_active":"2023-10-14T12:30:34.366288+0000","last_peered":"2023-10-14T12:30:34.366288+0000","last_clean":"2023-10-14T12:30:34.366288+0000","last_became_active":"2023-10-14T12:30:33.332275+0000","last_became_peered":"2023-10-14T12:30:33.332275+0000","last_unstale":"2023-10-14T12:30:34.366288+0000","last_undegraded":"2023-10-14T12:30:34.366288+0000","last_fullsized":"2023-10-14T12:30:34.366288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.033968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642514+0000","last_change":"2023-10-14T12:30:34.338766+0000","last_active":"2023-10-14T12:30:35.642514+0000","last_peered":"2023-10-14T12:30:35.642514+0000","last_clean":"2023-10-14T12:30:35.642514+0000","last_became_active":"2023-10-14T12:30:34.338433+0000","last_became_peered":"2023-10-14T12:30:34.338433+0000","last_unstale":"2023-10-14T12:30:35.642514+0000","last_undegraded":"2023-10-14T12:30:35.642514+0000","last_fullsized":"2023-10-14T12:30:35.642514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.354004+0000","last_change":"2023-10-14T12:30:33.326883+0000","last_active":"2023-10-14T12:30:34.354004+0000","last_peered":"2023-10-14T12:30:34.354004+0000","last_clean":"2023-10-14T12:30:34.354004+0000","last_became_active":"2023-10-14T12:30:33.326581+0000","last_became_peered":"2023-10-14T12:30:33.326581+0000","last_unstale":"2023-10-14T12:30:34.354004+0000","last_undegraded":"2023-10-14T12:30:34.354004+0000","last_fullsized":"2023-10-14T12:30:34.354004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:44.567204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340216+0000","last_change":"2023-10-14T12:30:34.336344+0000","last_active":"2023-10-14T12:30:35.340216+0000","last_peered":"2023-10-14T12:30:35.340216+0000","last_clean":"2023-10-14T12:30:35.340216+0000","last_became_active":"2023-10-14T12:30:34.334996+0000","last_became_peered":"2023-10-14T12:30:34.334996+0000","last_unstale":"2023-10-14T12:30:35.340216+0000","last_undegraded":"2023-10-14T12:30:35.340216+0000","last_fullsized":"2023-10-14T12:30:35.340216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.359680+0000","last_change":"2023-10-14T12:30:33.335259+0000","last_active":"2023-10-14T12:30:34.359680+0000","last_peered":"2023-10-14T12:30:34.359680+0000","last_clean":"2023-10-14T12:30:34.359680+0000","last_became_active":"2023-10-14T12:30:33.334954+0000","last_became_peered":"2023-10-14T12:30:33.334954+0000","last_unstale":"2023-10-14T12:30:34.359680+0000","last_undegraded":"2023-10-14T12:30:34.359680+0000","last_fullsized":"2023-10-14T12:30:34.359680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336704+0000","last_change":"2023-10-14T12:30:34.335691+0000","last_active":"2023-10-14T12:30:35.336704+0000","last_peered":"2023-10-14T12:30:35.336704+0000","last_clean":"2023-10-14T12:30:35.336704+0000","last_became_active":"2023-10-14T12:30:34.331967+0000","last_became_peered":"2023-10-14T12:30:34.331967+0000","last_unstale":"2023-10-14T12:30:35.336704+0000","last_undegraded":"2023-10-14T12:30:35.336704+0000","last_fullsized":"2023-10-14T12:30:35.336704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:51:00.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.352499+0000","last_change":"2023-10-14T12:30:33.331342+0000","last_active":"2023-10-14T12:30:34.352499+0000","last_peered":"2023-10-14T12:30:34.352499+0000","last_clean":"2023-10-14T12:30:34.352499+0000","last_became_active":"2023-10-14T12:30:33.331033+0000","last_became_peered":"2023-10-14T12:30:33.331033+0000","last_unstale":"2023-10-14T12:30:34.352499+0000","last_undegraded":"2023-10-14T12:30:34.352499+0000","last_fullsized":"2023-10-14T12:30:34.352499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:22.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640612+0000","last_change":"2023-10-14T12:30:34.340044+0000","last_active":"2023-10-14T12:30:35.640612+0000","last_peered":"2023-10-14T12:30:35.640612+0000","last_clean":"2023-10-14T12:30:35.640612+0000","last_became_active":"2023-10-14T12:30:34.339781+0000","last_became_peered":"2023-10-14T12:30:34.339781+0000","last_unstale":"2023-10-14T12:30:35.640612+0000","last_undegraded":"2023-10-14T12:30:35.640612+0000","last_fullsized":"2023-10-14T12:30:35.640612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:40.303123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.353622+0000","last_change":"2023-10-14T12:30:33.332976+0000","last_active":"2023-10-14T12:30:34.353622+0000","last_peered":"2023-10-14T12:30:34.353622+0000","last_clean":"2023-10-14T12:30:34.353622+0000","last_became_active":"2023-10-14T12:30:33.332092+0000","last_became_peered":"2023-10-14T12:30:33.332092+0000","last_unstale":"2023-10-14T12:30:34.353622+0000","last_undegraded":"2023-10-14T12:30:34.353622+0000","last_fullsized":"2023-10-14T12:30:34.353622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:16.163772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.337912+0000","last_change":"2023-10-14T12:30:34.342322+0000","last_active":"2023-10-14T12:30:35.337912+0000","last_peered":"2023-10-14T12:30:35.337912+0000","last_clean":"2023-10-14T12:30:35.337912+0000","last_became_active":"2023-10-14T12:30:34.341523+0000","last_became_peered":"2023-10-14T12:30:34.341523+0000","last_unstale":"2023-10-14T12:30:35.337912+0000","last_undegraded":"2023-10-14T12:30:35.337912+0000","last_fullsized":"2023-10-14T12:30:35.337912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361072+0000","last_change":"2023-10-14T12:30:33.336252+0000","last_active":"2023-10-14T12:30:34.361072+0000","last_peered":"2023-10-14T12:30:34.361072+0000","last_clean":"2023-10-14T12:30:34.361072+0000","last_became_active":"2023-10-14T12:30:33.335909+0000","last_became_peered":"2023-10-14T12:30:33.335909+0000","last_unstale":"2023-10-14T12:30:34.361072+0000","last_undegraded":"2023-10-14T12:30:34.361072+0000","last_fullsized":"2023-10-14T12:30:34.361072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340309+0000","last_change":"2023-10-14T12:30:34.335844+0000","last_active":"2023-10-14T12:30:35.340309+0000","last_peered":"2023-10-14T12:30:35.340309+0000","last_clean":"2023-10-14T12:30:35.340309+0000","last_became_active":"2023-10-14T12:30:34.335171+0000","last_became_peered":"2023-10-14T12:30:34.335171+0000","last_unstale":"2023-10-14T12:30:35.340309+0000","last_undegraded":"2023-10-14T12:30:35.340309+0000","last_fullsized":"2023-10-14T12:30:35.340309+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.322898+0000","last_change":"2023-10-14T12:30:33.332689+0000","last_active":"2023-10-14T12:30:34.322898+0000","last_peered":"2023-10-14T12:30:34.322898+0000","last_clean":"2023-10-14T12:30:34.322898+0000","last_became_active":"2023-10-14T12:30:33.332347+0000","last_became_peered":"2023-10-14T12:30:33.332347+0000","last_unstale":"2023-10-14T12:30:34.322898+0000","last_undegraded":"2023-10-14T12:30:34.322898+0000","last_fullsized":"2023-10-14T12:30:34.322898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:16.988646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336152+0000","last_change":"2023-10-14T12:30:34.332500+0000","last_active":"2023-10-14T12:30:35.336152+0000","last_peered":"2023-10-14T12:30:35.336152+0000","last_clean":"2023-10-14T12:30:35.336152+0000","last_became_active":"2023-10-14T12:30:34.331109+0000","last_became_peered":"2023-10-14T12:30:34.331109+0000","last_unstale":"2023-10-14T12:30:35.336152+0000","last_undegraded":"2023-10-14T12:30:35.336152+0000","last_fullsized":"2023-10-14T12:30:35.336152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:55:22.736621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.314725+0000","last_change":"2023-10-14T12:30:33.321473+0000","last_active":"2023-10-14T12:30:34.314725+0000","last_peered":"2023-10-14T12:30:34.314725+0000","last_clean":"2023-10-14T12:30:34.314725+0000","last_became_active":"2023-10-14T12:30:33.321139+0000","last_became_peered":"2023-10-14T12:30:33.321139+0000","last_unstale":"2023-10-14T12:30:34.314725+0000","last_undegraded":"2023-10-14T12:30:34.314725+0000","last_fullsized":"2023-10-14T12:30:34.314725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:16.988646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410318+0000","last_change":"2023-10-14T12:30:34.338583+0000","last_active":"2023-10-14T12:30:35.410318+0000","last_peered":"2023-10-14T12:30:35.410318+0000","last_clean":"2023-10-14T12:30:35.410318+0000","last_became_active":"2023-10-14T12:30:34.338189+0000","last_became_peered":"2023-10-14T12:30:34.338189+0000","last_unstale":"2023-10-14T12:30:35.410318+0000","last_undegraded":"2023-10-14T12:30:35.410318+0000","last_fullsized":"2023-10-14T12:30:35.410318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:01:36.790354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.306900+0000","last_change":"2023-10-14T12:30:33.320132+0000","last_active":"2023-10-14T12:30:34.306900+0000","last_peered":"2023-10-14T12:30:34.306900+0000","last_clean":"2023-10-14T12:30:34.306900+0000","last_became_active":"2023-10-14T12:30:33.319838+0000","last_became_peered":"2023-10-14T12:30:33.319838+0000","last_unstale":"2023-10-14T12:30:34.306900+0000","last_undegraded":"2023-10-14T12:30:34.306900+0000","last_fullsized":"2023-10-14T12:30:34.306900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:55.316034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642979+0000","last_change":"2023-10-14T12:30:34.344050+0000","last_active":"2023-10-14T12:30:35.642979+0000","last_peered":"2023-10-14T12:30:35.642979+0000","last_clean":"2023-10-14T12:30:35.642979+0000","last_became_active":"2023-10-14T12:30:34.343785+0000","last_became_peered":"2023-10-14T12:30:34.343785+0000","last_unstale":"2023-10-14T12:30:35.642979+0000","last_undegraded":"2023-10-14T12:30:35.642979+0000","last_fullsized":"2023-10-14T12:30:35.642979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:07.653661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.328033+0000","last_change":"2023-10-14T12:30:33.333797+0000","last_active":"2023-10-14T12:30:34.328033+0000","last_peered":"2023-10-14T12:30:34.328033+0000","last_clean":"2023-10-14T12:30:34.328033+0000","last_became_active":"2023-10-14T12:30:33.332493+0000","last_became_peered":"2023-10-14T12:30:33.332493+0000","last_unstale":"2023-10-14T12:30:34.328033+0000","last_undegraded":"2023-10-14T12:30:34.328033+0000","last_fullsized":"2023-10-14T12:30:34.328033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:55.316034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641670+0000","last_change":"2023-10-14T12:30:34.334615+0000","last_active":"2023-10-14T12:30:35.641670+0000","last_peered":"2023-10-14T12:30:35.641670+0000","last_clean":"2023-10-14T12:30:35.641670+0000","last_became_active":"2023-10-14T12:30:34.334350+0000","last_became_peered":"2023-10-14T12:30:34.334350+0000","last_unstale":"2023-10-14T12:30:35.641670+0000","last_undegraded":"2023-10-14T12:30:35.641670+0000","last_fullsized":"2023-10-14T12:30:35.641670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:06.867919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361709+0000","last_change":"2023-10-14T12:30:33.336933+0000","last_active":"2023-10-14T12:30:34.361709+0000","last_peered":"2023-10-14T12:30:34.361709+0000","last_clean":"2023-10-14T12:30:34.361709+0000","last_became_active":"2023-10-14T12:30:33.336490+0000","last_became_peered":"2023-10-14T12:30:33.336490+0000","last_unstale":"2023-10-14T12:30:34.361709+0000","last_undegraded":"2023-10-14T12:30:34.361709+0000","last_fullsized":"2023-10-14T12:30:34.361709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:49.407842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340595+0000","last_change":"2023-10-14T12:30:34.338293+0000","last_active":"2023-10-14T12:30:35.340595+0000","last_peered":"2023-10-14T12:30:35.340595+0000","last_clean":"2023-10-14T12:30:35.340595+0000","last_became_active":"2023-10-14T12:30:34.337931+0000","last_became_peered":"2023-10-14T12:30:34.337931+0000","last_unstale":"2023-10-14T12:30:35.340595+0000","last_undegraded":"2023-10-14T12:30:35.340595+0000","last_fullsized":"2023-10-14T12:30:35.340595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366483+0000","last_change":"2023-10-14T12:30:33.328447+0000","last_active":"2023-10-14T12:30:34.366483+0000","last_peered":"2023-10-14T12:30:34.366483+0000","last_clean":"2023-10-14T12:30:34.366483+0000","last_became_active":"2023-10-14T12:30:33.327737+0000","last_became_peered":"2023-10-14T12:30:33.327737+0000","last_unstale":"2023-10-14T12:30:34.366483+0000","last_undegraded":"2023-10-14T12:30:34.366483+0000","last_fullsized":"2023-10-14T12:30:34.366483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640594+0000","last_change":"2023-10-14T12:30:34.344171+0000","last_active":"2023-10-14T12:30:35.640594+0000","last_peered":"2023-10-14T12:30:35.640594+0000","last_clean":"2023-10-14T12:30:35.640594+0000","last_became_active":"2023-10-14T12:30:34.343500+0000","last_became_peered":"2023-10-14T12:30:34.343500+0000","last_unstale":"2023-10-14T12:30:35.640594+0000","last_undegraded":"2023-10-14T12:30:35.640594+0000","last_fullsized":"2023-10-14T12:30:35.640594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:16.183323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361264+0000","last_change":"2023-10-14T12:30:33.328766+0000","last_active":"2023-10-14T12:30:34.361264+0000","last_peered":"2023-10-14T12:30:34.361264+0000","last_clean":"2023-10-14T12:30:34.361264+0000","last_became_active":"2023-10-14T12:30:33.328489+0000","last_became_peered":"2023-10-14T12:30:33.328489+0000","last_unstale":"2023-10-14T12:30:34.361264+0000","last_undegraded":"2023-10-14T12:30:34.361264+0000","last_fullsized":"2023-10-14T12:30:34.361264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:06.640486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336014+0000","last_change":"2023-10-14T12:30:34.352227+0000","last_active":"2023-10-14T12:30:35.336014+0000","last_peered":"2023-10-14T12:30:35.336014+0000","last_clean":"2023-10-14T12:30:35.336014+0000","last_became_active":"2023-10-14T12:30:34.349317+0000","last_became_peered":"2023-10-14T12:30:34.349317+0000","last_unstale":"2023-10-14T12:30:35.336014+0000","last_undegraded":"2023-10-14T12:30:35.336014+0000","last_fullsized":"2023-10-14T12:30:35.336014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.325066+0000","last_change":"2023-10-14T12:30:33.332659+0000","last_active":"2023-10-14T12:30:34.325066+0000","last_peered":"2023-10-14T12:30:34.325066+0000","last_clean":"2023-10-14T12:30:34.325066+0000","last_became_active":"2023-10-14T12:30:33.332041+0000","last_became_peered":"2023-10-14T12:30:33.332041+0000","last_unstale":"2023-10-14T12:30:34.325066+0000","last_undegraded":"2023-10-14T12:30:34.325066+0000","last_fullsized":"2023-10-14T12:30:34.325066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642391+0000","last_change":"2023-10-14T12:30:34.348353+0000","last_active":"2023-10-14T12:30:35.642391+0000","last_peered":"2023-10-14T12:30:35.642391+0000","last_clean":"2023-10-14T12:30:35.642391+0000","last_became_active":"2023-10-14T12:30:34.348025+0000","last_became_peered":"2023-10-14T12:30:34.348025+0000","last_unstale":"2023-10-14T12:30:35.642391+0000","last_undegraded":"2023-10-14T12:30:35.642391+0000","last_fullsized":"2023-10-14T12:30:35.642391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.311069+0000","last_change":"2023-10-14T12:30:33.329100+0000","last_active":"2023-10-14T12:30:34.311069+0000","last_peered":"2023-10-14T12:30:34.311069+0000","last_clean":"2023-10-14T12:30:34.311069+0000","last_became_active":"2023-10-14T12:30:33.328823+0000","last_became_peered":"2023-10-14T12:30:33.328823+0000","last_unstale":"2023-10-14T12:30:34.311069+0000","last_undegraded":"2023-10-14T12:30:34.311069+0000","last_fullsized":"2023-10-14T12:30:34.311069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:02.880217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336381+0000","last_change":"2023-10-14T12:30:34.333464+0000","last_active":"2023-10-14T12:30:35.336381+0000","last_peered":"2023-10-14T12:30:35.336381+0000","last_clean":"2023-10-14T12:30:35.336381+0000","last_became_active":"2023-10-14T12:30:34.333191+0000","last_became_peered":"2023-10-14T12:30:34.333191+0000","last_unstale":"2023-10-14T12:30:35.336381+0000","last_undegraded":"2023-10-14T12:30:35.336381+0000","last_fullsized":"2023-10-14T12:30:35.336381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:32.399607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366273+0000","last_change":"2023-10-14T12:30:33.335192+0000","last_active":"2023-10-14T12:30:34.366273+0000","last_peered":"2023-10-14T12:30:34.366273+0000","last_clean":"2023-10-14T12:30:34.366273+0000","last_became_active":"2023-10-14T12:30:33.334783+0000","last_became_peered":"2023-10-14T12:30:33.334783+0000","last_unstale":"2023-10-14T12:30:34.366273+0000","last_undegraded":"2023-10-14T12:30:34.366273+0000","last_fullsized":"2023-10-14T12:30:34.366273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.033968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336275+0000","last_change":"2023-10-14T12:30:34.332683+0000","last_active":"2023-10-14T12:30:35.336275+0000","last_peered":"2023-10-14T12:30:35.336275+0000","last_clean":"2023-10-14T12:30:35.336275+0000","last_became_active":"2023-10-14T12:30:34.332353+0000","last_became_peered":"2023-10-14T12:30:34.332353+0000","last_unstale":"2023-10-14T12:30:35.336275+0000","last_undegraded":"2023-10-14T12:30:35.336275+0000","last_fullsized":"2023-10-14T12:30:35.336275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:08.458987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.356295+0000","last_change":"2023-10-14T12:30:33.337568+0000","last_active":"2023-10-14T12:30:34.356295+0000","last_peered":"2023-10-14T12:30:34.356295+0000","last_clean":"2023-10-14T12:30:34.356295+0000","last_became_active":"2023-10-14T12:30:33.337246+0000","last_became_peered":"2023-10-14T12:30:33.337246+0000","last_unstale":"2023-10-14T12:30:34.356295+0000","last_undegraded":"2023-10-14T12:30:34.356295+0000","last_fullsized":"2023-10-14T12:30:34.356295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:05.932464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340625+0000","last_change":"2023-10-14T12:30:34.341921+0000","last_active":"2023-10-14T12:30:35.340625+0000","last_peered":"2023-10-14T12:30:35.340625+0000","last_clean":"2023-10-14T12:30:35.340625+0000","last_became_active":"2023-10-14T12:30:34.340210+0000","last_became_peered":"2023-10-14T12:30:34.340210+0000","last_unstale":"2023-10-14T12:30:35.340625+0000","last_undegraded":"2023-10-14T12:30:35.340625+0000","last_fullsized":"2023-10-14T12:30:35.340625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:06.829396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.354127+0000","last_change":"2023-10-14T12:30:33.332639+0000","last_active":"2023-10-14T12:30:34.354127+0000","last_peered":"2023-10-14T12:30:34.354127+0000","last_clean":"2023-10-14T12:30:34.354127+0000","last_became_active":"2023-10-14T12:30:33.332366+0000","last_became_peered":"2023-10-14T12:30:33.332366+0000","last_unstale":"2023-10-14T12:30:34.354127+0000","last_undegraded":"2023-10-14T12:30:34.354127+0000","last_fullsized":"2023-10-14T12:30:34.354127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339756+0000","last_change":"2023-10-14T12:30:34.337511+0000","last_active":"2023-10-14T12:30:35.339756+0000","last_peered":"2023-10-14T12:30:35.339756+0000","last_clean":"2023-10-14T12:30:35.339756+0000","last_became_active":"2023-10-14T12:30:34.337096+0000","last_became_peered":"2023-10-14T12:30:34.337096+0000","last_unstale":"2023-10-14T12:30:35.339756+0000","last_undegraded":"2023-10-14T12:30:35.339756+0000","last_fullsized":"2023-10-14T12:30:35.339756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.363671+0000","last_change":"2023-10-14T12:30:33.326267+0000","last_active":"2023-10-14T12:30:34.363671+0000","last_peered":"2023-10-14T12:30:34.363671+0000","last_clean":"2023-10-14T12:30:34.363671+0000","last_became_active":"2023-10-14T12:30:33.326020+0000","last_became_peered":"2023-10-14T12:30:33.326020+0000","last_unstale":"2023-10-14T12:30:34.363671+0000","last_undegraded":"2023-10-14T12:30:34.363671+0000","last_fullsized":"2023-10-14T12:30:34.363671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:07.819706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410505+0000","last_change":"2023-10-14T12:30:34.348057+0000","last_active":"2023-10-14T12:30:35.410505+0000","last_peered":"2023-10-14T12:30:35.410505+0000","last_clean":"2023-10-14T12:30:35.410505+0000","last_became_active":"2023-10-14T12:30:34.347721+0000","last_became_peered":"2023-10-14T12:30:34.347721+0000","last_unstale":"2023-10-14T12:30:35.410505+0000","last_undegraded":"2023-10-14T12:30:35.410505+0000","last_fullsized":"2023-10-14T12:30:35.410505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:34:32.333549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.323960+0000","last_change":"2023-10-14T12:30:33.336624+0000","last_active":"2023-10-14T12:30:34.323960+0000","last_peered":"2023-10-14T12:30:34.323960+0000","last_clean":"2023-10-14T12:30:34.323960+0000","last_became_active":"2023-10-14T12:30:33.336299+0000","last_became_peered":"2023-10-14T12:30:33.336299+0000","last_unstale":"2023-10-14T12:30:34.323960+0000","last_undegraded":"2023-10-14T12:30:34.323960+0000","last_fullsized":"2023-10-14T12:30:34.323960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:22.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642505+0000","last_change":"2023-10-14T12:30:34.349582+0000","last_active":"2023-10-14T12:30:35.642505+0000","last_peered":"2023-10-14T12:30:35.642505+0000","last_clean":"2023-10-14T12:30:35.642505+0000","last_became_active":"2023-10-14T12:30:34.349281+0000","last_became_peered":"2023-10-14T12:30:34.349281+0000","last_unstale":"2023-10-14T12:30:35.642505+0000","last_undegraded":"2023-10-14T12:30:35.642505+0000","last_fullsized":"2023-10-14T12:30:35.642505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.362637+0000","last_change":"2023-10-14T12:30:33.323532+0000","last_active":"2023-10-14T12:30:34.362637+0000","last_peered":"2023-10-14T12:30:34.362637+0000","last_clean":"2023-10-14T12:30:34.362637+0000","last_became_active":"2023-10-14T12:30:33.323244+0000","last_became_peered":"2023-10-14T12:30:33.323244+0000","last_unstale":"2023-10-14T12:30:34.362637+0000","last_undegraded":"2023-10-14T12:30:34.362637+0000","last_fullsized":"2023-10-14T12:30:34.362637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:31.227443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640826+0000","last_change":"2023-10-14T12:30:34.339001+0000","last_active":"2023-10-14T12:30:35.640826+0000","last_peered":"2023-10-14T12:30:35.640826+0000","last_clean":"2023-10-14T12:30:35.640826+0000","last_became_active":"2023-10-14T12:30:34.338728+0000","last_became_peered":"2023-10-14T12:30:34.338728+0000","last_unstale":"2023-10-14T12:30:35.640826+0000","last_undegraded":"2023-10-14T12:30:35.640826+0000","last_fullsized":"2023-10-14T12:30:35.640826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:34.174928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.324150+0000","last_change":"2023-10-14T12:30:33.330930+0000","last_active":"2023-10-14T12:30:34.324150+0000","last_peered":"2023-10-14T12:30:34.324150+0000","last_clean":"2023-10-14T12:30:34.324150+0000","last_became_active":"2023-10-14T12:30:33.330353+0000","last_became_peered":"2023-10-14T12:30:33.330353+0000","last_unstale":"2023-10-14T12:30:34.324150+0000","last_undegraded":"2023-10-14T12:30:34.324150+0000","last_fullsized":"2023-10-14T12:30:34.324150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:22:49.880635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338674+0000","last_change":"2023-10-14T12:30:34.340027+0000","last_active":"2023-10-14T12:30:35.338674+0000","last_peered":"2023-10-14T12:30:35.338674+0000","last_clean":"2023-10-14T12:30:35.338674+0000","last_became_active":"2023-10-14T12:30:34.339704+0000","last_became_peered":"2023-10-14T12:30:34.339704+0000","last_unstale":"2023-10-14T12:30:35.338674+0000","last_undegraded":"2023-10-14T12:30:35.338674+0000","last_fullsized":"2023-10-14T12:30:35.338674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:07.653661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.316170+0000","last_change":"2023-10-14T12:30:33.326069+0000","last_active":"2023-10-14T12:30:34.316170+0000","last_peered":"2023-10-14T12:30:34.316170+0000","last_clean":"2023-10-14T12:30:34.316170+0000","last_became_active":"2023-10-14T12:30:33.325772+0000","last_became_peered":"2023-10-14T12:30:33.325772+0000","last_unstale":"2023-10-14T12:30:34.316170+0000","last_undegraded":"2023-10-14T12:30:34.316170+0000","last_fullsized":"2023-10-14T12:30:34.316170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336347+0000","last_change":"2023-10-14T12:30:34.334158+0000","last_active":"2023-10-14T12:30:35.336347+0000","last_peered":"2023-10-14T12:30:35.336347+0000","last_clean":"2023-10-14T12:30:35.336347+0000","last_became_active":"2023-10-14T12:30:34.333849+0000","last_became_peered":"2023-10-14T12:30:34.333849+0000","last_unstale":"2023-10-14T12:30:35.336347+0000","last_undegraded":"2023-10-14T12:30:35.336347+0000","last_fullsized":"2023-10-14T12:30:35.336347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:06.829396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.323148+0000","last_change":"2023-10-14T12:30:33.329870+0000","last_active":"2023-10-14T12:30:34.323148+0000","last_peered":"2023-10-14T12:30:34.323148+0000","last_clean":"2023-10-14T12:30:34.323148+0000","last_became_active":"2023-10-14T12:30:33.328179+0000","last_became_peered":"2023-10-14T12:30:33.328179+0000","last_unstale":"2023-10-14T12:30:34.323148+0000","last_undegraded":"2023-10-14T12:30:34.323148+0000","last_fullsized":"2023-10-14T12:30:34.323148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:31.238402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642638+0000","last_change":"2023-10-14T12:30:34.341041+0000","last_active":"2023-10-14T12:30:35.642638+0000","last_peered":"2023-10-14T12:30:35.642638+0000","last_clean":"2023-10-14T12:30:35.642638+0000","last_became_active":"2023-10-14T12:30:34.340754+0000","last_became_peered":"2023-10-14T12:30:34.340754+0000","last_unstale":"2023-10-14T12:30:35.642638+0000","last_undegraded":"2023-10-14T12:30:35.642638+0000","last_fullsized":"2023-10-14T12:30:35.642638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.360564+0000","last_change":"2023-10-14T12:30:33.335354+0000","last_active":"2023-10-14T12:30:34.360564+0000","last_peered":"2023-10-14T12:30:34.360564+0000","last_clean":"2023-10-14T12:30:34.360564+0000","last_became_active":"2023-10-14T12:30:33.334729+0000","last_became_peered":"2023-10-14T12:30:33.334729+0000","last_unstale":"2023-10-14T12:30:34.360564+0000","last_undegraded":"2023-10-14T12:30:34.360564+0000","last_fullsized":"2023-10-14T12:30:34.360564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:42.015187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642514+0000","last_change":"2023-10-14T12:30:34.344478+0000","last_active":"2023-10-14T12:30:35.642514+0000","last_peered":"2023-10-14T12:30:35.642514+0000","last_clean":"2023-10-14T12:30:35.642514+0000","last_became_active":"2023-10-14T12:30:34.344186+0000","last_became_peered":"2023-10-14T12:30:34.344186+0000","last_unstale":"2023-10-14T12:30:35.642514+0000","last_undegraded":"2023-10-14T12:30:35.642514+0000","last_fullsized":"2023-10-14T12:30:35.642514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410290+0000","last_change":"2023-10-14T12:30:33.332845+0000","last_active":"2023-10-14T12:30:35.410290+0000","last_peered":"2023-10-14T12:30:35.410290+0000","last_clean":"2023-10-14T12:30:35.410290+0000","last_became_active":"2023-10-14T12:30:33.332542+0000","last_became_peered":"2023-10-14T12:30:33.332542+0000","last_unstale":"2023-10-14T12:30:35.410290+0000","last_undegraded":"2023-10-14T12:30:35.410290+0000","last_fullsized":"2023-10-14T12:30:35.410290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:31.735498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336653+0000","last_change":"2023-10-14T12:30:34.326040+0000","last_active":"2023-10-14T12:30:35.336653+0000","last_peered":"2023-10-14T12:30:35.336653+0000","last_clean":"2023-10-14T12:30:35.336653+0000","last_became_active":"2023-10-14T12:30:34.325727+0000","last_became_peered":"2023-10-14T12:30:34.325727+0000","last_unstale":"2023-10-14T12:30:35.336653+0000","last_undegraded":"2023-10-14T12:30:35.336653+0000","last_fullsized":"2023-10-14T12:30:35.336653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:00.187156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.328527+0000","last_change":"2023-10-14T12:30:33.324071+0000","last_active":"2023-10-14T12:30:34.328527+0000","last_peered":"2023-10-14T12:30:34.328527+0000","last_clean":"2023-10-14T12:30:34.328527+0000","last_became_active":"2023-10-14T12:30:33.323094+0000","last_became_peered":"2023-10-14T12:30:33.323094+0000","last_unstale":"2023-10-14T12:30:34.328527+0000","last_undegraded":"2023-10-14T12:30:34.328527+0000","last_fullsized":"2023-10-14T12:30:34.328527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:37.737804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641010+0000","last_change":"2023-10-14T12:30:34.332515+0000","last_active":"2023-10-14T12:30:35.641010+0000","last_peered":"2023-10-14T12:30:35.641010+0000","last_clean":"2023-10-14T12:30:35.641010+0000","last_became_active":"2023-10-14T12:30:34.332238+0000","last_became_peered":"2023-10-14T12:30:34.332238+0000","last_unstale":"2023-10-14T12:30:35.641010+0000","last_undegraded":"2023-10-14T12:30:35.641010+0000","last_fullsized":"2023-10-14T12:30:35.641010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:47.296104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.330083+0000","last_change":"2023-10-14T12:30:33.326955+0000","last_active":"2023-10-14T12:30:34.330083+0000","last_peered":"2023-10-14T12:30:34.330083+0000","last_clean":"2023-10-14T12:30:34.330083+0000","last_became_active":"2023-10-14T12:30:33.326641+0000","last_became_peered":"2023-10-14T12:30:33.326641+0000","last_unstale":"2023-10-14T12:30:34.330083+0000","last_undegraded":"2023-10-14T12:30:34.330083+0000","last_fullsized":"2023-10-14T12:30:34.330083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:06.451441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642148+0000","last_change":"2023-10-14T12:30:34.337150+0000","last_active":"2023-10-14T12:30:35.642148+0000","last_peered":"2023-10-14T12:30:35.642148+0000","last_clean":"2023-10-14T12:30:35.642148+0000","last_became_active":"2023-10-14T12:30:34.336587+0000","last_became_peered":"2023-10-14T12:30:34.336587+0000","last_unstale":"2023-10-14T12:30:35.642148+0000","last_undegraded":"2023-10-14T12:30:35.642148+0000","last_fullsized":"2023-10-14T12:30:35.642148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:50.421016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.307375+0000","last_change":"2023-10-14T12:30:33.324592+0000","last_active":"2023-10-14T12:30:34.307375+0000","last_peered":"2023-10-14T12:30:34.307375+0000","last_clean":"2023-10-14T12:30:34.307375+0000","last_became_active":"2023-10-14T12:30:33.324291+0000","last_became_peered":"2023-10-14T12:30:33.324291+0000","last_unstale":"2023-10-14T12:30:34.307375+0000","last_undegraded":"2023-10-14T12:30:34.307375+0000","last_fullsized":"2023-10-14T12:30:34.307375+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339476+0000","last_change":"2023-10-14T12:30:34.336051+0000","last_active":"2023-10-14T12:30:35.339476+0000","last_peered":"2023-10-14T12:30:35.339476+0000","last_clean":"2023-10-14T12:30:35.339476+0000","last_became_active":"2023-10-14T12:30:34.335577+0000","last_became_peered":"2023-10-14T12:30:34.335577+0000","last_unstale":"2023-10-14T12:30:35.339476+0000","last_undegraded":"2023-10-14T12:30:35.339476+0000","last_fullsized":"2023-10-14T12:30:35.339476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.314696+0000","last_change":"2023-10-14T12:30:33.327237+0000","last_active":"2023-10-14T12:30:34.314696+0000","last_peered":"2023-10-14T12:30:34.314696+0000","last_clean":"2023-10-14T12:30:34.314696+0000","last_became_active":"2023-10-14T12:30:33.324300+0000","last_became_peered":"2023-10-14T12:30:33.324300+0000","last_unstale":"2023-10-14T12:30:34.314696+0000","last_undegraded":"2023-10-14T12:30:34.314696+0000","last_fullsized":"2023-10-14T12:30:34.314696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.643321+0000","last_change":"2023-10-14T12:30:34.348604+0000","last_active":"2023-10-14T12:30:35.643321+0000","last_peered":"2023-10-14T12:30:35.643321+0000","last_clean":"2023-10-14T12:30:35.643321+0000","last_became_active":"2023-10-14T12:30:34.348038+0000","last_became_peered":"2023-10-14T12:30:34.348038+0000","last_unstale":"2023-10-14T12:30:35.643321+0000","last_undegraded":"2023-10-14T12:30:35.643321+0000","last_fullsized":"2023-10-14T12:30:35.643321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.305160+0000","last_change":"2023-10-14T12:30:33.320974+0000","last_active":"2023-10-14T12:30:34.305160+0000","last_peered":"2023-10-14T12:30:34.305160+0000","last_clean":"2023-10-14T12:30:34.305160+0000","last_became_active":"2023-10-14T12:30:33.320705+0000","last_became_peered":"2023-10-14T12:30:33.320705+0000","last_unstale":"2023-10-14T12:30:34.305160+0000","last_undegraded":"2023-10-14T12:30:34.305160+0000","last_fullsized":"2023-10-14T12:30:34.305160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:52.984601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.341685+0000","last_change":"2023-10-14T12:30:34.352591+0000","last_active":"2023-10-14T12:30:35.341685+0000","last_peered":"2023-10-14T12:30:35.341685+0000","last_clean":"2023-10-14T12:30:35.341685+0000","last_became_active":"2023-10-14T12:30:34.352190+0000","last_became_peered":"2023-10-14T12:30:34.352190+0000","last_unstale":"2023-10-14T12:30:35.341685+0000","last_undegraded":"2023-10-14T12:30:35.341685+0000","last_fullsized":"2023-10-14T12:30:35.341685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:28.730425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.326107+0000","last_change":"2023-10-14T12:30:33.329384+0000","last_active":"2023-10-14T12:30:34.326107+0000","last_peered":"2023-10-14T12:30:34.326107+0000","last_clean":"2023-10-14T12:30:34.326107+0000","last_became_active":"2023-10-14T12:30:33.328937+0000","last_became_peered":"2023-10-14T12:30:33.328937+0000","last_unstale":"2023-10-14T12:30:34.326107+0000","last_undegraded":"2023-10-14T12:30:34.326107+0000","last_fullsized":"2023-10-14T12:30:34.326107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.319081+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:30:34.319081+0000","last_peered":"2023-10-14T12:30:34.319081+0000","last_clean":"2023-10-14T12:30:34.319081+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:30:34.319081+0000","last_undegraded":"2023-10-14T12:30:34.319081+0000","last_fullsized":"2023-10-14T12:30:34.319081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":796263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.264},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.91100000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1040000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.2210000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.651},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.498}]},{"osd":6,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.3540000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":204795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.474},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.77200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.234},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.1539999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.04}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.085},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.597}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3440000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":204325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1819999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.997}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.107},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.141}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.6360000000000001,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":1.367},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.325}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.53},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.494}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.571},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.7350000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":204817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.6599999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.387}]},{"osd":2,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.23}]},{"osd":3,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.995},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.28}]},{"osd":5,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.4339999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.605},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.629}]},{"osd":7,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.77},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.716}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":205859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.266},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.94599999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1339999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.218},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.84699999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.2030000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.419},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3109999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.7390000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.657},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.5469999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":204283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.306}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.1160000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.357},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.206}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.583},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.2529999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.825},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.5429999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.8},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.921}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":204303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.755}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1890000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.4900000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":1.3420000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.27},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.595}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.659},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.4279999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":794615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.379},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.496}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.2930000000000001,"5min":5.2930000000000001,"15min":5.2930000000000001},"last":0.442},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.363},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.94599999999999995}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.147}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.998}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.018}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:30:44.295 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T12:30:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.531+0000 7fe2d1f55640 1 Processor -- start 2023-10-14T12:30:44.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.531+0000 7fe2d1f55640 1 -- start start 2023-10-14T12:30:44.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2d1f55640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc0c20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:44.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2d1f55640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fe2cc0ca1e0 0x7fe2cc0710f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:44.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2d1f55640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe2cc071630 0x7fe2cc0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:44.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2d1f55640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc0cde00 con 0x7fe2cc071630 2023-10-14T12:30:44.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2d1f55640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2cc071e40 con 0x7fe2cc0ca1e0 2023-10-14T12:30:44.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2d1f55640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc072120 con 0x7fe2cc0c9e00 2023-10-14T12:30:44.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2cbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe2cc071630 0x7fe2cc0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2cbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fe2cc071630 0x7fe2cc0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52132/0 (socket says 172.21.15.64:52132) 2023-10-14T12:30:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.533+0000 7fe2cbfff640 1 -- 172.21.15.64:0/2158632166 learned_addr learned my addr 172.21.15.64:0/2158632166 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2caffd640 1 --2- 172.21.15.64:0/2158632166 >> v2:172.21.15.177:3300/0 conn(0x7fe2cc0ca1e0 0x7fe2cc0710f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2cb7fe640 1 --2- 172.21.15.64:0/2158632166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc0c20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:44.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2cbfff640 1 -- 172.21.15.64:0/2158632166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 msgr2=0x7fe2cc0c20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2cbfff640 1 --2- 172.21.15.64:0/2158632166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc0c20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2cbfff640 1 -- 172.21.15.64:0/2158632166 >> v2:172.21.15.177:3300/0 conn(0x7fe2cc0ca1e0 msgr2=0x7fe2cc0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2cbfff640 1 --2- 172.21.15.64:0/2158632166 >> v2:172.21.15.177:3300/0 conn(0x7fe2cc0ca1e0 0x7fe2cc0710f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2cbfff640 1 -- 172.21.15.64:0/2158632166 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc072400 con 0x7fe2cc071630 2023-10-14T12:30:44.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.534+0000 7fe2caffd640 1 --2- 172.21.15.64:0/2158632166 >> v2:172.21.15.177:3300/0 conn(0x7fe2cc0ca1e0 0x7fe2cc0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.536+0000 7fe2cbfff640 1 --2- 172.21.15.64:0/2158632166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc0cca00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc06fd70 tx=0x7fe2c402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7115d7d6ddf9b76 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.536+0000 7fe2ca7fc640 1 -- 172.21.15.64:0/2158632166 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c402ca70 con 0x7fe2cc071630 2023-10-14T12:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.536+0000 7fe2ca7fc640 1 -- 172.21.15.64:0/2158632166 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c402cbd0 con 0x7fe2cc071630 2023-10-14T12:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.536+0000 7fe2ca7fc640 1 -- 172.21.15.64:0/2158632166 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c40343f0 con 0x7fe2cc071630 2023-10-14T12:30:44.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2158632166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 msgr2=0x7fe2cc0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2158632166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc0cca00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc06fd70 tx=0x7fe2c402bed0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2158632166 shutdown_connections 2023-10-14T12:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2158632166 >> v2:172.21.15.177:3300/0 conn(0x7fe2cc0ca1e0 0x7fe2cc0710f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2158632166 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc0cca00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2158632166 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc0c20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2158632166 >> 172.21.15.64:0/2158632166 conn(0x7fe2cc06c1c0 msgr2=0x7fe2cc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:44.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2158632166 shutdown_connections 2023-10-14T12:30:44.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.537+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2158632166 wait complete. 2023-10-14T12:30:44.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.539+0000 7fe2d1f55640 1 Processor -- start 2023-10-14T12:30:44.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.540+0000 7fe2d1f55640 1 -- start start 2023-10-14T12:30:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2d1f55640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc150310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2d1f55640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc153000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2d1f55640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2cc0ca1e0 0x7fe2cc157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:44.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2d1f55640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc1edd60 con 0x7fe2cc071630 2023-10-14T12:30:44.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2d1f55640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc153920 con 0x7fe2cc0ca1e0 2023-10-14T12:30:44.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2d1f55640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2cc0c7830 con 0x7fe2cc0c9e00 2023-10-14T12:30:44.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2cb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc150310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:44.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2cb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc150310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52146/0 (socket says 172.21.15.64:52146) 2023-10-14T12:30:44.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.541+0000 7fe2cb7fe640 1 -- 172.21.15.64:0/2103103562 learned_addr learned my addr 172.21.15.64:0/2103103562 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cb7fe640 1 -- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 msgr2=0x7fe2cc153000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2caffd640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc153000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cb7fe640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc153000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cb7fe640 1 -- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2cc0ca1e0 msgr2=0x7fe2cc157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:44.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cbfff640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2cc0ca1e0 0x7fe2cc157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cb7fe640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2cc0ca1e0 0x7fe2cc157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cb7fe640 1 -- 172.21.15.64:0/2103103562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c4009b30 con 0x7fe2cc071630 2023-10-14T12:30:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cbfff640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2cc0ca1e0 0x7fe2cc157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2cb7fe640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc150310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d5f0 tx=0x7fe2bc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2b3fff640 1 -- 172.21.15.64:0/2103103562 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0125f0 con 0x7fe2cc071630 2023-10-14T12:30:44.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2b3fff640 1 -- 172.21.15.64:0/2103103562 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2bc012750 con 0x7fe2cc071630 2023-10-14T12:30:44.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2cc0c7b10 con 0x7fe2cc071630 2023-10-14T12:30:44.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.542+0000 7fe2b3fff640 1 -- 172.21.15.64:0/2103103562 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc012b00 con 0x7fe2cc071630 2023-10-14T12:30:44.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.543+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2cc0c80d0 con 0x7fe2cc071630 2023-10-14T12:30:44.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.544+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2cc073ef0 con 0x7fe2cc071630 2023-10-14T12:30:44.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.545+0000 7fe2b3fff640 1 -- 172.21.15.64:0/2103103562 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fe2bc012c60 con 0x7fe2cc071630 2023-10-14T12:30:44.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.546+0000 7fe2b3fff640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe2b806aea0 0x7fe2b806d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.546+0000 7fe2b3fff640 1 -- 172.21.15.64:0/2103103562 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fe2bc089cd0 con 0x7fe2cc071630 2023-10-14T12:30:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.546+0000 7fe2caffd640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe2b806aea0 0x7fe2b806d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.548+0000 7fe2caffd640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe2b806aea0 0x7fe2b806d360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0006fd0 tx=0x7fe2c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:44.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.550+0000 7fe2b3fff640 1 -- 172.21.15.64:0/2103103562 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fe2bc054b80 con 0x7fe2cc071630 2023-10-14T12:30:44.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.740+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2cc0cc4e0 con 0x7fe2b806aea0 2023-10-14T12:30:44.765 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.763+0000 7fe2b3fff640 1 -- 172.21.15.64:0/2103103562 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286966 (secure 0 0 0) 0x7fe2c000de00 con 0x7fe2b806aea0 2023-10-14T12:30:44.769 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:44.770 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T12:30:44.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe2b806aea0 msgr2=0x7fe2b806d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:44.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe2b806aea0 0x7fe2b806d360 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0006fd0 tx=0x7fe2c0008040 comp rx=0 tx=0).stop 2023-10-14T12:30:44.772 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 msgr2=0x7fe2cc150310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:44.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc150310 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc00d5f0 tx=0x7fe2bc00dab0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 shutdown_connections 2023-10-14T12:30:44.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fe2b806aea0 0x7fe2b806d360 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fe2cc0ca1e0 0x7fe2cc157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.773 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fe2cc0c9e00 0x7fe2cc153000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 --2- 172.21.15.64:0/2103103562 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fe2cc071630 0x7fe2cc150310 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:44.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 >> 172.21.15.64:0/2103103562 conn(0x7fe2cc06c1c0 msgr2=0x7fe2cc0cc900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:44.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 shutdown_connections 2023-10-14T12:30:44.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:44.769+0000 7fe2d1f55640 1 -- 172.21.15.64:0/2103103562 wait complete. 2023-10-14T12:30:44.792 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2023-10-14T12:30:43.769348+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221088,"kb_used_data":4904,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753632,"statfs":{"total":773094113280,"available":772867719168,"internally_reserved":0,"allocated":5021696,"data_stored":2819260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12743,"internal_metadata":221236793},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":46,"apply_latency_ms":46,"commit_latency_ns":46000000,"apply_latency_ns":46000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.469895"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336705+0000","last_change":"2023-10-14T12:30:34.349268+0000","last_active":"2023-10-14T12:30:35.336705+0000","last_peered":"2023-10-14T12:30:35.336705+0000","last_clean":"2023-10-14T12:30:35.336705+0000","last_became_active":"2023-10-14T12:30:34.348914+0000","last_became_peered":"2023-10-14T12:30:34.348914+0000","last_unstale":"2023-10-14T12:30:35.336705+0000","last_undegraded":"2023-10-14T12:30:35.336705+0000","last_fullsized":"2023-10-14T12:30:35.336705+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:42:50.006654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336576+0000","last_change":"2023-10-14T12:30:34.344887+0000","last_active":"2023-10-14T12:30:35.336576+0000","last_peered":"2023-10-14T12:30:35.336576+0000","last_clean":"2023-10-14T12:30:35.336576+0000","last_became_active":"2023-10-14T12:30:34.344581+0000","last_became_peered":"2023-10-14T12:30:34.344581+0000","last_unstale":"2023-10-14T12:30:35.336576+0000","last_undegraded":"2023-10-14T12:30:35.336576+0000","last_fullsized":"2023-10-14T12:30:35.336576+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:28.730425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640947+0000","last_change":"2023-10-14T12:30:34.343503+0000","last_active":"2023-10-14T12:30:35.640947+0000","last_peered":"2023-10-14T12:30:35.640947+0000","last_clean":"2023-10-14T12:30:35.640947+0000","last_became_active":"2023-10-14T12:30:34.343221+0000","last_became_peered":"2023-10-14T12:30:34.343221+0000","last_unstale":"2023-10-14T12:30:35.640947+0000","last_undegraded":"2023-10-14T12:30:35.640947+0000","last_fullsized":"2023-10-14T12:30:35.640947+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:32:37.840864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410105+0000","last_change":"2023-10-14T12:30:34.343025+0000","last_active":"2023-10-14T12:30:35.410105+0000","last_peered":"2023-10-14T12:30:35.410105+0000","last_clean":"2023-10-14T12:30:35.410105+0000","last_became_active":"2023-10-14T12:30:34.342733+0000","last_became_peered":"2023-10-14T12:30:34.342733+0000","last_unstale":"2023-10-14T12:30:35.410105+0000","last_undegraded":"2023-10-14T12:30:35.410105+0000","last_fullsized":"2023-10-14T12:30:35.410105+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:54:15.005093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.409587+0000","last_change":"2023-10-14T12:30:34.332160+0000","last_active":"2023-10-14T12:30:35.409587+0000","last_peered":"2023-10-14T12:30:35.409587+0000","last_clean":"2023-10-14T12:30:35.409587+0000","last_became_active":"2023-10-14T12:30:34.331843+0000","last_became_peered":"2023-10-14T12:30:34.331843+0000","last_unstale":"2023-10-14T12:30:35.409587+0000","last_undegraded":"2023-10-14T12:30:35.409587+0000","last_fullsized":"2023-10-14T12:30:35.409587+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:46.492583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642095+0000","last_change":"2023-10-14T12:30:34.345669+0000","last_active":"2023-10-14T12:30:35.642095+0000","last_peered":"2023-10-14T12:30:35.642095+0000","last_clean":"2023-10-14T12:30:35.642095+0000","last_became_active":"2023-10-14T12:30:34.345165+0000","last_became_peered":"2023-10-14T12:30:34.345165+0000","last_unstale":"2023-10-14T12:30:35.642095+0000","last_undegraded":"2023-10-14T12:30:35.642095+0000","last_fullsized":"2023-10-14T12:30:35.642095+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:53.997776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338165+0000","last_change":"2023-10-14T12:30:34.341127+0000","last_active":"2023-10-14T12:30:35.338165+0000","last_peered":"2023-10-14T12:30:35.338165+0000","last_clean":"2023-10-14T12:30:35.338165+0000","last_became_active":"2023-10-14T12:30:34.338798+0000","last_became_peered":"2023-10-14T12:30:34.338798+0000","last_unstale":"2023-10-14T12:30:35.338165+0000","last_undegraded":"2023-10-14T12:30:35.338165+0000","last_fullsized":"2023-10-14T12:30:35.338165+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:10:19.127848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.335883+0000","last_change":"2023-10-14T12:30:34.334706+0000","last_active":"2023-10-14T12:30:35.335883+0000","last_peered":"2023-10-14T12:30:35.335883+0000","last_clean":"2023-10-14T12:30:35.335883+0000","last_became_active":"2023-10-14T12:30:34.333742+0000","last_became_peered":"2023-10-14T12:30:34.333742+0000","last_unstale":"2023-10-14T12:30:35.335883+0000","last_undegraded":"2023-10-14T12:30:35.335883+0000","last_fullsized":"2023-10-14T12:30:35.335883+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641307+0000","last_change":"2023-10-14T12:30:34.347717+0000","last_active":"2023-10-14T12:30:35.641307+0000","last_peered":"2023-10-14T12:30:35.641307+0000","last_clean":"2023-10-14T12:30:35.641307+0000","last_became_active":"2023-10-14T12:30:34.347287+0000","last_became_peered":"2023-10-14T12:30:34.347287+0000","last_unstale":"2023-10-14T12:30:35.641307+0000","last_undegraded":"2023-10-14T12:30:35.641307+0000","last_fullsized":"2023-10-14T12:30:35.641307+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:16:40.404130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340931+0000","last_change":"2023-10-14T12:30:34.342074+0000","last_active":"2023-10-14T12:30:35.340931+0000","last_peered":"2023-10-14T12:30:35.340931+0000","last_clean":"2023-10-14T12:30:35.340931+0000","last_became_active":"2023-10-14T12:30:34.341599+0000","last_became_peered":"2023-10-14T12:30:34.341599+0000","last_unstale":"2023-10-14T12:30:35.340931+0000","last_undegraded":"2023-10-14T12:30:35.340931+0000","last_fullsized":"2023-10-14T12:30:35.340931+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:32.399607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340290+0000","last_change":"2023-10-14T12:30:34.347356+0000","last_active":"2023-10-14T12:30:35.340290+0000","last_peered":"2023-10-14T12:30:35.340290+0000","last_clean":"2023-10-14T12:30:35.340290+0000","last_became_active":"2023-10-14T12:30:34.346962+0000","last_became_peered":"2023-10-14T12:30:34.346962+0000","last_unstale":"2023-10-14T12:30:35.340290+0000","last_undegraded":"2023-10-14T12:30:35.340290+0000","last_fullsized":"2023-10-14T12:30:35.340290+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:08.458987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640987+0000","last_change":"2023-10-14T12:30:34.336929+0000","last_active":"2023-10-14T12:30:35.640987+0000","last_peered":"2023-10-14T12:30:35.640987+0000","last_clean":"2023-10-14T12:30:35.640987+0000","last_became_active":"2023-10-14T12:30:34.336490+0000","last_became_peered":"2023-10-14T12:30:34.336490+0000","last_unstale":"2023-10-14T12:30:35.640987+0000","last_undegraded":"2023-10-14T12:30:35.640987+0000","last_fullsized":"2023-10-14T12:30:35.640987+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:13:08.803544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338763+0000","last_change":"2023-10-14T12:30:34.336286+0000","last_active":"2023-10-14T12:30:35.338763+0000","last_peered":"2023-10-14T12:30:35.338763+0000","last_clean":"2023-10-14T12:30:35.338763+0000","last_became_active":"2023-10-14T12:30:34.335211+0000","last_became_peered":"2023-10-14T12:30:34.335211+0000","last_unstale":"2023-10-14T12:30:35.338763+0000","last_undegraded":"2023-10-14T12:30:35.338763+0000","last_fullsized":"2023-10-14T12:30:35.338763+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339098+0000","last_change":"2023-10-14T12:30:34.333675+0000","last_active":"2023-10-14T12:30:35.339098+0000","last_peered":"2023-10-14T12:30:35.339098+0000","last_clean":"2023-10-14T12:30:35.339098+0000","last_became_active":"2023-10-14T12:30:34.332753+0000","last_became_peered":"2023-10-14T12:30:34.332753+0000","last_unstale":"2023-10-14T12:30:35.339098+0000","last_undegraded":"2023-10-14T12:30:35.339098+0000","last_fullsized":"2023-10-14T12:30:35.339098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:50.421016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.337542+0000","last_change":"2023-10-14T12:30:34.344954+0000","last_active":"2023-10-14T12:30:35.337542+0000","last_peered":"2023-10-14T12:30:35.337542+0000","last_clean":"2023-10-14T12:30:35.337542+0000","last_became_active":"2023-10-14T12:30:34.344639+0000","last_became_peered":"2023-10-14T12:30:34.344639+0000","last_unstale":"2023-10-14T12:30:35.337542+0000","last_undegraded":"2023-10-14T12:30:35.337542+0000","last_fullsized":"2023-10-14T12:30:35.337542+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642014+0000","last_change":"2023-10-14T12:30:34.333857+0000","last_active":"2023-10-14T12:30:35.642014+0000","last_peered":"2023-10-14T12:30:35.642014+0000","last_clean":"2023-10-14T12:30:35.642014+0000","last_became_active":"2023-10-14T12:30:34.333436+0000","last_became_peered":"2023-10-14T12:30:34.333436+0000","last_unstale":"2023-10-14T12:30:35.642014+0000","last_undegraded":"2023-10-14T12:30:35.642014+0000","last_fullsized":"2023-10-14T12:30:35.642014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.643013+0000","last_change":"2023-10-14T12:30:34.342238+0000","last_active":"2023-10-14T12:30:35.643013+0000","last_peered":"2023-10-14T12:30:35.643013+0000","last_clean":"2023-10-14T12:30:35.643013+0000","last_became_active":"2023-10-14T12:30:34.341929+0000","last_became_peered":"2023-10-14T12:30:34.341929+0000","last_unstale":"2023-10-14T12:30:35.643013+0000","last_undegraded":"2023-10-14T12:30:35.643013+0000","last_fullsized":"2023-10-14T12:30:35.643013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.343109+0000","last_change":"2023-10-14T12:30:34.324627+0000","last_active":"2023-10-14T12:30:35.343109+0000","last_peered":"2023-10-14T12:30:35.343109+0000","last_clean":"2023-10-14T12:30:35.343109+0000","last_became_active":"2023-10-14T12:30:34.323870+0000","last_became_peered":"2023-10-14T12:30:34.323870+0000","last_unstale":"2023-10-14T12:30:35.343109+0000","last_undegraded":"2023-10-14T12:30:35.343109+0000","last_fullsized":"2023-10-14T12:30:35.343109+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:23.313808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410445+0000","last_change":"2023-10-14T12:30:34.342657+0000","last_active":"2023-10-14T12:30:35.410445+0000","last_peered":"2023-10-14T12:30:35.410445+0000","last_clean":"2023-10-14T12:30:35.410445+0000","last_became_active":"2023-10-14T12:30:34.342316+0000","last_became_peered":"2023-10-14T12:30:34.342316+0000","last_unstale":"2023-10-14T12:30:35.410445+0000","last_undegraded":"2023-10-14T12:30:35.410445+0000","last_fullsized":"2023-10-14T12:30:35.410445+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:55:53.909707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.341857+0000","last_change":"2023-10-14T12:30:34.321736+0000","last_active":"2023-10-14T12:30:35.341857+0000","last_peered":"2023-10-14T12:30:35.341857+0000","last_clean":"2023-10-14T12:30:35.341857+0000","last_became_active":"2023-10-14T12:30:34.321292+0000","last_became_peered":"2023-10-14T12:30:34.321292+0000","last_unstale":"2023-10-14T12:30:35.341857+0000","last_undegraded":"2023-10-14T12:30:35.341857+0000","last_fullsized":"2023-10-14T12:30:35.341857+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:32.309700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338754+0000","last_change":"2023-10-14T12:30:34.340531+0000","last_active":"2023-10-14T12:30:35.338754+0000","last_peered":"2023-10-14T12:30:35.338754+0000","last_clean":"2023-10-14T12:30:35.338754+0000","last_became_active":"2023-10-14T12:30:34.340192+0000","last_became_peered":"2023-10-14T12:30:34.340192+0000","last_unstale":"2023-10-14T12:30:35.338754+0000","last_undegraded":"2023-10-14T12:30:35.338754+0000","last_fullsized":"2023-10-14T12:30:35.338754+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:49:05.651960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339946+0000","last_change":"2023-10-14T12:30:34.344178+0000","last_active":"2023-10-14T12:30:35.339946+0000","last_peered":"2023-10-14T12:30:35.339946+0000","last_clean":"2023-10-14T12:30:35.339946+0000","last_became_active":"2023-10-14T12:30:34.343864+0000","last_became_peered":"2023-10-14T12:30:34.343864+0000","last_unstale":"2023-10-14T12:30:35.339946+0000","last_undegraded":"2023-10-14T12:30:35.339946+0000","last_fullsized":"2023-10-14T12:30:35.339946+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642013+0000","last_change":"2023-10-14T12:30:34.333294+0000","last_active":"2023-10-14T12:30:35.642013+0000","last_peered":"2023-10-14T12:30:35.642013+0000","last_clean":"2023-10-14T12:30:35.642013+0000","last_became_active":"2023-10-14T12:30:34.333013+0000","last_became_peered":"2023-10-14T12:30:34.333013+0000","last_unstale":"2023-10-14T12:30:35.642013+0000","last_undegraded":"2023-10-14T12:30:35.642013+0000","last_fullsized":"2023-10-14T12:30:35.642013+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.409280+0000","last_change":"2023-10-14T12:30:34.328544+0000","last_active":"2023-10-14T12:30:35.409280+0000","last_peered":"2023-10-14T12:30:35.409280+0000","last_clean":"2023-10-14T12:30:35.409280+0000","last_became_active":"2023-10-14T12:30:34.328152+0000","last_became_peered":"2023-10-14T12:30:34.328152+0000","last_unstale":"2023-10-14T12:30:35.409280+0000","last_undegraded":"2023-10-14T12:30:35.409280+0000","last_fullsized":"2023-10-14T12:30:35.409280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:44:27.435308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.343131+0000","last_change":"2023-10-14T12:30:34.337418+0000","last_active":"2023-10-14T12:30:35.343131+0000","last_peered":"2023-10-14T12:30:35.343131+0000","last_clean":"2023-10-14T12:30:35.343131+0000","last_became_active":"2023-10-14T12:30:34.337024+0000","last_became_peered":"2023-10-14T12:30:34.337024+0000","last_unstale":"2023-10-14T12:30:35.343131+0000","last_undegraded":"2023-10-14T12:30:35.343131+0000","last_fullsized":"2023-10-14T12:30:35.343131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:16:49.094700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642634+0000","last_change":"2023-10-14T12:30:34.334473+0000","last_active":"2023-10-14T12:30:35.642634+0000","last_peered":"2023-10-14T12:30:35.642634+0000","last_clean":"2023-10-14T12:30:35.642634+0000","last_became_active":"2023-10-14T12:30:34.334145+0000","last_became_peered":"2023-10-14T12:30:34.334145+0000","last_unstale":"2023-10-14T12:30:35.642634+0000","last_undegraded":"2023-10-14T12:30:35.642634+0000","last_fullsized":"2023-10-14T12:30:35.642634+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.342938+0000","last_change":"2023-10-14T12:30:34.337611+0000","last_active":"2023-10-14T12:30:35.342938+0000","last_peered":"2023-10-14T12:30:35.342938+0000","last_clean":"2023-10-14T12:30:35.342938+0000","last_became_active":"2023-10-14T12:30:34.336829+0000","last_became_peered":"2023-10-14T12:30:34.336829+0000","last_unstale":"2023-10-14T12:30:35.342938+0000","last_undegraded":"2023-10-14T12:30:35.342938+0000","last_fullsized":"2023-10-14T12:30:35.342938+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:18.001820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339787+0000","last_change":"2023-10-14T12:30:34.339603+0000","last_active":"2023-10-14T12:30:35.339787+0000","last_peered":"2023-10-14T12:30:35.339787+0000","last_clean":"2023-10-14T12:30:35.339787+0000","last_became_active":"2023-10-14T12:30:34.339299+0000","last_became_peered":"2023-10-14T12:30:34.339299+0000","last_unstale":"2023-10-14T12:30:35.339787+0000","last_undegraded":"2023-10-14T12:30:35.339787+0000","last_fullsized":"2023-10-14T12:30:35.339787+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:55:22.736621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.342499+0000","last_change":"2023-10-14T12:30:34.340774+0000","last_active":"2023-10-14T12:30:35.342499+0000","last_peered":"2023-10-14T12:30:35.342499+0000","last_clean":"2023-10-14T12:30:35.342499+0000","last_became_active":"2023-10-14T12:30:34.338070+0000","last_became_peered":"2023-10-14T12:30:34.338070+0000","last_unstale":"2023-10-14T12:30:35.342499+0000","last_undegraded":"2023-10-14T12:30:35.342499+0000","last_fullsized":"2023-10-14T12:30:35.342499+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:18.794987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338246+0000","last_change":"2023-10-14T12:30:34.325514+0000","last_active":"2023-10-14T12:30:35.338246+0000","last_peered":"2023-10-14T12:30:35.338246+0000","last_clean":"2023-10-14T12:30:35.338246+0000","last_became_active":"2023-10-14T12:30:34.325040+0000","last_became_peered":"2023-10-14T12:30:34.325040+0000","last_unstale":"2023-10-14T12:30:35.338246+0000","last_undegraded":"2023-10-14T12:30:35.338246+0000","last_fullsized":"2023-10-14T12:30:35.338246+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:55:57.942140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642219+0000","last_change":"2023-10-14T12:30:34.347217+0000","last_active":"2023-10-14T12:30:35.642219+0000","last_peered":"2023-10-14T12:30:35.642219+0000","last_clean":"2023-10-14T12:30:35.642219+0000","last_became_active":"2023-10-14T12:30:34.346911+0000","last_became_peered":"2023-10-14T12:30:34.346911+0000","last_unstale":"2023-10-14T12:30:35.642219+0000","last_undegraded":"2023-10-14T12:30:35.642219+0000","last_fullsized":"2023-10-14T12:30:35.642219+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642955+0000","last_change":"2023-10-14T12:30:34.346749+0000","last_active":"2023-10-14T12:30:35.642955+0000","last_peered":"2023-10-14T12:30:35.642955+0000","last_clean":"2023-10-14T12:30:35.642955+0000","last_became_active":"2023-10-14T12:30:34.346457+0000","last_became_peered":"2023-10-14T12:30:34.346457+0000","last_unstale":"2023-10-14T12:30:35.642955+0000","last_undegraded":"2023-10-14T12:30:35.642955+0000","last_fullsized":"2023-10-14T12:30:35.642955+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642953+0000","last_change":"2023-10-14T12:30:34.341761+0000","last_active":"2023-10-14T12:30:35.642953+0000","last_peered":"2023-10-14T12:30:35.642953+0000","last_clean":"2023-10-14T12:30:35.642953+0000","last_became_active":"2023-10-14T12:30:34.341455+0000","last_became_peered":"2023-10-14T12:30:34.341455+0000","last_unstale":"2023-10-14T12:30:35.642953+0000","last_undegraded":"2023-10-14T12:30:35.642953+0000","last_fullsized":"2023-10-14T12:30:35.642953+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:10:19.127848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366288+0000","last_change":"2023-10-14T12:30:33.332554+0000","last_active":"2023-10-14T12:30:34.366288+0000","last_peered":"2023-10-14T12:30:34.366288+0000","last_clean":"2023-10-14T12:30:34.366288+0000","last_became_active":"2023-10-14T12:30:33.332275+0000","last_became_peered":"2023-10-14T12:30:33.332275+0000","last_unstale":"2023-10-14T12:30:34.366288+0000","last_undegraded":"2023-10-14T12:30:34.366288+0000","last_fullsized":"2023-10-14T12:30:34.366288+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.033968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642514+0000","last_change":"2023-10-14T12:30:34.338766+0000","last_active":"2023-10-14T12:30:35.642514+0000","last_peered":"2023-10-14T12:30:35.642514+0000","last_clean":"2023-10-14T12:30:35.642514+0000","last_became_active":"2023-10-14T12:30:34.338433+0000","last_became_peered":"2023-10-14T12:30:34.338433+0000","last_unstale":"2023-10-14T12:30:35.642514+0000","last_undegraded":"2023-10-14T12:30:35.642514+0000","last_fullsized":"2023-10-14T12:30:35.642514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.354004+0000","last_change":"2023-10-14T12:30:33.326883+0000","last_active":"2023-10-14T12:30:34.354004+0000","last_peered":"2023-10-14T12:30:34.354004+0000","last_clean":"2023-10-14T12:30:34.354004+0000","last_became_active":"2023-10-14T12:30:33.326581+0000","last_became_peered":"2023-10-14T12:30:33.326581+0000","last_unstale":"2023-10-14T12:30:34.354004+0000","last_undegraded":"2023-10-14T12:30:34.354004+0000","last_fullsized":"2023-10-14T12:30:34.354004+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:05:44.567204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340216+0000","last_change":"2023-10-14T12:30:34.336344+0000","last_active":"2023-10-14T12:30:35.340216+0000","last_peered":"2023-10-14T12:30:35.340216+0000","last_clean":"2023-10-14T12:30:35.340216+0000","last_became_active":"2023-10-14T12:30:34.334996+0000","last_became_peered":"2023-10-14T12:30:34.334996+0000","last_unstale":"2023-10-14T12:30:35.340216+0000","last_undegraded":"2023-10-14T12:30:35.340216+0000","last_fullsized":"2023-10-14T12:30:35.340216+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.359680+0000","last_change":"2023-10-14T12:30:33.335259+0000","last_active":"2023-10-14T12:30:34.359680+0000","last_peered":"2023-10-14T12:30:34.359680+0000","last_clean":"2023-10-14T12:30:34.359680+0000","last_became_active":"2023-10-14T12:30:33.334954+0000","last_became_peered":"2023-10-14T12:30:33.334954+0000","last_unstale":"2023-10-14T12:30:34.359680+0000","last_undegraded":"2023-10-14T12:30:34.359680+0000","last_fullsized":"2023-10-14T12:30:34.359680+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336704+0000","last_change":"2023-10-14T12:30:34.335691+0000","last_active":"2023-10-14T12:30:35.336704+0000","last_peered":"2023-10-14T12:30:35.336704+0000","last_clean":"2023-10-14T12:30:35.336704+0000","last_became_active":"2023-10-14T12:30:34.331967+0000","last_became_peered":"2023-10-14T12:30:34.331967+0000","last_unstale":"2023-10-14T12:30:35.336704+0000","last_undegraded":"2023-10-14T12:30:35.336704+0000","last_fullsized":"2023-10-14T12:30:35.336704+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:51:00.787742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.352499+0000","last_change":"2023-10-14T12:30:33.331342+0000","last_active":"2023-10-14T12:30:34.352499+0000","last_peered":"2023-10-14T12:30:34.352499+0000","last_clean":"2023-10-14T12:30:34.352499+0000","last_became_active":"2023-10-14T12:30:33.331033+0000","last_became_peered":"2023-10-14T12:30:33.331033+0000","last_unstale":"2023-10-14T12:30:34.352499+0000","last_undegraded":"2023-10-14T12:30:34.352499+0000","last_fullsized":"2023-10-14T12:30:34.352499+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:22.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640612+0000","last_change":"2023-10-14T12:30:34.340044+0000","last_active":"2023-10-14T12:30:35.640612+0000","last_peered":"2023-10-14T12:30:35.640612+0000","last_clean":"2023-10-14T12:30:35.640612+0000","last_became_active":"2023-10-14T12:30:34.339781+0000","last_became_peered":"2023-10-14T12:30:34.339781+0000","last_unstale":"2023-10-14T12:30:35.640612+0000","last_undegraded":"2023-10-14T12:30:35.640612+0000","last_fullsized":"2023-10-14T12:30:35.640612+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:51:40.303123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.353622+0000","last_change":"2023-10-14T12:30:33.332976+0000","last_active":"2023-10-14T12:30:34.353622+0000","last_peered":"2023-10-14T12:30:34.353622+0000","last_clean":"2023-10-14T12:30:34.353622+0000","last_became_active":"2023-10-14T12:30:33.332092+0000","last_became_peered":"2023-10-14T12:30:33.332092+0000","last_unstale":"2023-10-14T12:30:34.353622+0000","last_undegraded":"2023-10-14T12:30:34.353622+0000","last_fullsized":"2023-10-14T12:30:34.353622+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:16.163772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.337912+0000","last_change":"2023-10-14T12:30:34.342322+0000","last_active":"2023-10-14T12:30:35.337912+0000","last_peered":"2023-10-14T12:30:35.337912+0000","last_clean":"2023-10-14T12:30:35.337912+0000","last_became_active":"2023-10-14T12:30:34.341523+0000","last_became_peered":"2023-10-14T12:30:34.341523+0000","last_unstale":"2023-10-14T12:30:35.337912+0000","last_undegraded":"2023-10-14T12:30:35.337912+0000","last_fullsized":"2023-10-14T12:30:35.337912+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361072+0000","last_change":"2023-10-14T12:30:33.336252+0000","last_active":"2023-10-14T12:30:34.361072+0000","last_peered":"2023-10-14T12:30:34.361072+0000","last_clean":"2023-10-14T12:30:34.361072+0000","last_became_active":"2023-10-14T12:30:33.335909+0000","last_became_peered":"2023-10-14T12:30:33.335909+0000","last_unstale":"2023-10-14T12:30:34.361072+0000","last_undegraded":"2023-10-14T12:30:34.361072+0000","last_fullsized":"2023-10-14T12:30:34.361072+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:10:31.296526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340309+0000","last_change":"2023-10-14T12:30:34.335844+0000","last_active":"2023-10-14T12:30:35.340309+0000","last_peered":"2023-10-14T12:30:35.340309+0000","last_clean":"2023-10-14T12:30:35.340309+0000","last_became_active":"2023-10-14T12:30:34.335171+0000","last_became_peered":"2023-10-14T12:30:34.335171+0000","last_unstale":"2023-10-14T12:30:35.340309+0000","last_undegraded":"2023-10-14T12:30:35.340309+0000","last_fullsized":"2023-10-14T12:30:35.340309+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.322898+0000","last_change":"2023-10-14T12:30:33.332689+0000","last_active":"2023-10-14T12:30:34.322898+0000","last_peered":"2023-10-14T12:30:34.322898+0000","last_clean":"2023-10-14T12:30:34.322898+0000","last_became_active":"2023-10-14T12:30:33.332347+0000","last_became_peered":"2023-10-14T12:30:33.332347+0000","last_unstale":"2023-10-14T12:30:34.322898+0000","last_undegraded":"2023-10-14T12:30:34.322898+0000","last_fullsized":"2023-10-14T12:30:34.322898+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:16.988646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336152+0000","last_change":"2023-10-14T12:30:34.332500+0000","last_active":"2023-10-14T12:30:35.336152+0000","last_peered":"2023-10-14T12:30:35.336152+0000","last_clean":"2023-10-14T12:30:35.336152+0000","last_became_active":"2023-10-14T12:30:34.331109+0000","last_became_peered":"2023-10-14T12:30:34.331109+0000","last_unstale":"2023-10-14T12:30:35.336152+0000","last_undegraded":"2023-10-14T12:30:35.336152+0000","last_fullsized":"2023-10-14T12:30:35.336152+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:55:22.736621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.314725+0000","last_change":"2023-10-14T12:30:33.321473+0000","last_active":"2023-10-14T12:30:34.314725+0000","last_peered":"2023-10-14T12:30:34.314725+0000","last_clean":"2023-10-14T12:30:34.314725+0000","last_became_active":"2023-10-14T12:30:33.321139+0000","last_became_peered":"2023-10-14T12:30:33.321139+0000","last_unstale":"2023-10-14T12:30:34.314725+0000","last_undegraded":"2023-10-14T12:30:34.314725+0000","last_fullsized":"2023-10-14T12:30:34.314725+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:36:16.988646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410318+0000","last_change":"2023-10-14T12:30:34.338583+0000","last_active":"2023-10-14T12:30:35.410318+0000","last_peered":"2023-10-14T12:30:35.410318+0000","last_clean":"2023-10-14T12:30:35.410318+0000","last_became_active":"2023-10-14T12:30:34.338189+0000","last_became_peered":"2023-10-14T12:30:34.338189+0000","last_unstale":"2023-10-14T12:30:35.410318+0000","last_undegraded":"2023-10-14T12:30:35.410318+0000","last_fullsized":"2023-10-14T12:30:35.410318+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:01:36.790354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.306900+0000","last_change":"2023-10-14T12:30:33.320132+0000","last_active":"2023-10-14T12:30:34.306900+0000","last_peered":"2023-10-14T12:30:34.306900+0000","last_clean":"2023-10-14T12:30:34.306900+0000","last_became_active":"2023-10-14T12:30:33.319838+0000","last_became_peered":"2023-10-14T12:30:33.319838+0000","last_unstale":"2023-10-14T12:30:34.306900+0000","last_undegraded":"2023-10-14T12:30:34.306900+0000","last_fullsized":"2023-10-14T12:30:34.306900+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:55.316034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642979+0000","last_change":"2023-10-14T12:30:34.344050+0000","last_active":"2023-10-14T12:30:35.642979+0000","last_peered":"2023-10-14T12:30:35.642979+0000","last_clean":"2023-10-14T12:30:35.642979+0000","last_became_active":"2023-10-14T12:30:34.343785+0000","last_became_peered":"2023-10-14T12:30:34.343785+0000","last_unstale":"2023-10-14T12:30:35.642979+0000","last_undegraded":"2023-10-14T12:30:35.642979+0000","last_fullsized":"2023-10-14T12:30:35.642979+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:07.653661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.328033+0000","last_change":"2023-10-14T12:30:33.333797+0000","last_active":"2023-10-14T12:30:34.328033+0000","last_peered":"2023-10-14T12:30:34.328033+0000","last_clean":"2023-10-14T12:30:34.328033+0000","last_became_active":"2023-10-14T12:30:33.332493+0000","last_became_peered":"2023-10-14T12:30:33.332493+0000","last_unstale":"2023-10-14T12:30:34.328033+0000","last_undegraded":"2023-10-14T12:30:34.328033+0000","last_fullsized":"2023-10-14T12:30:34.328033+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:55.316034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641670+0000","last_change":"2023-10-14T12:30:34.334615+0000","last_active":"2023-10-14T12:30:35.641670+0000","last_peered":"2023-10-14T12:30:35.641670+0000","last_clean":"2023-10-14T12:30:35.641670+0000","last_became_active":"2023-10-14T12:30:34.334350+0000","last_became_peered":"2023-10-14T12:30:34.334350+0000","last_unstale":"2023-10-14T12:30:35.641670+0000","last_undegraded":"2023-10-14T12:30:35.641670+0000","last_fullsized":"2023-10-14T12:30:35.641670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T22:41:06.867919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361709+0000","last_change":"2023-10-14T12:30:33.336933+0000","last_active":"2023-10-14T12:30:34.361709+0000","last_peered":"2023-10-14T12:30:34.361709+0000","last_clean":"2023-10-14T12:30:34.361709+0000","last_became_active":"2023-10-14T12:30:33.336490+0000","last_became_peered":"2023-10-14T12:30:33.336490+0000","last_unstale":"2023-10-14T12:30:34.361709+0000","last_undegraded":"2023-10-14T12:30:34.361709+0000","last_fullsized":"2023-10-14T12:30:34.361709+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:49.407842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340595+0000","last_change":"2023-10-14T12:30:34.338293+0000","last_active":"2023-10-14T12:30:35.340595+0000","last_peered":"2023-10-14T12:30:35.340595+0000","last_clean":"2023-10-14T12:30:35.340595+0000","last_became_active":"2023-10-14T12:30:34.337931+0000","last_became_peered":"2023-10-14T12:30:34.337931+0000","last_unstale":"2023-10-14T12:30:35.340595+0000","last_undegraded":"2023-10-14T12:30:35.340595+0000","last_fullsized":"2023-10-14T12:30:35.340595+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366483+0000","last_change":"2023-10-14T12:30:33.328447+0000","last_active":"2023-10-14T12:30:34.366483+0000","last_peered":"2023-10-14T12:30:34.366483+0000","last_clean":"2023-10-14T12:30:34.366483+0000","last_became_active":"2023-10-14T12:30:33.327737+0000","last_became_peered":"2023-10-14T12:30:33.327737+0000","last_unstale":"2023-10-14T12:30:34.366483+0000","last_undegraded":"2023-10-14T12:30:34.366483+0000","last_fullsized":"2023-10-14T12:30:34.366483+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640594+0000","last_change":"2023-10-14T12:30:34.344171+0000","last_active":"2023-10-14T12:30:35.640594+0000","last_peered":"2023-10-14T12:30:35.640594+0000","last_clean":"2023-10-14T12:30:35.640594+0000","last_became_active":"2023-10-14T12:30:34.343500+0000","last_became_peered":"2023-10-14T12:30:34.343500+0000","last_unstale":"2023-10-14T12:30:35.640594+0000","last_undegraded":"2023-10-14T12:30:35.640594+0000","last_fullsized":"2023-10-14T12:30:35.640594+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:14:16.183323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.361264+0000","last_change":"2023-10-14T12:30:33.328766+0000","last_active":"2023-10-14T12:30:34.361264+0000","last_peered":"2023-10-14T12:30:34.361264+0000","last_clean":"2023-10-14T12:30:34.361264+0000","last_became_active":"2023-10-14T12:30:33.328489+0000","last_became_peered":"2023-10-14T12:30:33.328489+0000","last_unstale":"2023-10-14T12:30:34.361264+0000","last_undegraded":"2023-10-14T12:30:34.361264+0000","last_fullsized":"2023-10-14T12:30:34.361264+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:06.640486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336014+0000","last_change":"2023-10-14T12:30:34.352227+0000","last_active":"2023-10-14T12:30:35.336014+0000","last_peered":"2023-10-14T12:30:35.336014+0000","last_clean":"2023-10-14T12:30:35.336014+0000","last_became_active":"2023-10-14T12:30:34.349317+0000","last_became_peered":"2023-10-14T12:30:34.349317+0000","last_unstale":"2023-10-14T12:30:35.336014+0000","last_undegraded":"2023-10-14T12:30:35.336014+0000","last_fullsized":"2023-10-14T12:30:35.336014+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.325066+0000","last_change":"2023-10-14T12:30:33.332659+0000","last_active":"2023-10-14T12:30:34.325066+0000","last_peered":"2023-10-14T12:30:34.325066+0000","last_clean":"2023-10-14T12:30:34.325066+0000","last_became_active":"2023-10-14T12:30:33.332041+0000","last_became_peered":"2023-10-14T12:30:33.332041+0000","last_unstale":"2023-10-14T12:30:34.325066+0000","last_undegraded":"2023-10-14T12:30:34.325066+0000","last_fullsized":"2023-10-14T12:30:34.325066+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642391+0000","last_change":"2023-10-14T12:30:34.348353+0000","last_active":"2023-10-14T12:30:35.642391+0000","last_peered":"2023-10-14T12:30:35.642391+0000","last_clean":"2023-10-14T12:30:35.642391+0000","last_became_active":"2023-10-14T12:30:34.348025+0000","last_became_peered":"2023-10-14T12:30:34.348025+0000","last_unstale":"2023-10-14T12:30:35.642391+0000","last_undegraded":"2023-10-14T12:30:35.642391+0000","last_fullsized":"2023-10-14T12:30:35.642391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:43.028361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.311069+0000","last_change":"2023-10-14T12:30:33.329100+0000","last_active":"2023-10-14T12:30:34.311069+0000","last_peered":"2023-10-14T12:30:34.311069+0000","last_clean":"2023-10-14T12:30:34.311069+0000","last_became_active":"2023-10-14T12:30:33.328823+0000","last_became_peered":"2023-10-14T12:30:33.328823+0000","last_unstale":"2023-10-14T12:30:34.311069+0000","last_undegraded":"2023-10-14T12:30:34.311069+0000","last_fullsized":"2023-10-14T12:30:34.311069+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:41:02.880217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336381+0000","last_change":"2023-10-14T12:30:34.333464+0000","last_active":"2023-10-14T12:30:35.336381+0000","last_peered":"2023-10-14T12:30:35.336381+0000","last_clean":"2023-10-14T12:30:35.336381+0000","last_became_active":"2023-10-14T12:30:34.333191+0000","last_became_peered":"2023-10-14T12:30:34.333191+0000","last_unstale":"2023-10-14T12:30:35.336381+0000","last_undegraded":"2023-10-14T12:30:35.336381+0000","last_fullsized":"2023-10-14T12:30:35.336381+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:56:32.399607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.366273+0000","last_change":"2023-10-14T12:30:33.335192+0000","last_active":"2023-10-14T12:30:34.366273+0000","last_peered":"2023-10-14T12:30:34.366273+0000","last_clean":"2023-10-14T12:30:34.366273+0000","last_became_active":"2023-10-14T12:30:33.334783+0000","last_became_peered":"2023-10-14T12:30:33.334783+0000","last_unstale":"2023-10-14T12:30:34.366273+0000","last_undegraded":"2023-10-14T12:30:34.366273+0000","last_fullsized":"2023-10-14T12:30:34.366273+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:20:38.033968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336275+0000","last_change":"2023-10-14T12:30:34.332683+0000","last_active":"2023-10-14T12:30:35.336275+0000","last_peered":"2023-10-14T12:30:35.336275+0000","last_clean":"2023-10-14T12:30:35.336275+0000","last_became_active":"2023-10-14T12:30:34.332353+0000","last_became_peered":"2023-10-14T12:30:34.332353+0000","last_unstale":"2023-10-14T12:30:35.336275+0000","last_undegraded":"2023-10-14T12:30:35.336275+0000","last_fullsized":"2023-10-14T12:30:35.336275+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:48:08.458987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.356295+0000","last_change":"2023-10-14T12:30:33.337568+0000","last_active":"2023-10-14T12:30:34.356295+0000","last_peered":"2023-10-14T12:30:34.356295+0000","last_clean":"2023-10-14T12:30:34.356295+0000","last_became_active":"2023-10-14T12:30:33.337246+0000","last_became_peered":"2023-10-14T12:30:33.337246+0000","last_unstale":"2023-10-14T12:30:34.356295+0000","last_undegraded":"2023-10-14T12:30:34.356295+0000","last_fullsized":"2023-10-14T12:30:34.356295+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:05.932464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.340625+0000","last_change":"2023-10-14T12:30:34.341921+0000","last_active":"2023-10-14T12:30:35.340625+0000","last_peered":"2023-10-14T12:30:35.340625+0000","last_clean":"2023-10-14T12:30:35.340625+0000","last_became_active":"2023-10-14T12:30:34.340210+0000","last_became_peered":"2023-10-14T12:30:34.340210+0000","last_unstale":"2023-10-14T12:30:35.340625+0000","last_undegraded":"2023-10-14T12:30:35.340625+0000","last_fullsized":"2023-10-14T12:30:35.340625+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:06.829396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.354127+0000","last_change":"2023-10-14T12:30:33.332639+0000","last_active":"2023-10-14T12:30:34.354127+0000","last_peered":"2023-10-14T12:30:34.354127+0000","last_clean":"2023-10-14T12:30:34.354127+0000","last_became_active":"2023-10-14T12:30:33.332366+0000","last_became_peered":"2023-10-14T12:30:33.332366+0000","last_unstale":"2023-10-14T12:30:34.354127+0000","last_undegraded":"2023-10-14T12:30:34.354127+0000","last_fullsized":"2023-10-14T12:30:34.354127+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339756+0000","last_change":"2023-10-14T12:30:34.337511+0000","last_active":"2023-10-14T12:30:35.339756+0000","last_peered":"2023-10-14T12:30:35.339756+0000","last_clean":"2023-10-14T12:30:35.339756+0000","last_became_active":"2023-10-14T12:30:34.337096+0000","last_became_peered":"2023-10-14T12:30:34.337096+0000","last_unstale":"2023-10-14T12:30:35.339756+0000","last_undegraded":"2023-10-14T12:30:35.339756+0000","last_fullsized":"2023-10-14T12:30:35.339756+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:19:56.329209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.363671+0000","last_change":"2023-10-14T12:30:33.326267+0000","last_active":"2023-10-14T12:30:34.363671+0000","last_peered":"2023-10-14T12:30:34.363671+0000","last_clean":"2023-10-14T12:30:34.363671+0000","last_became_active":"2023-10-14T12:30:33.326020+0000","last_became_peered":"2023-10-14T12:30:33.326020+0000","last_unstale":"2023-10-14T12:30:34.363671+0000","last_undegraded":"2023-10-14T12:30:34.363671+0000","last_fullsized":"2023-10-14T12:30:34.363671+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T17:42:07.819706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410505+0000","last_change":"2023-10-14T12:30:34.348057+0000","last_active":"2023-10-14T12:30:35.410505+0000","last_peered":"2023-10-14T12:30:35.410505+0000","last_clean":"2023-10-14T12:30:35.410505+0000","last_became_active":"2023-10-14T12:30:34.347721+0000","last_became_peered":"2023-10-14T12:30:34.347721+0000","last_unstale":"2023-10-14T12:30:35.410505+0000","last_undegraded":"2023-10-14T12:30:35.410505+0000","last_fullsized":"2023-10-14T12:30:35.410505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:34:32.333549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.323960+0000","last_change":"2023-10-14T12:30:33.336624+0000","last_active":"2023-10-14T12:30:34.323960+0000","last_peered":"2023-10-14T12:30:34.323960+0000","last_clean":"2023-10-14T12:30:34.323960+0000","last_became_active":"2023-10-14T12:30:33.336299+0000","last_became_peered":"2023-10-14T12:30:33.336299+0000","last_unstale":"2023-10-14T12:30:34.323960+0000","last_undegraded":"2023-10-14T12:30:34.323960+0000","last_fullsized":"2023-10-14T12:30:34.323960+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:23:22.300634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642505+0000","last_change":"2023-10-14T12:30:34.349582+0000","last_active":"2023-10-14T12:30:35.642505+0000","last_peered":"2023-10-14T12:30:35.642505+0000","last_clean":"2023-10-14T12:30:35.642505+0000","last_became_active":"2023-10-14T12:30:34.349281+0000","last_became_peered":"2023-10-14T12:30:34.349281+0000","last_unstale":"2023-10-14T12:30:35.642505+0000","last_undegraded":"2023-10-14T12:30:35.642505+0000","last_fullsized":"2023-10-14T12:30:35.642505+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:47:14.673575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.362637+0000","last_change":"2023-10-14T12:30:33.323532+0000","last_active":"2023-10-14T12:30:34.362637+0000","last_peered":"2023-10-14T12:30:34.362637+0000","last_clean":"2023-10-14T12:30:34.362637+0000","last_became_active":"2023-10-14T12:30:33.323244+0000","last_became_peered":"2023-10-14T12:30:33.323244+0000","last_unstale":"2023-10-14T12:30:34.362637+0000","last_undegraded":"2023-10-14T12:30:34.362637+0000","last_fullsized":"2023-10-14T12:30:34.362637+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:23:31.227443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.640826+0000","last_change":"2023-10-14T12:30:34.339001+0000","last_active":"2023-10-14T12:30:35.640826+0000","last_peered":"2023-10-14T12:30:35.640826+0000","last_clean":"2023-10-14T12:30:35.640826+0000","last_became_active":"2023-10-14T12:30:34.338728+0000","last_became_peered":"2023-10-14T12:30:34.338728+0000","last_unstale":"2023-10-14T12:30:35.640826+0000","last_undegraded":"2023-10-14T12:30:35.640826+0000","last_fullsized":"2023-10-14T12:30:35.640826+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:13:34.174928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.324150+0000","last_change":"2023-10-14T12:30:33.330930+0000","last_active":"2023-10-14T12:30:34.324150+0000","last_peered":"2023-10-14T12:30:34.324150+0000","last_clean":"2023-10-14T12:30:34.324150+0000","last_became_active":"2023-10-14T12:30:33.330353+0000","last_became_peered":"2023-10-14T12:30:33.330353+0000","last_unstale":"2023-10-14T12:30:34.324150+0000","last_undegraded":"2023-10-14T12:30:34.324150+0000","last_fullsized":"2023-10-14T12:30:34.324150+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:22:49.880635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.338674+0000","last_change":"2023-10-14T12:30:34.340027+0000","last_active":"2023-10-14T12:30:35.338674+0000","last_peered":"2023-10-14T12:30:35.338674+0000","last_clean":"2023-10-14T12:30:35.338674+0000","last_became_active":"2023-10-14T12:30:34.339704+0000","last_became_peered":"2023-10-14T12:30:34.339704+0000","last_unstale":"2023-10-14T12:30:35.338674+0000","last_undegraded":"2023-10-14T12:30:35.338674+0000","last_fullsized":"2023-10-14T12:30:35.338674+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:49:07.653661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.316170+0000","last_change":"2023-10-14T12:30:33.326069+0000","last_active":"2023-10-14T12:30:34.316170+0000","last_peered":"2023-10-14T12:30:34.316170+0000","last_clean":"2023-10-14T12:30:34.316170+0000","last_became_active":"2023-10-14T12:30:33.325772+0000","last_became_peered":"2023-10-14T12:30:33.325772+0000","last_unstale":"2023-10-14T12:30:34.316170+0000","last_undegraded":"2023-10-14T12:30:34.316170+0000","last_fullsized":"2023-10-14T12:30:34.316170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336347+0000","last_change":"2023-10-14T12:30:34.334158+0000","last_active":"2023-10-14T12:30:35.336347+0000","last_peered":"2023-10-14T12:30:35.336347+0000","last_clean":"2023-10-14T12:30:35.336347+0000","last_became_active":"2023-10-14T12:30:34.333849+0000","last_became_peered":"2023-10-14T12:30:34.333849+0000","last_unstale":"2023-10-14T12:30:35.336347+0000","last_undegraded":"2023-10-14T12:30:35.336347+0000","last_fullsized":"2023-10-14T12:30:35.336347+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:34:06.829396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.323148+0000","last_change":"2023-10-14T12:30:33.329870+0000","last_active":"2023-10-14T12:30:34.323148+0000","last_peered":"2023-10-14T12:30:34.323148+0000","last_clean":"2023-10-14T12:30:34.323148+0000","last_became_active":"2023-10-14T12:30:33.328179+0000","last_became_peered":"2023-10-14T12:30:33.328179+0000","last_unstale":"2023-10-14T12:30:34.323148+0000","last_undegraded":"2023-10-14T12:30:34.323148+0000","last_fullsized":"2023-10-14T12:30:34.323148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:37:31.238402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642638+0000","last_change":"2023-10-14T12:30:34.341041+0000","last_active":"2023-10-14T12:30:35.642638+0000","last_peered":"2023-10-14T12:30:35.642638+0000","last_clean":"2023-10-14T12:30:35.642638+0000","last_became_active":"2023-10-14T12:30:34.340754+0000","last_became_peered":"2023-10-14T12:30:34.340754+0000","last_unstale":"2023-10-14T12:30:35.642638+0000","last_undegraded":"2023-10-14T12:30:35.642638+0000","last_fullsized":"2023-10-14T12:30:35.642638+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T15:05:06.945638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.360564+0000","last_change":"2023-10-14T12:30:33.335354+0000","last_active":"2023-10-14T12:30:34.360564+0000","last_peered":"2023-10-14T12:30:34.360564+0000","last_clean":"2023-10-14T12:30:34.360564+0000","last_became_active":"2023-10-14T12:30:33.334729+0000","last_became_peered":"2023-10-14T12:30:33.334729+0000","last_unstale":"2023-10-14T12:30:34.360564+0000","last_undegraded":"2023-10-14T12:30:34.360564+0000","last_fullsized":"2023-10-14T12:30:34.360564+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T18:24:42.015187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642514+0000","last_change":"2023-10-14T12:30:34.344478+0000","last_active":"2023-10-14T12:30:35.642514+0000","last_peered":"2023-10-14T12:30:35.642514+0000","last_clean":"2023-10-14T12:30:35.642514+0000","last_became_active":"2023-10-14T12:30:34.344186+0000","last_became_peered":"2023-10-14T12:30:34.344186+0000","last_unstale":"2023-10-14T12:30:35.642514+0000","last_undegraded":"2023-10-14T12:30:35.642514+0000","last_fullsized":"2023-10-14T12:30:35.642514+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T12:45:56.945381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"41'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.410290+0000","last_change":"2023-10-14T12:30:33.332845+0000","last_active":"2023-10-14T12:30:35.410290+0000","last_peered":"2023-10-14T12:30:35.410290+0000","last_clean":"2023-10-14T12:30:35.410290+0000","last_became_active":"2023-10-14T12:30:33.332542+0000","last_became_peered":"2023-10-14T12:30:33.332542+0000","last_unstale":"2023-10-14T12:30:35.410290+0000","last_undegraded":"2023-10-14T12:30:35.410290+0000","last_fullsized":"2023-10-14T12:30:35.410290+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T20:52:31.735498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.336653+0000","last_change":"2023-10-14T12:30:34.326040+0000","last_active":"2023-10-14T12:30:35.336653+0000","last_peered":"2023-10-14T12:30:35.336653+0000","last_clean":"2023-10-14T12:30:35.336653+0000","last_became_active":"2023-10-14T12:30:34.325727+0000","last_became_peered":"2023-10-14T12:30:34.325727+0000","last_unstale":"2023-10-14T12:30:35.336653+0000","last_undegraded":"2023-10-14T12:30:35.336653+0000","last_fullsized":"2023-10-14T12:30:35.336653+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:00.187156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.328527+0000","last_change":"2023-10-14T12:30:33.324071+0000","last_active":"2023-10-14T12:30:34.328527+0000","last_peered":"2023-10-14T12:30:34.328527+0000","last_clean":"2023-10-14T12:30:34.328527+0000","last_became_active":"2023-10-14T12:30:33.323094+0000","last_became_peered":"2023-10-14T12:30:33.323094+0000","last_unstale":"2023-10-14T12:30:34.328527+0000","last_undegraded":"2023-10-14T12:30:34.328527+0000","last_fullsized":"2023-10-14T12:30:34.328527+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:17:37.737804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.641010+0000","last_change":"2023-10-14T12:30:34.332515+0000","last_active":"2023-10-14T12:30:35.641010+0000","last_peered":"2023-10-14T12:30:35.641010+0000","last_clean":"2023-10-14T12:30:35.641010+0000","last_became_active":"2023-10-14T12:30:34.332238+0000","last_became_peered":"2023-10-14T12:30:34.332238+0000","last_unstale":"2023-10-14T12:30:35.641010+0000","last_undegraded":"2023-10-14T12:30:35.641010+0000","last_fullsized":"2023-10-14T12:30:35.641010+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:17:47.296104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.330083+0000","last_change":"2023-10-14T12:30:33.326955+0000","last_active":"2023-10-14T12:30:34.330083+0000","last_peered":"2023-10-14T12:30:34.330083+0000","last_clean":"2023-10-14T12:30:34.330083+0000","last_became_active":"2023-10-14T12:30:33.326641+0000","last_became_peered":"2023-10-14T12:30:33.326641+0000","last_unstale":"2023-10-14T12:30:34.330083+0000","last_undegraded":"2023-10-14T12:30:34.330083+0000","last_fullsized":"2023-10-14T12:30:34.330083+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:40:06.451441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.642148+0000","last_change":"2023-10-14T12:30:34.337150+0000","last_active":"2023-10-14T12:30:35.642148+0000","last_peered":"2023-10-14T12:30:35.642148+0000","last_clean":"2023-10-14T12:30:35.642148+0000","last_became_active":"2023-10-14T12:30:34.336587+0000","last_became_peered":"2023-10-14T12:30:34.336587+0000","last_unstale":"2023-10-14T12:30:35.642148+0000","last_undegraded":"2023-10-14T12:30:35.642148+0000","last_fullsized":"2023-10-14T12:30:35.642148+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T16:20:50.421016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.307375+0000","last_change":"2023-10-14T12:30:33.324592+0000","last_active":"2023-10-14T12:30:34.307375+0000","last_peered":"2023-10-14T12:30:34.307375+0000","last_clean":"2023-10-14T12:30:34.307375+0000","last_became_active":"2023-10-14T12:30:33.324291+0000","last_became_peered":"2023-10-14T12:30:33.324291+0000","last_unstale":"2023-10-14T12:30:34.307375+0000","last_undegraded":"2023-10-14T12:30:34.307375+0000","last_fullsized":"2023-10-14T12:30:34.307375+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:16:49.872326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.339476+0000","last_change":"2023-10-14T12:30:34.336051+0000","last_active":"2023-10-14T12:30:35.339476+0000","last_peered":"2023-10-14T12:30:35.339476+0000","last_clean":"2023-10-14T12:30:35.339476+0000","last_became_active":"2023-10-14T12:30:34.335577+0000","last_became_peered":"2023-10-14T12:30:34.335577+0000","last_unstale":"2023-10-14T12:30:35.339476+0000","last_undegraded":"2023-10-14T12:30:35.339476+0000","last_fullsized":"2023-10-14T12:30:35.339476+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T13:45:17.176947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.314696+0000","last_change":"2023-10-14T12:30:33.327237+0000","last_active":"2023-10-14T12:30:34.314696+0000","last_peered":"2023-10-14T12:30:34.314696+0000","last_clean":"2023-10-14T12:30:34.314696+0000","last_became_active":"2023-10-14T12:30:33.324300+0000","last_became_peered":"2023-10-14T12:30:33.324300+0000","last_unstale":"2023-10-14T12:30:34.314696+0000","last_undegraded":"2023-10-14T12:30:34.314696+0000","last_fullsized":"2023-10-14T12:30:34.314696+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:07:17.781812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.643321+0000","last_change":"2023-10-14T12:30:34.348604+0000","last_active":"2023-10-14T12:30:35.643321+0000","last_peered":"2023-10-14T12:30:35.643321+0000","last_clean":"2023-10-14T12:30:35.643321+0000","last_became_active":"2023-10-14T12:30:34.348038+0000","last_became_peered":"2023-10-14T12:30:34.348038+0000","last_unstale":"2023-10-14T12:30:35.643321+0000","last_undegraded":"2023-10-14T12:30:35.643321+0000","last_fullsized":"2023-10-14T12:30:35.643321+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T14:30:53.508918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.305160+0000","last_change":"2023-10-14T12:30:33.320974+0000","last_active":"2023-10-14T12:30:34.305160+0000","last_peered":"2023-10-14T12:30:34.305160+0000","last_clean":"2023-10-14T12:30:34.305160+0000","last_became_active":"2023-10-14T12:30:33.320705+0000","last_became_peered":"2023-10-14T12:30:33.320705+0000","last_unstale":"2023-10-14T12:30:34.305160+0000","last_undegraded":"2023-10-14T12:30:34.305160+0000","last_fullsized":"2023-10-14T12:30:34.305160+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:27:52.984601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-10-14T12:30:35.341685+0000","last_change":"2023-10-14T12:30:34.352591+0000","last_active":"2023-10-14T12:30:35.341685+0000","last_peered":"2023-10-14T12:30:35.341685+0000","last_clean":"2023-10-14T12:30:35.341685+0000","last_became_active":"2023-10-14T12:30:34.352190+0000","last_became_peered":"2023-10-14T12:30:34.352190+0000","last_unstale":"2023-10-14T12:30:35.341685+0000","last_undegraded":"2023-10-14T12:30:35.341685+0000","last_fullsized":"2023-10-14T12:30:35.341685+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:33.278433+0000","last_clean_scrub_stamp":"2023-10-14T12:30:33.278433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T19:11:28.730425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.326107+0000","last_change":"2023-10-14T12:30:33.329384+0000","last_active":"2023-10-14T12:30:34.326107+0000","last_peered":"2023-10-14T12:30:34.326107+0000","last_clean":"2023-10-14T12:30:34.326107+0000","last_became_active":"2023-10-14T12:30:33.328937+0000","last_became_peered":"2023-10-14T12:30:33.328937+0000","last_unstale":"2023-10-14T12:30:34.326107+0000","last_undegraded":"2023-10-14T12:30:34.326107+0000","last_fullsized":"2023-10-14T12:30:34.326107+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:30:32.265259+0000","last_clean_scrub_stamp":"2023-10-14T12:30:32.265259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-16T00:10:43.333747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":182,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-10-14T12:30:34.319081+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T12:30:34.319081+0000","last_peered":"2023-10-14T12:30:34.319081+0000","last_clean":"2023-10-14T12:30:34.319081+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T12:30:34.319081+0000","last_undegraded":"2023-10-14T12:30:34.319081+0000","last_fullsized":"2023-10-14T12:30:34.319081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542171,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28080,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343760,"statfs":{"total":96636764160,"available":96608010240,"internally_reserved":0,"allocated":1081344,"data_stored":796263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":1.264},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.91100000000000003}]},{"osd":1,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.363,"5min":1.363,"15min":1.363},"last":0.63300000000000001},{"interface":"front","average":{"1min":1.115,"5min":1.115,"15min":1.115},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":1.7929999999999999,"5min":1.7929999999999999,"15min":1.7929999999999999},"last":1.1040000000000001}]},{"osd":2,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":1.853,"5min":1.853,"15min":1.853},"last":1.4430000000000001},{"interface":"front","average":{"1min":1.169,"5min":1.169,"15min":1.169},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.80800000000000005}]},{"osd":3,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.0990000000000002,"5min":2.0990000000000002,"15min":2.0990000000000002},"last":0.94099999999999995},{"interface":"front","average":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"min":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"max":{"1min":1.7370000000000001,"5min":1.7370000000000001,"15min":1.7370000000000001},"last":1.5569999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.907,"5min":1.907,"15min":1.907},"last":1.3959999999999999},{"interface":"front","average":{"1min":1.409,"5min":1.409,"15min":1.409},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":1.2210000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.972,"5min":1.972,"15min":1.972},"last":1.651},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":2.0579999999999998,"5min":2.0579999999999998,"15min":2.0579999999999998},"last":1.498}]},{"osd":6,"last update":"Sat Oct 14 12:29:41 2023","interfaces":[{"interface":"back","average":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.4950000000000001},"min":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":1.3120000000000001},{"interface":"front","average":{"1min":1.454,"5min":1.454,"15min":1.454},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.2040000000000002,"5min":2.2040000000000002,"15min":2.2040000000000002},"last":1.3540000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":204795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.714,"5min":1.714,"15min":1.714},"last":1.474},{"interface":"front","average":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.9690000000000001,"5min":1.9690000000000001,"15min":1.9690000000000001},"last":0.95399999999999996}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7430000000000001,"5min":1.7430000000000001,"15min":1.7430000000000001},"last":0.77200000000000002}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.871,"5min":1.871,"15min":1.871},"last":1.234},{"interface":"front","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.8540000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.246,"5min":1.246,"15min":1.246},"min":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.1539999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.339,"5min":1.339,"15min":1.339},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.9670000000000001,"5min":1.9670000000000001,"15min":1.9670000000000001},"last":1.3839999999999999},{"interface":"front","average":{"1min":1.401,"5min":1.401,"15min":1.401},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":1.04}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.085},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.105,"5min":2.105,"15min":2.105},"last":1.597}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":2.1309999999999998,"5min":2.1309999999999998,"15min":2.1309999999999998},"last":1.3100000000000001},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":2.2029999999999998,"5min":2.2029999999999998,"15min":2.2029999999999998},"last":1.3440000000000001}]}]},{"osd":5,"up_from":14,"seq":60129542170,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":204325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.89300000000000002},{"interface":"front","average":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"last":1.1819999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"last":0.997}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.133,"5min":1.133,"15min":1.133},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":1.107},{"interface":"front","average":{"1min":1.1859999999999999,"5min":1.1859999999999999,"15min":1.1859999999999999},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":1.141}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":3.5899999999999999,"5min":3.5899999999999999,"15min":3.5899999999999999},"last":0.94699999999999995},{"interface":"front","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":3.6360000000000001,"5min":3.6360000000000001,"15min":3.6360000000000001},"last":1.2769999999999999}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":2.54,"5min":2.54,"15min":2.54},"last":1.367},{"interface":"front","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":3.2949999999999999,"5min":3.2949999999999999,"15min":3.2949999999999999},"last":1.325}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.484,"5min":1.484,"15min":1.484},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":2.9929999999999999,"5min":2.9929999999999999,"15min":2.9929999999999999},"last":1.53},{"interface":"front","average":{"1min":1.552,"5min":1.552,"15min":1.552},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.494}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.554,"5min":1.554,"15min":1.554},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":3.1549999999999998,"5min":3.1549999999999998,"15min":3.1549999999999998},"last":1.571},{"interface":"front","average":{"1min":1.585,"5min":1.585,"15min":1.585},"min":{"1min":0.624,"5min":0.624,"15min":0.624},"max":{"1min":3.242,"5min":3.242,"15min":3.242},"last":1.7350000000000001}]}]},{"osd":4,"up_from":14,"seq":60129542171,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":204817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.7390000000000001,"5min":1.7390000000000001,"15min":1.7390000000000001},"last":0.89700000000000002},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.627,"5min":1.627,"15min":1.627},"last":1.6599999999999999}]},{"osd":1,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.0349999999999999},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":1.387}]},{"osd":2,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.327,"5min":1.327,"15min":1.327},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":2.661,"5min":2.661,"15min":2.661},"last":1.5089999999999999},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":2.605,"5min":2.605,"15min":2.605},"last":1.23}]},{"osd":3,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.984,"5min":1.984,"15min":1.984},"last":0.995},{"interface":"front","average":{"1min":1.26,"5min":1.26,"15min":1.26},"min":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"max":{"1min":1.9219999999999999,"5min":1.9219999999999999,"15min":1.9219999999999999},"last":1.28}]},{"osd":5,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.159,"5min":1.159,"15min":1.159},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":1.9199999999999999},"last":1.5680000000000001},{"interface":"front","average":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":1.4339999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.377,"5min":1.377,"15min":1.377},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":2.0449999999999999,"5min":2.0449999999999999,"15min":2.0449999999999999},"last":1.605},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.121,"5min":2.121,"15min":2.121},"last":1.629}]},{"osd":7,"last update":"Sat Oct 14 12:29:40 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.222,"5min":2.222,"15min":2.222},"last":1.77},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":1.716}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27500,"kb_used_data":476,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344340,"statfs":{"total":96636764160,"available":96608604160,"internally_reserved":0,"allocated":487424,"data_stored":205859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1591,"internal_metadata":27654601},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":1.266},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.94599999999999995}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":3.3879999999999999,"5min":3.3879999999999999,"15min":3.3879999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":1.1339999999999999}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":1.218},{"interface":"front","average":{"1min":1.093,"5min":1.093,"15min":1.093},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":2.298,"5min":2.298,"15min":2.298},"last":0.84699999999999998}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"min":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"max":{"1min":2.355,"5min":2.355,"15min":2.355},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":2.5819999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":1.2030000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.419},{"interface":"front","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.431,"5min":2.431,"15min":2.431},"last":1.3109999999999999}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"max":{"1min":2.52,"5min":2.52,"15min":2.52},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"max":{"1min":2.2400000000000002,"5min":2.2400000000000002,"15min":2.2400000000000002},"last":1.7390000000000001}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"min":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"max":{"1min":2.3980000000000001,"5min":2.3980000000000001,"15min":2.3980000000000001},"last":1.657},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":3.504,"5min":3.504,"15min":3.504},"last":1.5469999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542171,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":475136,"data_stored":204283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.504,"5min":1.504,"15min":1.504},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.306}]},{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":0.79300000000000004},{"interface":"front","average":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.661,"5min":1.661,"15min":1.661},"last":1.1160000000000001}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.042,"5min":1.042,"15min":1.042},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.7490000000000001,"5min":1.7490000000000001,"15min":1.7490000000000001},"last":1.357},{"interface":"front","average":{"1min":1.171,"5min":1.171,"15min":1.171},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.206}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.258,"5min":1.258,"15min":1.258},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":1.583},{"interface":"front","average":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.2529999999999999}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.423,"5min":1.423,"15min":1.423},"min":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.0960000000000001,"5min":2.0960000000000001,"15min":2.0960000000000001},"last":1.4119999999999999},{"interface":"front","average":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.4329999999999998,"5min":2.4329999999999998,"15min":2.4329999999999998},"last":1.4570000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"max":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"last":1.825},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.6160000000000001,"15min":1.6160000000000001},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.5680000000000001,"5min":2.5680000000000001,"15min":2.5680000000000001},"last":1.5429999999999999}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":1.8},{"interface":"front","average":{"1min":1.653,"5min":1.653,"15min":1.653},"min":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.921}]}]},{"osd":1,"up_from":14,"seq":60129542171,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":475136,"data_stored":204303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.80300000000000005}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.601,"5min":1.601,"15min":1.601},"last":0.71599999999999997},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.744,"5min":1.744,"15min":1.744},"last":0.755}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.8700000000000001,"5min":1.8700000000000001,"15min":1.8700000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.1890000000000001}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2230000000000001,"5min":1.2230000000000001,"15min":1.2230000000000001},"min":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"max":{"1min":2.1230000000000002,"5min":2.1230000000000002,"15min":2.1230000000000002},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.343,"5min":1.343,"15min":1.343},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"last":1.3220000000000001}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.5},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":2.4900000000000002,"5min":2.4900000000000002,"15min":2.4900000000000002},"last":1.3420000000000001}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":1.27},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":1.595}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.2170000000000001,"5min":2.2170000000000001,"15min":2.2170000000000001},"last":1.659},{"interface":"front","average":{"1min":1.4850000000000001,"5min":1.4850000000000001,"15min":1.4850000000000001},"min":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"max":{"1min":2.569,"5min":2.569,"15min":2.569},"last":1.4279999999999999}]}]},{"osd":0,"up_from":14,"seq":60129542170,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28064,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343776,"statfs":{"total":96636764160,"available":96608026624,"internally_reserved":0,"allocated":1069056,"data_stored":794615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.544,"5min":2.544,"15min":2.544},"last":0.379},{"interface":"front","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"last":0.496}]},{"osd":2,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":5.2930000000000001,"5min":5.2930000000000001,"15min":5.2930000000000001},"last":0.442},{"interface":"front","average":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.81999999999999995}]},{"osd":3,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.56200000000000006},{"interface":"front","average":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":2.8010000000000002,"5min":2.8010000000000002,"15min":2.8010000000000002},"last":0.68600000000000005}]},{"osd":4,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":2.2629999999999999,"5min":2.2629999999999999,"15min":2.2629999999999999},"last":1.363},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.754,"5min":1.754,"15min":1.754},"last":0.94599999999999995}]},{"osd":5,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.49,"5min":1.49,"15min":1.49},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.7170000000000001,"5min":2.7170000000000001,"15min":2.7170000000000001},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4199999999999999,"5min":1.4199999999999999,"15min":1.4199999999999999},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":2.4300000000000002,"5min":2.4300000000000002,"15min":2.4300000000000002},"last":1.147}]},{"osd":6,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3240000000000001,"5min":1.3240000000000001,"15min":1.3240000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":2.5139999999999998,"5min":2.5139999999999998,"15min":2.5139999999999998},"last":0.98999999999999999},{"interface":"front","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":3.6549999999999998,"5min":3.6549999999999998,"15min":3.6549999999999998},"last":0.998}]},{"osd":7,"last update":"Sat Oct 14 12:29:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":2.5600000000000001,"5min":2.5600000000000001,"15min":2.5600000000000001},"last":1.2569999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"min":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"max":{"1min":2.827,"5min":2.827,"15min":2.827},"last":1.018}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T12:30:44.798 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-14T12:30:44.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=testcephfs1' mds allow 2023-10-14T12:30:45.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.074+0000 7fdf2ffff640 1 Processor -- start 2023-10-14T12:30:45.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.075+0000 7fdf2ffff640 1 -- start start 2023-10-14T12:30:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf30159640 0x7fdf300b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdf300b2d50 0x7fdf300cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2ffff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf300b3d50 con 0x7fdf300cf900 2023-10-14T12:30:45.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2ffff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf300cfd90 con 0x7fdf30159640 2023-10-14T12:30:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2ffff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf30072190 con 0x7fdf300b2d50 2023-10-14T12:30:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdf30159640 0x7fdf300b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2f7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdf300cf900 0x7fdf3006e830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:56004/0 (socket says 172.21.15.64:56004) 2023-10-14T12:30:45.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.077+0000 7fdf2f7fe640 1 -- 172.21.15.64:0/567729528 learned_addr learned my addr 172.21.15.64:0/567729528 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.078+0000 7fdf27fff640 1 --2- 172.21.15.64:0/567729528 >> v2:172.21.15.177:3300/0 conn(0x7fdf300b2d50 0x7fdf300cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.078+0000 7fdf2effd640 1 -- 172.21.15.64:0/567729528 >> v2:172.21.15.177:3300/0 conn(0x7fdf300b2d50 msgr2=0x7fdf300cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.078+0000 7fdf2effd640 1 --2- 172.21.15.64:0/567729528 >> v2:172.21.15.177:3300/0 conn(0x7fdf300b2d50 0x7fdf300cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.082 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.078+0000 7fdf2effd640 1 -- 172.21.15.64:0/567729528 >> v1:172.21.15.64:6789/0 conn(0x7fdf300cf900 legacy=0x7fdf3006e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.078+0000 7fdf2effd640 1 -- 172.21.15.64:0/567729528 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf30071bd0 con 0x7fdf30159640 2023-10-14T12:30:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.078+0000 7fdf27fff640 1 --2- 172.21.15.64:0/567729528 >> v2:172.21.15.177:3300/0 conn(0x7fdf300b2d50 0x7fdf300cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.079+0000 7fdf2effd640 1 --2- 172.21.15.64:0/567729528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf30159640 0x7fdf300b41e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdf200097a0 tx=0x7fdf2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8932160c49c51d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.079+0000 7fdf2e7fc640 1 -- 172.21.15.64:0/567729528 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20031830 con 0x7fdf30159640 2023-10-14T12:30:45.083 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2e7fc640 1 -- 172.21.15.64:0/567729528 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf20031990 con 0x7fdf30159640 2023-10-14T12:30:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2e7fc640 1 -- 172.21.15.64:0/567729528 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20031d20 con 0x7fdf30159640 2023-10-14T12:30:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 -- 172.21.15.64:0/567729528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf30159640 msgr2=0x7fdf300b41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/567729528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf30159640 0x7fdf300b41e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fdf200097a0 tx=0x7fdf2002b8d0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 -- 172.21.15.64:0/567729528 shutdown_connections 2023-10-14T12:30:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/567729528 >> v2:172.21.15.177:3300/0 conn(0x7fdf300b2d50 0x7fdf300cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/567729528 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf30159640 0x7fdf300b41e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 -- 172.21.15.64:0/567729528 >> 172.21.15.64:0/567729528 conn(0x7fdf300b1040 msgr2=0x7fdf300b1420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:45.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 -- 172.21.15.64:0/567729528 shutdown_connections 2023-10-14T12:30:45.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.080+0000 7fdf2ffff640 1 -- 172.21.15.64:0/567729528 wait complete. 2023-10-14T12:30:45.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.082+0000 7fdf2ffff640 1 Processor -- start 2023-10-14T12:30:45.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.082+0000 7fdf2ffff640 1 -- start start 2023-10-14T12:30:45.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2ffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf300b2d50 0x7fdf300aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf300cf900 0x7fdf30152560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2ffff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf30159640 0x7fdf300afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2ffff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3015a4f0 con 0x7fdf300b2d50 2023-10-14T12:30:45.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2ffff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf300af1b0 con 0x7fdf30159640 2023-10-14T12:30:45.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2ffff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf30159b50 con 0x7fdf300cf900 2023-10-14T12:30:45.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf300b2d50 0x7fdf300aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2effd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf300b2d50 0x7fdf300aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52168/0 (socket says 172.21.15.64:52168) 2023-10-14T12:30:45.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.083+0000 7fdf2effd640 1 -- 172.21.15.64:0/2889653206 learned_addr learned my addr 172.21.15.64:0/2889653206 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:45.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf27fff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf300cf900 0x7fdf30152560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf2f7fe640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf30159640 0x7fdf300afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf2effd640 1 -- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf300cf900 msgr2=0x7fdf30152560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf2effd640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf300cf900 0x7fdf30152560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf2effd640 1 -- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf30159640 msgr2=0x7fdf300afd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf2effd640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf30159640 0x7fdf300afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf2effd640 1 -- 172.21.15.64:0/2889653206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf20009400 con 0x7fdf300b2d50 2023-10-14T12:30:45.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf27fff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf300cf900 0x7fdf30152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:45.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf2effd640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf300b2d50 0x7fdf300aec70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdf20034040 tx=0x7fdf200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:45.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.084+0000 7fdf277fe640 1 -- 172.21.15.64:0/2889653206 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2003aa60 con 0x7fdf300b2d50 2023-10-14T12:30:45.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.085+0000 7fdf277fe640 1 -- 172.21.15.64:0/2889653206 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2003abe0 con 0x7fdf300b2d50 2023-10-14T12:30:45.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.085+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf30159e30 con 0x7fdf300b2d50 2023-10-14T12:30:45.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.085+0000 7fdf277fe640 1 -- 172.21.15.64:0/2889653206 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf20044400 con 0x7fdf300b2d50 2023-10-14T12:30:45.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.085+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3015a910 con 0x7fdf300b2d50 2023-10-14T12:30:45.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.086+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf30067440 con 0x7fdf300b2d50 2023-10-14T12:30:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.087+0000 7fdf277fe640 1 -- 172.21.15.64:0/2889653206 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdf2004d440 con 0x7fdf300b2d50 2023-10-14T12:30:45.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.088+0000 7fdf277fe640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf1006ae70 0x7fdf1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.088+0000 7fdf277fe640 1 -- 172.21.15.64:0/2889653206 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fdf200aba90 con 0x7fdf300b2d50 2023-10-14T12:30:45.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.089+0000 7fdf27fff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf1006ae70 0x7fdf1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.090+0000 7fdf27fff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf1006ae70 0x7fdf1006d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf18006fd0 tx=0x7fdf18008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:45.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.093+0000 7fdf277fe640 1 -- 172.21.15.64:0/2889653206 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fdf200769d0 con 0x7fdf300b2d50 2023-10-14T12:30:45.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.367+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]} v 0) v1 -- 0x7fdf3006a310 con 0x7fdf300b2d50 2023-10-14T12:30:45.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.373+0000 7fdf277fe640 1 -- 172.21.15.64:0/2889653206 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=testcephfs1", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 195+0+152 (secure 0 0 0) 0x7fdf200350f0 con 0x7fdf300b2d50 2023-10-14T12:30:45.376 INFO:teuthology.orchestra.run.smithi064.stdout:[client.0] 2023-10-14T12:30:45.376 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQBBiSplkVBXBhAA+eSaJH/y9hONFgFzhTnWKQ== 2023-10-14T12:30:45.376 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow" 2023-10-14T12:30:45.377 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow r" 2023-10-14T12:30:45.377 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow rw tag cephfs data=testcephfs1" 2023-10-14T12:30:45.379 INFO:teuthology.orchestra.run.smithi064.stderr:updated caps for client.0 2023-10-14T12:30:45.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf1006ae70 msgr2=0x7fdf1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf1006ae70 0x7fdf1006d330 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fdf18006fd0 tx=0x7fdf18008040 comp rx=0 tx=0).stop 2023-10-14T12:30:45.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf300b2d50 msgr2=0x7fdf300aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.380 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf300b2d50 0x7fdf300aec70 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fdf20034040 tx=0x7fdf200046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 shutdown_connections 2023-10-14T12:30:45.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdf1006ae70 0x7fdf1006d330 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdf30159640 0x7fdf300afd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdf300cf900 0x7fdf30152560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 --2- 172.21.15.64:0/2889653206 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdf300b2d50 0x7fdf300aec70 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 >> 172.21.15.64:0/2889653206 conn(0x7fdf300b1040 msgr2=0x7fdf300cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:45.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 shutdown_connections 2023-10-14T12:30:45.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.376+0000 7fdf2ffff640 1 -- 172.21.15.64:0/2889653206 wait complete. 2023-10-14T12:30:45.397 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T12:30:45.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.613+0000 7fde8f59e640 1 Processor -- start 2023-10-14T12:30:45.615 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.614+0000 7fde8f59e640 1 -- start start 2023-10-14T12:30:45.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.615+0000 7fde8f59e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fde9015a8d0 0x7fde900cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.615+0000 7fde8f59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fde9006ff40 0x7fde900cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.615+0000 7fde8f59e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde9015acb0 con 0x7fde900ca660 2023-10-14T12:30:45.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.615+0000 7fde8f59e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde900c1c60 con 0x7fde9015a8d0 2023-10-14T12:30:45.617 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.615+0000 7fde8f59e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde9015e350 con 0x7fde9006ff40 2023-10-14T12:30:45.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8dd9b640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fde900ca660 0x7fde9006bf30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:56020/0 (socket says 172.21.15.64:56020) 2023-10-14T12:30:45.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8dd9b640 1 -- 172.21.15.64:0/1965688971 learned_addr learned my addr 172.21.15.64:0/1965688971 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:45.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8e59c640 1 --2- 172.21.15.64:0/1965688971 >> v2:172.21.15.64:3300/0 conn(0x7fde9015a8d0 0x7fde900cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8ed9d640 1 --2- 172.21.15.64:0/1965688971 >> v2:172.21.15.177:3300/0 conn(0x7fde9006ff40 0x7fde900cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.619 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8d59a640 1 -- 172.21.15.64:0/1965688971 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1172224638 0 0) 0x7fde84001110 con 0x7fde900ca660 2023-10-14T12:30:45.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8d59a640 1 -- 172.21.15.64:0/1965688971 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde78003520 con 0x7fde900ca660 2023-10-14T12:30:45.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8e59c640 1 -- 172.21.15.64:0/1965688971 >> v2:172.21.15.177:3300/0 conn(0x7fde9006ff40 msgr2=0x7fde900cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:45.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8e59c640 1 --2- 172.21.15.64:0/1965688971 >> v2:172.21.15.177:3300/0 conn(0x7fde9006ff40 0x7fde900cb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8e59c640 1 -- 172.21.15.64:0/1965688971 >> v1:172.21.15.64:6789/0 conn(0x7fde900ca660 legacy=0x7fde9006bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.620 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.616+0000 7fde8e59c640 1 -- 172.21.15.64:0/1965688971 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9015e630 con 0x7fde9015a8d0 2023-10-14T12:30:45.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.617+0000 7fde8e59c640 1 --2- 172.21.15.64:0/1965688971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9015a8d0 0x7fde900cab40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fde900c1a30 tx=0x7fde8002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22fd9a33e3379493 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8d59a640 1 -- 172.21.15.64:0/1965688971 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80031830 con 0x7fde9015a8d0 2023-10-14T12:30:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8d59a640 1 -- 172.21.15.64:0/1965688971 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde80031990 con 0x7fde9015a8d0 2023-10-14T12:30:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8d59a640 1 -- 172.21.15.64:0/1965688971 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde80031d20 con 0x7fde9015a8d0 2023-10-14T12:30:45.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8f59e640 1 -- 172.21.15.64:0/1965688971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9015a8d0 msgr2=0x7fde900cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1965688971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9015a8d0 0x7fde900cab40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fde900c1a30 tx=0x7fde8002b8d0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8f59e640 1 -- 172.21.15.64:0/1965688971 shutdown_connections 2023-10-14T12:30:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1965688971 >> v2:172.21.15.177:3300/0 conn(0x7fde9006ff40 0x7fde900cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1965688971 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9015a8d0 0x7fde900cab40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.618+0000 7fde8f59e640 1 -- 172.21.15.64:0/1965688971 >> 172.21.15.64:0/1965688971 conn(0x7fde9006a470 msgr2=0x7fde900afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:45.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.619+0000 7fde8f59e640 1 -- 172.21.15.64:0/1965688971 shutdown_connections 2023-10-14T12:30:45.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.619+0000 7fde8f59e640 1 -- 172.21.15.64:0/1965688971 wait complete. 2023-10-14T12:30:45.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.621+0000 7fde8f59e640 1 Processor -- start 2023-10-14T12:30:45.626 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.621+0000 7fde8f59e640 1 -- start start 2023-10-14T12:30:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.622+0000 7fde8f59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9006ff40 0x7fde901532f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.622+0000 7fde8f59e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde900ca660 0x7fde900c7510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.622+0000 7fde8f59e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde9015a8d0 0x7fde900c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.622+0000 7fde8f59e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde900cdc80 con 0x7fde9006ff40 2023-10-14T12:30:45.627 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.622+0000 7fde8f59e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde900ccd90 con 0x7fde9015a8d0 2023-10-14T12:30:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.622+0000 7fde8f59e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde900cd070 con 0x7fde900ca660 2023-10-14T12:30:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9006ff40 0x7fde901532f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9006ff40 0x7fde901532f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:52178/0 (socket says 172.21.15.64:52178) 2023-10-14T12:30:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 -- 172.21.15.64:0/1343691577 learned_addr learned my addr 172.21.15.64:0/1343691577 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:45.628 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8dd9b640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde900ca660 0x7fde900c7510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8ed9d640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde9015a8d0 0x7fde900c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 -- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde900ca660 msgr2=0x7fde900c7510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde900ca660 0x7fde900c7510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 -- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde9015a8d0 msgr2=0x7fde900c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde9015a8d0 0x7fde900c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8e59c640 1 -- 172.21.15.64:0/1343691577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde800093a0 con 0x7fde9006ff40 2023-10-14T12:30:45.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8dd9b640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde900ca660 0x7fde900c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:45.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.623+0000 7fde8ed9d640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde9015a8d0 0x7fde900c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:45.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.624+0000 7fde8e59c640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9006ff40 0x7fde901532f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fde80000c00 tx=0x7fde800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:45.630 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.624+0000 7fde7effd640 1 -- 172.21.15.64:0/1343691577 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8003a8f0 con 0x7fde9006ff40 2023-10-14T12:30:45.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.624+0000 7fde7effd640 1 -- 172.21.15.64:0/1343691577 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8003aa70 con 0x7fde9006ff40 2023-10-14T12:30:45.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.624+0000 7fde7effd640 1 -- 172.21.15.64:0/1343691577 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8003ae20 con 0x7fde9006ff40 2023-10-14T12:30:45.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.624+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde900cd350 con 0x7fde9006ff40 2023-10-14T12:30:45.631 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.624+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde900cd910 con 0x7fde9006ff40 2023-10-14T12:30:45.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.625+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde900c15f0 con 0x7fde9006ff40 2023-10-14T12:30:45.632 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.627+0000 7fde7effd640 1 -- 172.21.15.64:0/1343691577 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fde8004d450 con 0x7fde9006ff40 2023-10-14T12:30:45.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.627+0000 7fde7effd640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde7006ae70 0x7fde7006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:45.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.628+0000 7fde7effd640 1 -- 172.21.15.64:0/1343691577 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fde800ab880 con 0x7fde9006ff40 2023-10-14T12:30:45.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.628+0000 7fde8dd9b640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde7006ae70 0x7fde7006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:45.633 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.629+0000 7fde8dd9b640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde7006ae70 0x7fde7006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde900c4c40 tx=0x7fde84009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:45.634 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.632+0000 7fde7effd640 1 -- 172.21.15.64:0/1343691577 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fde80076730 con 0x7fde9006ff40 2023-10-14T12:30:45.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.860+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde9004e9b0 con 0x7fde9006ff40 2023-10-14T12:30:45.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.861+0000 7fde7effd640 1 -- 172.21.15.64:0/1343691577 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4918 (secure 0 0 0) 0x7fde80035090 con 0x7fde9006ff40 2023-10-14T12:30:45.863 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:45.864 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2123710189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2123710189},{"type":"v1","addr":"172.21.15.177:6837","nonce":2123710189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1971405270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1971405270},{"type":"v1","addr":"172.21.15.177:6836","nonce":1971405270}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/47775465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":47775465},{"type":"v1","addr":"172.21.15.64:6833","nonce":47775465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:30:33.786154+0000","modified":"2023-10-14T12:30:36.843227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5457":{"gid":5457,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3900287009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3900287009},{"type":"v1","addr":"172.21.15.64:6835","nonce":3900287009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T12:30:45.864 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2023-10-14T12:30:45.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde7006ae70 msgr2=0x7fde7006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde7006ae70 0x7fde7006d330 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fde900c4c40 tx=0x7fde84009040 comp rx=0 tx=0).stop 2023-10-14T12:30:45.866 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9006ff40 msgr2=0x7fde901532f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:45.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9006ff40 0x7fde901532f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fde80000c00 tx=0x7fde800046c0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 shutdown_connections 2023-10-14T12:30:45.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fde7006ae70 0x7fde7006d330 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fde9015a8d0 0x7fde900c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.867 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fde900ca660 0x7fde900c7510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 --2- 172.21.15.64:0/1343691577 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fde9006ff40 0x7fde901532f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:45.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 >> 172.21.15.64:0/1343691577 conn(0x7fde9006a470 msgr2=0x7fde900afea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:45.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 shutdown_connections 2023-10-14T12:30:45.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:45.864+0000 7fde8f59e640 1 -- 172.21.15.64:0/1343691577 wait complete. 2023-10-14T12:30:46.286 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-14T12:30:33.786154+0000', 'modified': '2023-10-14T12:30:36.843227+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5457}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5457': {'gid': 5457, 'name': 'c', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.64:6835/3900287009', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.64:6834', 'nonce': 3900287009}, {'type': 'v1', 'addr': '172.21.15.64:6835', 'nonce': 3900287009}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'testcephfs1', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-10-14T12:30:46.287 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-14T12:30:46.287 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-14T12:30:46.533 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.532+0000 7f2f14eda640 1 Processor -- start 2023-10-14T12:30:46.534 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.532+0000 7f2f14eda640 1 -- start start 2023-10-14T12:30:46.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f14eda640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2f100b01b0 0x7f2f100b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.535 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f14eda640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100c9c70 con 0x7f2f1015cc20 2023-10-14T12:30:46.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f14eda640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f100cca90 con 0x7f2f10161310 2023-10-14T12:30:46.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f14eda640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f100c9490 con 0x7f2f100b01b0 2023-10-14T12:30:46.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f0e59c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f2f1015cc20 0x7f2f100c8d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:53258/0 (socket says 172.21.15.64:53258) 2023-10-14T12:30:46.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f0e59c640 1 -- 172.21.15.64:0/1783886806 learned_addr learned my addr 172.21.15.64:0/1783886806 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T12:30:46.536 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/1783886806 >> v2:172.21.15.64:3300/0 conn(0x7f2f100b01b0 0x7f2f100b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.537 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f0dd9b640 1 -- 172.21.15.64:0/1783886806 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 153166553 0 0) 0x7f2f100c9c70 con 0x7f2f1015cc20 2023-10-14T12:30:46.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.534+0000 7f2f0dd9b640 1 -- 172.21.15.64:0/1783886806 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2efc003520 con 0x7f2f1015cc20 2023-10-14T12:30:46.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.535+0000 7f2f0ed9d640 1 -- 172.21.15.64:0/1783886806 >> v1:172.21.15.177:6789/0 conn(0x7f2f10161310 legacy=0x7f2f100ab860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.535+0000 7f2f0ed9d640 1 -- 172.21.15.64:0/1783886806 >> v1:172.21.15.64:6789/0 conn(0x7f2f1015cc20 legacy=0x7f2f100c8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.535+0000 7f2f0ed9d640 1 -- 172.21.15.64:0/1783886806 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1015d000 con 0x7f2f100b01b0 2023-10-14T12:30:46.538 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.536+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/1783886806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f100b01b0 0x7f2f100b0620 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009d90 tx=0x7f2f0802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bfa8e604d4e08c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.536+0000 7f2f0dd9b640 1 -- 172.21.15.64:0/1783886806 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0802cc60 con 0x7f2f100b01b0 2023-10-14T12:30:46.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.536+0000 7f2f0dd9b640 1 -- 172.21.15.64:0/1783886806 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0802cdc0 con 0x7f2f100b01b0 2023-10-14T12:30:46.539 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.536+0000 7f2f0dd9b640 1 -- 172.21.15.64:0/1783886806 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f08034660 con 0x7f2f100b01b0 2023-10-14T12:30:46.540 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.536+0000 7f2f14eda640 1 -- 172.21.15.64:0/1783886806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f100b01b0 msgr2=0x7f2f100b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.536+0000 7f2f14eda640 1 --2- 172.21.15.64:0/1783886806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f100b01b0 0x7f2f100b0620 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2f08009d90 tx=0x7f2f0802beb0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.537+0000 7f2f14eda640 1 -- 172.21.15.64:0/1783886806 shutdown_connections 2023-10-14T12:30:46.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.537+0000 7f2f14eda640 1 --2- 172.21.15.64:0/1783886806 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f100b01b0 0x7f2f100b0620 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.541 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.537+0000 7f2f14eda640 1 -- 172.21.15.64:0/1783886806 >> 172.21.15.64:0/1783886806 conn(0x7f2f100cb1b0 msgr2=0x7f2f100cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:46.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.537+0000 7f2f14eda640 1 -- 172.21.15.64:0/1783886806 shutdown_connections 2023-10-14T12:30:46.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.537+0000 7f2f14eda640 1 -- 172.21.15.64:0/1783886806 wait complete. 2023-10-14T12:30:46.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.538+0000 7f2f14eda640 1 Processor -- start 2023-10-14T12:30:46.542 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.539+0000 7f2f14eda640 1 -- start start 2023-10-14T12:30:46.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.539+0000 7f2f14eda640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f100b01b0 0x7f2f101598c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.539+0000 7f2f14eda640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f1015cc20 0x7f2f100b36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f14eda640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f10161310 0x7f2f100b3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f14eda640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1015f270 con 0x7f2f1015cc20 2023-10-14T12:30:46.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f14eda640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1015e5f0 con 0x7f2f100b01b0 2023-10-14T12:30:46.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f14eda640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f1015e8d0 con 0x7f2f10161310 2023-10-14T12:30:46.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f1015cc20 0x7f2f100b36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f1015cc20 0x7f2f100b36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36342/0 (socket says 172.21.15.64:36342) 2023-10-14T12:30:46.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 -- 172.21.15.64:0/14282560 learned_addr learned my addr 172.21.15.64:0/14282560 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:46.545 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f100b01b0 0x7f2f101598c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f10161310 0x7f2f100b3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 -- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f10161310 msgr2=0x7f2f100b3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f10161310 0x7f2f100b3c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 -- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f100b01b0 msgr2=0x7f2f101598c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f100b01b0 0x7f2f101598c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f07fff640 1 -- 172.21.15.64:0/14282560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f08009a70 con 0x7f2f1015cc20 2023-10-14T12:30:46.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.540+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f100b01b0 0x7f2f101598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:46.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.541+0000 7f2f07fff640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f1015cc20 0x7f2f100b36e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800b3f0 tx=0x7f2ef800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.541+0000 7f2f06ffd640 1 -- 172.21.15.64:0/14282560 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8011830 con 0x7f2f1015cc20 2023-10-14T12:30:46.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.541+0000 7f2f06ffd640 1 -- 172.21.15.64:0/14282560 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef8011990 con 0x7f2f1015cc20 2023-10-14T12:30:46.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.541+0000 7f2f06ffd640 1 -- 172.21.15.64:0/14282560 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef8011d40 con 0x7f2f1015cc20 2023-10-14T12:30:46.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.541+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1015ebb0 con 0x7f2f1015cc20 2023-10-14T12:30:46.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.541+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f10159e00 con 0x7f2f1015cc20 2023-10-14T12:30:46.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.543+0000 7f2f06ffd640 1 -- 172.21.15.64:0/14282560 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2ef801a400 con 0x7f2f1015cc20 2023-10-14T12:30:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.544+0000 7f2f06ffd640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2ef006ae70 0x7f2ef006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.544+0000 7f2f06ffd640 1 -- 172.21.15.64:0/14282560 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2ef8089620 con 0x7f2f1015cc20 2023-10-14T12:30:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.545+0000 7f2f17a6f740 1 Processor -- start 2023-10-14T12:30:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.545+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2ef006ae70 0x7f2ef006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.545+0000 7f2f17a6f740 1 -- start start 2023-10-14T12:30:46.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.546+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a8948e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.546+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8976360 0x55b2a8978d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.546+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a89493c0 0x55b2a8979250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.546+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2ef006ae70 0x7f2ef006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f000011e0 tx=0x7f2f00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.546+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a88697a0 con 0x55b2a8975f80 2023-10-14T12:30:46.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.546+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a88bb740 con 0x55b2a8976360 2023-10-14T12:30:46.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.546+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a88b8e30 con 0x55b2a89493c0 2023-10-14T12:30:46.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a8948e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a8948e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36350/0 (socket says 172.21.15.64:36350) 2023-10-14T12:30:46.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 -- 172.21.15.64:0/1520515187 learned_addr learned my addr 172.21.15.64:0/1520515187 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:46.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f07fff640 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8976360 0x55b2a8978d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a89493c0 0x55b2a8979250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 -- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a89493c0 msgr2=0x55b2a8979250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a89493c0 0x55b2a8979250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 -- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8976360 msgr2=0x55b2a8978d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8976360 0x55b2a8978d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.547+0000 7f2f0e59c640 1 -- 172.21.15.64:0/1520515187 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a8878910 con 0x55b2a8975f80 2023-10-14T12:30:46.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.548+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a8948e80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2f00005950 tx=0x7f2f00010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeaa0ff783580afd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.548+0000 7f2eeffff640 1 -- 172.21.15.64:0/1520515187 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000d9a0 con 0x55b2a8975f80 2023-10-14T12:30:46.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.548+0000 7f2eeffff640 1 -- 172.21.15.64:0/1520515187 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f0000db00 con 0x55b2a8975f80 2023-10-14T12:30:46.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.548+0000 7f2eeffff640 1 -- 172.21.15.64:0/1520515187 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000de70 con 0x55b2a8975f80 2023-10-14T12:30:46.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 -- 172.21.15.64:0/1520515187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 msgr2=0x55b2a8948e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a8948e80 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2f00005950 tx=0x7f2f00010000 comp rx=0 tx=0).stop 2023-10-14T12:30:46.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 -- 172.21.15.64:0/1520515187 shutdown_connections 2023-10-14T12:30:46.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a89493c0 0x55b2a8979250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8976360 0x55b2a8978d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/1520515187 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a8948e80 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 -- 172.21.15.64:0/1520515187 >> 172.21.15.64:0/1520515187 conn(0x55b2a894b190 msgr2=0x55b2a8993d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:46.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 -- 172.21.15.64:0/1520515187 shutdown_connections 2023-10-14T12:30:46.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.549+0000 7f2f17a6f740 1 -- 172.21.15.64:0/1520515187 wait complete. 2023-10-14T12:30:46.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.550+0000 7f2f17a6f740 1 -- start start 2023-10-14T12:30:46.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.550+0000 7f2f17a6f740 1 Processor -- start 2023-10-14T12:30:46.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a898dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a897ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8991750 0x55b2a8991bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a88b4720 con 0x55b2a8975f80 2023-10-14T12:30:46.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a8852970 con 0x55b2a8991750 2023-10-14T12:30:46.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a8852610 con 0x55b2a8976360 2023-10-14T12:30:46.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f17a6f740 10 client.0 _ll_register_callbacks cb 0x55b2a88749d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:30:46.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f0e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a898dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f0e59c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a898dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36352/0 (socket says 172.21.15.64:36352) 2023-10-14T12:30:46.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.551+0000 7f2f0e59c640 1 -- 172.21.15.64:0/2715204357 learned_addr learned my addr 172.21.15.64:0/2715204357 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:46.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f07fff640 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a897ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8991750 0x55b2a8991bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f0e59c640 1 -- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 msgr2=0x55b2a897ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a897ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f0e59c640 1 -- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8991750 msgr2=0x55b2a8991bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8991750 0x55b2a8991bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f0e59c640 1 -- 172.21.15.64:0/2715204357 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2efc003520 con 0x55b2a8975f80 2023-10-14T12:30:46.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a898dd70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2f000074a0 tx=0x7f2f00000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9eb0ee066a62d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2eed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2023-10-14T12:30:46.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2eed7fa640 1 -- 172.21.15.64:0/2715204357 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f00027070 con 0x55b2a8975f80 2023-10-14T12:30:46.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2eed7fa640 1 -- 172.21.15.64:0/2715204357 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2f00020720 con 0x55b2a8975f80 2023-10-14T12:30:46.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.552+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2a88db160 con 0x55b2a8975f80 2023-10-14T12:30:46.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2eed7fa640 1 -- 172.21.15.64:0/2715204357 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f000208e0 con 0x55b2a8975f80 2023-10-14T12:30:46.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 10 client.5667 fetch_fsmap learned FSMap version 18 2023-10-14T12:30:46.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b2a88b2da0 con 0x55b2a8975f80 2023-10-14T12:30:46.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2eed7fa640 1 -- 172.21.15.64:0/2715204357 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2a88db160 con 0x55b2a8975f80 2023-10-14T12:30:46.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2eed7fa640 1 -- 172.21.15.64:0/2715204357 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 18) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f2f00020a40 con 0x55b2a8975f80 2023-10-14T12:30:46.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 10 client.5667 fetch_fsmap finished waiting for FSMap version 18 2023-10-14T12:30:46.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 10 client.5667 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T12:30:46.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 20 client.5667 populate_metadata read hostname 'smithi064' 2023-10-14T12:30:46.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89a7f20 0x55b2a898eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 4 client.5667 mds_command: new command op to 5457 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-10-14T12:30:46.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 --> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2a8886cc0 con 0x55b2a89a7f20 2023-10-14T12:30:46.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.553+0000 7f2f07fff640 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89a7f20 0x55b2a898eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.554+0000 7f2f07fff640 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89a7f20 0x55b2a898eff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=beb952dcf6fbdbb5 server_cookie=e5f145f16e8c8a4f in_seq=0 out_seq=0 2023-10-14T12:30:46.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.554+0000 7f2eed7fa640 10 client.5667 ms_handle_connect on v2:172.21.15.64:6834/3900287009 2023-10-14T12:30:46.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2eed7fa640 1 -- 172.21.15.64:0/2715204357 <== mds.0 v2:172.21.15.64:6834/3900287009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b2a8886cc0 con 0x55b2a89a7f20 2023-10-14T12:30:46.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2eed7fa640 10 client.5667 handle_command_reply: tid=0 2023-10-14T12:30:46.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 client.5667 shutdown 2023-10-14T12:30:46.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 msgr2=0x55b2a898dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a898dd70 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2f000074a0 tx=0x7f2f00000ed0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 shutdown_connections 2023-10-14T12:30:46.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89a7f20 0x55b2a898eff0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8991750 0x55b2a8991bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a897ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2eed7fa640 0 client.5667 ms_handle_reset on v2:172.21.15.64:6834/3900287009 2023-10-14T12:30:46.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/2715204357 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8975f80 0x55b2a898dd70 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 >> 172.21.15.64:0/2715204357 conn(0x55b2a89493c0 msgr2=0x55b2a894ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:46.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 shutdown_connections 2023-10-14T12:30:46.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 1 -- 172.21.15.64:0/2715204357 wait complete. 2023-10-14T12:30:46.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.555+0000 7f2f17a6f740 20 client.5667 trim_cache size 0 max 16384 2023-10-14T12:30:46.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.572+0000 7f2f17a6f740 1 Processor -- start 2023-10-14T12:30:46.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.572+0000 7f2f17a6f740 1 -- start start 2023-10-14T12:30:46.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.573+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.573+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a89967e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.573+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8991750 0x55b2a89749d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.573+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a8618f20 con 0x55b2a8991750 2023-10-14T12:30:46.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.573+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a8993d40 con 0x55b2a8975f80 2023-10-14T12:30:46.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.573+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a89939d0 con 0x55b2a8976360 2023-10-14T12:30:46.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.573+0000 7f2f0ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8991750 0x55b2a89749d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8991750 0x55b2a89749d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36364/0 (socket says 172.21.15.64:36364) 2023-10-14T12:30:46.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 -- 172.21.15.64:0/3665981732 learned_addr learned my addr 172.21.15.64:0/3665981732 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:46.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f07fff640 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a89967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 -- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 msgr2=0x55b2a89967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a89967e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 -- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 msgr2=0x55b2a89a3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 -- 172.21.15.64:0/3665981732 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a8851b80 con 0x55b2a8991750 2023-10-14T12:30:46.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.574+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8991750 0x55b2a89749d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2f08037040 tx=0x7f2f0802e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49a8afee9cfc338 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f04ff9640 1 -- 172.21.15.64:0/3665981732 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0804a480 con 0x55b2a8991750 2023-10-14T12:30:46.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f04ff9640 1 -- 172.21.15.64:0/3665981732 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f08043070 con 0x55b2a8991750 2023-10-14T12:30:46.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f04ff9640 1 -- 172.21.15.64:0/3665981732 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f0804a7e0 con 0x55b2a8991750 2023-10-14T12:30:46.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f17a6f740 1 -- 172.21.15.64:0/3665981732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8991750 msgr2=0x55b2a89749d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8991750 0x55b2a89749d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f2f08037040 tx=0x7f2f0802e000 comp rx=0 tx=0).stop 2023-10-14T12:30:46.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f17a6f740 1 -- 172.21.15.64:0/3665981732 shutdown_connections 2023-10-14T12:30:46.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8991750 0x55b2a89749d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8976360 0x55b2a89967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/3665981732 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.575+0000 7f2f17a6f740 1 -- 172.21.15.64:0/3665981732 >> 172.21.15.64:0/3665981732 conn(0x55b2a89493c0 msgr2=0x55b2a897c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:46.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.576+0000 7f2f17a6f740 1 -- 172.21.15.64:0/3665981732 shutdown_connections 2023-10-14T12:30:46.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.576+0000 7f2f17a6f740 1 -- 172.21.15.64:0/3665981732 wait complete. 2023-10-14T12:30:46.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.576+0000 7f2f17a6f740 1 -- start start 2023-10-14T12:30:46.582 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.576+0000 7f2f17a6f740 1 Processor -- start 2023-10-14T12:30:46.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.577+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.577+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8976360 0x55b2a89a2970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.577+0000 7f2f17a6f740 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8991750 0x55b2a8997220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.577+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a8a05c30 con 0x55b2a8976360 2023-10-14T12:30:46.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.577+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a8a06070 con 0x55b2a8975f80 2023-10-14T12:30:46.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.577+0000 7f2f17a6f740 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a8a059e0 con 0x55b2a8991750 2023-10-14T12:30:46.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.577+0000 7f2f17a6f740 10 client.0 _ll_register_callbacks cb 0x7f2f000014f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-14T12:30:46.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8976360 0x55b2a89a2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8976360 0x55b2a89a2970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36372/0 (socket says 172.21.15.64:36372) 2023-10-14T12:30:46.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 -- 172.21.15.64:0/409077257 learned_addr learned my addr 172.21.15.64:0/409077257 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:46.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f0ed9d640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8991750 0x55b2a8997220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 -- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8991750 msgr2=0x55b2a8997220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8991750 0x55b2a8997220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 -- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 msgr2=0x55b2a89a2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f07fff640 1 -- 172.21.15.64:0/409077257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1015d000 con 0x55b2a8976360 2023-10-14T12:30:46.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.578+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T12:30:46.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2f07fff640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8976360 0x55b2a89a2970 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2ef805ff60 tx=0x7f2ef805c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba88ee5a7d900230 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2eed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.64:3300/0 2023-10-14T12:30:46.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2eed7fa640 1 -- 172.21.15.64:0/409077257 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ef80548a0 con 0x55b2a8976360 2023-10-14T12:30:46.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2eed7fa640 1 -- 172.21.15.64:0/409077257 <== mon.0 v2:172.21.15.64:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2ef8054a00 con 0x55b2a8976360 2023-10-14T12:30:46.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f0000db00 con 0x55b2a8976360 2023-10-14T12:30:46.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2eed7fa640 1 -- 172.21.15.64:0/409077257 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ef8057680 con 0x55b2a8976360 2023-10-14T12:30:46.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2f17a6f740 10 client.5673 fetch_fsmap learned FSMap version 18 2023-10-14T12:30:46.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x55b2a8877170 con 0x55b2a8976360 2023-10-14T12:30:46.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2eed7fa640 1 -- 172.21.15.64:0/409077257 <== mon.0 v2:172.21.15.64:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ef807a080 con 0x55b2a8976360 2023-10-14T12:30:46.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.579+0000 7f2eed7fa640 1 -- 172.21.15.64:0/409077257 <== mon.0 v2:172.21.15.64:3300/0 5 ==== fsmap(e 18) v1 ==== 3299+0+0 (secure 0 0 0) 0x7f2ef8021020 con 0x55b2a8976360 2023-10-14T12:30:46.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f17a6f740 10 client.5673 fetch_fsmap finished waiting for FSMap version 18 2023-10-14T12:30:46.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f17a6f740 10 client.5673 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-14T12:30:46.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f17a6f740 20 client.5673 populate_metadata read hostname 'smithi064' 2023-10-14T12:30:46.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89979e0 0x55b2a8990270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f17a6f740 4 client.5673 mds_command: new command op to 5457 tid=0 multi_id=0 [{"prefix": "status"}] 2023-10-14T12:30:46.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 --> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2a88ad700 con 0x55b2a89979e0 2023-10-14T12:30:46.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89979e0 0x55b2a8990270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2f0e59c640 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89979e0 0x55b2a8990270 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6bcf210c28018ac server_cookie=d5d62c46e8948d5b in_seq=0 out_seq=0 2023-10-14T12:30:46.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.580+0000 7f2eed7fa640 10 client.5673 ms_handle_connect on v2:172.21.15.64:6834/3900287009 2023-10-14T12:30:46.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2eed7fa640 1 -- 172.21.15.64:0/409077257 <== mds.0 v2:172.21.15.64:6834/3900287009 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55b2a88ad700 con 0x55b2a89979e0 2023-10-14T12:30:46.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2eed7fa640 10 client.5673 handle_command_reply: tid=0 2023-10-14T12:30:46.593 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 client.5673 shutdown 2023-10-14T12:30:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8976360 msgr2=0x55b2a89a2970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8976360 0x55b2a89a2970 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2ef805ff60 tx=0x7f2ef805c3a0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 shutdown_connections 2023-10-14T12:30:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:6834/3900287009,v1:172.21.15.64:6835/3900287009] conn(0x55b2a89979e0 0x55b2a8990270 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.594 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x55b2a8991750 0x55b2a8997220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x55b2a8976360 0x55b2a89a2970 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2eed7fa640 0 client.5673 ms_handle_reset on v2:172.21.15.64:6834/3900287009 2023-10-14T12:30:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 --2- 172.21.15.64:0/409077257 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x55b2a8975f80 0x55b2a89a2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 >> 172.21.15.64:0/409077257 conn(0x55b2a89493c0 msgr2=0x55b2a894ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:46.595 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 shutdown_connections 2023-10-14T12:30:46.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 1 -- 172.21.15.64:0/409077257 wait complete. 2023-10-14T12:30:46.596 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.581+0000 7f2f17a6f740 20 client.5673 trim_cache size 0 max 16384 2023-10-14T12:30:46.596 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:30:46.596 INFO:teuthology.orchestra.run.smithi064.stdout: "cluster_fsid": "0b341ded-8bb8-4993-857a-677cfc30784b", 2023-10-14T12:30:46.597 INFO:teuthology.orchestra.run.smithi064.stdout: "whoami": 0, 2023-10-14T12:30:46.597 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 5457, 2023-10-14T12:30:46.597 INFO:teuthology.orchestra.run.smithi064.stdout: "want_state": "up:active", 2023-10-14T12:30:46.597 INFO:teuthology.orchestra.run.smithi064.stdout: "state": "up:active", 2023-10-14T12:30:46.597 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "testcephfs1", 2023-10-14T12:30:46.598 INFO:teuthology.orchestra.run.smithi064.stdout: "rank_uptime": 12.257633106, 2023-10-14T12:30:46.598 INFO:teuthology.orchestra.run.smithi064.stdout: "mdsmap_epoch": 18, 2023-10-14T12:30:46.598 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch": 41, 2023-10-14T12:30:46.598 INFO:teuthology.orchestra.run.smithi064.stdout: "osdmap_epoch_barrier": 41, 2023-10-14T12:30:46.598 INFO:teuthology.orchestra.run.smithi064.stdout: "uptime": 21.181095260999999 2023-10-14T12:30:46.599 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:30:46.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2ef006ae70 msgr2=0x7f2ef006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2ef006ae70 0x7f2ef006d330 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2f000011e0 tx=0x7f2f00009040 comp rx=0 tx=0).stop 2023-10-14T12:30:46.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f1015cc20 msgr2=0x7f2f100b36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f1015cc20 0x7f2f100b36e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2ef800b3f0 tx=0x7f2ef800b8b0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 shutdown_connections 2023-10-14T12:30:46.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2ef006ae70 0x7f2ef006d330 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f10161310 0x7f2f100b3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f1015cc20 0x7f2f100b36e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 --2- 172.21.15.64:0/14282560 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f100b01b0 0x7f2f101598c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.601 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 >> 172.21.15.64:0/14282560 conn(0x7f2f100cb1b0 msgr2=0x7f2f100aec70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:46.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 shutdown_connections 2023-10-14T12:30:46.602 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.582+0000 7f2f14eda640 1 -- 172.21.15.64:0/14282560 wait complete. 2023-10-14T12:30:46.603 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-14T12:30:46.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.810+0000 7fa18deda640 1 Processor -- start 2023-10-14T12:30:46.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.810+0000 7fa18deda640 1 -- start start 2023-10-14T12:30:46.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa18deda640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa1880b0720 0x7fa1880cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa18deda640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fa18815ce60 0x7fa1880cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa18deda640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa188161620 con 0x7fa18815ca80 2023-10-14T12:30:46.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa18deda640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1880cafa0 con 0x7fa1880b0720 2023-10-14T12:30:46.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa18deda640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1880cb280 con 0x7fa18815ce60 2023-10-14T12:30:46.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa17effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa1880b0720 0x7fa1880cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa17effd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fa1880b0720 0x7fa1880cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36382/0 (socket says 172.21.15.64:36382) 2023-10-14T12:30:46.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa17effd640 1 -- 172.21.15.64:0/3911753371 learned_addr learned my addr 172.21.15.64:0/3911753371 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:46.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.812+0000 7fa187fff640 1 --2- 172.21.15.64:0/3911753371 >> v2:172.21.15.177:3300/0 conn(0x7fa18815ce60 0x7fa1880cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.813+0000 7fa17effd640 1 -- 172.21.15.64:0/3911753371 >> v2:172.21.15.177:3300/0 conn(0x7fa18815ce60 msgr2=0x7fa1880cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.813+0000 7fa17effd640 1 --2- 172.21.15.64:0/3911753371 >> v2:172.21.15.177:3300/0 conn(0x7fa18815ce60 0x7fa1880cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.813+0000 7fa17effd640 1 -- 172.21.15.64:0/3911753371 >> v1:172.21.15.177:6789/0 conn(0x7fa18815ca80 legacy=0x7fa1880b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:30:46.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.813+0000 7fa17effd640 1 -- 172.21.15.64:0/3911753371 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1880cb560 con 0x7fa1880b0720 2023-10-14T12:30:46.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.814+0000 7fa17effd640 1 --2- 172.21.15.64:0/3911753371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1880b0720 0x7fa1880cddf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa1880b10e0 tx=0x7fa17002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=149b2d43dd053872 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.814+0000 7fa186ffd640 1 -- 172.21.15.64:0/3911753371 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170031640 con 0x7fa1880b0720 2023-10-14T12:30:46.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.814+0000 7fa186ffd640 1 -- 172.21.15.64:0/3911753371 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1700317a0 con 0x7fa1880b0720 2023-10-14T12:30:46.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.814+0000 7fa186ffd640 1 -- 172.21.15.64:0/3911753371 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170031b30 con 0x7fa1880b0720 2023-10-14T12:30:46.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 -- 172.21.15.64:0/3911753371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1880b0720 msgr2=0x7fa1880cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 --2- 172.21.15.64:0/3911753371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1880b0720 0x7fa1880cddf0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fa1880b10e0 tx=0x7fa17002b8f0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 -- 172.21.15.64:0/3911753371 shutdown_connections 2023-10-14T12:30:46.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 --2- 172.21.15.64:0/3911753371 >> v2:172.21.15.177:3300/0 conn(0x7fa18815ce60 0x7fa1880cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 --2- 172.21.15.64:0/3911753371 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa1880b0720 0x7fa1880cddf0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 -- 172.21.15.64:0/3911753371 >> 172.21.15.64:0/3911753371 conn(0x7fa18806c1c0 msgr2=0x7fa18806c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:46.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 -- 172.21.15.64:0/3911753371 shutdown_connections 2023-10-14T12:30:46.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.815+0000 7fa18deda640 1 -- 172.21.15.64:0/3911753371 wait complete. 2023-10-14T12:30:46.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.817+0000 7fa18deda640 1 Processor -- start 2023-10-14T12:30:46.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.817+0000 7fa18deda640 1 -- start start 2023-10-14T12:30:46.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa18deda640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1880b0720 0x7fa18815fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa18deda640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa18815ca80 0x7fa188154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa18deda640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa18815ce60 0x7fa1880af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa18deda640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188154aa0 con 0x7fa18815ce60 2023-10-14T12:30:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa18deda640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa188154d70 con 0x7fa1880b0720 2023-10-14T12:30:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa18deda640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa188155050 con 0x7fa18815ca80 2023-10-14T12:30:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa187fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa18815ce60 0x7fa1880af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa187fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa18815ce60 0x7fa1880af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36394/0 (socket says 172.21.15.64:36394) 2023-10-14T12:30:46.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.818+0000 7fa187fff640 1 -- 172.21.15.64:0/4145295855 learned_addr learned my addr 172.21.15.64:0/4145295855 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:30:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa1877fe640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1880b0720 0x7fa18815fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa187fff640 1 -- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa18815ca80 msgr2=0x7fa188154560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa17effd640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa18815ca80 0x7fa188154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa187fff640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa18815ca80 0x7fa188154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa187fff640 1 -- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1880b0720 msgr2=0x7fa18815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa187fff640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1880b0720 0x7fa18815fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa187fff640 1 -- 172.21.15.64:0/4145295855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1700094d0 con 0x7fa18815ce60 2023-10-14T12:30:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa1877fe640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1880b0720 0x7fa18815fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:30:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa187fff640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa18815ce60 0x7fa1880af2b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa180007e30 tx=0x7fa18000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa184ff9640 1 -- 172.21.15.64:0/4145295855 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa180014620 con 0x7fa18815ce60 2023-10-14T12:30:46.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa184ff9640 1 -- 172.21.15.64:0/4145295855 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18000ee90 con 0x7fa18815ce60 2023-10-14T12:30:46.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa184ff9640 1 -- 172.21.15.64:0/4145295855 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1800149c0 con 0x7fa18815ce60 2023-10-14T12:30:46.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.819+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa188155330 con 0x7fa18815ce60 2023-10-14T12:30:46.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.820+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1881558f0 con 0x7fa18815ce60 2023-10-14T12:30:46.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.821+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa188073ef0 con 0x7fa18815ce60 2023-10-14T12:30:46.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.821+0000 7fa184ff9640 1 -- 172.21.15.64:0/4145295855 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fa180014b20 con 0x7fa18815ce60 2023-10-14T12:30:46.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.822+0000 7fa184ff9640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa16806ae70 0x7fa16806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:30:46.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.822+0000 7fa184ff9640 1 -- 172.21.15.64:0/4145295855 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7fa18008a0a0 con 0x7fa18815ce60 2023-10-14T12:30:46.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.823+0000 7fa1877fe640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa16806ae70 0x7fa16806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:30:46.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.824+0000 7fa1877fe640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa16806ae70 0x7fa16806d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a830 tx=0x7fa178008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:30:46.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:46.828+0000 7fa184ff9640 1 -- 172.21.15.64:0/4145295855 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fa180055080 con 0x7fa18815ce60 2023-10-14T12:30:47.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.064+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa1880b4510 con 0x7fa18815ce60 2023-10-14T12:30:47.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.064+0000 7fa184ff9640 1 -- 172.21.15.64:0/4145295855 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa1800586a0 con 0x7fa18815ce60 2023-10-14T12:30:47.067 INFO:teuthology.orchestra.run.smithi064.stdout:name: testcephfs1, metadata pool: testcephfs1_metadata, data pools: [testcephfs1_data ] 2023-10-14T12:30:47.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa16806ae70 msgr2=0x7fa16806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:47.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa16806ae70 0x7fa16806d330 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa17800a830 tx=0x7fa178008040 comp rx=0 tx=0).stop 2023-10-14T12:30:47.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa18815ce60 msgr2=0x7fa1880af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:30:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa18815ce60 0x7fa1880af2b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa180007e30 tx=0x7fa18000e4b0 comp rx=0 tx=0).stop 2023-10-14T12:30:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 shutdown_connections 2023-10-14T12:30:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fa16806ae70 0x7fa16806d330 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fa18815ce60 0x7fa1880af2b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:47.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fa18815ca80 0x7fa188154560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 --2- 172.21.15.64:0/4145295855 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fa1880b0720 0x7fa18815fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:30:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 >> 172.21.15.64:0/4145295855 conn(0x7fa18806c1c0 msgr2=0x7fa1880700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:30:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 shutdown_connections 2023-10-14T12:30:47.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:47.067+0000 7fa18deda640 1 -- 172.21.15.64:0/4145295855 wait complete. 2023-10-14T12:30:47.087 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-14T12:30:47.087 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-14T12:30:47.088 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi064.front.sepia.ceph.com 2023-10-14T12:30:47.088 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-14T12:30:47.088 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-14T12:30:47.089 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-14T12:30:47.089 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-14T12:30:47.089 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-14T12:30:47.090 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:30:47.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:47.091 DEBUG:teuthology.orchestra.run.smithi064:> ip addr 2023-10-14T12:30:47.143 INFO:teuthology.orchestra.run.smithi064.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-14T12:30:47.143 INFO:teuthology.orchestra.run.smithi064.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-14T12:30:47.144 INFO:teuthology.orchestra.run.smithi064.stdout: inet 127.0.0.1/8 scope host lo 2023-10-14T12:30:47.144 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:30:47.144 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 ::1/128 scope host 2023-10-14T12:30:47.144 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:30:47.144 INFO:teuthology.orchestra.run.smithi064.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:30:47.145 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:78 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:30:47.145 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f0 2023-10-14T12:30:47.145 INFO:teuthology.orchestra.run.smithi064.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:30:47.145 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:a9:a3:79 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:30:47.145 INFO:teuthology.orchestra.run.smithi064.stdout: altname enp7s0f1 2023-10-14T12:30:47.146 INFO:teuthology.orchestra.run.smithi064.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-14T12:30:47.146 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:de brd ff:ff:ff:ff:ff:ff 2023-10-14T12:30:47.146 INFO:teuthology.orchestra.run.smithi064.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-14T12:30:47.146 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 0c:c4:7a:b6:f8:df brd ff:ff:ff:ff:ff:ff 2023-10-14T12:30:47.146 INFO:teuthology.orchestra.run.smithi064.stdout: inet 172.21.15.64/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-14T12:30:47.147 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft 42266sec preferred_lft 42266sec 2023-10-14T12:30:47.147 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::ec4:7aff:feb6:f8df/64 scope link 2023-10-14T12:30:47.147 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:30:47.147 INFO:teuthology.orchestra.run.smithi064.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-14T12:30:47.147 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 4e:86:1a:dd:19:f9 brd ff:ff:ff:ff:ff:ff 2023-10-14T12:30:47.148 INFO:teuthology.orchestra.run.smithi064.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-14T12:30:47.148 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:30:47.148 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::f853:96ff:fe9b:a6cf/64 scope link 2023-10-14T12:30:47.148 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:30:47.148 INFO:teuthology.orchestra.run.smithi064.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:30:47.149 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether d2:57:ab:74:ce:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:30:47.149 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::d057:abff:fe74:ce78/64 scope link 2023-10-14T12:30:47.149 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:30:47.149 INFO:teuthology.orchestra.run.smithi064.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-14T12:30:47.149 INFO:teuthology.orchestra.run.smithi064.stdout: link/ether 4e:86:1a:dd:19:f9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:30:47.149 INFO:teuthology.orchestra.run.smithi064.stdout: inet6 fe80::4c86:1aff:fedd:19f9/64 scope link 2023-10-14T12:30:47.150 INFO:teuthology.orchestra.run.smithi064.stdout: valid_lft forever preferred_lft forever 2023-10-14T12:30:47.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:47.151 DEBUG:teuthology.orchestra.run.smithi064:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-14T12:30:47.250 INFO:teuthology.orchestra.run.smithi064.stdout:1 2023-10-14T12:30:47.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:47.255 DEBUG:teuthology.orchestra.run.smithi064:> route 2023-10-14T12:30:47.313 INFO:teuthology.orchestra.run.smithi064.stdout:Kernel IP routing table 2023-10-14T12:30:47.313 INFO:teuthology.orchestra.run.smithi064.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-14T12:30:47.313 INFO:teuthology.orchestra.run.smithi064.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-14T12:30:47.313 INFO:teuthology.orchestra.run.smithi064.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-14T12:30:47.314 INFO:teuthology.orchestra.run.smithi064.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-14T12:30:47.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:47.315 DEBUG:teuthology.orchestra.run.smithi064:> (cd / && exec bash -c ' 2023-10-14T12:30:47.316 DEBUG:teuthology.orchestra.run.smithi064:> set -e 2023-10-14T12:30:47.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-14T12:30:47.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-14T12:30:47.317 DEBUG:teuthology.orchestra.run.smithi064:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-14T12:30:47.317 DEBUG:teuthology.orchestra.run.smithi064:> ') 2023-10-14T12:30:47.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:47.512 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-10-14T12:30:47.567 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T12:30:47.568 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T12:30:47.569 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:30:47.569 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:47.569 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link set brx.0 up 2023-10-14T12:30:47.676 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-10-14T12:30:47.677 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:30:47.677 DEBUG:teuthology.orchestra.run.smithi064:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-14T12:30:47.739 INFO:teuthology.orchestra.run.smithi064.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-14T12:30:47.740 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-14T12:30:47.740 DEBUG:teuthology.orchestra.run.smithi064:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:30:47.795 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:30:47.900 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:30:47.964 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:30:47.964 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:30:47.964 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:30:47.964 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:30:47.965 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:30:47.965 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:30:47.965 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:30:47.965 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:30:47.965 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:30:47.966 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:30:47.966 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:30:47.966 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:30:47.966 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:30:47.966 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:30:47.967 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:30:47.967 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:30:47.967 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:30:47.967 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:30:47.967 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:30:47.968 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:30:47.968 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:30:47.968 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:30:47.968 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:30:47.969 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:30:47.969 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:30:47.969 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:30:47.970 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:30:47.970 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:30:47.970 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:30:47.970 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:30:47.970 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:30:47.971 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:30:47.971 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:30:47.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:47.972 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:30:48.032 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-10-14T12:30:48.033 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-10-14T12:30:48.039 DEBUG:teuthology.orchestra.run.smithi064:> sudo modprobe fuse 2023-10-14T12:30:48.120 DEBUG:teuthology.orchestra.run.smithi064:> cat /proc/self/mounts | awk '{print $2}' 2023-10-14T12:30:48.164 INFO:teuthology.orchestra.run.smithi064.stdout:/proc 2023-10-14T12:30:48.165 INFO:teuthology.orchestra.run.smithi064.stdout:/sys 2023-10-14T12:30:48.165 INFO:teuthology.orchestra.run.smithi064.stdout:/dev 2023-10-14T12:30:48.165 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/security 2023-10-14T12:30:48.165 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/shm 2023-10-14T12:30:48.166 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/pts 2023-10-14T12:30:48.166 INFO:teuthology.orchestra.run.smithi064.stdout:/run 2023-10-14T12:30:48.166 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/cgroup 2023-10-14T12:30:48.166 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/pstore 2023-10-14T12:30:48.166 INFO:teuthology.orchestra.run.smithi064.stdout:/ 2023-10-14T12:30:48.167 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/selinux 2023-10-14T12:30:48.167 INFO:teuthology.orchestra.run.smithi064.stdout:/proc/sys/fs/binfmt_misc 2023-10-14T12:30:48.167 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/mqueue 2023-10-14T12:30:48.167 INFO:teuthology.orchestra.run.smithi064.stdout:/dev/hugepages 2023-10-14T12:30:48.167 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/debug 2023-10-14T12:30:48.168 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/tracing 2023-10-14T12:30:48.168 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/fs/fuse/connections 2023-10-14T12:30:48.168 INFO:teuthology.orchestra.run.smithi064.stdout:/sys/kernel/config 2023-10-14T12:30:48.168 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-sysctl.service 2023-10-14T12:30:48.168 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-10-14T12:30:48.169 INFO:teuthology.orchestra.run.smithi064.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-10-14T12:30:48.169 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/nfs/rpc_pipefs 2023-10-14T12:30:48.169 INFO:teuthology.orchestra.run.smithi064.stdout:/run/user/1000 2023-10-14T12:30:48.169 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph 2023-10-14T12:30:48.169 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-0 2023-10-14T12:30:48.170 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-1 2023-10-14T12:30:48.170 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-2 2023-10-14T12:30:48.170 INFO:teuthology.orchestra.run.smithi064.stdout:/var/lib/ceph/osd/ceph-3 2023-10-14T12:30:48.170 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns 2023-10-14T12:30:48.170 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:30:48.170 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T12:30:48.171 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:30:48.171 INFO:teuthology.orchestra.run.smithi064.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T12:30:48.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:48.172 DEBUG:teuthology.orchestra.run.smithi064:> ls /sys/fs/fuse/connections 2023-10-14T12:30:48.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi064.stderr:2023-10-14T12:30:48.232+0000 7fabb8e37480 -1 init, newargv = 0x55b1feefa900 newargc=15 2023-10-14T12:30:48.234 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi064.stderr:ceph-fuse[102912]: starting ceph client 2023-10-14T12:30:48.243 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi064.stderr:ceph-fuse[102912]: starting fuse 2023-10-14T12:30:48.261 INFO:teuthology.orchestra.run.smithi064.stdout:39 2023-10-14T12:30:48.261 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-10-14T12:30:48.262 DEBUG:teuthology.orchestra.run.smithi064:> sudo stdin-killer -- python3 -c ' 2023-10-14T12:30:48.262 DEBUG:teuthology.orchestra.run.smithi064:> import glob 2023-10-14T12:30:48.263 DEBUG:teuthology.orchestra.run.smithi064:> import re 2023-10-14T12:30:48.263 DEBUG:teuthology.orchestra.run.smithi064:> import os 2023-10-14T12:30:48.263 DEBUG:teuthology.orchestra.run.smithi064:> import subprocess 2023-10-14T12:30:48.264 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:30:48.264 DEBUG:teuthology.orchestra.run.smithi064:> def _find_admin_socket(client_name): 2023-10-14T12:30:48.264 DEBUG:teuthology.orchestra.run.smithi064:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-10-14T12:30:48.265 DEBUG:teuthology.orchestra.run.smithi064:> files = glob.glob(asok_path) 2023-10-14T12:30:48.265 DEBUG:teuthology.orchestra.run.smithi064:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-10-14T12:30:48.266 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:30:48.266 DEBUG:teuthology.orchestra.run.smithi064:> # Given a non-glob path, it better be there 2023-10-14T12:30:48.266 DEBUG:teuthology.orchestra.run.smithi064:> if "*" not in asok_path: 2023-10-14T12:30:48.267 DEBUG:teuthology.orchestra.run.smithi064:> assert(len(files) == 1) 2023-10-14T12:30:48.267 DEBUG:teuthology.orchestra.run.smithi064:> return files[0] 2023-10-14T12:30:48.268 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:30:48.268 DEBUG:teuthology.orchestra.run.smithi064:> for f in files: 2023-10-14T12:30:48.268 DEBUG:teuthology.orchestra.run.smithi064:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-10-14T12:30:48.269 DEBUG:teuthology.orchestra.run.smithi064:> if os.path.exists("/proc/{0}".format(pid)): 2023-10-14T12:30:48.269 DEBUG:teuthology.orchestra.run.smithi064:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-10-14T12:30:48.269 DEBUG:teuthology.orchestra.run.smithi064:> contents = proc_f.read() 2023-10-14T12:30:48.270 DEBUG:teuthology.orchestra.run.smithi064:> if mountpoint in contents: 2023-10-14T12:30:48.270 DEBUG:teuthology.orchestra.run.smithi064:> return f 2023-10-14T12:30:48.271 DEBUG:teuthology.orchestra.run.smithi064:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-10-14T12:30:48.271 DEBUG:teuthology.orchestra.run.smithi064:> 2023-10-14T12:30:48.271 DEBUG:teuthology.orchestra.run.smithi064:> print(_find_admin_socket("client.0")) 2023-10-14T12:30:48.272 DEBUG:teuthology.orchestra.run.smithi064:> ' 2023-10-14T12:30:48.481 INFO:teuthology.orchestra.run.smithi064.stdout:/var/run/ceph/ceph-client.0.102912.asok 2023-10-14T12:30:48.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:30:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-10-14T12:30:48.499 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.102912.asok 2023-10-14T12:30:48.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:48.500 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.102912.asok status 2023-10-14T12:30:48.749 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T12:30:48.749 INFO:teuthology.orchestra.run.smithi064.stdout: "metadata": { 2023-10-14T12:30:48.750 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_sha1": "4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0", 2023-10-14T12:30:48.750 INFO:teuthology.orchestra.run.smithi064.stdout: "ceph_version": "ceph version 18.0.0-6730-g4ba8a190 (4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0) reef (dev)", 2023-10-14T12:30:48.750 INFO:teuthology.orchestra.run.smithi064.stdout: "entity_id": "0", 2023-10-14T12:30:48.750 INFO:teuthology.orchestra.run.smithi064.stdout: "hostname": "smithi064", 2023-10-14T12:30:48.751 INFO:teuthology.orchestra.run.smithi064.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-10-14T12:30:48.751 INFO:teuthology.orchestra.run.smithi064.stdout: "pid": "102912", 2023-10-14T12:30:48.751 INFO:teuthology.orchestra.run.smithi064.stdout: "root": "/" 2023-10-14T12:30:48.751 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:48.751 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_count": 0, 2023-10-14T12:30:48.752 INFO:teuthology.orchestra.run.smithi064.stdout: "dentry_pinned_count": 0, 2023-10-14T12:30:48.752 INFO:teuthology.orchestra.run.smithi064.stdout: "id": 5688, 2023-10-14T12:30:48.752 INFO:teuthology.orchestra.run.smithi064.stdout: "inst": { 2023-10-14T12:30:48.752 INFO:teuthology.orchestra.run.smithi064.stdout: "name": { 2023-10-14T12:30:48.752 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "client", 2023-10-14T12:30:48.753 INFO:teuthology.orchestra.run.smithi064.stdout: "num": 5688 2023-10-14T12:30:48.753 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:48.753 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:30:48.753 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:30:48.753 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:30:48.754 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 1266222159 2023-10-14T12:30:48.754 INFO:teuthology.orchestra.run.smithi064.stdout: } 2023-10-14T12:30:48.754 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:48.754 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": { 2023-10-14T12:30:48.755 INFO:teuthology.orchestra.run.smithi064.stdout: "type": "v1", 2023-10-14T12:30:48.755 INFO:teuthology.orchestra.run.smithi064.stdout: "addr": "192.168.0.1:0", 2023-10-14T12:30:48.755 INFO:teuthology.orchestra.run.smithi064.stdout: "nonce": 1266222159 2023-10-14T12:30:48.755 INFO:teuthology.orchestra.run.smithi064.stdout: }, 2023-10-14T12:30:48.755 INFO:teuthology.orchestra.run.smithi064.stdout: "inst_str": "client.5688 192.168.0.1:0/1266222159", 2023-10-14T12:30:48.756 INFO:teuthology.orchestra.run.smithi064.stdout: "addr_str": "192.168.0.1:0/1266222159", 2023-10-14T12:30:48.756 INFO:teuthology.orchestra.run.smithi064.stdout: "inode_count": 1, 2023-10-14T12:30:48.756 INFO:teuthology.orchestra.run.smithi064.stdout: "mds_epoch": 18, 2023-10-14T12:30:48.756 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch": 41, 2023-10-14T12:30:48.756 INFO:teuthology.orchestra.run.smithi064.stdout: "osd_epoch_barrier": 0, 2023-10-14T12:30:48.756 INFO:teuthology.orchestra.run.smithi064.stdout: "blocklisted": false, 2023-10-14T12:30:48.757 INFO:teuthology.orchestra.run.smithi064.stdout: "fs_name": "testcephfs1" 2023-10-14T12:30:48.757 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T12:30:48.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:48.765 DEBUG:teuthology.orchestra.run.smithi064:> stat --file-system '--printf=%T 2023-10-14T12:30:48.765 DEBUG:teuthology.orchestra.run.smithi064:> ' -- /home/ubuntu/cephtest/mnt.0 2023-10-14T12:30:48.826 INFO:teuthology.orchestra.run.smithi064.stdout:fuseblk 2023-10-14T12:30:48.827 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-10-14T12:30:48.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:48.828 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-14T12:30:48.933 DEBUG:teuthology.orchestra.run.smithi064:> mktemp -d --suffix=xfstests-dev 2023-10-14T12:30:48.991 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.fHRpaBS5ywxfstests-dev 2023-10-14T12:30:48.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:48.992 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.fHRpaBS5ywxfstests-dev) 2023-10-14T12:30:49.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:49.094 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.fHRpaBS5ywxfstests-dev) 2023-10-14T12:30:49.161 INFO:teuthology.orchestra.run.smithi064.stderr:Cloning into '/tmp/tmp.fHRpaBS5ywxfstests-dev'... 2023-10-14T12:30:50.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:50.222 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-10-14T12:30:50.300 DEBUG:teuthology.orchestra.run.smithi064:> mktemp -d --suffix=test 2023-10-14T12:30:50.359 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.LYaLaNSY2Vtest 2023-10-14T12:30:50.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:30:50.360 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-10-14T12:30:50.419 DEBUG:teuthology.orchestra.run.smithi064:> mktemp -d --suffix=scratch 2023-10-14T12:30:50.471 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.EMAiFrXOt8scratch 2023-10-14T12:30:50.472 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-10-14T12:30:50.473 DEBUG:teuthology.orchestra.run.smithi064:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel python3 sqlite xfsprogs-qa-devel 2023-10-14T12:30:51.348 INFO:teuthology.orchestra.run.smithi064.stdout:Last metadata expiration check: 0:04:50 ago on Sat 14 Oct 2023 12:26:01 PM UTC. 2023-10-14T12:30:51.446 INFO:teuthology.orchestra.run.smithi064.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-10-14T12:30:51.447 INFO:teuthology.orchestra.run.smithi064.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T12:30:51.447 INFO:teuthology.orchestra.run.smithi064.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-10-14T12:30:51.449 INFO:teuthology.orchestra.run.smithi064.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-10-14T12:30:51.449 INFO:teuthology.orchestra.run.smithi064.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-10-14T12:30:51.452 INFO:teuthology.orchestra.run.smithi064.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-10-14T12:30:51.454 INFO:teuthology.orchestra.run.smithi064.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-10-14T12:30:51.455 INFO:teuthology.orchestra.run.smithi064.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-10-14T12:30:51.457 INFO:teuthology.orchestra.run.smithi064.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-10-14T12:30:51.458 INFO:teuthology.orchestra.run.smithi064.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-10-14T12:30:51.459 INFO:teuthology.orchestra.run.smithi064.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-10-14T12:30:51.460 INFO:teuthology.orchestra.run.smithi064.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-10-14T12:30:51.461 INFO:teuthology.orchestra.run.smithi064.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-10-14T12:30:51.462 INFO:teuthology.orchestra.run.smithi064.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-10-14T12:30:51.463 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2023-10-14T12:30:51.464 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T12:30:51.465 INFO:teuthology.orchestra.run.smithi064.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-10-14T12:30:51.466 INFO:teuthology.orchestra.run.smithi064.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-10-14T12:30:51.467 INFO:teuthology.orchestra.run.smithi064.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-10-14T12:30:51.468 INFO:teuthology.orchestra.run.smithi064.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-10-14T12:30:51.470 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-devel-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T12:30:51.471 INFO:teuthology.orchestra.run.smithi064.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-10-14T12:30:51.475 INFO:teuthology.orchestra.run.smithi064.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-10-14T12:30:51.534 INFO:teuthology.orchestra.run.smithi064.stdout:Dependencies resolved. 2023-10-14T12:30:51.536 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-10-14T12:30:51.536 INFO:teuthology.orchestra.run.smithi064.stdout: Package Arch Version Repository Size 2023-10-14T12:30:51.536 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-10-14T12:30:51.536 INFO:teuthology.orchestra.run.smithi064.stdout:Installing: 2023-10-14T12:30:51.537 INFO:teuthology.orchestra.run.smithi064.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-10-14T12:30:51.537 INFO:teuthology.orchestra.run.smithi064.stdout: fio x86_64 3.35-1.el9 appstream 6.2 M 2023-10-14T12:30:51.537 INFO:teuthology.orchestra.run.smithi064.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-10-14T12:30:51.537 INFO:teuthology.orchestra.run.smithi064.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-10-14T12:30:51.537 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrading: 2023-10-14T12:30:51.537 INFO:teuthology.orchestra.run.smithi064.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-10-14T12:30:51.538 INFO:teuthology.orchestra.run.smithi064.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-10-14T12:30:51.538 INFO:teuthology.orchestra.run.smithi064.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-10-14T12:30:51.538 INFO:teuthology.orchestra.run.smithi064.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-10-14T12:30:51.538 INFO:teuthology.orchestra.run.smithi064.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-10-14T12:30:51.538 INFO:teuthology.orchestra.run.smithi064.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-10-14T12:30:51.539 INFO:teuthology.orchestra.run.smithi064.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-10-14T12:30:51.539 INFO:teuthology.orchestra.run.smithi064.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-10-14T12:30:51.539 INFO:teuthology.orchestra.run.smithi064.stdout:Installing dependencies: 2023-10-14T12:30:51.539 INFO:teuthology.orchestra.run.smithi064.stdout: libnbd x86_64 1.16.0-1.el9 appstream 161 k 2023-10-14T12:30:51.539 INFO:teuthology.orchestra.run.smithi064.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-10-14T12:30:51.540 INFO:teuthology.orchestra.run.smithi064.stdout:Installing weak dependencies: 2023-10-14T12:30:51.540 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-http x86_64 3.35-1.el9 appstream 18 k 2023-10-14T12:30:51.540 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-libaio x86_64 3.35-1.el9 appstream 16 k 2023-10-14T12:30:51.540 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-nbd x86_64 3.35-1.el9 appstream 15 k 2023-10-14T12:30:51.540 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-rados x86_64 3.35-1.el9 appstream 16 k 2023-10-14T12:30:51.540 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-rbd x86_64 3.35-1.el9 appstream 16 k 2023-10-14T12:30:51.541 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-rdma x86_64 3.35-1.el9 appstream 21 k 2023-10-14T12:30:51.541 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:51.541 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction Summary 2023-10-14T12:30:51.541 INFO:teuthology.orchestra.run.smithi064.stdout:================================================================================ 2023-10-14T12:30:51.541 INFO:teuthology.orchestra.run.smithi064.stdout:Install 12 Packages 2023-10-14T12:30:51.542 INFO:teuthology.orchestra.run.smithi064.stdout:Upgrade 8 Packages 2023-10-14T12:30:51.542 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:30:51.542 INFO:teuthology.orchestra.run.smithi064.stdout:Total download size: 66 M 2023-10-14T12:30:51.543 INFO:teuthology.orchestra.run.smithi064.stdout:Downloading Packages: 2023-10-14T12:30:52.324 INFO:teuthology.orchestra.run.smithi064.stdout:(1/20): sqlite-3.34.1-6.el9.x86_64.rpm 2.4 MB/s | 747 kB 00:00 2023-10-14T12:30:52.355 INFO:teuthology.orchestra.run.smithi064.stdout:(2/20): rmt-1.6-6.el9.x86_64.rpm 133 kB/s | 45 kB 00:00 2023-10-14T12:30:52.681 INFO:teuthology.orchestra.run.smithi064.stdout:(3/20): fio-engine-http-3.35-1.el9.x86_64.rpm 52 kB/s | 18 kB 00:00 2023-10-14T12:30:52.706 INFO:teuthology.orchestra.run.smithi064.stdout:(4/20): fio-engine-libaio-3.35-1.el9.x86_64.rpm 45 kB/s | 16 kB 00:00 2023-10-14T12:30:52.881 INFO:teuthology.orchestra.run.smithi064.stdout:(5/20): fio-engine-nbd-3.35-1.el9.x86_64.rpm 73 kB/s | 15 kB 00:00 2023-10-14T12:30:52.923 INFO:teuthology.orchestra.run.smithi064.stdout:(6/20): fio-engine-rados-3.35-1.el9.x86_64.rpm 73 kB/s | 16 kB 00:00 2023-10-14T12:30:53.073 INFO:teuthology.orchestra.run.smithi064.stdout:(7/20): fio-engine-rbd-3.35-1.el9.x86_64.rpm 86 kB/s | 16 kB 00:00 2023-10-14T12:30:53.099 INFO:teuthology.orchestra.run.smithi064.stdout:(8/20): fio-engine-rdma-3.35-1.el9.x86_64.rpm 121 kB/s | 21 kB 00:00 2023-10-14T12:30:53.224 INFO:teuthology.orchestra.run.smithi064.stdout:(9/20): fio-3.35-1.el9.x86_64.rpm 5.2 MB/s | 6.2 MB 00:01 2023-10-14T12:30:53.278 INFO:teuthology.orchestra.run.smithi064.stdout:(10/20): libnbd-1.16.0-1.el9.x86_64.rpm 978 kB/s | 161 kB 00:00 2023-10-14T12:30:53.533 INFO:teuthology.orchestra.run.smithi064.stdout:(11/20): cpp-11.4.1-2.3.el9.x86_64.rpm 42 MB/s | 11 MB 00:00 2023-10-14T12:30:53.658 INFO:teuthology.orchestra.run.smithi064.stdout:(12/20): dump-0.4-0.51.b47.el9.x86_64.rpm 161 kB/s | 88 kB 00:00 2023-10-14T12:30:53.850 INFO:teuthology.orchestra.run.smithi064.stdout:(13/20): indent-2.2.13-4.el9.x86_64.rpm 288 kB/s | 179 kB 00:00 2023-10-14T12:30:54.245 INFO:teuthology.orchestra.run.smithi064.stdout:(14/20): gcc-11.4.1-2.3.el9.x86_64.rpm 45 MB/s | 32 MB 00:00 2023-10-14T12:30:54.301 INFO:teuthology.orchestra.run.smithi064.stdout:(15/20): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 104 kB/s | 47 kB 00:00 2023-10-14T12:30:54.509 INFO:teuthology.orchestra.run.smithi064.stdout:(16/20): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 15 MB/s | 13 MB 00:00 2023-10-14T12:30:54.584 INFO:teuthology.orchestra.run.smithi064.stdout:(17/20): libstdc++-devel-11.4.1-2.3.el9.x86_64. 6.8 MB/s | 2.2 MB 00:00 2023-10-14T12:30:54.610 INFO:teuthology.orchestra.run.smithi064.stdout:(18/20): libgcc-11.4.1-2.3.el9.x86_64.rpm 315 kB/s | 92 kB 00:00 2023-10-14T12:30:54.643 INFO:teuthology.orchestra.run.smithi064.stdout:(19/20): libgomp-11.4.1-2.3.el9.x86_64.rpm 2.1 MB/s | 268 kB 00:00 2023-10-14T12:30:54.693 INFO:teuthology.orchestra.run.smithi064.stdout:(20/20): libstdc++-11.4.1-2.3.el9.x86_64.rpm 9.0 MB/s | 735 kB 00:00 2023-10-14T12:30:54.699 INFO:teuthology.orchestra.run.smithi064.stdout:-------------------------------------------------------------------------------- 2023-10-14T12:30:54.699 INFO:teuthology.orchestra.run.smithi064.stdout:Total 21 MB/s | 66 MB 00:03 2023-10-14T12:30:55.057 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction check 2023-10-14T12:30:55.243 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction check succeeded. 2023-10-14T12:30:55.243 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction test 2023-10-14T12:30:55.881 INFO:teuthology.orchestra.run.smithi064.stdout:Transaction test succeeded. 2023-10-14T12:30:55.882 INFO:teuthology.orchestra.run.smithi064.stdout:Running transaction 2023-10-14T12:30:57.467 INFO:teuthology.orchestra.run.smithi064.stdout: Preparing : 1/1 2023-10-14T12:30:57.527 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 1/28 2023-10-14T12:30:57.694 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 1/28 2023-10-14T12:30:58.435 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 2/28 2023-10-14T12:30:58.524 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 3/28 2023-10-14T12:30:58.835 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 4/28 2023-10-14T12:31:00.068 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 5/28 2023-10-14T12:31:00.289 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 6/28 2023-10-14T12:31:00.380 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 6/28 2023-10-14T12:31:00.418 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : libnbd-1.16.0-1.el9.x86_64 7/28 2023-10-14T12:31:00.452 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 8/28 2023-10-14T12:31:00.486 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 9/28 2023-10-14T12:31:00.519 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 10/28 2023-10-14T12:31:00.553 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 11/28 2023-10-14T12:31:00.587 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 12/28 2023-10-14T12:31:00.849 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 13/28 2023-10-14T12:31:00.916 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : fio-3.35-1.el9.x86_64 14/28 2023-10-14T12:31:00.957 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : rmt-2:1.6-6.el9.x86_64 15/28 2023-10-14T12:31:01.354 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 16/28 2023-10-14T12:31:01.524 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 17/28 2023-10-14T12:31:01.563 INFO:teuthology.orchestra.run.smithi064.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 18/28 2023-10-14T12:31:01.681 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 18/28 2023-10-14T12:31:01.739 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : indent-2.2.13-4.el9.x86_64 19/28 2023-10-14T12:31:01.761 INFO:teuthology.orchestra.run.smithi064.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 20/28 2023-10-14T12:31:01.792 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 21/28 2023-10-14T12:31:01.792 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 22/28 2023-10-14T12:31:01.911 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 22/28 2023-10-14T12:31:01.986 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 23/28 2023-10-14T12:31:02.033 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 24/28 2023-10-14T12:31:02.088 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 25/28 2023-10-14T12:31:02.128 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 26/28 2023-10-14T12:31:02.128 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 27/28 2023-10-14T12:31:02.238 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 27/28 2023-10-14T12:31:02.355 INFO:teuthology.orchestra.run.smithi064.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 28/28 2023-10-14T12:31:04.034 INFO:teuthology.orchestra.run.smithi064.stdout: Running scriptlet: libgomp-11.4.1-2.1.el9.x86_64 28/28 2023-10-14T12:31:04.034 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 1/28 2023-10-14T12:31:04.035 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 2/28 2023-10-14T12:31:04.035 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fio-3.35-1.el9.x86_64 3/28 2023-10-14T12:31:04.035 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 4/28 2023-10-14T12:31:04.035 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 5/28 2023-10-14T12:31:04.035 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 6/28 2023-10-14T12:31:04.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 7/28 2023-10-14T12:31:04.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 8/28 2023-10-14T12:31:04.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 9/28 2023-10-14T12:31:04.036 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libnbd-1.16.0-1.el9.x86_64 10/28 2023-10-14T12:31:04.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 11/28 2023-10-14T12:31:04.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : indent-2.2.13-4.el9.x86_64 12/28 2023-10-14T12:31:04.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 13/28 2023-10-14T12:31:04.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 14/28 2023-10-14T12:31:04.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 15/28 2023-10-14T12:31:04.037 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 16/28 2023-10-14T12:31:04.038 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 17/28 2023-10-14T12:31:04.038 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 18/28 2023-10-14T12:31:04.038 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 19/28 2023-10-14T12:31:04.038 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 20/28 2023-10-14T12:31:04.039 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 21/28 2023-10-14T12:31:04.039 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 22/28 2023-10-14T12:31:04.039 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 23/28 2023-10-14T12:31:04.039 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 24/28 2023-10-14T12:31:04.039 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 25/28 2023-10-14T12:31:04.040 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 26/28 2023-10-14T12:31:04.040 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 27/28 2023-10-14T12:31:04.789 INFO:teuthology.orchestra.run.smithi064.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 28/28 2023-10-14T12:31:04.790 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:31:04.790 INFO:teuthology.orchestra.run.smithi064.stdout:Upgraded: 2023-10-14T12:31:04.790 INFO:teuthology.orchestra.run.smithi064.stdout: cpp-11.4.1-2.3.el9.x86_64 gcc-11.4.1-2.3.el9.x86_64 2023-10-14T12:31:04.790 INFO:teuthology.orchestra.run.smithi064.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-10-14T12:31:04.790 INFO:teuthology.orchestra.run.smithi064.stdout: libgcc-11.4.1-2.3.el9.x86_64 libgomp-11.4.1-2.3.el9.x86_64 2023-10-14T12:31:04.791 INFO:teuthology.orchestra.run.smithi064.stdout: libstdc++-11.4.1-2.3.el9.x86_64 libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-10-14T12:31:04.791 INFO:teuthology.orchestra.run.smithi064.stdout:Installed: 2023-10-14T12:31:04.791 INFO:teuthology.orchestra.run.smithi064.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-10-14T12:31:04.791 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-10-14T12:31:04.791 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-10-14T12:31:04.792 INFO:teuthology.orchestra.run.smithi064.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-10-14T12:31:04.792 INFO:teuthology.orchestra.run.smithi064.stdout: indent-2.2.13-4.el9.x86_64 libnbd-1.16.0-1.el9.x86_64 2023-10-14T12:31:04.792 INFO:teuthology.orchestra.run.smithi064.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-10-14T12:31:04.792 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:31:04.792 INFO:teuthology.orchestra.run.smithi064.stdout:Complete! 2023-10-14T12:31:05.346 DEBUG:teuthology.orchestra.run.smithi064:> sudo useradd -m fsgqa 2023-10-14T12:31:05.450 INFO:teuthology.orchestra.run.smithi064.stderr:useradd: user 'fsgqa' already exists 2023-10-14T12:31:05.454 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-14T12:31:05.455 DEBUG:teuthology.orchestra.run.smithi064:> sudo groupadd fsgqa 2023-10-14T12:31:05.552 INFO:teuthology.orchestra.run.smithi064.stderr:groupadd: group 'fsgqa' already exists 2023-10-14T12:31:05.556 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-10-14T12:31:05.556 DEBUG:teuthology.orchestra.run.smithi064:> sudo useradd fsgqa2 2023-10-14T12:31:06.522 DEBUG:teuthology.orchestra.run.smithi064:> sudo useradd 123456-fsgqa 2023-10-14T12:31:07.231 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-10-14T12:31:07.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.468+0000 7f9357260640 1 Processor -- start 2023-10-14T12:31:07.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.468+0000 7f9357260640 1 -- start start 2023-10-14T12:31:07.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.469+0000 7f9357260640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f935015c990 0x7f9350065ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:07.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f9357260640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500cb0f0 0x7f93500cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:07.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f9357260640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f93500ce0f0 0x7f93501604f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:07.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f9357260640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935006b460 con 0x7f935015c990 2023-10-14T12:31:07.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f9357260640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f935006a890 con 0x7f93500ce0f0 2023-10-14T12:31:07.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f9357260640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93500ce9a0 con 0x7f93500cb0f0 2023-10-14T12:31:07.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f935015c990 0x7f9350065ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:07.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f935015c990 0x7f9350065ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34166/0 (socket says 172.21.15.64:34166) 2023-10-14T12:31:07.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 -- 172.21.15.64:0/3486322377 learned_addr learned my addr 172.21.15.64:0/3486322377 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:31:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 -- 172.21.15.64:0/3486322377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500cb0f0 msgr2=0x7f93500cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:31:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 --2- 172.21.15.64:0/3486322377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500cb0f0 0x7f93500cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 -- 172.21.15.64:0/3486322377 >> v2:172.21.15.177:3300/0 conn(0x7f93500ce0f0 msgr2=0x7f93501604f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:31:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 --2- 172.21.15.64:0/3486322377 >> v2:172.21.15.177:3300/0 conn(0x7f93500ce0f0 0x7f93501604f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.470+0000 7f935625e640 1 -- 172.21.15.64:0/3486322377 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f935006ab30 con 0x7f935015c990 2023-10-14T12:31:07.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.471+0000 7f935625e640 1 --2- 172.21.15.64:0/3486322377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f9350065ab0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9350070760 tx=0x7f934c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c6bd107e347d72 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:31:07.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.472+0000 7f935525c640 1 -- 172.21.15.64:0/3486322377 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0317e0 con 0x7f935015c990 2023-10-14T12:31:07.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.472+0000 7f935525c640 1 -- 172.21.15.64:0/3486322377 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c031940 con 0x7f935015c990 2023-10-14T12:31:07.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.472+0000 7f935525c640 1 -- 172.21.15.64:0/3486322377 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c031cd0 con 0x7f935015c990 2023-10-14T12:31:07.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 -- 172.21.15.64:0/3486322377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 msgr2=0x7f9350065ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:07.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 --2- 172.21.15.64:0/3486322377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f9350065ab0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9350070760 tx=0x7f934c02b880 comp rx=0 tx=0).stop 2023-10-14T12:31:07.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 -- 172.21.15.64:0/3486322377 shutdown_connections 2023-10-14T12:31:07.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 --2- 172.21.15.64:0/3486322377 >> v2:172.21.15.177:3300/0 conn(0x7f93500ce0f0 0x7f93501604f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 --2- 172.21.15.64:0/3486322377 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500cb0f0 0x7f93500cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 --2- 172.21.15.64:0/3486322377 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f9350065ab0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 -- 172.21.15.64:0/3486322377 >> 172.21.15.64:0/3486322377 conn(0x7f93500b06b0 msgr2=0x7f93500b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 -- 172.21.15.64:0/3486322377 shutdown_connections 2023-10-14T12:31:07.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.473+0000 7f9357260640 1 -- 172.21.15.64:0/3486322377 wait complete. 2023-10-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.475+0000 7f9357260640 1 Processor -- start 2023-10-14T12:31:07.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.475+0000 7f9357260640 1 -- start start 2023-10-14T12:31:07.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9357260640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500cb0f0 0x7f93500b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:07.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9357260640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500ce0f0 0x7f93500c65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:07.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9357260640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f935015b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:07.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9357260640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501f27f0 con 0x7f935015c990 2023-10-14T12:31:07.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9357260640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93500c6ae0 con 0x7f93500cb0f0 2023-10-14T12:31:07.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9357260640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9350160780 con 0x7f93500ce0f0 2023-10-14T12:31:07.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9356a5f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f935015b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:07.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9356a5f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f935015b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34172/0 (socket says 172.21.15.64:34172) 2023-10-14T12:31:07.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.476+0000 7f9356a5f640 1 -- 172.21.15.64:0/843501249 learned_addr learned my addr 172.21.15.64:0/843501249 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:31:07.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f935625e640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500cb0f0 0x7f93500b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:07.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9355a5d640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500ce0f0 0x7f93500c65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:07.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9356a5f640 1 -- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500ce0f0 msgr2=0x7f93500c65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:07.483 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9356a5f640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500ce0f0 0x7f93500c65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9356a5f640 1 -- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500cb0f0 msgr2=0x7f93500b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:07.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9356a5f640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500cb0f0 0x7f93500b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9356a5f640 1 -- 172.21.15.64:0/843501249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f934c0094d0 con 0x7f935015c990 2023-10-14T12:31:07.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f935625e640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500cb0f0 0x7f93500b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:31:07.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9356a5f640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f935015b780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f934800ba10 tx=0x7f934800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:31:07.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9346ffd640 1 -- 172.21.15.64:0/843501249 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934800cac0 con 0x7f935015c990 2023-10-14T12:31:07.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9346ffd640 1 -- 172.21.15.64:0/843501249 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800cc40 con 0x7f935015c990 2023-10-14T12:31:07.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9346ffd640 1 -- 172.21.15.64:0/843501249 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348014440 con 0x7f935015c990 2023-10-14T12:31:07.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.477+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9350160a20 con 0x7f935015c990 2023-10-14T12:31:07.485 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.478+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93501f2320 con 0x7f935015c990 2023-10-14T12:31:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.479+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93500cccc0 con 0x7f935015c990 2023-10-14T12:31:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.480+0000 7f9346ffd640 1 -- 172.21.15.64:0/843501249 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f934801d3b0 con 0x7f935015c990 2023-10-14T12:31:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.480+0000 7f9346ffd640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f933406ae70 0x7f933406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:07.486 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.481+0000 7f9346ffd640 1 -- 172.21.15.64:0/843501249 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f9348089640 con 0x7f935015c990 2023-10-14T12:31:07.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.481+0000 7f935625e640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f933406ae70 0x7f933406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:07.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.482+0000 7f935625e640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f933406ae70 0x7f933406d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f934c036000 tx=0x7f934c03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:31:07.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.485+0000 7f9346ffd640 1 -- 172.21.15.64:0/843501249 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f9348054580 con 0x7f935015c990 2023-10-14T12:31:07.757 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.757+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f93501f2540 con 0x7f935015c990 2023-10-14T12:31:07.758 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.757+0000 7f9346ffd640 1 -- 172.21.15.64:0/843501249 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f9348057ba0 con 0x7f935015c990 2023-10-14T12:31:07.758 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:31:07.759 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":1,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","modified":"2023-10-14T12:27:42.320737Z","created":"2023-10-14T12:27:42.320737Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:3300","nonce":0},{"type":"v1","addr":"172.21.15.64:6789","nonce":0}]},"addr":"172.21.15.64:6789/0","public_addr":"172.21.15.64:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3300","nonce":0},{"type":"v1","addr":"172.21.15.177:6789","nonce":0}]},"addr":"172.21.15.177:6789/0","public_addr":"172.21.15.177:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:3301","nonce":0},{"type":"v1","addr":"172.21.15.177:6790","nonce":0}]},"addr":"172.21.15.177:6790/0","public_addr":"172.21.15.177:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-10-14T12:31:07.759 INFO:teuthology.orchestra.run.smithi064.stderr:dumped monmap epoch 1 2023-10-14T12:31:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f933406ae70 msgr2=0x7f933406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:07.761 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f933406ae70 0x7f933406d330 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f934c036000 tx=0x7f934c03d040 comp rx=0 tx=0).stop 2023-10-14T12:31:07.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 msgr2=0x7f935015b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:07.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f935015b780 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f934800ba10 tx=0x7f934800bed0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 shutdown_connections 2023-10-14T12:31:07.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f933406ae70 0x7f933406d330 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.762 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f935015c990 0x7f935015b780 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f93500ce0f0 0x7f93500c65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 --2- 172.21.15.64:0/843501249 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f93500cb0f0 0x7f93500b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.760+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 >> 172.21.15.64:0/843501249 conn(0x7f93500b06b0 msgr2=0x7f9350070e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:31:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.761+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 shutdown_connections 2023-10-14T12:31:07.763 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:07.761+0000 7f9357260640 1 -- 172.21.15.64:0/843501249 wait complete. 2023-10-14T12:31:07.780 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.admin 2023-10-14T12:31:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.016+0000 7f2f72dd7640 1 Processor -- start 2023-10-14T12:31:08.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.017+0000 7f2f72dd7640 1 -- start start 2023-10-14T12:31:08.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.018+0000 7f2f72dd7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2f6c0b2dd0 0x7f2f6c06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:08.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.018+0000 7f2f72dd7640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c15f0d0 con 0x7f2f6c0ced10 2023-10-14T12:31:08.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.018+0000 7f2f72dd7640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f6c15ab50 con 0x7f2f6c06dc20 2023-10-14T12:31:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.018+0000 7f2f72dd7640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f6c15e2b0 con 0x7f2f6c0b2dd0 2023-10-14T12:31:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.018+0000 7f2f71dd5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2f6c0b2dd0 0x7f2f6c06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.018+0000 7f2f71dd5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2f6c0b2dd0 0x7f2f6c06d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34174/0 (socket says 172.21.15.64:34174) 2023-10-14T12:31:08.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.018+0000 7f2f71dd5640 1 -- 172.21.15.64:0/827741754 learned_addr learned my addr 172.21.15.64:0/827741754 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:31:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.019+0000 7f2f71dd5640 1 -- 172.21.15.64:0/827741754 >> v1:172.21.15.177:6789/0 conn(0x7f2f6c06dc20 legacy=0x7f2f6c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T12:31:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.019+0000 7f2f71dd5640 1 -- 172.21.15.64:0/827741754 >> v1:172.21.15.64:6789/0 conn(0x7f2f6c0ced10 legacy=0x7f2f6c0ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:08.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.019+0000 7f2f71dd5640 1 -- 172.21.15.64:0/827741754 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f6c06d3a0 con 0x7f2f6c0b2dd0 2023-10-14T12:31:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.020+0000 7f2f71dd5640 1 --2- 172.21.15.64:0/827741754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c06d6e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009850 tx=0x7f2f6802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78ee77aefc2ee9e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:31:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.020+0000 7f2f70dd3640 1 -- 172.21.15.64:0/827741754 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68004230 con 0x7f2f6c0b2dd0 2023-10-14T12:31:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.020+0000 7f2f70dd3640 1 -- 172.21.15.64:0/827741754 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68004390 con 0x7f2f6c0b2dd0 2023-10-14T12:31:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.020+0000 7f2f70dd3640 1 -- 172.21.15.64:0/827741754 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68030840 con 0x7f2f6c0b2dd0 2023-10-14T12:31:08.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.021+0000 7f2f72dd7640 1 -- 172.21.15.64:0/827741754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c0b2dd0 msgr2=0x7f2f6c06d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.021+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/827741754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c06d6e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2f68009850 tx=0x7f2f6802b980 comp rx=0 tx=0).stop 2023-10-14T12:31:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.021+0000 7f2f72dd7640 1 -- 172.21.15.64:0/827741754 shutdown_connections 2023-10-14T12:31:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.021+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/827741754 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c06d6e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.021+0000 7f2f72dd7640 1 -- 172.21.15.64:0/827741754 >> 172.21.15.64:0/827741754 conn(0x7f2f6c069fc0 msgr2=0x7f2f6c06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:31:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.021+0000 7f2f72dd7640 1 -- 172.21.15.64:0/827741754 shutdown_connections 2023-10-14T12:31:08.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.021+0000 7f2f72dd7640 1 -- 172.21.15.64:0/827741754 wait complete. 2023-10-14T12:31:08.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.023+0000 7f2f72dd7640 1 Processor -- start 2023-10-14T12:31:08.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.023+0000 7f2f72dd7640 1 -- start start 2023-10-14T12:31:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f72dd7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c06dc20 0x7f2f6c0c62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f72dd7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c0cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:08.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f72dd7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f6c0ced10 0x7f2f6c0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:08.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f72dd7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c5ed0 con 0x7f2f6c06dc20 2023-10-14T12:31:08.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f72dd7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c7d80 con 0x7f2f6c0b2dd0 2023-10-14T12:31:08.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f72dd7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c0c5530 con 0x7f2f6c0ced10 2023-10-14T12:31:08.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f71dd5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c06dc20 0x7f2f6c0c62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:08.029 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f71dd5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c06dc20 0x7f2f6c0c62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:34176/0 (socket says 172.21.15.64:34176) 2023-10-14T12:31:08.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.024+0000 7f2f71dd5640 1 -- 172.21.15.64:0/2511264625 learned_addr learned my addr 172.21.15.64:0/2511264625 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T12:31:08.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f71dd5640 1 -- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f6c0ced10 msgr2=0x7f2f6c0c3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:08.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f71dd5640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f6c0ced10 0x7f2f6c0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f71dd5640 1 -- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0b2dd0 msgr2=0x7f2f6c0cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:08.030 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f715d4640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c0cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:08.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f71dd5640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c0cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f71dd5640 1 -- 172.21.15.64:0/2511264625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f68009460 con 0x7f2f6c06dc20 2023-10-14T12:31:08.031 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f715d4640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T12:31:08.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.025+0000 7f2f71dd5640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c06dc20 0x7f2f6c0c62f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f680090b0 tx=0x7f2f680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:31:08.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.026+0000 7f2f627fc640 1 -- 172.21.15.64:0/2511264625 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6803e070 con 0x7f2f6c06dc20 2023-10-14T12:31:08.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.026+0000 7f2f627fc640 1 -- 172.21.15.64:0/2511264625 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f68004500 con 0x7f2f6c06dc20 2023-10-14T12:31:08.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.026+0000 7f2f627fc640 1 -- 172.21.15.64:0/2511264625 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68030e00 con 0x7f2f6c06dc20 2023-10-14T12:31:08.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.026+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c0c5810 con 0x7f2f6c06dc20 2023-10-14T12:31:08.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.026+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c0c6830 con 0x7f2f6c06dc20 2023-10-14T12:31:08.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.027+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c04e9b0 con 0x7f2f6c06dc20 2023-10-14T12:31:08.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.028+0000 7f2f627fc640 1 -- 172.21.15.64:0/2511264625 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2f68003610 con 0x7f2f6c06dc20 2023-10-14T12:31:08.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.029+0000 7f2f627fc640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f5006ae70 0x7f2f5006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T12:31:08.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.029+0000 7f2f627fc640 1 -- 172.21.15.64:0/2511264625 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6049+0+0 (secure 0 0 0) 0x7f2f680ab550 con 0x7f2f6c06dc20 2023-10-14T12:31:08.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.030+0000 7f2f715d4640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f5006ae70 0x7f2f5006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T12:31:08.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.031+0000 7f2f715d4640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f5006ae70 0x7f2f5006d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c156ef0 tx=0x7f2f5c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T12:31:08.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.033+0000 7f2f627fc640 1 -- 172.21.15.64:0/2511264625 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2f680765e0 con 0x7f2f6c06dc20 2023-10-14T12:31:08.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.298+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.admin"} v 0) v1 -- 0x7f2f6c0b23e0 con 0x7f2f6c06dc20 2023-10-14T12:31:08.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.299+0000 7f2f627fc640 1 -- 172.21.15.64:0/2511264625 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.admin"}]=0 v13) v1 ==== 82+0+151 (secure 0 0 0) 0x7f2f68079c00 con 0x7f2f6c06dc20 2023-10-14T12:31:08.300 INFO:teuthology.orchestra.run.smithi064.stdout:[client.admin] 2023-10-14T12:31:08.300 INFO:teuthology.orchestra.run.smithi064.stdout: key = AQA+iSpl1oF6LhAAuhBxJB02FxMYZUC47L5i6g== 2023-10-14T12:31:08.301 INFO:teuthology.orchestra.run.smithi064.stdout: caps mds = "allow *" 2023-10-14T12:31:08.301 INFO:teuthology.orchestra.run.smithi064.stdout: caps mgr = "allow *" 2023-10-14T12:31:08.301 INFO:teuthology.orchestra.run.smithi064.stdout: caps mon = "allow *" 2023-10-14T12:31:08.301 INFO:teuthology.orchestra.run.smithi064.stdout: caps osd = "allow *" 2023-10-14T12:31:08.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f5006ae70 msgr2=0x7f2f5006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:08.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f5006ae70 0x7f2f5006d330 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c156ef0 tx=0x7f2f5c009040 comp rx=0 tx=0).stop 2023-10-14T12:31:08.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c06dc20 msgr2=0x7f2f6c0c62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T12:31:08.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c06dc20 0x7f2f6c0c62f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2f680090b0 tx=0x7f2f680046c0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 shutdown_connections 2023-10-14T12:31:08.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f2f5006ae70 0x7f2f5006d330 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2f6c0ced10 0x7f2f6c0c3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2f6c0b2dd0 0x7f2f6c0cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 --2- 172.21.15.64:0/2511264625 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2f6c06dc20 0x7f2f6c0c62f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T12:31:08.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 >> 172.21.15.64:0/2511264625 conn(0x7f2f6c069fc0 msgr2=0x7f2f6c158b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T12:31:08.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 shutdown_connections 2023-10-14T12:31:08.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T12:31:08.302+0000 7f2f72dd7640 1 -- 172.21.15.64:0/2511264625 wait complete. 2023-10-14T12:31:08.322 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2023-10-14T12:31:08.373 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.AM5NLddQah 2023-10-14T12:31:08.373 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:31:08.374 DEBUG:teuthology.orchestra.run.smithi064:> dd of=/tmp/tmp.AM5NLddQah 2023-10-14T12:31:08.426 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:31:08.426 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/tmp/tmp.fHRpaBS5ywxfstests-dev/local.config 2023-10-14T12:31:08.580 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph-fuse export CEPH_FUSE_BIN_PATH=ceph-fuse export TEST_DEV=ceph-fuse # without this tests won't get started export TEST_DIR=/tmp/tmp.LYaLaNSY2Vtest export SCRATCH_DEV= export SCRATCH_MNT=/tmp/tmp.EMAiFrXOt8scratch export CEPHFS_MOUNT_OPTIONS="-m 172.21.15.64:6789 -k /tmp/tmp.AM5NLddQah --client_mountpoint /test" 2023-10-14T12:31:08.580 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T12:31:08.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo dd of=/tmp/tmp.fHRpaBS5ywxfstests-dev/ceph.exclude 2023-10-14T12:31:08.733 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo make) 2023-10-14T12:31:08.904 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize -cfi 2023-10-14T12:31:09.669 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: putting auxiliary files in '.'. 2023-10-14T12:31:09.670 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file './config.guess' 2023-10-14T12:31:09.685 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file './config.sub' 2023-10-14T12:31:09.701 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file './install-sh' 2023-10-14T12:31:09.717 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file './ltmain.sh' 2023-10-14T12:31:09.814 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-10-14T12:31:09.815 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-10-14T12:31:09.836 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-10-14T12:31:09.856 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-10-14T12:31:09.875 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-10-14T12:31:09.893 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-10-14T12:31:09.919 INFO:teuthology.orchestra.run.smithi064.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-10-14T12:31:09.924 INFO:teuthology.orchestra.run.smithi064.stdout:cp include/install-sh . 2023-10-14T12:31:09.928 INFO:teuthology.orchestra.run.smithi064.stdout:aclocal -I m4 2023-10-14T12:31:10.579 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:31:10.589 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:31:11.324 INFO:teuthology.orchestra.run.smithi064.stdout:autoheader 2023-10-14T12:31:11.754 INFO:teuthology.orchestra.run.smithi064.stdout:autoconf 2023-10-14T12:31:12.030 INFO:teuthology.orchestra.run.smithi064.stdout:./configure \ 2023-10-14T12:31:12.031 INFO:teuthology.orchestra.run.smithi064.stdout: --libexecdir=/usr/lib \ 2023-10-14T12:31:12.031 INFO:teuthology.orchestra.run.smithi064.stdout: --exec_prefix=/var/lib 2023-10-14T12:31:12.502 INFO:teuthology.orchestra.run.smithi064.stdout:checking build system type... x86_64-pc-linux-gnu 2023-10-14T12:31:12.503 INFO:teuthology.orchestra.run.smithi064.stdout:checking host system type... x86_64-pc-linux-gnu 2023-10-14T12:31:12.510 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to print strings... printf 2023-10-14T12:31:12.510 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gcc... gcc 2023-10-14T12:31:12.653 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether the C compiler works... yes 2023-10-14T12:31:12.653 INFO:teuthology.orchestra.run.smithi064.stdout:checking for C compiler default output file name... a.out 2023-10-14T12:31:12.729 INFO:teuthology.orchestra.run.smithi064.stdout:checking for suffix of executables... 2023-10-14T12:31:12.833 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether we are cross compiling... no 2023-10-14T12:31:12.886 INFO:teuthology.orchestra.run.smithi064.stdout:checking for suffix of object files... o 2023-10-14T12:31:12.934 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether we are using the GNU C compiler... yes 2023-10-14T12:31:12.982 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether gcc accepts -g... yes 2023-10-14T12:31:13.049 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gcc option to accept ISO C89... none needed 2023-10-14T12:31:13.060 INFO:teuthology.orchestra.run.smithi064.stdout:checking for a sed that does not truncate output... /bin/sed 2023-10-14T12:31:13.070 INFO:teuthology.orchestra.run.smithi064.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-10-14T12:31:13.076 INFO:teuthology.orchestra.run.smithi064.stdout:checking for egrep... /bin/grep -E 2023-10-14T12:31:13.083 INFO:teuthology.orchestra.run.smithi064.stdout:checking for fgrep... /bin/grep -F 2023-10-14T12:31:13.096 INFO:teuthology.orchestra.run.smithi064.stdout:checking for ld used by gcc... /bin/ld 2023-10-14T12:31:13.102 INFO:teuthology.orchestra.run.smithi064.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-10-14T12:31:13.113 INFO:teuthology.orchestra.run.smithi064.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-10-14T12:31:14.137 INFO:teuthology.orchestra.run.smithi064.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-10-14T12:31:14.137 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether ln -s works... yes 2023-10-14T12:31:14.178 INFO:teuthology.orchestra.run.smithi064.stdout:checking the maximum length of command line arguments... 1572864 2023-10-14T12:31:14.189 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-10-14T12:31:14.189 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-10-14T12:31:14.190 INFO:teuthology.orchestra.run.smithi064.stdout:checking for /bin/ld option to reload object files... -r 2023-10-14T12:31:14.190 INFO:teuthology.orchestra.run.smithi064.stdout:checking for objdump... objdump 2023-10-14T12:31:14.191 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to recognize dependent libraries... pass_all 2023-10-14T12:31:14.193 INFO:teuthology.orchestra.run.smithi064.stdout:checking for dlltool... no 2023-10-14T12:31:14.193 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-10-14T12:31:14.193 INFO:teuthology.orchestra.run.smithi064.stdout:checking for ar... ar 2023-10-14T12:31:14.311 INFO:teuthology.orchestra.run.smithi064.stdout:checking for archiver @FILE support... @ 2023-10-14T12:31:14.313 INFO:teuthology.orchestra.run.smithi064.stdout:checking for strip... strip 2023-10-14T12:31:14.314 INFO:teuthology.orchestra.run.smithi064.stdout:checking for ranlib... ranlib 2023-10-14T12:31:14.315 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gawk... gawk 2023-10-14T12:31:14.510 INFO:teuthology.orchestra.run.smithi064.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-10-14T12:31:14.515 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sysroot... no 2023-10-14T12:31:14.527 INFO:teuthology.orchestra.run.smithi064.stdout:checking for a working dd... /bin/dd 2023-10-14T12:31:14.540 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-10-14T12:31:14.586 INFO:teuthology.orchestra.run.smithi064.stdout:checking for mt... no 2023-10-14T12:31:14.595 INFO:teuthology.orchestra.run.smithi064.stdout:checking if : is a manifest tool... no 2023-10-14T12:31:14.699 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to run the C preprocessor... gcc -E 2023-10-14T12:31:15.081 INFO:teuthology.orchestra.run.smithi064.stdout:checking for ANSI C header files... yes 2023-10-14T12:31:15.146 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/types.h... yes 2023-10-14T12:31:15.228 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/stat.h... yes 2023-10-14T12:31:15.301 INFO:teuthology.orchestra.run.smithi064.stdout:checking for stdlib.h... yes 2023-10-14T12:31:15.378 INFO:teuthology.orchestra.run.smithi064.stdout:checking for string.h... yes 2023-10-14T12:31:15.467 INFO:teuthology.orchestra.run.smithi064.stdout:checking for memory.h... yes 2023-10-14T12:31:15.542 INFO:teuthology.orchestra.run.smithi064.stdout:checking for strings.h... yes 2023-10-14T12:31:15.628 INFO:teuthology.orchestra.run.smithi064.stdout:checking for inttypes.h... yes 2023-10-14T12:31:15.710 INFO:teuthology.orchestra.run.smithi064.stdout:checking for stdint.h... yes 2023-10-14T12:31:15.803 INFO:teuthology.orchestra.run.smithi064.stdout:checking for unistd.h... yes 2023-10-14T12:31:15.884 INFO:teuthology.orchestra.run.smithi064.stdout:checking for dlfcn.h... yes 2023-10-14T12:31:15.898 INFO:teuthology.orchestra.run.smithi064.stdout:checking for objdir... .libs 2023-10-14T12:31:16.085 INFO:teuthology.orchestra.run.smithi064.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-10-14T12:31:16.086 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-10-14T12:31:16.146 INFO:teuthology.orchestra.run.smithi064.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-10-14T12:31:16.201 INFO:teuthology.orchestra.run.smithi064.stdout:checking if gcc static flag -static works... no 2023-10-14T12:31:16.285 INFO:teuthology.orchestra.run.smithi064.stdout:checking if gcc supports -c -o file.o... yes 2023-10-14T12:31:16.285 INFO:teuthology.orchestra.run.smithi064.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-10-14T12:31:16.313 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-10-14T12:31:16.388 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether -lc should be explicitly linked in... no 2023-10-14T12:31:16.552 INFO:teuthology.orchestra.run.smithi064.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-10-14T12:31:16.552 INFO:teuthology.orchestra.run.smithi064.stdout:checking how to hardcode library paths into programs... immediate 2023-10-14T12:31:16.556 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether stripping libraries is possible... yes 2023-10-14T12:31:16.556 INFO:teuthology.orchestra.run.smithi064.stdout:checking if libtool supports shared libraries... yes 2023-10-14T12:31:16.556 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether to build shared libraries... yes 2023-10-14T12:31:16.557 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether to build static libraries... yes 2023-10-14T12:31:16.577 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gcc... (cached) gcc 2023-10-14T12:31:16.630 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-10-14T12:31:16.630 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether gcc accepts -g... (cached) yes 2023-10-14T12:31:16.631 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-10-14T12:31:16.631 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gmake... /usr/bin/gmake 2023-10-14T12:31:16.632 INFO:teuthology.orchestra.run.smithi064.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-10-14T12:31:16.633 INFO:teuthology.orchestra.run.smithi064.stdout:checking for tar... /bin/tar 2023-10-14T12:31:16.633 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gzip... /bin/gzip 2023-10-14T12:31:16.658 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether gcc -MM is supported... yes 2023-10-14T12:31:16.659 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sort... /bin/sort 2023-10-14T12:31:16.660 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether ln -s works... yes 2023-10-14T12:31:16.661 INFO:teuthology.orchestra.run.smithi064.stdout:checking for rpm... /bin/rpm 2023-10-14T12:31:16.672 INFO:teuthology.orchestra.run.smithi064.stdout:checking for rpmbuild... no 2023-10-14T12:31:16.757 INFO:teuthology.orchestra.run.smithi064.stdout:checking assert.h usability... yes 2023-10-14T12:31:16.784 INFO:teuthology.orchestra.run.smithi064.stdout:checking assert.h presence... yes 2023-10-14T12:31:16.785 INFO:teuthology.orchestra.run.smithi064.stdout:checking for assert.h... yes 2023-10-14T12:31:16.873 INFO:teuthology.orchestra.run.smithi064.stdout:checking bstring.h usability... no 2023-10-14T12:31:16.919 INFO:teuthology.orchestra.run.smithi064.stdout:checking bstring.h presence... no 2023-10-14T12:31:16.920 INFO:teuthology.orchestra.run.smithi064.stdout:checking for bstring.h... no 2023-10-14T12:31:16.997 INFO:teuthology.orchestra.run.smithi064.stdout:checking libgen.h usability... yes 2023-10-14T12:31:17.024 INFO:teuthology.orchestra.run.smithi064.stdout:checking libgen.h presence... yes 2023-10-14T12:31:17.025 INFO:teuthology.orchestra.run.smithi064.stdout:checking for libgen.h... yes 2023-10-14T12:31:17.117 INFO:teuthology.orchestra.run.smithi064.stdout:checking dirent.h usability... yes 2023-10-14T12:31:17.146 INFO:teuthology.orchestra.run.smithi064.stdout:checking dirent.h presence... yes 2023-10-14T12:31:17.146 INFO:teuthology.orchestra.run.smithi064.stdout:checking for dirent.h... yes 2023-10-14T12:31:17.258 INFO:teuthology.orchestra.run.smithi064.stdout:checking errno.h usability... yes 2023-10-14T12:31:17.286 INFO:teuthology.orchestra.run.smithi064.stdout:checking errno.h presence... yes 2023-10-14T12:31:17.287 INFO:teuthology.orchestra.run.smithi064.stdout:checking for errno.h... yes 2023-10-14T12:31:17.375 INFO:teuthology.orchestra.run.smithi064.stdout:checking malloc.h usability... yes 2023-10-14T12:31:17.405 INFO:teuthology.orchestra.run.smithi064.stdout:checking malloc.h presence... yes 2023-10-14T12:31:17.406 INFO:teuthology.orchestra.run.smithi064.stdout:checking for malloc.h... yes 2023-10-14T12:31:17.491 INFO:teuthology.orchestra.run.smithi064.stdout:checking uuid.h usability... no 2023-10-14T12:31:17.534 INFO:teuthology.orchestra.run.smithi064.stdout:checking uuid.h presence... no 2023-10-14T12:31:17.534 INFO:teuthology.orchestra.run.smithi064.stdout:checking for uuid.h... no 2023-10-14T12:31:17.626 INFO:teuthology.orchestra.run.smithi064.stdout:checking uuid/uuid.h usability... yes 2023-10-14T12:31:17.663 INFO:teuthology.orchestra.run.smithi064.stdout:checking uuid/uuid.h presence... yes 2023-10-14T12:31:17.663 INFO:teuthology.orchestra.run.smithi064.stdout:checking for uuid/uuid.h... yes 2023-10-14T12:31:17.753 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/uuid.h usability... no 2023-10-14T12:31:17.800 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/uuid.h presence... no 2023-10-14T12:31:17.800 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/uuid.h... no 2023-10-14T12:31:17.886 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/file.h usability... yes 2023-10-14T12:31:17.915 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/file.h presence... yes 2023-10-14T12:31:17.915 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/file.h... yes 2023-10-14T12:31:17.996 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/fcntl.h usability... yes 2023-10-14T12:31:18.024 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/fcntl.h presence... yes 2023-10-14T12:31:18.024 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/fcntl.h... yes 2023-10-14T12:31:18.111 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/syssgi.h usability... no 2023-10-14T12:31:18.157 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/syssgi.h presence... no 2023-10-14T12:31:18.157 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/syssgi.h... no 2023-10-14T12:31:18.245 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/param.h usability... yes 2023-10-14T12:31:18.283 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/param.h presence... yes 2023-10-14T12:31:18.283 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/param.h... yes 2023-10-14T12:31:18.305 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/stat.h... (cached) yes 2023-10-14T12:31:18.397 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/statvfs.h usability... yes 2023-10-14T12:31:18.423 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/statvfs.h presence... yes 2023-10-14T12:31:18.423 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/statvfs.h... yes 2023-10-14T12:31:18.498 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/time.h usability... yes 2023-10-14T12:31:18.527 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/time.h presence... yes 2023-10-14T12:31:18.527 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/time.h... yes 2023-10-14T12:31:18.621 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/ioctl.h usability... yes 2023-10-14T12:31:18.651 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/ioctl.h presence... yes 2023-10-14T12:31:18.651 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/ioctl.h... yes 2023-10-14T12:31:18.745 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/wait.h usability... yes 2023-10-14T12:31:18.777 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/wait.h presence... yes 2023-10-14T12:31:18.778 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/wait.h... yes 2023-10-14T12:31:18.798 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/types.h... (cached) yes 2023-10-14T12:31:18.815 INFO:teuthology.orchestra.run.smithi064.stdout:checking for strings.h... (cached) yes 2023-10-14T12:31:18.894 INFO:teuthology.orchestra.run.smithi064.stdout:checking err.h usability... yes 2023-10-14T12:31:18.924 INFO:teuthology.orchestra.run.smithi064.stdout:checking err.h presence... yes 2023-10-14T12:31:18.925 INFO:teuthology.orchestra.run.smithi064.stdout:checking for err.h... yes 2023-10-14T12:31:19.008 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/falloc.h usability... yes 2023-10-14T12:31:19.036 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/falloc.h presence... yes 2023-10-14T12:31:19.036 INFO:teuthology.orchestra.run.smithi064.stdout:checking for linux/falloc.h... yes 2023-10-14T12:31:19.122 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-10-14T12:31:19.164 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-10-14T12:31:19.165 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/fs/xfs_fsops.h... no 2023-10-14T12:31:19.245 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/fs/xfs_itable.h usability... no 2023-10-14T12:31:19.291 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/fs/xfs_itable.h presence... no 2023-10-14T12:31:19.291 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/fs/xfs_itable.h... no 2023-10-14T12:31:19.367 INFO:teuthology.orchestra.run.smithi064.stdout:checking xfs/platform_defs.h usability... no 2023-10-14T12:31:19.409 INFO:teuthology.orchestra.run.smithi064.stdout:checking xfs/platform_defs.h presence... no 2023-10-14T12:31:19.410 INFO:teuthology.orchestra.run.smithi064.stdout:checking for xfs/platform_defs.h... no 2023-10-14T12:31:19.488 INFO:teuthology.orchestra.run.smithi064.stdout:checking btrfs/ioctl.h usability... no 2023-10-14T12:31:19.532 INFO:teuthology.orchestra.run.smithi064.stdout:checking btrfs/ioctl.h presence... no 2023-10-14T12:31:19.532 INFO:teuthology.orchestra.run.smithi064.stdout:checking for btrfs/ioctl.h... no 2023-10-14T12:31:19.609 INFO:teuthology.orchestra.run.smithi064.stdout:checking cifs/ioctl.h usability... no 2023-10-14T12:31:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:checking cifs/ioctl.h presence... no 2023-10-14T12:31:19.654 INFO:teuthology.orchestra.run.smithi064.stdout:checking for cifs/ioctl.h... no 2023-10-14T12:31:19.733 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/mman.h usability... yes 2023-10-14T12:31:19.760 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/mman.h presence... yes 2023-10-14T12:31:19.761 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/mman.h... yes 2023-10-14T12:31:19.819 INFO:teuthology.orchestra.run.smithi064.stdout:checking for xfs/xfs_log_format.h... no 2023-10-14T12:31:19.921 INFO:teuthology.orchestra.run.smithi064.stdout:checking for uuid_compare... no 2023-10-14T12:31:20.002 INFO:teuthology.orchestra.run.smithi064.stdout:checking for uuid_compare in -luuid... yes 2023-10-14T12:31:20.121 INFO:teuthology.orchestra.run.smithi064.stdout:checking for xfs/xfs.h... yes 2023-10-14T12:31:20.174 INFO:teuthology.orchestra.run.smithi064.stdout:checking for xfs/libxfs.h... no 2023-10-14T12:31:20.236 INFO:teuthology.orchestra.run.smithi064.stdout:checking whether xlog_assign_lsn is declared... no 2023-10-14T12:31:20.313 INFO:teuthology.orchestra.run.smithi064.stdout:checking for xfs/xqm.h... yes 2023-10-14T12:31:20.430 INFO:teuthology.orchestra.run.smithi064.stdout:checking xfsctl from xfs/xfs.h... ok 2023-10-14T12:31:20.498 INFO:teuthology.orchestra.run.smithi064.stdout:checking xfs/handle.h usability... yes 2023-10-14T12:31:20.523 INFO:teuthology.orchestra.run.smithi064.stdout:checking xfs/handle.h presence... yes 2023-10-14T12:31:20.523 INFO:teuthology.orchestra.run.smithi064.stdout:checking for xfs/handle.h... yes 2023-10-14T12:31:20.647 INFO:teuthology.orchestra.run.smithi064.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-10-14T12:31:20.719 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/acl.h usability... yes 2023-10-14T12:31:20.749 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/acl.h presence... yes 2023-10-14T12:31:20.749 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/acl.h... yes 2023-10-14T12:31:20.814 INFO:teuthology.orchestra.run.smithi064.stdout:checking acl/libacl.h usability... yes 2023-10-14T12:31:20.848 INFO:teuthology.orchestra.run.smithi064.stdout:checking acl/libacl.h presence... yes 2023-10-14T12:31:20.848 INFO:teuthology.orchestra.run.smithi064.stdout:checking for acl/libacl.h... yes 2023-10-14T12:31:20.941 INFO:teuthology.orchestra.run.smithi064.stdout:checking for acl_init in -lacl... yes 2023-10-14T12:31:21.010 INFO:teuthology.orchestra.run.smithi064.stdout:checking gdbm-ndbm.h usability... no 2023-10-14T12:31:21.052 INFO:teuthology.orchestra.run.smithi064.stdout:checking gdbm-ndbm.h presence... no 2023-10-14T12:31:21.052 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gdbm-ndbm.h... no 2023-10-14T12:31:21.122 INFO:teuthology.orchestra.run.smithi064.stdout:checking gdbm/ndbm.h usability... no 2023-10-14T12:31:21.167 INFO:teuthology.orchestra.run.smithi064.stdout:checking gdbm/ndbm.h presence... no 2023-10-14T12:31:21.167 INFO:teuthology.orchestra.run.smithi064.stdout:checking for gdbm/ndbm.h... no 2023-10-14T12:31:21.238 INFO:teuthology.orchestra.run.smithi064.stdout:checking ndbm.h usability... no 2023-10-14T12:31:21.280 INFO:teuthology.orchestra.run.smithi064.stdout:checking ndbm.h presence... no 2023-10-14T12:31:21.280 INFO:teuthology.orchestra.run.smithi064.stdout:checking for ndbm.h... no 2023-10-14T12:31:21.353 INFO:teuthology.orchestra.run.smithi064.stdout:checking libaio.h usability... yes 2023-10-14T12:31:21.384 INFO:teuthology.orchestra.run.smithi064.stdout:checking libaio.h presence... yes 2023-10-14T12:31:21.385 INFO:teuthology.orchestra.run.smithi064.stdout:checking for libaio.h... yes 2023-10-14T12:31:21.455 INFO:teuthology.orchestra.run.smithi064.stdout:checking liburing.h usability... no 2023-10-14T12:31:21.500 INFO:teuthology.orchestra.run.smithi064.stdout:checking liburing.h presence... no 2023-10-14T12:31:21.500 INFO:teuthology.orchestra.run.smithi064.stdout:checking for liburing.h... no 2023-10-14T12:31:21.568 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/capability.h usability... no 2023-10-14T12:31:21.611 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/capability.h presence... no 2023-10-14T12:31:21.611 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/capability.h... no 2023-10-14T12:31:21.678 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/fiemap.h usability... yes 2023-10-14T12:31:21.706 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/fiemap.h presence... yes 2023-10-14T12:31:21.707 INFO:teuthology.orchestra.run.smithi064.stdout:checking for linux/fiemap.h... yes 2023-10-14T12:31:21.799 INFO:teuthology.orchestra.run.smithi064.stdout:checking for fallocate... yes 2023-10-14T12:31:21.891 INFO:teuthology.orchestra.run.smithi064.stdout:checking for open_by_handle_at... yes 2023-10-14T12:31:21.965 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/prctl.h usability... yes 2023-10-14T12:31:21.998 INFO:teuthology.orchestra.run.smithi064.stdout:checking sys/prctl.h presence... yes 2023-10-14T12:31:21.998 INFO:teuthology.orchestra.run.smithi064.stdout:checking for sys/prctl.h... yes 2023-10-14T12:31:22.069 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/fs.h usability... yes 2023-10-14T12:31:22.101 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/fs.h presence... yes 2023-10-14T12:31:22.101 INFO:teuthology.orchestra.run.smithi064.stdout:checking for linux/fs.h... yes 2023-10-14T12:31:22.169 INFO:teuthology.orchestra.run.smithi064.stdout:checking btrfsutil.h usability... no 2023-10-14T12:31:22.215 INFO:teuthology.orchestra.run.smithi064.stdout:checking btrfsutil.h presence... no 2023-10-14T12:31:22.215 INFO:teuthology.orchestra.run.smithi064.stdout:checking for btrfsutil.h... no 2023-10-14T12:31:22.308 INFO:teuthology.orchestra.run.smithi064.stdout:checking for copy_file_range... yes 2023-10-14T12:31:22.402 INFO:teuthology.orchestra.run.smithi064.stdout:checking for SEEK_DATA... yes 2023-10-14T12:31:22.519 INFO:teuthology.orchestra.run.smithi064.stdout:checking for BMV_OF_SHARED... yes 2023-10-14T12:31:22.615 INFO:teuthology.orchestra.run.smithi064.stdout:checking for nftw... yes 2023-10-14T12:31:22.712 INFO:teuthology.orchestra.run.smithi064.stdout:checking for RLIMIT_NOFILE... yes 2023-10-14T12:31:22.769 INFO:teuthology.orchestra.run.smithi064.stdout:checking for FIEXCHANGE_RANGE... no 2023-10-14T12:31:22.863 INFO:teuthology.orchestra.run.smithi064.stdout:checking for renameat2... yes 2023-10-14T12:31:22.950 INFO:teuthology.orchestra.run.smithi064.stdout:checking for reallocarray... yes 2023-10-14T12:31:23.056 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct mount_attr... yes 2023-10-14T12:31:23.171 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_qgroup_limit... yes 2023-10-14T12:31:23.285 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-10-14T12:31:23.402 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-10-14T12:31:23.520 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-10-14T12:31:23.634 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-10-14T12:31:23.749 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-10-14T12:31:23.861 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-10-14T12:31:23.939 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/btrfs.h usability... yes 2023-10-14T12:31:23.968 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/btrfs.h presence... yes 2023-10-14T12:31:23.968 INFO:teuthology.orchestra.run.smithi064.stdout:checking for linux/btrfs.h... yes 2023-10-14T12:31:24.053 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/btrfs_tree.h usability... yes 2023-10-14T12:31:24.082 INFO:teuthology.orchestra.run.smithi064.stdout:checking linux/btrfs_tree.h presence... yes 2023-10-14T12:31:24.083 INFO:teuthology.orchestra.run.smithi064.stdout:checking for linux/btrfs_tree.h... yes 2023-10-14T12:31:24.150 INFO:teuthology.orchestra.run.smithi064.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-10-14T12:31:24.195 INFO:teuthology.orchestra.run.smithi064.stdout:configure: creating ./config.status 2023-10-14T12:31:25.595 INFO:teuthology.orchestra.run.smithi064.stdout:config.status: creating include/builddefs 2023-10-14T12:31:25.642 INFO:teuthology.orchestra.run.smithi064.stdout:config.status: creating include/config.h 2023-10-14T12:31:25.675 INFO:teuthology.orchestra.run.smithi064.stdout:config.status: executing libtool commands 2023-10-14T12:31:25.802 INFO:teuthology.orchestra.run.smithi064.stdout:Building include 2023-10-14T12:31:25.814 INFO:teuthology.orchestra.run.smithi064.stdout:Building lib 2023-10-14T12:31:25.824 INFO:teuthology.orchestra.run.smithi064.stdout: [LTDEP] 2023-10-14T12:31:26.160 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] dataascii.lo 2023-10-14T12:31:26.445 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] databin.lo 2023-10-14T12:31:26.774 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] datapid.lo 2023-10-14T12:31:27.047 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] file_lock.lo 2023-10-14T12:31:27.374 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] forker.lo 2023-10-14T12:31:27.686 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] pattern.lo 2023-10-14T12:31:27.972 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] open_flags.lo 2023-10-14T12:31:28.286 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] random_range.lo 2023-10-14T12:31:28.697 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] string_to_tokens.lo 2023-10-14T12:31:28.960 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] str_to_bytes.lo 2023-10-14T12:31:29.279 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] tlibio.lo 2023-10-14T12:31:29.699 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] write_log.lo 2023-10-14T12:31:30.138 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] random.lo 2023-10-14T12:31:30.405 INFO:teuthology.orchestra.run.smithi064.stdout: [LD] 2023-10-14T12:31:30.626 INFO:teuthology.orchestra.run.smithi064.stdout:Building ltp 2023-10-14T12:31:30.637 INFO:teuthology.orchestra.run.smithi064.stdout: [DEP] 2023-10-14T12:31:30.951 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] doio 2023-10-14T12:31:31.918 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fsstress 2023-10-14T12:31:33.645 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fsx 2023-10-14T12:31:34.633 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] growfiles 2023-10-14T12:31:35.398 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] iogen 2023-10-14T12:31:36.020 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-stress 2023-10-14T12:31:36.674 INFO:teuthology.orchestra.run.smithi064.stdout:Building src 2023-10-14T12:31:36.689 INFO:teuthology.orchestra.run.smithi064.stdout: [DEP] 2023-10-14T12:31:40.689 INFO:teuthology.orchestra.run.smithi064.stdout: [DEP] 2023-10-14T12:31:40.718 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:31:40.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:31:40.771 INFO:teuthology.orchestra.run.smithi064.stdout: [DEP] 2023-10-14T12:31:40.790 INFO:teuthology.orchestra.run.smithi064.stdout: [DEP] 2023-10-14T12:31:41.318 INFO:teuthology.orchestra.run.smithi064.stdout: [DEP] 2023-10-14T12:31:41.381 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] dirstress 2023-10-14T12:31:41.844 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fill 2023-10-14T12:31:42.189 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fill2 2023-10-14T12:31:42.672 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] getpagesize 2023-10-14T12:31:43.018 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] holes 2023-10-14T12:31:43.445 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] lstat64 2023-10-14T12:31:43.854 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] nametest 2023-10-14T12:31:44.331 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] permname 2023-10-14T12:31:44.792 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] randholes 2023-10-14T12:31:45.256 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] runas 2023-10-14T12:31:45.681 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] truncfile 2023-10-14T12:31:46.047 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] usemem 2023-10-14T12:31:46.397 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] mmapcat 2023-10-14T12:31:46.750 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] append_reader 2023-10-14T12:31:47.080 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] append_writer 2023-10-14T12:31:47.417 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] dirperf 2023-10-14T12:31:47.863 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] metaperf 2023-10-14T12:31:48.330 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] devzero 2023-10-14T12:31:48.743 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] feature 2023-10-14T12:31:49.194 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] alloc 2023-10-14T12:31:49.644 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fault 2023-10-14T12:31:50.023 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fstest 2023-10-14T12:31:50.476 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_access_root 2023-10-14T12:31:50.830 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] godown 2023-10-14T12:31:51.218 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] resvtest 2023-10-14T12:31:51.620 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] writemod 2023-10-14T12:31:51.951 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] writev_on_pagefault 2023-10-14T12:31:52.269 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] makeextents 2023-10-14T12:31:52.667 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] itrash 2023-10-14T12:31:53.054 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] rename 2023-10-14T12:31:53.385 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] multi_open_unlink 2023-10-14T12:31:53.748 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] unwritten_sync 2023-10-14T12:31:54.148 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] genhashnames 2023-10-14T12:31:54.544 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_holes 2023-10-14T12:31:54.896 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_writev 2023-10-14T12:31:55.219 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_truncate_cmtime 2023-10-14T12:31:55.588 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] dirhash_collide 2023-10-14T12:31:55.956 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_rename_overwrite 2023-10-14T12:31:56.270 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] holetest 2023-10-14T12:31:56.715 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_truncate_self 2023-10-14T12:31:57.025 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] af_unix 2023-10-14T12:31:57.389 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_stale_pmd 2023-10-14T12:31:57.720 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_cow_race 2023-10-14T12:31:58.119 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_fallocate 2023-10-14T12:31:58.474 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fsync-err 2023-10-14T12:31:58.862 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_write_ro 2023-10-14T12:31:59.221 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_ext4_dax_journal_corruption 2023-10-14T12:31:59.606 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_ext4_dax_inline_corruption 2023-10-14T12:31:59.975 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_ofd_locks 2023-10-14T12:32:00.399 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_collision 2023-10-14T12:32:00.849 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] mmap-write-concurrent 2023-10-14T12:32:01.227 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_get_file_time 2023-10-14T12:32:01.556 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_create_short_dirs 2023-10-14T12:32:01.926 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_create_long_dirs 2023-10-14T12:32:02.285 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_enospc 2023-10-14T12:32:02.635 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_writev_overlap 2023-10-14T12:32:03.023 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] checkpoint_journal 2023-10-14T12:32:03.391 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] mmap-rw-fault 2023-10-14T12:32:03.785 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] allocstale 2023-10-14T12:32:04.168 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_cow_memory_failure 2023-10-14T12:32:04.546 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fake-dump-rootino 2023-10-14T12:32:04.890 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] dio-buf-fault 2023-10-14T12:32:05.246 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] rewinddir-test 2023-10-14T12:32:05.615 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] xfsctl 2023-10-14T12:32:05.999 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] bstat 2023-10-14T12:32:06.429 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mtab 2023-10-14T12:32:06.788 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] getdevicesize 2023-10-14T12:32:07.144 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] preallo_rw_pattern_reader 2023-10-14T12:32:07.558 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] preallo_rw_pattern_writer 2023-10-14T12:32:07.914 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] ftrunc 2023-10-14T12:32:08.257 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] trunc 2023-10-14T12:32:08.636 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fs_perms 2023-10-14T12:32:09.011 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] testx 2023-10-14T12:32:09.351 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] looptest 2023-10-14T12:32:09.736 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] locktest 2023-10-14T12:32:10.306 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] unwritten_mmap 2023-10-14T12:32:10.655 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] bulkstat_unlink_test 2023-10-14T12:32:10.865 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:10.872 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:11.052 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] deduperace 2023-10-14T12:32:11.463 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] bulkstat_unlink_test_modified 2023-10-14T12:32:11.865 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_dir_offset 2023-10-14T12:32:12.238 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_futimens 2023-10-14T12:32:12.610 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_immutable 2023-10-14T12:32:13.543 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] stale_handle 2023-10-14T12:32:13.917 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] pwrite_mmap_blocked 2023-10-14T12:32:14.284 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_dir_offset2 2023-10-14T12:32:14.690 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] seek_sanity_test 2023-10-14T12:32:15.346 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] seek_copy_test 2023-10-14T12:32:15.701 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_readdir_1 2023-10-14T12:32:16.069 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_readdir_2 2023-10-14T12:32:16.421 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fsync-tester 2023-10-14T12:32:16.901 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] nsexec 2023-10-14T12:32:17.296 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] cloner 2023-10-14T12:32:17.713 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] renameat2 2023-10-14T12:32:18.099 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_getcwd 2023-10-14T12:32:18.447 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] e4compact 2023-10-14T12:32:18.823 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] test-nextquota 2023-10-14T12:32:19.199 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] punch-alternating 2023-10-14T12:32:19.549 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] attr-list-by-handle-cursor-test 2023-10-14T12:32:19.920 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] listxattr 2023-10-14T12:32:20.269 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] dio-interleaved 2023-10-14T12:32:20.626 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_dir_type 2023-10-14T12:32:20.990 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] dio-invalidate-cache 2023-10-14T12:32:21.417 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] stat_test 2023-10-14T12:32:21.988 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_encrypted_d_revalidate 2023-10-14T12:32:22.362 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] attr_replace_test 2023-10-14T12:32:22.730 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] swapon 2023-10-14T12:32:23.059 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] mkswap 2023-10-14T12:32:23.421 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_attr_corruption 2023-10-14T12:32:23.782 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_open_tmpfiles 2023-10-14T12:32:24.191 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fscrypt-crypt-util 2023-10-14T12:32:25.108 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] bulkstat_null_ocount 2023-10-14T12:32:25.512 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] splice-test 2023-10-14T12:32:25.907 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] chprojid_fail 2023-10-14T12:32:26.289 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] detached_mounts_propagation 2023-10-14T12:32:26.652 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] ext4_resize 2023-10-14T12:32:27.003 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_readdir_3 2023-10-14T12:32:27.422 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] splice2pipe 2023-10-14T12:32:27.796 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] uuid_ioctl 2023-10-14T12:32:28.162 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fiemap-tester 2023-10-14T12:32:28.661 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_stripealign 2023-10-14T12:32:29.023 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] open_by_handle 2023-10-14T12:32:29.523 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] t_mmap_dio 2023-10-14T12:32:29.890 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] xfsfind 2023-10-14T12:32:30.280 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] fssum 2023-10-14T12:32:31.018 INFO:teuthology.orchestra.run.smithi064.stdout:Building log-writes 2023-10-14T12:32:31.032 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] replay-log 2023-10-14T12:32:31.585 INFO:teuthology.orchestra.run.smithi064.stdout:Building perf 2023-10-14T12:32:31.597 INFO:teuthology.orchestra.run.smithi064.stdout:Building aio-dio-regress 2023-10-14T12:32:31.614 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aiocp 2023-10-14T12:32:32.067 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-append-write-fallocate-race 2023-10-14T12:32:32.422 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-append-write-read-race 2023-10-14T12:32:32.778 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-cow-race 2023-10-14T12:32:33.152 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-cycle-write 2023-10-14T12:32:33.557 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-eof-race 2023-10-14T12:32:33.972 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-extend-stat 2023-10-14T12:32:34.344 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-fcntl-race 2023-10-14T12:32:34.713 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-hole-filling-race 2023-10-14T12:32:35.065 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-invalidate-failure 2023-10-14T12:32:35.435 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-invalidate-readahead 2023-10-14T12:32:35.835 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aiodio_sparse2 2023-10-14T12:32:36.254 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-subblock-eof-read 2023-10-14T12:32:36.612 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-dio-write-verify 2023-10-14T12:32:37.020 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-10-14T12:32:37.357 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-10-14T12:32:37.723 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] aio-last-ref-held-by-io 2023-10-14T12:32:38.133 INFO:teuthology.orchestra.run.smithi064.stdout:Building vfs 2023-10-14T12:32:38.148 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] vfstest 2023-10-14T12:32:40.655 INFO:teuthology.orchestra.run.smithi064.stdout: [CC] mount-idmapped 2023-10-14T12:32:40.985 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:40.995 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:32:41.265 INFO:teuthology.orchestra.run.smithi064.stdout:Building m4 2023-10-14T12:32:41.281 INFO:teuthology.orchestra.run.smithi064.stdout:Building common 2023-10-14T12:32:41.292 INFO:teuthology.orchestra.run.smithi064.stdout:Building tests 2023-10-14T12:32:41.308 INFO:teuthology.orchestra.run.smithi064.stdout:Building btrfs 2023-10-14T12:32:41.325 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/btrfs/group.list 2023-10-14T12:32:41.567 INFO:teuthology.orchestra.run.smithi064.stdout:Building ceph 2023-10-14T12:32:41.583 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ceph/group.list 2023-10-14T12:32:41.639 INFO:teuthology.orchestra.run.smithi064.stdout:Building cifs 2023-10-14T12:32:41.653 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/cifs/group.list 2023-10-14T12:32:41.702 INFO:teuthology.orchestra.run.smithi064.stdout:Building ext4 2023-10-14T12:32:41.718 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ext4/group.list 2023-10-14T12:32:41.880 INFO:teuthology.orchestra.run.smithi064.stdout:Building f2fs 2023-10-14T12:32:41.897 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/f2fs/group.list 2023-10-14T12:32:41.967 INFO:teuthology.orchestra.run.smithi064.stdout:Building generic 2023-10-14T12:32:41.987 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/generic/group.list 2023-10-14T12:32:42.395 INFO:teuthology.orchestra.run.smithi064.stdout:Building nfs 2023-10-14T12:32:42.410 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/nfs/group.list 2023-10-14T12:32:42.467 INFO:teuthology.orchestra.run.smithi064.stdout:Building ocfs2 2023-10-14T12:32:42.482 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ocfs2/group.list 2023-10-14T12:32:42.537 INFO:teuthology.orchestra.run.smithi064.stdout:Building overlay 2023-10-14T12:32:42.553 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/overlay/group.list 2023-10-14T12:32:42.725 INFO:teuthology.orchestra.run.smithi064.stdout:Building perf 2023-10-14T12:32:42.740 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/perf/group.list 2023-10-14T12:32:42.788 INFO:teuthology.orchestra.run.smithi064.stdout:Building selftest 2023-10-14T12:32:42.804 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/selftest/group.list 2023-10-14T12:32:42.852 INFO:teuthology.orchestra.run.smithi064.stdout:Building shared 2023-10-14T12:32:42.867 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/shared/group.list 2023-10-14T12:32:42.934 INFO:teuthology.orchestra.run.smithi064.stdout:Building tmpfs 2023-10-14T12:32:42.949 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/tmpfs/group.list 2023-10-14T12:32:43.005 INFO:teuthology.orchestra.run.smithi064.stdout:Building udf 2023-10-14T12:32:43.021 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/udf/group.list 2023-10-14T12:32:43.067 INFO:teuthology.orchestra.run.smithi064.stdout:Building xfs 2023-10-14T12:32:43.083 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/xfs/group.list 2023-10-14T12:32:43.468 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo make install) 2023-10-14T12:32:43.605 INFO:teuthology.orchestra.run.smithi064.stdout:Building include 2023-10-14T12:32:43.616 INFO:teuthology.orchestra.run.smithi064.stdout:Building lib 2023-10-14T12:32:43.628 INFO:teuthology.orchestra.run.smithi064.stdout:Building ltp 2023-10-14T12:32:43.641 INFO:teuthology.orchestra.run.smithi064.stdout:Building src 2023-10-14T12:32:43.736 INFO:teuthology.orchestra.run.smithi064.stdout:Building log-writes 2023-10-14T12:32:43.747 INFO:teuthology.orchestra.run.smithi064.stdout:Building perf 2023-10-14T12:32:43.757 INFO:teuthology.orchestra.run.smithi064.stdout:Building aio-dio-regress 2023-10-14T12:32:43.769 INFO:teuthology.orchestra.run.smithi064.stdout:Building vfs 2023-10-14T12:32:43.781 INFO:teuthology.orchestra.run.smithi064.stdout:Building m4 2023-10-14T12:32:43.793 INFO:teuthology.orchestra.run.smithi064.stdout:Building common 2023-10-14T12:32:43.804 INFO:teuthology.orchestra.run.smithi064.stdout:Building tests 2023-10-14T12:32:43.819 INFO:teuthology.orchestra.run.smithi064.stdout:Building btrfs 2023-10-14T12:32:43.837 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/btrfs/group.list 2023-10-14T12:32:44.074 INFO:teuthology.orchestra.run.smithi064.stdout:Building ceph 2023-10-14T12:32:44.089 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ceph/group.list 2023-10-14T12:32:44.150 INFO:teuthology.orchestra.run.smithi064.stdout:Building cifs 2023-10-14T12:32:44.166 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/cifs/group.list 2023-10-14T12:32:44.215 INFO:teuthology.orchestra.run.smithi064.stdout:Building ext4 2023-10-14T12:32:44.229 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ext4/group.list 2023-10-14T12:32:44.381 INFO:teuthology.orchestra.run.smithi064.stdout:Building f2fs 2023-10-14T12:32:44.397 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/f2fs/group.list 2023-10-14T12:32:44.467 INFO:teuthology.orchestra.run.smithi064.stdout:Building generic 2023-10-14T12:32:44.487 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/generic/group.list 2023-10-14T12:32:44.883 INFO:teuthology.orchestra.run.smithi064.stdout:Building nfs 2023-10-14T12:32:44.899 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/nfs/group.list 2023-10-14T12:32:44.959 INFO:teuthology.orchestra.run.smithi064.stdout:Building ocfs2 2023-10-14T12:32:44.975 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ocfs2/group.list 2023-10-14T12:32:45.029 INFO:teuthology.orchestra.run.smithi064.stdout:Building overlay 2023-10-14T12:32:45.046 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/overlay/group.list 2023-10-14T12:32:45.213 INFO:teuthology.orchestra.run.smithi064.stdout:Building perf 2023-10-14T12:32:45.229 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/perf/group.list 2023-10-14T12:32:45.275 INFO:teuthology.orchestra.run.smithi064.stdout:Building selftest 2023-10-14T12:32:45.291 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/selftest/group.list 2023-10-14T12:32:45.337 INFO:teuthology.orchestra.run.smithi064.stdout:Building shared 2023-10-14T12:32:45.351 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/shared/group.list 2023-10-14T12:32:45.420 INFO:teuthology.orchestra.run.smithi064.stdout:Building tmpfs 2023-10-14T12:32:45.434 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/tmpfs/group.list 2023-10-14T12:32:45.489 INFO:teuthology.orchestra.run.smithi064.stdout:Building udf 2023-10-14T12:32:45.505 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/udf/group.list 2023-10-14T12:32:45.553 INFO:teuthology.orchestra.run.smithi064.stdout:Building xfs 2023-10-14T12:32:45.570 INFO:teuthology.orchestra.run.smithi064.stdout: [GROUP] /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/xfs/group.list 2023-10-14T12:32:45.969 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-10-14T12:32:45.973 INFO:teuthology.orchestra.run.smithi064.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-14T12:32:45.973 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-10-14T12:32:45.978 INFO:teuthology.orchestra.run.smithi064.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-14T12:32:45.979 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-10-14T12:32:45.984 INFO:teuthology.orchestra.run.smithi064.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-10-14T12:32:46.022 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-10-14T12:32:46.282 INFO:teuthology.orchestra.run.smithi064.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-10-14T12:32:46.320 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-10-14T12:32:46.369 INFO:teuthology.orchestra.run.smithi064.stdout:Building log-writes 2023-10-14T12:32:46.381 INFO:teuthology.orchestra.run.smithi064.stdout:Building perf 2023-10-14T12:32:46.392 INFO:teuthology.orchestra.run.smithi064.stdout:Building aio-dio-regress 2023-10-14T12:32:46.405 INFO:teuthology.orchestra.run.smithi064.stdout:Building vfs 2023-10-14T12:32:46.413 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake -C log-writes install 2023-10-14T12:32:46.419 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-10-14T12:32:46.454 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-10-14T12:32:46.488 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake -C perf install 2023-10-14T12:32:46.492 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-10-14T12:32:46.524 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-10-14T12:32:46.612 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-10-14T12:32:46.617 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-10-14T12:32:46.654 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-10-14T12:32:46.879 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake -C vfs install 2023-10-14T12:32:46.883 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-10-14T12:32:46.919 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-10-14T12:32:46.967 INFO:teuthology.orchestra.run.smithi064.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-10-14T12:32:47.003 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-10-14T12:32:51.748 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-10-14T12:32:52.118 INFO:teuthology.orchestra.run.smithi064.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-10-14T12:32:52.195 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-10-14T12:32:52.199 INFO:teuthology.orchestra.run.smithi064.stdout:gmake[1]: Nothing to be done for 'install'. 2023-10-14T12:32:52.199 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-10-14T12:32:52.203 INFO:teuthology.orchestra.run.smithi064.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-10-14T12:32:52.240 INFO:teuthology.orchestra.run.smithi064.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-10-14T12:32:52.801 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-10-14T12:32:52.805 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/btrfs/ install 2023-10-14T12:32:52.813 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-10-14T12:32:52.850 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 299 300 /var/lib/xfstests/tests/btrfs 2023-10-14T12:32:56.265 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-10-14T12:32:56.301 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 299.out 300.out /var/lib/xfstests/tests/btrfs 2023-10-14T12:32:59.773 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ceph/ install 2023-10-14T12:32:59.777 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-10-14T12:32:59.815 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-10-14T12:32:59.899 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-10-14T12:32:59.936 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-10-14T12:33:00.015 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/cifs/ install 2023-10-14T12:33:00.019 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-10-14T12:33:00.053 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-10-14T12:33:00.089 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-10-14T12:33:00.125 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-10-14T12:33:00.163 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ext4/ install 2023-10-14T12:33:00.168 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-10-14T12:33:00.203 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-10-14T12:33:00.995 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-10-14T12:33:01.030 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-10-14T12:33:01.862 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/f2fs/ install 2023-10-14T12:33:01.867 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-10-14T12:33:01.902 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-10-14T12:33:01.948 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-10-14T12:33:01.983 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-10-14T12:33:02.029 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/generic/ install 2023-10-14T12:33:02.040 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-10-14T12:33:02.074 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 /var/lib/xfstests/tests/generic 2023-10-14T12:33:11.124 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:11.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:11.202 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-10-14T12:33:11.232 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out /var/lib/xfstests/tests/generic 2023-10-14T12:33:20.381 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/nfs/ install 2023-10-14T12:33:20.385 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-10-14T12:33:20.423 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-10-14T12:33:20.459 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-10-14T12:33:20.495 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-10-14T12:33:20.532 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/ocfs2/ install 2023-10-14T12:33:20.536 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-10-14T12:33:20.573 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-10-14T12:33:20.609 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-10-14T12:33:20.646 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-10-14T12:33:20.683 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/overlay/ install 2023-10-14T12:33:20.688 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-10-14T12:33:20.725 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-10-14T12:33:21.942 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-10-14T12:33:21.978 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-10-14T12:33:23.198 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/perf/ install 2023-10-14T12:33:23.204 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-10-14T12:33:23.241 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-10-14T12:33:23.277 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-10-14T12:33:23.312 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-10-14T12:33:23.349 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/selftest/ install 2023-10-14T12:33:23.353 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-10-14T12:33:23.390 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-10-14T12:33:23.483 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-10-14T12:33:23.518 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-10-14T12:33:23.614 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/shared/ install 2023-10-14T12:33:23.619 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-10-14T12:33:23.656 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-10-14T12:33:23.714 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-10-14T12:33:23.749 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-10-14T12:33:23.807 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/tmpfs/ install 2023-10-14T12:33:23.811 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-10-14T12:33:23.848 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-10-14T12:33:23.886 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-10-14T12:33:23.922 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-10-14T12:33:23.959 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/udf/ install 2023-10-14T12:33:23.963 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-10-14T12:33:23.999 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-10-14T12:33:24.036 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-10-14T12:33:24.072 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-10-14T12:33:24.109 INFO:teuthology.orchestra.run.smithi064.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.fHRpaBS5ywxfstests-dev/tests/xfs/ install 2023-10-14T12:33:24.118 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-10-14T12:33:24.154 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-10-14T12:33:32.788 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-10-14T12:33:32.826 INFO:teuthology.orchestra.run.smithi064.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-10-14T12:33:41.085 INFO:teuthology.orchestra.run.smithi064.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-10-14T12:33:41.123 INFO:teuthology.orchestra.run.smithi064.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-10-14T12:33:41.160 INFO:teuthology.orchestra.run.smithi064.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-10-14T12:33:41.196 INFO:teuthology.orchestra.run.smithi064.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-10-14T12:33:41.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T12:33:41.241 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec ls tests/generic) 2023-10-14T12:33:41.253 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:41.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:33:41.303 INFO:teuthology.orchestra.run.smithi064.stdout:001 2023-10-14T12:33:41.303 INFO:teuthology.orchestra.run.smithi064.stdout:001.out 2023-10-14T12:33:41.303 INFO:teuthology.orchestra.run.smithi064.stdout:002 2023-10-14T12:33:41.304 INFO:teuthology.orchestra.run.smithi064.stdout:002.out 2023-10-14T12:33:41.304 INFO:teuthology.orchestra.run.smithi064.stdout:003 2023-10-14T12:33:41.304 INFO:teuthology.orchestra.run.smithi064.stdout:003.out 2023-10-14T12:33:41.304 INFO:teuthology.orchestra.run.smithi064.stdout:004 2023-10-14T12:33:41.304 INFO:teuthology.orchestra.run.smithi064.stdout:004.out 2023-10-14T12:33:41.305 INFO:teuthology.orchestra.run.smithi064.stdout:005 2023-10-14T12:33:41.305 INFO:teuthology.orchestra.run.smithi064.stdout:005.out 2023-10-14T12:33:41.305 INFO:teuthology.orchestra.run.smithi064.stdout:006 2023-10-14T12:33:41.305 INFO:teuthology.orchestra.run.smithi064.stdout:006.out 2023-10-14T12:33:41.305 INFO:teuthology.orchestra.run.smithi064.stdout:007 2023-10-14T12:33:41.306 INFO:teuthology.orchestra.run.smithi064.stdout:007.out 2023-10-14T12:33:41.306 INFO:teuthology.orchestra.run.smithi064.stdout:008 2023-10-14T12:33:41.307 INFO:teuthology.orchestra.run.smithi064.stdout:008.out 2023-10-14T12:33:41.307 INFO:teuthology.orchestra.run.smithi064.stdout:009 2023-10-14T12:33:41.307 INFO:teuthology.orchestra.run.smithi064.stdout:009.out 2023-10-14T12:33:41.307 INFO:teuthology.orchestra.run.smithi064.stdout:010 2023-10-14T12:33:41.308 INFO:teuthology.orchestra.run.smithi064.stdout:010.out 2023-10-14T12:33:41.308 INFO:teuthology.orchestra.run.smithi064.stdout:011 2023-10-14T12:33:41.308 INFO:teuthology.orchestra.run.smithi064.stdout:011.out 2023-10-14T12:33:41.308 INFO:teuthology.orchestra.run.smithi064.stdout:012 2023-10-14T12:33:41.308 INFO:teuthology.orchestra.run.smithi064.stdout:012.out 2023-10-14T12:33:41.309 INFO:teuthology.orchestra.run.smithi064.stdout:013 2023-10-14T12:33:41.309 INFO:teuthology.orchestra.run.smithi064.stdout:013.out 2023-10-14T12:33:41.309 INFO:teuthology.orchestra.run.smithi064.stdout:014 2023-10-14T12:33:41.309 INFO:teuthology.orchestra.run.smithi064.stdout:014.out 2023-10-14T12:33:41.309 INFO:teuthology.orchestra.run.smithi064.stdout:015 2023-10-14T12:33:41.309 INFO:teuthology.orchestra.run.smithi064.stdout:015.out 2023-10-14T12:33:41.310 INFO:teuthology.orchestra.run.smithi064.stdout:016 2023-10-14T12:33:41.310 INFO:teuthology.orchestra.run.smithi064.stdout:016.out 2023-10-14T12:33:41.310 INFO:teuthology.orchestra.run.smithi064.stdout:017 2023-10-14T12:33:41.310 INFO:teuthology.orchestra.run.smithi064.stdout:017.out 2023-10-14T12:33:41.310 INFO:teuthology.orchestra.run.smithi064.stdout:018 2023-10-14T12:33:41.311 INFO:teuthology.orchestra.run.smithi064.stdout:018.out 2023-10-14T12:33:41.311 INFO:teuthology.orchestra.run.smithi064.stdout:019 2023-10-14T12:33:41.311 INFO:teuthology.orchestra.run.smithi064.stdout:019.out 2023-10-14T12:33:41.311 INFO:teuthology.orchestra.run.smithi064.stdout:020 2023-10-14T12:33:41.311 INFO:teuthology.orchestra.run.smithi064.stdout:020.out 2023-10-14T12:33:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:021 2023-10-14T12:33:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:021.out 2023-10-14T12:33:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:022 2023-10-14T12:33:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:022.out 2023-10-14T12:33:41.312 INFO:teuthology.orchestra.run.smithi064.stdout:023 2023-10-14T12:33:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:023.out 2023-10-14T12:33:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:024 2023-10-14T12:33:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:024.out 2023-10-14T12:33:41.313 INFO:teuthology.orchestra.run.smithi064.stdout:025 2023-10-14T12:33:41.314 INFO:teuthology.orchestra.run.smithi064.stdout:025.out 2023-10-14T12:33:41.314 INFO:teuthology.orchestra.run.smithi064.stdout:026 2023-10-14T12:33:41.314 INFO:teuthology.orchestra.run.smithi064.stdout:026.out 2023-10-14T12:33:41.314 INFO:teuthology.orchestra.run.smithi064.stdout:027 2023-10-14T12:33:41.314 INFO:teuthology.orchestra.run.smithi064.stdout:027.out 2023-10-14T12:33:41.315 INFO:teuthology.orchestra.run.smithi064.stdout:028 2023-10-14T12:33:41.315 INFO:teuthology.orchestra.run.smithi064.stdout:028.out 2023-10-14T12:33:41.315 INFO:teuthology.orchestra.run.smithi064.stdout:029 2023-10-14T12:33:41.315 INFO:teuthology.orchestra.run.smithi064.stdout:029.out 2023-10-14T12:33:41.315 INFO:teuthology.orchestra.run.smithi064.stdout:030 2023-10-14T12:33:41.316 INFO:teuthology.orchestra.run.smithi064.stdout:030.out 2023-10-14T12:33:41.316 INFO:teuthology.orchestra.run.smithi064.stdout:031 2023-10-14T12:33:41.316 INFO:teuthology.orchestra.run.smithi064.stdout:031.out 2023-10-14T12:33:41.316 INFO:teuthology.orchestra.run.smithi064.stdout:032 2023-10-14T12:33:41.316 INFO:teuthology.orchestra.run.smithi064.stdout:032.out 2023-10-14T12:33:41.317 INFO:teuthology.orchestra.run.smithi064.stdout:033 2023-10-14T12:33:41.317 INFO:teuthology.orchestra.run.smithi064.stdout:033.out 2023-10-14T12:33:41.317 INFO:teuthology.orchestra.run.smithi064.stdout:034 2023-10-14T12:33:41.317 INFO:teuthology.orchestra.run.smithi064.stdout:034.out 2023-10-14T12:33:41.318 INFO:teuthology.orchestra.run.smithi064.stdout:035 2023-10-14T12:33:41.318 INFO:teuthology.orchestra.run.smithi064.stdout:035.cfg 2023-10-14T12:33:41.318 INFO:teuthology.orchestra.run.smithi064.stdout:035.out.default 2023-10-14T12:33:41.318 INFO:teuthology.orchestra.run.smithi064.stdout:035.out.nfs 2023-10-14T12:33:41.318 INFO:teuthology.orchestra.run.smithi064.stdout:036 2023-10-14T12:33:41.319 INFO:teuthology.orchestra.run.smithi064.stdout:036.out 2023-10-14T12:33:41.319 INFO:teuthology.orchestra.run.smithi064.stdout:037 2023-10-14T12:33:41.319 INFO:teuthology.orchestra.run.smithi064.stdout:037.out 2023-10-14T12:33:41.319 INFO:teuthology.orchestra.run.smithi064.stdout:038 2023-10-14T12:33:41.319 INFO:teuthology.orchestra.run.smithi064.stdout:038.out 2023-10-14T12:33:41.319 INFO:teuthology.orchestra.run.smithi064.stdout:039 2023-10-14T12:33:41.320 INFO:teuthology.orchestra.run.smithi064.stdout:039.out 2023-10-14T12:33:41.320 INFO:teuthology.orchestra.run.smithi064.stdout:040 2023-10-14T12:33:41.320 INFO:teuthology.orchestra.run.smithi064.stdout:040.out 2023-10-14T12:33:41.320 INFO:teuthology.orchestra.run.smithi064.stdout:041 2023-10-14T12:33:41.320 INFO:teuthology.orchestra.run.smithi064.stdout:041.out 2023-10-14T12:33:41.321 INFO:teuthology.orchestra.run.smithi064.stdout:042 2023-10-14T12:33:41.321 INFO:teuthology.orchestra.run.smithi064.stdout:042.out 2023-10-14T12:33:41.321 INFO:teuthology.orchestra.run.smithi064.stdout:043 2023-10-14T12:33:41.321 INFO:teuthology.orchestra.run.smithi064.stdout:043.out 2023-10-14T12:33:41.321 INFO:teuthology.orchestra.run.smithi064.stdout:044 2023-10-14T12:33:41.322 INFO:teuthology.orchestra.run.smithi064.stdout:044.out 2023-10-14T12:33:41.322 INFO:teuthology.orchestra.run.smithi064.stdout:045 2023-10-14T12:33:41.322 INFO:teuthology.orchestra.run.smithi064.stdout:045.out 2023-10-14T12:33:41.322 INFO:teuthology.orchestra.run.smithi064.stdout:046 2023-10-14T12:33:41.322 INFO:teuthology.orchestra.run.smithi064.stdout:046.out 2023-10-14T12:33:41.323 INFO:teuthology.orchestra.run.smithi064.stdout:047 2023-10-14T12:33:41.323 INFO:teuthology.orchestra.run.smithi064.stdout:047.out 2023-10-14T12:33:41.323 INFO:teuthology.orchestra.run.smithi064.stdout:048 2023-10-14T12:33:41.323 INFO:teuthology.orchestra.run.smithi064.stdout:048.out 2023-10-14T12:33:41.323 INFO:teuthology.orchestra.run.smithi064.stdout:049 2023-10-14T12:33:41.324 INFO:teuthology.orchestra.run.smithi064.stdout:049.out 2023-10-14T12:33:41.324 INFO:teuthology.orchestra.run.smithi064.stdout:050 2023-10-14T12:33:41.324 INFO:teuthology.orchestra.run.smithi064.stdout:050.cfg 2023-10-14T12:33:41.324 INFO:teuthology.orchestra.run.smithi064.stdout:050.out.default 2023-10-14T12:33:41.324 INFO:teuthology.orchestra.run.smithi064.stdout:050.out.nojournal 2023-10-14T12:33:41.325 INFO:teuthology.orchestra.run.smithi064.stdout:050.out.xfsquota 2023-10-14T12:33:41.325 INFO:teuthology.orchestra.run.smithi064.stdout:051 2023-10-14T12:33:41.325 INFO:teuthology.orchestra.run.smithi064.stdout:051.out 2023-10-14T12:33:41.325 INFO:teuthology.orchestra.run.smithi064.stdout:052 2023-10-14T12:33:41.325 INFO:teuthology.orchestra.run.smithi064.stdout:052.out 2023-10-14T12:33:41.325 INFO:teuthology.orchestra.run.smithi064.stdout:053 2023-10-14T12:33:41.326 INFO:teuthology.orchestra.run.smithi064.stdout:053.out 2023-10-14T12:33:41.326 INFO:teuthology.orchestra.run.smithi064.stdout:054 2023-10-14T12:33:41.326 INFO:teuthology.orchestra.run.smithi064.stdout:054.out 2023-10-14T12:33:41.326 INFO:teuthology.orchestra.run.smithi064.stdout:055 2023-10-14T12:33:41.326 INFO:teuthology.orchestra.run.smithi064.stdout:055.out 2023-10-14T12:33:41.327 INFO:teuthology.orchestra.run.smithi064.stdout:056 2023-10-14T12:33:41.327 INFO:teuthology.orchestra.run.smithi064.stdout:056.out 2023-10-14T12:33:41.327 INFO:teuthology.orchestra.run.smithi064.stdout:057 2023-10-14T12:33:41.327 INFO:teuthology.orchestra.run.smithi064.stdout:057.out 2023-10-14T12:33:41.327 INFO:teuthology.orchestra.run.smithi064.stdout:058 2023-10-14T12:33:41.327 INFO:teuthology.orchestra.run.smithi064.stdout:058.out 2023-10-14T12:33:41.328 INFO:teuthology.orchestra.run.smithi064.stdout:059 2023-10-14T12:33:41.328 INFO:teuthology.orchestra.run.smithi064.stdout:059.out 2023-10-14T12:33:41.328 INFO:teuthology.orchestra.run.smithi064.stdout:060 2023-10-14T12:33:41.328 INFO:teuthology.orchestra.run.smithi064.stdout:060.out 2023-10-14T12:33:41.329 INFO:teuthology.orchestra.run.smithi064.stdout:061 2023-10-14T12:33:41.329 INFO:teuthology.orchestra.run.smithi064.stdout:061.out 2023-10-14T12:33:41.329 INFO:teuthology.orchestra.run.smithi064.stdout:062 2023-10-14T12:33:41.329 INFO:teuthology.orchestra.run.smithi064.stdout:062.out 2023-10-14T12:33:41.329 INFO:teuthology.orchestra.run.smithi064.stdout:063 2023-10-14T12:33:41.330 INFO:teuthology.orchestra.run.smithi064.stdout:063.out 2023-10-14T12:33:41.330 INFO:teuthology.orchestra.run.smithi064.stdout:064 2023-10-14T12:33:41.330 INFO:teuthology.orchestra.run.smithi064.stdout:064.out 2023-10-14T12:33:41.330 INFO:teuthology.orchestra.run.smithi064.stdout:065 2023-10-14T12:33:41.330 INFO:teuthology.orchestra.run.smithi064.stdout:065.out 2023-10-14T12:33:41.331 INFO:teuthology.orchestra.run.smithi064.stdout:066 2023-10-14T12:33:41.331 INFO:teuthology.orchestra.run.smithi064.stdout:066.out 2023-10-14T12:33:41.331 INFO:teuthology.orchestra.run.smithi064.stdout:067 2023-10-14T12:33:41.331 INFO:teuthology.orchestra.run.smithi064.stdout:067.out 2023-10-14T12:33:41.331 INFO:teuthology.orchestra.run.smithi064.stdout:068 2023-10-14T12:33:41.331 INFO:teuthology.orchestra.run.smithi064.stdout:068.out 2023-10-14T12:33:41.332 INFO:teuthology.orchestra.run.smithi064.stdout:069 2023-10-14T12:33:41.332 INFO:teuthology.orchestra.run.smithi064.stdout:069.out 2023-10-14T12:33:41.332 INFO:teuthology.orchestra.run.smithi064.stdout:070 2023-10-14T12:33:41.332 INFO:teuthology.orchestra.run.smithi064.stdout:070.out 2023-10-14T12:33:41.332 INFO:teuthology.orchestra.run.smithi064.stdout:071 2023-10-14T12:33:41.332 INFO:teuthology.orchestra.run.smithi064.stdout:071.out 2023-10-14T12:33:41.333 INFO:teuthology.orchestra.run.smithi064.stdout:072 2023-10-14T12:33:41.333 INFO:teuthology.orchestra.run.smithi064.stdout:072.out 2023-10-14T12:33:41.333 INFO:teuthology.orchestra.run.smithi064.stdout:073 2023-10-14T12:33:41.333 INFO:teuthology.orchestra.run.smithi064.stdout:073.out 2023-10-14T12:33:41.334 INFO:teuthology.orchestra.run.smithi064.stdout:074 2023-10-14T12:33:41.334 INFO:teuthology.orchestra.run.smithi064.stdout:074.out 2023-10-14T12:33:41.334 INFO:teuthology.orchestra.run.smithi064.stdout:075 2023-10-14T12:33:41.334 INFO:teuthology.orchestra.run.smithi064.stdout:075.out 2023-10-14T12:33:41.335 INFO:teuthology.orchestra.run.smithi064.stdout:076 2023-10-14T12:33:41.335 INFO:teuthology.orchestra.run.smithi064.stdout:076.out 2023-10-14T12:33:41.335 INFO:teuthology.orchestra.run.smithi064.stdout:077 2023-10-14T12:33:41.335 INFO:teuthology.orchestra.run.smithi064.stdout:077.out 2023-10-14T12:33:41.335 INFO:teuthology.orchestra.run.smithi064.stdout:078 2023-10-14T12:33:41.335 INFO:teuthology.orchestra.run.smithi064.stdout:078.out 2023-10-14T12:33:41.336 INFO:teuthology.orchestra.run.smithi064.stdout:079 2023-10-14T12:33:41.336 INFO:teuthology.orchestra.run.smithi064.stdout:079.out 2023-10-14T12:33:41.336 INFO:teuthology.orchestra.run.smithi064.stdout:080 2023-10-14T12:33:41.336 INFO:teuthology.orchestra.run.smithi064.stdout:080.out 2023-10-14T12:33:41.336 INFO:teuthology.orchestra.run.smithi064.stdout:081 2023-10-14T12:33:41.336 INFO:teuthology.orchestra.run.smithi064.stdout:081.out 2023-10-14T12:33:41.337 INFO:teuthology.orchestra.run.smithi064.stdout:082 2023-10-14T12:33:41.337 INFO:teuthology.orchestra.run.smithi064.stdout:082.out 2023-10-14T12:33:41.337 INFO:teuthology.orchestra.run.smithi064.stdout:083 2023-10-14T12:33:41.337 INFO:teuthology.orchestra.run.smithi064.stdout:083.out 2023-10-14T12:33:41.337 INFO:teuthology.orchestra.run.smithi064.stdout:084 2023-10-14T12:33:41.337 INFO:teuthology.orchestra.run.smithi064.stdout:084.out 2023-10-14T12:33:41.338 INFO:teuthology.orchestra.run.smithi064.stdout:085 2023-10-14T12:33:41.338 INFO:teuthology.orchestra.run.smithi064.stdout:085.out 2023-10-14T12:33:41.338 INFO:teuthology.orchestra.run.smithi064.stdout:086 2023-10-14T12:33:41.338 INFO:teuthology.orchestra.run.smithi064.stdout:086.out 2023-10-14T12:33:41.338 INFO:teuthology.orchestra.run.smithi064.stdout:087 2023-10-14T12:33:41.339 INFO:teuthology.orchestra.run.smithi064.stdout:087.out 2023-10-14T12:33:41.339 INFO:teuthology.orchestra.run.smithi064.stdout:088 2023-10-14T12:33:41.339 INFO:teuthology.orchestra.run.smithi064.stdout:088.out 2023-10-14T12:33:41.339 INFO:teuthology.orchestra.run.smithi064.stdout:089 2023-10-14T12:33:41.339 INFO:teuthology.orchestra.run.smithi064.stdout:089.out 2023-10-14T12:33:41.339 INFO:teuthology.orchestra.run.smithi064.stdout:090 2023-10-14T12:33:41.340 INFO:teuthology.orchestra.run.smithi064.stdout:090.out 2023-10-14T12:33:41.340 INFO:teuthology.orchestra.run.smithi064.stdout:091 2023-10-14T12:33:41.340 INFO:teuthology.orchestra.run.smithi064.stdout:091.out 2023-10-14T12:33:41.340 INFO:teuthology.orchestra.run.smithi064.stdout:092 2023-10-14T12:33:41.340 INFO:teuthology.orchestra.run.smithi064.stdout:092.out 2023-10-14T12:33:41.341 INFO:teuthology.orchestra.run.smithi064.stdout:093 2023-10-14T12:33:41.341 INFO:teuthology.orchestra.run.smithi064.stdout:093.out 2023-10-14T12:33:41.341 INFO:teuthology.orchestra.run.smithi064.stdout:094 2023-10-14T12:33:41.341 INFO:teuthology.orchestra.run.smithi064.stdout:094.out 2023-10-14T12:33:41.341 INFO:teuthology.orchestra.run.smithi064.stdout:095 2023-10-14T12:33:41.341 INFO:teuthology.orchestra.run.smithi064.stdout:095.out 2023-10-14T12:33:41.342 INFO:teuthology.orchestra.run.smithi064.stdout:096 2023-10-14T12:33:41.342 INFO:teuthology.orchestra.run.smithi064.stdout:096.out 2023-10-14T12:33:41.342 INFO:teuthology.orchestra.run.smithi064.stdout:097 2023-10-14T12:33:41.342 INFO:teuthology.orchestra.run.smithi064.stdout:097.out 2023-10-14T12:33:41.342 INFO:teuthology.orchestra.run.smithi064.stdout:098 2023-10-14T12:33:41.345 INFO:teuthology.orchestra.run.smithi064.stdout:098.out 2023-10-14T12:33:41.345 INFO:teuthology.orchestra.run.smithi064.stdout:099 2023-10-14T12:33:41.345 INFO:teuthology.orchestra.run.smithi064.stdout:099.out 2023-10-14T12:33:41.345 INFO:teuthology.orchestra.run.smithi064.stdout:100 2023-10-14T12:33:41.346 INFO:teuthology.orchestra.run.smithi064.stdout:100.out 2023-10-14T12:33:41.346 INFO:teuthology.orchestra.run.smithi064.stdout:101 2023-10-14T12:33:41.346 INFO:teuthology.orchestra.run.smithi064.stdout:101.out 2023-10-14T12:33:41.346 INFO:teuthology.orchestra.run.smithi064.stdout:102 2023-10-14T12:33:41.347 INFO:teuthology.orchestra.run.smithi064.stdout:102.out 2023-10-14T12:33:41.347 INFO:teuthology.orchestra.run.smithi064.stdout:103 2023-10-14T12:33:41.347 INFO:teuthology.orchestra.run.smithi064.stdout:103.out 2023-10-14T12:33:41.347 INFO:teuthology.orchestra.run.smithi064.stdout:104 2023-10-14T12:33:41.347 INFO:teuthology.orchestra.run.smithi064.stdout:104.out 2023-10-14T12:33:41.348 INFO:teuthology.orchestra.run.smithi064.stdout:105 2023-10-14T12:33:41.348 INFO:teuthology.orchestra.run.smithi064.stdout:105.out 2023-10-14T12:33:41.348 INFO:teuthology.orchestra.run.smithi064.stdout:106 2023-10-14T12:33:41.348 INFO:teuthology.orchestra.run.smithi064.stdout:106.out 2023-10-14T12:33:41.349 INFO:teuthology.orchestra.run.smithi064.stdout:107 2023-10-14T12:33:41.349 INFO:teuthology.orchestra.run.smithi064.stdout:107.out 2023-10-14T12:33:41.349 INFO:teuthology.orchestra.run.smithi064.stdout:108 2023-10-14T12:33:41.349 INFO:teuthology.orchestra.run.smithi064.stdout:108.out 2023-10-14T12:33:41.349 INFO:teuthology.orchestra.run.smithi064.stdout:109 2023-10-14T12:33:41.349 INFO:teuthology.orchestra.run.smithi064.stdout:109.out 2023-10-14T12:33:41.350 INFO:teuthology.orchestra.run.smithi064.stdout:110 2023-10-14T12:33:41.350 INFO:teuthology.orchestra.run.smithi064.stdout:110.out 2023-10-14T12:33:41.350 INFO:teuthology.orchestra.run.smithi064.stdout:111 2023-10-14T12:33:41.350 INFO:teuthology.orchestra.run.smithi064.stdout:111.out 2023-10-14T12:33:41.350 INFO:teuthology.orchestra.run.smithi064.stdout:112 2023-10-14T12:33:41.351 INFO:teuthology.orchestra.run.smithi064.stdout:112.out 2023-10-14T12:33:41.351 INFO:teuthology.orchestra.run.smithi064.stdout:113 2023-10-14T12:33:41.351 INFO:teuthology.orchestra.run.smithi064.stdout:113.out 2023-10-14T12:33:41.351 INFO:teuthology.orchestra.run.smithi064.stdout:114 2023-10-14T12:33:41.351 INFO:teuthology.orchestra.run.smithi064.stdout:114.out 2023-10-14T12:33:41.352 INFO:teuthology.orchestra.run.smithi064.stdout:115 2023-10-14T12:33:41.352 INFO:teuthology.orchestra.run.smithi064.stdout:115.out 2023-10-14T12:33:41.352 INFO:teuthology.orchestra.run.smithi064.stdout:116 2023-10-14T12:33:41.352 INFO:teuthology.orchestra.run.smithi064.stdout:116.out 2023-10-14T12:33:41.352 INFO:teuthology.orchestra.run.smithi064.stdout:117 2023-10-14T12:33:41.353 INFO:teuthology.orchestra.run.smithi064.stdout:117.out 2023-10-14T12:33:41.353 INFO:teuthology.orchestra.run.smithi064.stdout:118 2023-10-14T12:33:41.353 INFO:teuthology.orchestra.run.smithi064.stdout:118.out 2023-10-14T12:33:41.353 INFO:teuthology.orchestra.run.smithi064.stdout:119 2023-10-14T12:33:41.353 INFO:teuthology.orchestra.run.smithi064.stdout:119.out 2023-10-14T12:33:41.354 INFO:teuthology.orchestra.run.smithi064.stdout:120 2023-10-14T12:33:41.354 INFO:teuthology.orchestra.run.smithi064.stdout:120.out 2023-10-14T12:33:41.354 INFO:teuthology.orchestra.run.smithi064.stdout:121 2023-10-14T12:33:41.354 INFO:teuthology.orchestra.run.smithi064.stdout:121.out 2023-10-14T12:33:41.354 INFO:teuthology.orchestra.run.smithi064.stdout:122 2023-10-14T12:33:41.355 INFO:teuthology.orchestra.run.smithi064.stdout:122.out 2023-10-14T12:33:41.355 INFO:teuthology.orchestra.run.smithi064.stdout:123 2023-10-14T12:33:41.355 INFO:teuthology.orchestra.run.smithi064.stdout:123.out 2023-10-14T12:33:41.355 INFO:teuthology.orchestra.run.smithi064.stdout:124 2023-10-14T12:33:41.355 INFO:teuthology.orchestra.run.smithi064.stdout:124.out 2023-10-14T12:33:41.356 INFO:teuthology.orchestra.run.smithi064.stdout:125 2023-10-14T12:33:41.356 INFO:teuthology.orchestra.run.smithi064.stdout:125.out 2023-10-14T12:33:41.356 INFO:teuthology.orchestra.run.smithi064.stdout:126 2023-10-14T12:33:41.356 INFO:teuthology.orchestra.run.smithi064.stdout:126.out 2023-10-14T12:33:41.356 INFO:teuthology.orchestra.run.smithi064.stdout:127 2023-10-14T12:33:41.357 INFO:teuthology.orchestra.run.smithi064.stdout:127.out 2023-10-14T12:33:41.357 INFO:teuthology.orchestra.run.smithi064.stdout:128 2023-10-14T12:33:41.357 INFO:teuthology.orchestra.run.smithi064.stdout:128.out 2023-10-14T12:33:41.357 INFO:teuthology.orchestra.run.smithi064.stdout:129 2023-10-14T12:33:41.357 INFO:teuthology.orchestra.run.smithi064.stdout:129.out 2023-10-14T12:33:41.357 INFO:teuthology.orchestra.run.smithi064.stdout:130 2023-10-14T12:33:41.358 INFO:teuthology.orchestra.run.smithi064.stdout:130.out 2023-10-14T12:33:41.358 INFO:teuthology.orchestra.run.smithi064.stdout:131 2023-10-14T12:33:41.358 INFO:teuthology.orchestra.run.smithi064.stdout:131.out 2023-10-14T12:33:41.358 INFO:teuthology.orchestra.run.smithi064.stdout:132 2023-10-14T12:33:41.358 INFO:teuthology.orchestra.run.smithi064.stdout:132.out 2023-10-14T12:33:41.359 INFO:teuthology.orchestra.run.smithi064.stdout:133 2023-10-14T12:33:41.359 INFO:teuthology.orchestra.run.smithi064.stdout:133.out 2023-10-14T12:33:41.359 INFO:teuthology.orchestra.run.smithi064.stdout:134 2023-10-14T12:33:41.359 INFO:teuthology.orchestra.run.smithi064.stdout:134.out 2023-10-14T12:33:41.359 INFO:teuthology.orchestra.run.smithi064.stdout:135 2023-10-14T12:33:41.360 INFO:teuthology.orchestra.run.smithi064.stdout:135.out 2023-10-14T12:33:41.360 INFO:teuthology.orchestra.run.smithi064.stdout:136 2023-10-14T12:33:41.360 INFO:teuthology.orchestra.run.smithi064.stdout:136.out 2023-10-14T12:33:41.360 INFO:teuthology.orchestra.run.smithi064.stdout:137 2023-10-14T12:33:41.360 INFO:teuthology.orchestra.run.smithi064.stdout:137.out 2023-10-14T12:33:41.361 INFO:teuthology.orchestra.run.smithi064.stdout:138 2023-10-14T12:33:41.361 INFO:teuthology.orchestra.run.smithi064.stdout:138.out 2023-10-14T12:33:41.361 INFO:teuthology.orchestra.run.smithi064.stdout:139 2023-10-14T12:33:41.361 INFO:teuthology.orchestra.run.smithi064.stdout:139.out 2023-10-14T12:33:41.361 INFO:teuthology.orchestra.run.smithi064.stdout:140 2023-10-14T12:33:41.362 INFO:teuthology.orchestra.run.smithi064.stdout:140.out 2023-10-14T12:33:41.362 INFO:teuthology.orchestra.run.smithi064.stdout:141 2023-10-14T12:33:41.362 INFO:teuthology.orchestra.run.smithi064.stdout:141.out 2023-10-14T12:33:41.362 INFO:teuthology.orchestra.run.smithi064.stdout:142 2023-10-14T12:33:41.363 INFO:teuthology.orchestra.run.smithi064.stdout:142.out 2023-10-14T12:33:41.363 INFO:teuthology.orchestra.run.smithi064.stdout:143 2023-10-14T12:33:41.363 INFO:teuthology.orchestra.run.smithi064.stdout:143.out 2023-10-14T12:33:41.363 INFO:teuthology.orchestra.run.smithi064.stdout:144 2023-10-14T12:33:41.363 INFO:teuthology.orchestra.run.smithi064.stdout:144.out 2023-10-14T12:33:41.364 INFO:teuthology.orchestra.run.smithi064.stdout:145 2023-10-14T12:33:41.364 INFO:teuthology.orchestra.run.smithi064.stdout:145.out 2023-10-14T12:33:41.364 INFO:teuthology.orchestra.run.smithi064.stdout:146 2023-10-14T12:33:41.364 INFO:teuthology.orchestra.run.smithi064.stdout:146.out 2023-10-14T12:33:41.364 INFO:teuthology.orchestra.run.smithi064.stdout:147 2023-10-14T12:33:41.365 INFO:teuthology.orchestra.run.smithi064.stdout:147.out 2023-10-14T12:33:41.365 INFO:teuthology.orchestra.run.smithi064.stdout:148 2023-10-14T12:33:41.365 INFO:teuthology.orchestra.run.smithi064.stdout:148.out 2023-10-14T12:33:41.365 INFO:teuthology.orchestra.run.smithi064.stdout:149 2023-10-14T12:33:41.365 INFO:teuthology.orchestra.run.smithi064.stdout:149.out 2023-10-14T12:33:41.365 INFO:teuthology.orchestra.run.smithi064.stdout:150 2023-10-14T12:33:41.366 INFO:teuthology.orchestra.run.smithi064.stdout:150.out 2023-10-14T12:33:41.366 INFO:teuthology.orchestra.run.smithi064.stdout:151 2023-10-14T12:33:41.366 INFO:teuthology.orchestra.run.smithi064.stdout:151.out 2023-10-14T12:33:41.366 INFO:teuthology.orchestra.run.smithi064.stdout:152 2023-10-14T12:33:41.366 INFO:teuthology.orchestra.run.smithi064.stdout:152.out 2023-10-14T12:33:41.367 INFO:teuthology.orchestra.run.smithi064.stdout:153 2023-10-14T12:33:41.367 INFO:teuthology.orchestra.run.smithi064.stdout:153.out 2023-10-14T12:33:41.367 INFO:teuthology.orchestra.run.smithi064.stdout:154 2023-10-14T12:33:41.367 INFO:teuthology.orchestra.run.smithi064.stdout:154.out 2023-10-14T12:33:41.368 INFO:teuthology.orchestra.run.smithi064.stdout:155 2023-10-14T12:33:41.368 INFO:teuthology.orchestra.run.smithi064.stdout:155.out 2023-10-14T12:33:41.368 INFO:teuthology.orchestra.run.smithi064.stdout:156 2023-10-14T12:33:41.368 INFO:teuthology.orchestra.run.smithi064.stdout:156.out 2023-10-14T12:33:41.368 INFO:teuthology.orchestra.run.smithi064.stdout:157 2023-10-14T12:33:41.369 INFO:teuthology.orchestra.run.smithi064.stdout:157.out 2023-10-14T12:33:41.369 INFO:teuthology.orchestra.run.smithi064.stdout:158 2023-10-14T12:33:41.369 INFO:teuthology.orchestra.run.smithi064.stdout:158.out 2023-10-14T12:33:41.369 INFO:teuthology.orchestra.run.smithi064.stdout:159 2023-10-14T12:33:41.369 INFO:teuthology.orchestra.run.smithi064.stdout:159.out 2023-10-14T12:33:41.369 INFO:teuthology.orchestra.run.smithi064.stdout:160 2023-10-14T12:33:41.370 INFO:teuthology.orchestra.run.smithi064.stdout:160.out 2023-10-14T12:33:41.370 INFO:teuthology.orchestra.run.smithi064.stdout:161 2023-10-14T12:33:41.370 INFO:teuthology.orchestra.run.smithi064.stdout:161.out 2023-10-14T12:33:41.370 INFO:teuthology.orchestra.run.smithi064.stdout:162 2023-10-14T12:33:41.370 INFO:teuthology.orchestra.run.smithi064.stdout:162.out 2023-10-14T12:33:41.371 INFO:teuthology.orchestra.run.smithi064.stdout:163 2023-10-14T12:33:41.371 INFO:teuthology.orchestra.run.smithi064.stdout:163.out 2023-10-14T12:33:41.371 INFO:teuthology.orchestra.run.smithi064.stdout:164 2023-10-14T12:33:41.371 INFO:teuthology.orchestra.run.smithi064.stdout:164.out 2023-10-14T12:33:41.371 INFO:teuthology.orchestra.run.smithi064.stdout:165 2023-10-14T12:33:41.372 INFO:teuthology.orchestra.run.smithi064.stdout:165.out 2023-10-14T12:33:41.372 INFO:teuthology.orchestra.run.smithi064.stdout:166 2023-10-14T12:33:41.372 INFO:teuthology.orchestra.run.smithi064.stdout:166.out 2023-10-14T12:33:41.372 INFO:teuthology.orchestra.run.smithi064.stdout:167 2023-10-14T12:33:41.372 INFO:teuthology.orchestra.run.smithi064.stdout:167.out 2023-10-14T12:33:41.372 INFO:teuthology.orchestra.run.smithi064.stdout:168 2023-10-14T12:33:41.373 INFO:teuthology.orchestra.run.smithi064.stdout:168.out 2023-10-14T12:33:41.373 INFO:teuthology.orchestra.run.smithi064.stdout:169 2023-10-14T12:33:41.373 INFO:teuthology.orchestra.run.smithi064.stdout:169.out 2023-10-14T12:33:41.373 INFO:teuthology.orchestra.run.smithi064.stdout:170 2023-10-14T12:33:41.373 INFO:teuthology.orchestra.run.smithi064.stdout:170.out 2023-10-14T12:33:41.374 INFO:teuthology.orchestra.run.smithi064.stdout:171 2023-10-14T12:33:41.374 INFO:teuthology.orchestra.run.smithi064.stdout:171.out 2023-10-14T12:33:41.374 INFO:teuthology.orchestra.run.smithi064.stdout:172 2023-10-14T12:33:41.374 INFO:teuthology.orchestra.run.smithi064.stdout:172.out 2023-10-14T12:33:41.374 INFO:teuthology.orchestra.run.smithi064.stdout:173 2023-10-14T12:33:41.375 INFO:teuthology.orchestra.run.smithi064.stdout:173.out 2023-10-14T12:33:41.375 INFO:teuthology.orchestra.run.smithi064.stdout:174 2023-10-14T12:33:41.375 INFO:teuthology.orchestra.run.smithi064.stdout:174.out 2023-10-14T12:33:41.375 INFO:teuthology.orchestra.run.smithi064.stdout:175 2023-10-14T12:33:41.375 INFO:teuthology.orchestra.run.smithi064.stdout:175.out 2023-10-14T12:33:41.376 INFO:teuthology.orchestra.run.smithi064.stdout:176 2023-10-14T12:33:41.376 INFO:teuthology.orchestra.run.smithi064.stdout:176.out 2023-10-14T12:33:41.376 INFO:teuthology.orchestra.run.smithi064.stdout:177 2023-10-14T12:33:41.376 INFO:teuthology.orchestra.run.smithi064.stdout:177.out 2023-10-14T12:33:41.376 INFO:teuthology.orchestra.run.smithi064.stdout:178 2023-10-14T12:33:41.377 INFO:teuthology.orchestra.run.smithi064.stdout:178.out 2023-10-14T12:33:41.377 INFO:teuthology.orchestra.run.smithi064.stdout:179 2023-10-14T12:33:41.377 INFO:teuthology.orchestra.run.smithi064.stdout:179.out 2023-10-14T12:33:41.377 INFO:teuthology.orchestra.run.smithi064.stdout:180 2023-10-14T12:33:41.377 INFO:teuthology.orchestra.run.smithi064.stdout:180.out 2023-10-14T12:33:41.378 INFO:teuthology.orchestra.run.smithi064.stdout:181 2023-10-14T12:33:41.378 INFO:teuthology.orchestra.run.smithi064.stdout:181.out 2023-10-14T12:33:41.378 INFO:teuthology.orchestra.run.smithi064.stdout:182 2023-10-14T12:33:41.378 INFO:teuthology.orchestra.run.smithi064.stdout:182.out 2023-10-14T12:33:41.378 INFO:teuthology.orchestra.run.smithi064.stdout:183 2023-10-14T12:33:41.378 INFO:teuthology.orchestra.run.smithi064.stdout:183.out 2023-10-14T12:33:41.379 INFO:teuthology.orchestra.run.smithi064.stdout:184 2023-10-14T12:33:41.379 INFO:teuthology.orchestra.run.smithi064.stdout:184.out 2023-10-14T12:33:41.379 INFO:teuthology.orchestra.run.smithi064.stdout:185 2023-10-14T12:33:41.379 INFO:teuthology.orchestra.run.smithi064.stdout:185.out 2023-10-14T12:33:41.379 INFO:teuthology.orchestra.run.smithi064.stdout:186 2023-10-14T12:33:41.379 INFO:teuthology.orchestra.run.smithi064.stdout:186.out 2023-10-14T12:33:41.380 INFO:teuthology.orchestra.run.smithi064.stdout:187 2023-10-14T12:33:41.380 INFO:teuthology.orchestra.run.smithi064.stdout:187.out 2023-10-14T12:33:41.380 INFO:teuthology.orchestra.run.smithi064.stdout:188 2023-10-14T12:33:41.380 INFO:teuthology.orchestra.run.smithi064.stdout:188.out 2023-10-14T12:33:41.380 INFO:teuthology.orchestra.run.smithi064.stdout:189 2023-10-14T12:33:41.381 INFO:teuthology.orchestra.run.smithi064.stdout:189.out 2023-10-14T12:33:41.381 INFO:teuthology.orchestra.run.smithi064.stdout:190 2023-10-14T12:33:41.381 INFO:teuthology.orchestra.run.smithi064.stdout:190.out 2023-10-14T12:33:41.381 INFO:teuthology.orchestra.run.smithi064.stdout:191 2023-10-14T12:33:41.381 INFO:teuthology.orchestra.run.smithi064.stdout:191.out 2023-10-14T12:33:41.382 INFO:teuthology.orchestra.run.smithi064.stdout:192 2023-10-14T12:33:41.382 INFO:teuthology.orchestra.run.smithi064.stdout:192.out 2023-10-14T12:33:41.382 INFO:teuthology.orchestra.run.smithi064.stdout:193 2023-10-14T12:33:41.382 INFO:teuthology.orchestra.run.smithi064.stdout:193.out 2023-10-14T12:33:41.382 INFO:teuthology.orchestra.run.smithi064.stdout:194 2023-10-14T12:33:41.382 INFO:teuthology.orchestra.run.smithi064.stdout:194.out 2023-10-14T12:33:41.383 INFO:teuthology.orchestra.run.smithi064.stdout:195 2023-10-14T12:33:41.383 INFO:teuthology.orchestra.run.smithi064.stdout:195.out 2023-10-14T12:33:41.383 INFO:teuthology.orchestra.run.smithi064.stdout:196 2023-10-14T12:33:41.383 INFO:teuthology.orchestra.run.smithi064.stdout:196.out 2023-10-14T12:33:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:197 2023-10-14T12:33:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:197.out 2023-10-14T12:33:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:198 2023-10-14T12:33:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:198.out 2023-10-14T12:33:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:199 2023-10-14T12:33:41.384 INFO:teuthology.orchestra.run.smithi064.stdout:199.out 2023-10-14T12:33:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:200 2023-10-14T12:33:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:200.out 2023-10-14T12:33:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:201 2023-10-14T12:33:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:201.out 2023-10-14T12:33:41.385 INFO:teuthology.orchestra.run.smithi064.stdout:202 2023-10-14T12:33:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:202.out 2023-10-14T12:33:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:203 2023-10-14T12:33:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:203.out 2023-10-14T12:33:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:204 2023-10-14T12:33:41.386 INFO:teuthology.orchestra.run.smithi064.stdout:204.out 2023-10-14T12:33:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:205 2023-10-14T12:33:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:205.out 2023-10-14T12:33:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:206 2023-10-14T12:33:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:206.out 2023-10-14T12:33:41.387 INFO:teuthology.orchestra.run.smithi064.stdout:207 2023-10-14T12:33:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:207.out 2023-10-14T12:33:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:208 2023-10-14T12:33:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:208.out 2023-10-14T12:33:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:209 2023-10-14T12:33:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:209.out 2023-10-14T12:33:41.388 INFO:teuthology.orchestra.run.smithi064.stdout:210 2023-10-14T12:33:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:210.out 2023-10-14T12:33:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:211 2023-10-14T12:33:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:211.out 2023-10-14T12:33:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:212 2023-10-14T12:33:41.389 INFO:teuthology.orchestra.run.smithi064.stdout:212.out 2023-10-14T12:33:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:213 2023-10-14T12:33:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:213.out 2023-10-14T12:33:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:214 2023-10-14T12:33:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:214.out 2023-10-14T12:33:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:215 2023-10-14T12:33:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:215.out 2023-10-14T12:33:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:216 2023-10-14T12:33:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:216.out 2023-10-14T12:33:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:217 2023-10-14T12:33:41.391 INFO:teuthology.orchestra.run.smithi064.stdout:217.out 2023-10-14T12:33:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:218 2023-10-14T12:33:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:218.out 2023-10-14T12:33:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:219 2023-10-14T12:33:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:219.out 2023-10-14T12:33:41.392 INFO:teuthology.orchestra.run.smithi064.stdout:220 2023-10-14T12:33:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:220.out 2023-10-14T12:33:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:221 2023-10-14T12:33:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:221.out 2023-10-14T12:33:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:222 2023-10-14T12:33:41.393 INFO:teuthology.orchestra.run.smithi064.stdout:222.out 2023-10-14T12:33:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:223 2023-10-14T12:33:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:223.out 2023-10-14T12:33:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:224 2023-10-14T12:33:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:224.out 2023-10-14T12:33:41.394 INFO:teuthology.orchestra.run.smithi064.stdout:225 2023-10-14T12:33:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:225.out 2023-10-14T12:33:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:226 2023-10-14T12:33:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:226.out 2023-10-14T12:33:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:227 2023-10-14T12:33:41.395 INFO:teuthology.orchestra.run.smithi064.stdout:227.out 2023-10-14T12:33:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:228 2023-10-14T12:33:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:228.out 2023-10-14T12:33:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:229 2023-10-14T12:33:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:229.out 2023-10-14T12:33:41.396 INFO:teuthology.orchestra.run.smithi064.stdout:230 2023-10-14T12:33:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:230.out 2023-10-14T12:33:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:231 2023-10-14T12:33:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:231.out 2023-10-14T12:33:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:232 2023-10-14T12:33:41.397 INFO:teuthology.orchestra.run.smithi064.stdout:232.out 2023-10-14T12:33:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:233 2023-10-14T12:33:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:233.out 2023-10-14T12:33:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:234 2023-10-14T12:33:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:234.out 2023-10-14T12:33:41.398 INFO:teuthology.orchestra.run.smithi064.stdout:235 2023-10-14T12:33:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:235.out 2023-10-14T12:33:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:236 2023-10-14T12:33:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:236.out 2023-10-14T12:33:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:237 2023-10-14T12:33:41.399 INFO:teuthology.orchestra.run.smithi064.stdout:237.out 2023-10-14T12:33:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:238 2023-10-14T12:33:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:238.out 2023-10-14T12:33:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:239 2023-10-14T12:33:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:239.out 2023-10-14T12:33:41.400 INFO:teuthology.orchestra.run.smithi064.stdout:240 2023-10-14T12:33:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:240.out 2023-10-14T12:33:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:241 2023-10-14T12:33:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:241.out 2023-10-14T12:33:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:242 2023-10-14T12:33:41.401 INFO:teuthology.orchestra.run.smithi064.stdout:242.out 2023-10-14T12:33:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:243 2023-10-14T12:33:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:243.out 2023-10-14T12:33:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:244 2023-10-14T12:33:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:244.out 2023-10-14T12:33:41.402 INFO:teuthology.orchestra.run.smithi064.stdout:245 2023-10-14T12:33:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:245.out 2023-10-14T12:33:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:246 2023-10-14T12:33:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:246.out 2023-10-14T12:33:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:247 2023-10-14T12:33:41.403 INFO:teuthology.orchestra.run.smithi064.stdout:247.out 2023-10-14T12:33:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:248 2023-10-14T12:33:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:248.out 2023-10-14T12:33:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:249 2023-10-14T12:33:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:249.out 2023-10-14T12:33:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:250 2023-10-14T12:33:41.404 INFO:teuthology.orchestra.run.smithi064.stdout:250.out 2023-10-14T12:33:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:251 2023-10-14T12:33:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:251.out 2023-10-14T12:33:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:252 2023-10-14T12:33:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:252.out 2023-10-14T12:33:41.405 INFO:teuthology.orchestra.run.smithi064.stdout:253 2023-10-14T12:33:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:253.out 2023-10-14T12:33:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:254 2023-10-14T12:33:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:254.out 2023-10-14T12:33:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:255 2023-10-14T12:33:41.406 INFO:teuthology.orchestra.run.smithi064.stdout:255.out 2023-10-14T12:33:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:256 2023-10-14T12:33:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:256.out 2023-10-14T12:33:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:257 2023-10-14T12:33:41.407 INFO:teuthology.orchestra.run.smithi064.stdout:257.out 2023-10-14T12:33:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:258 2023-10-14T12:33:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:258.out 2023-10-14T12:33:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:259 2023-10-14T12:33:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:259.out 2023-10-14T12:33:41.408 INFO:teuthology.orchestra.run.smithi064.stdout:260 2023-10-14T12:33:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:260.out 2023-10-14T12:33:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:261 2023-10-14T12:33:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:261.out 2023-10-14T12:33:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:262 2023-10-14T12:33:41.409 INFO:teuthology.orchestra.run.smithi064.stdout:262.out 2023-10-14T12:33:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:263 2023-10-14T12:33:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:263.out 2023-10-14T12:33:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:264 2023-10-14T12:33:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:264.out 2023-10-14T12:33:41.410 INFO:teuthology.orchestra.run.smithi064.stdout:265 2023-10-14T12:33:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:265.out 2023-10-14T12:33:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:266 2023-10-14T12:33:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:266.out 2023-10-14T12:33:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:267 2023-10-14T12:33:41.411 INFO:teuthology.orchestra.run.smithi064.stdout:267.out 2023-10-14T12:33:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:268 2023-10-14T12:33:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:268.out 2023-10-14T12:33:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:269 2023-10-14T12:33:41.412 INFO:teuthology.orchestra.run.smithi064.stdout:269.out 2023-10-14T12:33:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:270 2023-10-14T12:33:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:270.out 2023-10-14T12:33:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:271 2023-10-14T12:33:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:271.out 2023-10-14T12:33:41.413 INFO:teuthology.orchestra.run.smithi064.stdout:272 2023-10-14T12:33:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:272.out 2023-10-14T12:33:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:273 2023-10-14T12:33:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:273.out 2023-10-14T12:33:41.414 INFO:teuthology.orchestra.run.smithi064.stdout:274 2023-10-14T12:33:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:274.out 2023-10-14T12:33:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:275 2023-10-14T12:33:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:275.out 2023-10-14T12:33:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:276 2023-10-14T12:33:41.415 INFO:teuthology.orchestra.run.smithi064.stdout:276.out 2023-10-14T12:33:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:277 2023-10-14T12:33:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:277.out 2023-10-14T12:33:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:278 2023-10-14T12:33:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:278.out 2023-10-14T12:33:41.416 INFO:teuthology.orchestra.run.smithi064.stdout:279 2023-10-14T12:33:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:279.out 2023-10-14T12:33:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:280 2023-10-14T12:33:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:280.out 2023-10-14T12:33:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:281 2023-10-14T12:33:41.417 INFO:teuthology.orchestra.run.smithi064.stdout:281.out 2023-10-14T12:33:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:282 2023-10-14T12:33:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:282.out 2023-10-14T12:33:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:283 2023-10-14T12:33:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:283.out 2023-10-14T12:33:41.418 INFO:teuthology.orchestra.run.smithi064.stdout:284 2023-10-14T12:33:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:284.out 2023-10-14T12:33:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:285 2023-10-14T12:33:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:285.out 2023-10-14T12:33:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:286 2023-10-14T12:33:41.419 INFO:teuthology.orchestra.run.smithi064.stdout:286.out 2023-10-14T12:33:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:287 2023-10-14T12:33:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:287.out 2023-10-14T12:33:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:288 2023-10-14T12:33:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:288.out 2023-10-14T12:33:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:289 2023-10-14T12:33:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:289.out 2023-10-14T12:33:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:290 2023-10-14T12:33:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:290.out 2023-10-14T12:33:41.421 INFO:teuthology.orchestra.run.smithi064.stdout:291 2023-10-14T12:33:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:291.out 2023-10-14T12:33:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:292 2023-10-14T12:33:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:292.out 2023-10-14T12:33:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:293 2023-10-14T12:33:41.422 INFO:teuthology.orchestra.run.smithi064.stdout:293.out 2023-10-14T12:33:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:294 2023-10-14T12:33:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:294.out 2023-10-14T12:33:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:295 2023-10-14T12:33:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:295.out 2023-10-14T12:33:41.423 INFO:teuthology.orchestra.run.smithi064.stdout:296 2023-10-14T12:33:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:296.out 2023-10-14T12:33:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:297 2023-10-14T12:33:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:297.out 2023-10-14T12:33:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:298 2023-10-14T12:33:41.424 INFO:teuthology.orchestra.run.smithi064.stdout:298.out 2023-10-14T12:33:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:299 2023-10-14T12:33:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:299.out 2023-10-14T12:33:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:300 2023-10-14T12:33:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:300.out 2023-10-14T12:33:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:301 2023-10-14T12:33:41.425 INFO:teuthology.orchestra.run.smithi064.stdout:301.out 2023-10-14T12:33:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:302 2023-10-14T12:33:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:302.out 2023-10-14T12:33:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:303 2023-10-14T12:33:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:303.out 2023-10-14T12:33:41.426 INFO:teuthology.orchestra.run.smithi064.stdout:304 2023-10-14T12:33:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:304.out 2023-10-14T12:33:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:305 2023-10-14T12:33:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:305.out 2023-10-14T12:33:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:306 2023-10-14T12:33:41.427 INFO:teuthology.orchestra.run.smithi064.stdout:306.out 2023-10-14T12:33:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:307 2023-10-14T12:33:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:307.out 2023-10-14T12:33:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:308 2023-10-14T12:33:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:308.out 2023-10-14T12:33:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:309 2023-10-14T12:33:41.428 INFO:teuthology.orchestra.run.smithi064.stdout:309.out 2023-10-14T12:33:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:310 2023-10-14T12:33:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:310.out 2023-10-14T12:33:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:311 2023-10-14T12:33:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:311.out 2023-10-14T12:33:41.429 INFO:teuthology.orchestra.run.smithi064.stdout:312 2023-10-14T12:33:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:312.out 2023-10-14T12:33:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:313 2023-10-14T12:33:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:313.out 2023-10-14T12:33:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:314 2023-10-14T12:33:41.430 INFO:teuthology.orchestra.run.smithi064.stdout:314.out 2023-10-14T12:33:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:315 2023-10-14T12:33:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:315.out 2023-10-14T12:33:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:316 2023-10-14T12:33:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:316.out 2023-10-14T12:33:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:317 2023-10-14T12:33:41.431 INFO:teuthology.orchestra.run.smithi064.stdout:317.out 2023-10-14T12:33:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:318 2023-10-14T12:33:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:318.out 2023-10-14T12:33:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:319 2023-10-14T12:33:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:319.out 2023-10-14T12:33:41.432 INFO:teuthology.orchestra.run.smithi064.stdout:320 2023-10-14T12:33:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:320.out 2023-10-14T12:33:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:321 2023-10-14T12:33:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:321.out 2023-10-14T12:33:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:322 2023-10-14T12:33:41.433 INFO:teuthology.orchestra.run.smithi064.stdout:322.out 2023-10-14T12:33:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:323 2023-10-14T12:33:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:323.out 2023-10-14T12:33:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:324 2023-10-14T12:33:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:324.out 2023-10-14T12:33:41.434 INFO:teuthology.orchestra.run.smithi064.stdout:325 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:325.out 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:326 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:326.out 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:327 2023-10-14T12:33:41.435 INFO:teuthology.orchestra.run.smithi064.stdout:327.out 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:328 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:328.out 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:329 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:329.out 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:330 2023-10-14T12:33:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:330.out 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:331 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:331.out 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:332 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:332.out 2023-10-14T12:33:41.437 INFO:teuthology.orchestra.run.smithi064.stdout:333 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:333.out 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:334 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:334.out 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:335 2023-10-14T12:33:41.438 INFO:teuthology.orchestra.run.smithi064.stdout:335.out 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:336 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:336.out 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:337 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:337.out 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:338 2023-10-14T12:33:41.439 INFO:teuthology.orchestra.run.smithi064.stdout:338.out 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:339 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:339.out 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:340 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:340.out 2023-10-14T12:33:41.440 INFO:teuthology.orchestra.run.smithi064.stdout:341 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:341.out 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:342 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:342.out 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:343 2023-10-14T12:33:41.441 INFO:teuthology.orchestra.run.smithi064.stdout:343.out 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:344 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:344.out 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:345 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:345.out 2023-10-14T12:33:41.442 INFO:teuthology.orchestra.run.smithi064.stdout:346 2023-10-14T12:33:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:346.out 2023-10-14T12:33:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:347 2023-10-14T12:33:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:347.out 2023-10-14T12:33:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:348 2023-10-14T12:33:41.443 INFO:teuthology.orchestra.run.smithi064.stdout:348.out 2023-10-14T12:33:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:349 2023-10-14T12:33:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:349.out 2023-10-14T12:33:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:350 2023-10-14T12:33:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:350.out 2023-10-14T12:33:41.444 INFO:teuthology.orchestra.run.smithi064.stdout:351 2023-10-14T12:33:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:351.out 2023-10-14T12:33:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:352 2023-10-14T12:33:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:352.out 2023-10-14T12:33:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:353 2023-10-14T12:33:41.445 INFO:teuthology.orchestra.run.smithi064.stdout:353.out 2023-10-14T12:33:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:354 2023-10-14T12:33:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:354.out 2023-10-14T12:33:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:355 2023-10-14T12:33:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:355.out 2023-10-14T12:33:41.446 INFO:teuthology.orchestra.run.smithi064.stdout:356 2023-10-14T12:33:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:356.out 2023-10-14T12:33:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:357 2023-10-14T12:33:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:357.out 2023-10-14T12:33:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:358 2023-10-14T12:33:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:358.out 2023-10-14T12:33:41.447 INFO:teuthology.orchestra.run.smithi064.stdout:359 2023-10-14T12:33:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:359.out 2023-10-14T12:33:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:360 2023-10-14T12:33:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:360.out 2023-10-14T12:33:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:361 2023-10-14T12:33:41.448 INFO:teuthology.orchestra.run.smithi064.stdout:361.out 2023-10-14T12:33:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:362 2023-10-14T12:33:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:362.out 2023-10-14T12:33:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:363 2023-10-14T12:33:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:363.out 2023-10-14T12:33:41.449 INFO:teuthology.orchestra.run.smithi064.stdout:364 2023-10-14T12:33:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:364.out 2023-10-14T12:33:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:365 2023-10-14T12:33:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:365.out 2023-10-14T12:33:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:366 2023-10-14T12:33:41.450 INFO:teuthology.orchestra.run.smithi064.stdout:366.out 2023-10-14T12:33:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:367 2023-10-14T12:33:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:367.out 2023-10-14T12:33:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:368 2023-10-14T12:33:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:368.out 2023-10-14T12:33:41.451 INFO:teuthology.orchestra.run.smithi064.stdout:369 2023-10-14T12:33:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:369.out 2023-10-14T12:33:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:370 2023-10-14T12:33:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:370.out 2023-10-14T12:33:41.452 INFO:teuthology.orchestra.run.smithi064.stdout:371 2023-10-14T12:33:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:371.out 2023-10-14T12:33:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:372 2023-10-14T12:33:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:372.out 2023-10-14T12:33:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:373 2023-10-14T12:33:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:373.out 2023-10-14T12:33:41.453 INFO:teuthology.orchestra.run.smithi064.stdout:374 2023-10-14T12:33:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:374.out 2023-10-14T12:33:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:375 2023-10-14T12:33:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:375.out 2023-10-14T12:33:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:376 2023-10-14T12:33:41.454 INFO:teuthology.orchestra.run.smithi064.stdout:376.out 2023-10-14T12:33:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:377 2023-10-14T12:33:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:377.out 2023-10-14T12:33:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:378 2023-10-14T12:33:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:378.out 2023-10-14T12:33:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:379 2023-10-14T12:33:41.455 INFO:teuthology.orchestra.run.smithi064.stdout:379.out 2023-10-14T12:33:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:380 2023-10-14T12:33:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:380.out 2023-10-14T12:33:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:381 2023-10-14T12:33:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:381.out 2023-10-14T12:33:41.456 INFO:teuthology.orchestra.run.smithi064.stdout:382 2023-10-14T12:33:41.457 INFO:teuthology.orchestra.run.smithi064.stdout:382.out 2023-10-14T12:33:41.457 INFO:teuthology.orchestra.run.smithi064.stdout:383 2023-10-14T12:33:41.457 INFO:teuthology.orchestra.run.smithi064.stdout:383.out 2023-10-14T12:33:41.457 INFO:teuthology.orchestra.run.smithi064.stdout:384 2023-10-14T12:33:41.457 INFO:teuthology.orchestra.run.smithi064.stdout:384.out 2023-10-14T12:33:41.458 INFO:teuthology.orchestra.run.smithi064.stdout:385 2023-10-14T12:33:41.458 INFO:teuthology.orchestra.run.smithi064.stdout:385.out 2023-10-14T12:33:41.458 INFO:teuthology.orchestra.run.smithi064.stdout:386 2023-10-14T12:33:41.458 INFO:teuthology.orchestra.run.smithi064.stdout:386.out 2023-10-14T12:33:41.458 INFO:teuthology.orchestra.run.smithi064.stdout:387 2023-10-14T12:33:41.459 INFO:teuthology.orchestra.run.smithi064.stdout:387.out 2023-10-14T12:33:41.459 INFO:teuthology.orchestra.run.smithi064.stdout:388 2023-10-14T12:33:41.459 INFO:teuthology.orchestra.run.smithi064.stdout:388.out 2023-10-14T12:33:41.459 INFO:teuthology.orchestra.run.smithi064.stdout:389 2023-10-14T12:33:41.459 INFO:teuthology.orchestra.run.smithi064.stdout:389.out 2023-10-14T12:33:41.459 INFO:teuthology.orchestra.run.smithi064.stdout:390 2023-10-14T12:33:41.460 INFO:teuthology.orchestra.run.smithi064.stdout:390.out 2023-10-14T12:33:41.460 INFO:teuthology.orchestra.run.smithi064.stdout:391 2023-10-14T12:33:41.460 INFO:teuthology.orchestra.run.smithi064.stdout:391.out 2023-10-14T12:33:41.460 INFO:teuthology.orchestra.run.smithi064.stdout:392 2023-10-14T12:33:41.460 INFO:teuthology.orchestra.run.smithi064.stdout:392.out 2023-10-14T12:33:41.461 INFO:teuthology.orchestra.run.smithi064.stdout:393 2023-10-14T12:33:41.461 INFO:teuthology.orchestra.run.smithi064.stdout:393.out 2023-10-14T12:33:41.461 INFO:teuthology.orchestra.run.smithi064.stdout:394 2023-10-14T12:33:41.461 INFO:teuthology.orchestra.run.smithi064.stdout:394.out 2023-10-14T12:33:41.461 INFO:teuthology.orchestra.run.smithi064.stdout:395 2023-10-14T12:33:41.462 INFO:teuthology.orchestra.run.smithi064.stdout:395.out 2023-10-14T12:33:41.462 INFO:teuthology.orchestra.run.smithi064.stdout:396 2023-10-14T12:33:41.462 INFO:teuthology.orchestra.run.smithi064.stdout:396.out 2023-10-14T12:33:41.462 INFO:teuthology.orchestra.run.smithi064.stdout:397 2023-10-14T12:33:41.462 INFO:teuthology.orchestra.run.smithi064.stdout:397.out 2023-10-14T12:33:41.463 INFO:teuthology.orchestra.run.smithi064.stdout:398 2023-10-14T12:33:41.463 INFO:teuthology.orchestra.run.smithi064.stdout:398.out 2023-10-14T12:33:41.463 INFO:teuthology.orchestra.run.smithi064.stdout:399 2023-10-14T12:33:41.463 INFO:teuthology.orchestra.run.smithi064.stdout:399.out 2023-10-14T12:33:41.463 INFO:teuthology.orchestra.run.smithi064.stdout:400 2023-10-14T12:33:41.463 INFO:teuthology.orchestra.run.smithi064.stdout:400.out 2023-10-14T12:33:41.464 INFO:teuthology.orchestra.run.smithi064.stdout:401 2023-10-14T12:33:41.464 INFO:teuthology.orchestra.run.smithi064.stdout:401.out 2023-10-14T12:33:41.464 INFO:teuthology.orchestra.run.smithi064.stdout:402 2023-10-14T12:33:41.464 INFO:teuthology.orchestra.run.smithi064.stdout:402.out 2023-10-14T12:33:41.464 INFO:teuthology.orchestra.run.smithi064.stdout:403 2023-10-14T12:33:41.465 INFO:teuthology.orchestra.run.smithi064.stdout:403.out 2023-10-14T12:33:41.465 INFO:teuthology.orchestra.run.smithi064.stdout:404 2023-10-14T12:33:41.465 INFO:teuthology.orchestra.run.smithi064.stdout:404.out 2023-10-14T12:33:41.465 INFO:teuthology.orchestra.run.smithi064.stdout:405 2023-10-14T12:33:41.465 INFO:teuthology.orchestra.run.smithi064.stdout:405.out 2023-10-14T12:33:41.466 INFO:teuthology.orchestra.run.smithi064.stdout:406 2023-10-14T12:33:41.466 INFO:teuthology.orchestra.run.smithi064.stdout:406.out 2023-10-14T12:33:41.466 INFO:teuthology.orchestra.run.smithi064.stdout:407 2023-10-14T12:33:41.466 INFO:teuthology.orchestra.run.smithi064.stdout:407.out 2023-10-14T12:33:41.466 INFO:teuthology.orchestra.run.smithi064.stdout:408 2023-10-14T12:33:41.467 INFO:teuthology.orchestra.run.smithi064.stdout:408.out 2023-10-14T12:33:41.467 INFO:teuthology.orchestra.run.smithi064.stdout:409 2023-10-14T12:33:41.467 INFO:teuthology.orchestra.run.smithi064.stdout:409.out 2023-10-14T12:33:41.467 INFO:teuthology.orchestra.run.smithi064.stdout:410 2023-10-14T12:33:41.467 INFO:teuthology.orchestra.run.smithi064.stdout:410.out 2023-10-14T12:33:41.468 INFO:teuthology.orchestra.run.smithi064.stdout:411 2023-10-14T12:33:41.468 INFO:teuthology.orchestra.run.smithi064.stdout:411.out 2023-10-14T12:33:41.468 INFO:teuthology.orchestra.run.smithi064.stdout:412 2023-10-14T12:33:41.468 INFO:teuthology.orchestra.run.smithi064.stdout:412.out 2023-10-14T12:33:41.468 INFO:teuthology.orchestra.run.smithi064.stdout:413 2023-10-14T12:33:41.469 INFO:teuthology.orchestra.run.smithi064.stdout:413.out 2023-10-14T12:33:41.469 INFO:teuthology.orchestra.run.smithi064.stdout:414 2023-10-14T12:33:41.469 INFO:teuthology.orchestra.run.smithi064.stdout:414.out 2023-10-14T12:33:41.469 INFO:teuthology.orchestra.run.smithi064.stdout:415 2023-10-14T12:33:41.469 INFO:teuthology.orchestra.run.smithi064.stdout:415.out 2023-10-14T12:33:41.470 INFO:teuthology.orchestra.run.smithi064.stdout:416 2023-10-14T12:33:41.470 INFO:teuthology.orchestra.run.smithi064.stdout:416.out 2023-10-14T12:33:41.470 INFO:teuthology.orchestra.run.smithi064.stdout:417 2023-10-14T12:33:41.470 INFO:teuthology.orchestra.run.smithi064.stdout:417.out 2023-10-14T12:33:41.470 INFO:teuthology.orchestra.run.smithi064.stdout:418 2023-10-14T12:33:41.471 INFO:teuthology.orchestra.run.smithi064.stdout:418.out 2023-10-14T12:33:41.471 INFO:teuthology.orchestra.run.smithi064.stdout:419 2023-10-14T12:33:41.471 INFO:teuthology.orchestra.run.smithi064.stdout:419.out 2023-10-14T12:33:41.471 INFO:teuthology.orchestra.run.smithi064.stdout:420 2023-10-14T12:33:41.471 INFO:teuthology.orchestra.run.smithi064.stdout:420.out 2023-10-14T12:33:41.472 INFO:teuthology.orchestra.run.smithi064.stdout:421 2023-10-14T12:33:41.472 INFO:teuthology.orchestra.run.smithi064.stdout:421.out 2023-10-14T12:33:41.472 INFO:teuthology.orchestra.run.smithi064.stdout:422 2023-10-14T12:33:41.472 INFO:teuthology.orchestra.run.smithi064.stdout:422.out 2023-10-14T12:33:41.472 INFO:teuthology.orchestra.run.smithi064.stdout:423 2023-10-14T12:33:41.473 INFO:teuthology.orchestra.run.smithi064.stdout:423.out 2023-10-14T12:33:41.473 INFO:teuthology.orchestra.run.smithi064.stdout:424 2023-10-14T12:33:41.473 INFO:teuthology.orchestra.run.smithi064.stdout:424.out 2023-10-14T12:33:41.473 INFO:teuthology.orchestra.run.smithi064.stdout:425 2023-10-14T12:33:41.473 INFO:teuthology.orchestra.run.smithi064.stdout:425.out 2023-10-14T12:33:41.473 INFO:teuthology.orchestra.run.smithi064.stdout:426 2023-10-14T12:33:41.474 INFO:teuthology.orchestra.run.smithi064.stdout:426.out 2023-10-14T12:33:41.474 INFO:teuthology.orchestra.run.smithi064.stdout:427 2023-10-14T12:33:41.474 INFO:teuthology.orchestra.run.smithi064.stdout:427.out 2023-10-14T12:33:41.474 INFO:teuthology.orchestra.run.smithi064.stdout:428 2023-10-14T12:33:41.474 INFO:teuthology.orchestra.run.smithi064.stdout:428.out 2023-10-14T12:33:41.475 INFO:teuthology.orchestra.run.smithi064.stdout:429 2023-10-14T12:33:41.475 INFO:teuthology.orchestra.run.smithi064.stdout:429.out 2023-10-14T12:33:41.475 INFO:teuthology.orchestra.run.smithi064.stdout:430 2023-10-14T12:33:41.475 INFO:teuthology.orchestra.run.smithi064.stdout:430.out 2023-10-14T12:33:41.475 INFO:teuthology.orchestra.run.smithi064.stdout:431 2023-10-14T12:33:41.475 INFO:teuthology.orchestra.run.smithi064.stdout:431.out 2023-10-14T12:33:41.476 INFO:teuthology.orchestra.run.smithi064.stdout:432 2023-10-14T12:33:41.476 INFO:teuthology.orchestra.run.smithi064.stdout:432.out 2023-10-14T12:33:41.476 INFO:teuthology.orchestra.run.smithi064.stdout:433 2023-10-14T12:33:41.476 INFO:teuthology.orchestra.run.smithi064.stdout:433.out 2023-10-14T12:33:41.476 INFO:teuthology.orchestra.run.smithi064.stdout:434 2023-10-14T12:33:41.477 INFO:teuthology.orchestra.run.smithi064.stdout:434.out 2023-10-14T12:33:41.477 INFO:teuthology.orchestra.run.smithi064.stdout:435 2023-10-14T12:33:41.477 INFO:teuthology.orchestra.run.smithi064.stdout:435.out 2023-10-14T12:33:41.477 INFO:teuthology.orchestra.run.smithi064.stdout:436 2023-10-14T12:33:41.477 INFO:teuthology.orchestra.run.smithi064.stdout:436.out 2023-10-14T12:33:41.478 INFO:teuthology.orchestra.run.smithi064.stdout:437 2023-10-14T12:33:41.478 INFO:teuthology.orchestra.run.smithi064.stdout:437.out 2023-10-14T12:33:41.478 INFO:teuthology.orchestra.run.smithi064.stdout:438 2023-10-14T12:33:41.478 INFO:teuthology.orchestra.run.smithi064.stdout:438.out 2023-10-14T12:33:41.478 INFO:teuthology.orchestra.run.smithi064.stdout:439 2023-10-14T12:33:41.478 INFO:teuthology.orchestra.run.smithi064.stdout:439.out 2023-10-14T12:33:41.479 INFO:teuthology.orchestra.run.smithi064.stdout:440 2023-10-14T12:33:41.479 INFO:teuthology.orchestra.run.smithi064.stdout:440.out 2023-10-14T12:33:41.479 INFO:teuthology.orchestra.run.smithi064.stdout:441 2023-10-14T12:33:41.479 INFO:teuthology.orchestra.run.smithi064.stdout:441.out 2023-10-14T12:33:41.479 INFO:teuthology.orchestra.run.smithi064.stdout:442 2023-10-14T12:33:41.480 INFO:teuthology.orchestra.run.smithi064.stdout:442.out 2023-10-14T12:33:41.480 INFO:teuthology.orchestra.run.smithi064.stdout:443 2023-10-14T12:33:41.480 INFO:teuthology.orchestra.run.smithi064.stdout:443.out 2023-10-14T12:33:41.480 INFO:teuthology.orchestra.run.smithi064.stdout:444 2023-10-14T12:33:41.480 INFO:teuthology.orchestra.run.smithi064.stdout:444.out 2023-10-14T12:33:41.480 INFO:teuthology.orchestra.run.smithi064.stdout:445 2023-10-14T12:33:41.481 INFO:teuthology.orchestra.run.smithi064.stdout:445.out 2023-10-14T12:33:41.481 INFO:teuthology.orchestra.run.smithi064.stdout:446 2023-10-14T12:33:41.481 INFO:teuthology.orchestra.run.smithi064.stdout:446.out 2023-10-14T12:33:41.481 INFO:teuthology.orchestra.run.smithi064.stdout:447 2023-10-14T12:33:41.481 INFO:teuthology.orchestra.run.smithi064.stdout:447.out 2023-10-14T12:33:41.482 INFO:teuthology.orchestra.run.smithi064.stdout:448 2023-10-14T12:33:41.482 INFO:teuthology.orchestra.run.smithi064.stdout:448.out 2023-10-14T12:33:41.482 INFO:teuthology.orchestra.run.smithi064.stdout:449 2023-10-14T12:33:41.482 INFO:teuthology.orchestra.run.smithi064.stdout:449.out 2023-10-14T12:33:41.482 INFO:teuthology.orchestra.run.smithi064.stdout:450 2023-10-14T12:33:41.483 INFO:teuthology.orchestra.run.smithi064.stdout:450.out 2023-10-14T12:33:41.483 INFO:teuthology.orchestra.run.smithi064.stdout:451 2023-10-14T12:33:41.483 INFO:teuthology.orchestra.run.smithi064.stdout:451.out 2023-10-14T12:33:41.483 INFO:teuthology.orchestra.run.smithi064.stdout:452 2023-10-14T12:33:41.483 INFO:teuthology.orchestra.run.smithi064.stdout:452.out 2023-10-14T12:33:41.484 INFO:teuthology.orchestra.run.smithi064.stdout:453 2023-10-14T12:33:41.484 INFO:teuthology.orchestra.run.smithi064.stdout:453.out 2023-10-14T12:33:41.484 INFO:teuthology.orchestra.run.smithi064.stdout:454 2023-10-14T12:33:41.484 INFO:teuthology.orchestra.run.smithi064.stdout:454.out 2023-10-14T12:33:41.484 INFO:teuthology.orchestra.run.smithi064.stdout:455 2023-10-14T12:33:41.485 INFO:teuthology.orchestra.run.smithi064.stdout:455.out 2023-10-14T12:33:41.485 INFO:teuthology.orchestra.run.smithi064.stdout:456 2023-10-14T12:33:41.485 INFO:teuthology.orchestra.run.smithi064.stdout:456.out 2023-10-14T12:33:41.485 INFO:teuthology.orchestra.run.smithi064.stdout:457 2023-10-14T12:33:41.485 INFO:teuthology.orchestra.run.smithi064.stdout:457.out 2023-10-14T12:33:41.486 INFO:teuthology.orchestra.run.smithi064.stdout:458 2023-10-14T12:33:41.486 INFO:teuthology.orchestra.run.smithi064.stdout:458.out 2023-10-14T12:33:41.486 INFO:teuthology.orchestra.run.smithi064.stdout:459 2023-10-14T12:33:41.486 INFO:teuthology.orchestra.run.smithi064.stdout:459.out 2023-10-14T12:33:41.486 INFO:teuthology.orchestra.run.smithi064.stdout:460 2023-10-14T12:33:41.487 INFO:teuthology.orchestra.run.smithi064.stdout:460.out 2023-10-14T12:33:41.487 INFO:teuthology.orchestra.run.smithi064.stdout:461 2023-10-14T12:33:41.487 INFO:teuthology.orchestra.run.smithi064.stdout:461.out 2023-10-14T12:33:41.487 INFO:teuthology.orchestra.run.smithi064.stdout:462 2023-10-14T12:33:41.487 INFO:teuthology.orchestra.run.smithi064.stdout:462.out 2023-10-14T12:33:41.488 INFO:teuthology.orchestra.run.smithi064.stdout:463 2023-10-14T12:33:41.488 INFO:teuthology.orchestra.run.smithi064.stdout:463.out 2023-10-14T12:33:41.488 INFO:teuthology.orchestra.run.smithi064.stdout:464 2023-10-14T12:33:41.488 INFO:teuthology.orchestra.run.smithi064.stdout:464.out 2023-10-14T12:33:41.488 INFO:teuthology.orchestra.run.smithi064.stdout:465 2023-10-14T12:33:41.488 INFO:teuthology.orchestra.run.smithi064.stdout:465.out 2023-10-14T12:33:41.489 INFO:teuthology.orchestra.run.smithi064.stdout:466 2023-10-14T12:33:41.489 INFO:teuthology.orchestra.run.smithi064.stdout:466.out 2023-10-14T12:33:41.489 INFO:teuthology.orchestra.run.smithi064.stdout:467 2023-10-14T12:33:41.489 INFO:teuthology.orchestra.run.smithi064.stdout:467.out 2023-10-14T12:33:41.489 INFO:teuthology.orchestra.run.smithi064.stdout:468 2023-10-14T12:33:41.490 INFO:teuthology.orchestra.run.smithi064.stdout:468.out 2023-10-14T12:33:41.490 INFO:teuthology.orchestra.run.smithi064.stdout:469 2023-10-14T12:33:41.490 INFO:teuthology.orchestra.run.smithi064.stdout:469.out 2023-10-14T12:33:41.490 INFO:teuthology.orchestra.run.smithi064.stdout:470 2023-10-14T12:33:41.490 INFO:teuthology.orchestra.run.smithi064.stdout:470.out 2023-10-14T12:33:41.491 INFO:teuthology.orchestra.run.smithi064.stdout:471 2023-10-14T12:33:41.491 INFO:teuthology.orchestra.run.smithi064.stdout:471.out 2023-10-14T12:33:41.491 INFO:teuthology.orchestra.run.smithi064.stdout:472 2023-10-14T12:33:41.491 INFO:teuthology.orchestra.run.smithi064.stdout:472.out 2023-10-14T12:33:41.491 INFO:teuthology.orchestra.run.smithi064.stdout:473 2023-10-14T12:33:41.492 INFO:teuthology.orchestra.run.smithi064.stdout:473.out 2023-10-14T12:33:41.492 INFO:teuthology.orchestra.run.smithi064.stdout:474 2023-10-14T12:33:41.492 INFO:teuthology.orchestra.run.smithi064.stdout:474.out 2023-10-14T12:33:41.492 INFO:teuthology.orchestra.run.smithi064.stdout:475 2023-10-14T12:33:41.492 INFO:teuthology.orchestra.run.smithi064.stdout:475.out 2023-10-14T12:33:41.493 INFO:teuthology.orchestra.run.smithi064.stdout:476 2023-10-14T12:33:41.493 INFO:teuthology.orchestra.run.smithi064.stdout:476.out 2023-10-14T12:33:41.493 INFO:teuthology.orchestra.run.smithi064.stdout:477 2023-10-14T12:33:41.493 INFO:teuthology.orchestra.run.smithi064.stdout:477.out 2023-10-14T12:33:41.493 INFO:teuthology.orchestra.run.smithi064.stdout:478 2023-10-14T12:33:41.494 INFO:teuthology.orchestra.run.smithi064.stdout:478.out 2023-10-14T12:33:41.494 INFO:teuthology.orchestra.run.smithi064.stdout:479 2023-10-14T12:33:41.494 INFO:teuthology.orchestra.run.smithi064.stdout:479.out 2023-10-14T12:33:41.494 INFO:teuthology.orchestra.run.smithi064.stdout:480 2023-10-14T12:33:41.494 INFO:teuthology.orchestra.run.smithi064.stdout:480.out 2023-10-14T12:33:41.495 INFO:teuthology.orchestra.run.smithi064.stdout:481 2023-10-14T12:33:41.495 INFO:teuthology.orchestra.run.smithi064.stdout:481.out 2023-10-14T12:33:41.495 INFO:teuthology.orchestra.run.smithi064.stdout:482 2023-10-14T12:33:41.495 INFO:teuthology.orchestra.run.smithi064.stdout:482.out 2023-10-14T12:33:41.495 INFO:teuthology.orchestra.run.smithi064.stdout:483 2023-10-14T12:33:41.496 INFO:teuthology.orchestra.run.smithi064.stdout:483.out 2023-10-14T12:33:41.496 INFO:teuthology.orchestra.run.smithi064.stdout:484 2023-10-14T12:33:41.496 INFO:teuthology.orchestra.run.smithi064.stdout:484.out 2023-10-14T12:33:41.496 INFO:teuthology.orchestra.run.smithi064.stdout:485 2023-10-14T12:33:41.496 INFO:teuthology.orchestra.run.smithi064.stdout:485.out 2023-10-14T12:33:41.497 INFO:teuthology.orchestra.run.smithi064.stdout:486 2023-10-14T12:33:41.497 INFO:teuthology.orchestra.run.smithi064.stdout:486.out 2023-10-14T12:33:41.497 INFO:teuthology.orchestra.run.smithi064.stdout:487 2023-10-14T12:33:41.497 INFO:teuthology.orchestra.run.smithi064.stdout:487.out 2023-10-14T12:33:41.497 INFO:teuthology.orchestra.run.smithi064.stdout:488 2023-10-14T12:33:41.497 INFO:teuthology.orchestra.run.smithi064.stdout:488.out 2023-10-14T12:33:41.498 INFO:teuthology.orchestra.run.smithi064.stdout:489 2023-10-14T12:33:41.498 INFO:teuthology.orchestra.run.smithi064.stdout:489.out 2023-10-14T12:33:41.498 INFO:teuthology.orchestra.run.smithi064.stdout:490 2023-10-14T12:33:41.498 INFO:teuthology.orchestra.run.smithi064.stdout:490.out 2023-10-14T12:33:41.498 INFO:teuthology.orchestra.run.smithi064.stdout:491 2023-10-14T12:33:41.499 INFO:teuthology.orchestra.run.smithi064.stdout:491.out 2023-10-14T12:33:41.499 INFO:teuthology.orchestra.run.smithi064.stdout:492 2023-10-14T12:33:41.499 INFO:teuthology.orchestra.run.smithi064.stdout:492.out 2023-10-14T12:33:41.499 INFO:teuthology.orchestra.run.smithi064.stdout:493 2023-10-14T12:33:41.499 INFO:teuthology.orchestra.run.smithi064.stdout:493.out 2023-10-14T12:33:41.500 INFO:teuthology.orchestra.run.smithi064.stdout:494 2023-10-14T12:33:41.500 INFO:teuthology.orchestra.run.smithi064.stdout:494.out 2023-10-14T12:33:41.500 INFO:teuthology.orchestra.run.smithi064.stdout:495 2023-10-14T12:33:41.500 INFO:teuthology.orchestra.run.smithi064.stdout:495.out 2023-10-14T12:33:41.500 INFO:teuthology.orchestra.run.smithi064.stdout:496 2023-10-14T12:33:41.500 INFO:teuthology.orchestra.run.smithi064.stdout:496.out 2023-10-14T12:33:41.501 INFO:teuthology.orchestra.run.smithi064.stdout:497 2023-10-14T12:33:41.501 INFO:teuthology.orchestra.run.smithi064.stdout:497.out 2023-10-14T12:33:41.501 INFO:teuthology.orchestra.run.smithi064.stdout:498 2023-10-14T12:33:41.501 INFO:teuthology.orchestra.run.smithi064.stdout:498.out 2023-10-14T12:33:41.501 INFO:teuthology.orchestra.run.smithi064.stdout:499 2023-10-14T12:33:41.502 INFO:teuthology.orchestra.run.smithi064.stdout:499.out 2023-10-14T12:33:41.502 INFO:teuthology.orchestra.run.smithi064.stdout:500 2023-10-14T12:33:41.502 INFO:teuthology.orchestra.run.smithi064.stdout:500.out 2023-10-14T12:33:41.502 INFO:teuthology.orchestra.run.smithi064.stdout:501 2023-10-14T12:33:41.502 INFO:teuthology.orchestra.run.smithi064.stdout:501.out 2023-10-14T12:33:41.502 INFO:teuthology.orchestra.run.smithi064.stdout:502 2023-10-14T12:33:41.503 INFO:teuthology.orchestra.run.smithi064.stdout:502.out 2023-10-14T12:33:41.503 INFO:teuthology.orchestra.run.smithi064.stdout:503 2023-10-14T12:33:41.503 INFO:teuthology.orchestra.run.smithi064.stdout:503.out 2023-10-14T12:33:41.503 INFO:teuthology.orchestra.run.smithi064.stdout:504 2023-10-14T12:33:41.503 INFO:teuthology.orchestra.run.smithi064.stdout:504.out 2023-10-14T12:33:41.504 INFO:teuthology.orchestra.run.smithi064.stdout:505 2023-10-14T12:33:41.504 INFO:teuthology.orchestra.run.smithi064.stdout:505.out 2023-10-14T12:33:41.504 INFO:teuthology.orchestra.run.smithi064.stdout:506 2023-10-14T12:33:41.504 INFO:teuthology.orchestra.run.smithi064.stdout:506.out 2023-10-14T12:33:41.504 INFO:teuthology.orchestra.run.smithi064.stdout:507 2023-10-14T12:33:41.505 INFO:teuthology.orchestra.run.smithi064.stdout:507.out 2023-10-14T12:33:41.505 INFO:teuthology.orchestra.run.smithi064.stdout:508 2023-10-14T12:33:41.505 INFO:teuthology.orchestra.run.smithi064.stdout:508.out 2023-10-14T12:33:41.505 INFO:teuthology.orchestra.run.smithi064.stdout:509 2023-10-14T12:33:41.505 INFO:teuthology.orchestra.run.smithi064.stdout:509.out 2023-10-14T12:33:41.506 INFO:teuthology.orchestra.run.smithi064.stdout:510 2023-10-14T12:33:41.506 INFO:teuthology.orchestra.run.smithi064.stdout:510.out 2023-10-14T12:33:41.506 INFO:teuthology.orchestra.run.smithi064.stdout:511 2023-10-14T12:33:41.506 INFO:teuthology.orchestra.run.smithi064.stdout:511.out 2023-10-14T12:33:41.506 INFO:teuthology.orchestra.run.smithi064.stdout:512 2023-10-14T12:33:41.507 INFO:teuthology.orchestra.run.smithi064.stdout:512.out 2023-10-14T12:33:41.507 INFO:teuthology.orchestra.run.smithi064.stdout:513 2023-10-14T12:33:41.507 INFO:teuthology.orchestra.run.smithi064.stdout:513.out 2023-10-14T12:33:41.507 INFO:teuthology.orchestra.run.smithi064.stdout:514 2023-10-14T12:33:41.507 INFO:teuthology.orchestra.run.smithi064.stdout:514.out 2023-10-14T12:33:41.507 INFO:teuthology.orchestra.run.smithi064.stdout:515 2023-10-14T12:33:41.508 INFO:teuthology.orchestra.run.smithi064.stdout:515.out 2023-10-14T12:33:41.508 INFO:teuthology.orchestra.run.smithi064.stdout:516 2023-10-14T12:33:41.508 INFO:teuthology.orchestra.run.smithi064.stdout:516.out 2023-10-14T12:33:41.508 INFO:teuthology.orchestra.run.smithi064.stdout:517 2023-10-14T12:33:41.508 INFO:teuthology.orchestra.run.smithi064.stdout:517.out 2023-10-14T12:33:41.509 INFO:teuthology.orchestra.run.smithi064.stdout:518 2023-10-14T12:33:41.509 INFO:teuthology.orchestra.run.smithi064.stdout:518.out 2023-10-14T12:33:41.509 INFO:teuthology.orchestra.run.smithi064.stdout:519 2023-10-14T12:33:41.509 INFO:teuthology.orchestra.run.smithi064.stdout:519.out 2023-10-14T12:33:41.509 INFO:teuthology.orchestra.run.smithi064.stdout:520 2023-10-14T12:33:41.509 INFO:teuthology.orchestra.run.smithi064.stdout:520.out 2023-10-14T12:33:41.510 INFO:teuthology.orchestra.run.smithi064.stdout:521 2023-10-14T12:33:41.510 INFO:teuthology.orchestra.run.smithi064.stdout:521.out 2023-10-14T12:33:41.510 INFO:teuthology.orchestra.run.smithi064.stdout:522 2023-10-14T12:33:41.510 INFO:teuthology.orchestra.run.smithi064.stdout:522.out 2023-10-14T12:33:41.510 INFO:teuthology.orchestra.run.smithi064.stdout:523 2023-10-14T12:33:41.511 INFO:teuthology.orchestra.run.smithi064.stdout:523.out 2023-10-14T12:33:41.511 INFO:teuthology.orchestra.run.smithi064.stdout:524 2023-10-14T12:33:41.511 INFO:teuthology.orchestra.run.smithi064.stdout:524.out 2023-10-14T12:33:41.511 INFO:teuthology.orchestra.run.smithi064.stdout:525 2023-10-14T12:33:41.511 INFO:teuthology.orchestra.run.smithi064.stdout:525.out 2023-10-14T12:33:41.512 INFO:teuthology.orchestra.run.smithi064.stdout:526 2023-10-14T12:33:41.512 INFO:teuthology.orchestra.run.smithi064.stdout:526.out 2023-10-14T12:33:41.512 INFO:teuthology.orchestra.run.smithi064.stdout:527 2023-10-14T12:33:41.512 INFO:teuthology.orchestra.run.smithi064.stdout:527.out 2023-10-14T12:33:41.512 INFO:teuthology.orchestra.run.smithi064.stdout:528 2023-10-14T12:33:41.512 INFO:teuthology.orchestra.run.smithi064.stdout:528.out 2023-10-14T12:33:41.513 INFO:teuthology.orchestra.run.smithi064.stdout:529 2023-10-14T12:33:41.513 INFO:teuthology.orchestra.run.smithi064.stdout:529.out 2023-10-14T12:33:41.513 INFO:teuthology.orchestra.run.smithi064.stdout:530 2023-10-14T12:33:41.513 INFO:teuthology.orchestra.run.smithi064.stdout:530.out 2023-10-14T12:33:41.513 INFO:teuthology.orchestra.run.smithi064.stdout:531 2023-10-14T12:33:41.514 INFO:teuthology.orchestra.run.smithi064.stdout:531.out 2023-10-14T12:33:41.514 INFO:teuthology.orchestra.run.smithi064.stdout:532 2023-10-14T12:33:41.514 INFO:teuthology.orchestra.run.smithi064.stdout:532.out 2023-10-14T12:33:41.514 INFO:teuthology.orchestra.run.smithi064.stdout:533 2023-10-14T12:33:41.514 INFO:teuthology.orchestra.run.smithi064.stdout:533.out 2023-10-14T12:33:41.515 INFO:teuthology.orchestra.run.smithi064.stdout:534 2023-10-14T12:33:41.515 INFO:teuthology.orchestra.run.smithi064.stdout:534.out 2023-10-14T12:33:41.515 INFO:teuthology.orchestra.run.smithi064.stdout:535 2023-10-14T12:33:41.515 INFO:teuthology.orchestra.run.smithi064.stdout:535.out 2023-10-14T12:33:41.515 INFO:teuthology.orchestra.run.smithi064.stdout:536 2023-10-14T12:33:41.516 INFO:teuthology.orchestra.run.smithi064.stdout:536.out 2023-10-14T12:33:41.516 INFO:teuthology.orchestra.run.smithi064.stdout:537 2023-10-14T12:33:41.516 INFO:teuthology.orchestra.run.smithi064.stdout:537.out 2023-10-14T12:33:41.516 INFO:teuthology.orchestra.run.smithi064.stdout:538 2023-10-14T12:33:41.516 INFO:teuthology.orchestra.run.smithi064.stdout:538.out 2023-10-14T12:33:41.517 INFO:teuthology.orchestra.run.smithi064.stdout:539 2023-10-14T12:33:41.517 INFO:teuthology.orchestra.run.smithi064.stdout:539.out 2023-10-14T12:33:41.517 INFO:teuthology.orchestra.run.smithi064.stdout:540 2023-10-14T12:33:41.517 INFO:teuthology.orchestra.run.smithi064.stdout:540.out 2023-10-14T12:33:41.517 INFO:teuthology.orchestra.run.smithi064.stdout:541 2023-10-14T12:33:41.517 INFO:teuthology.orchestra.run.smithi064.stdout:541.out 2023-10-14T12:33:41.518 INFO:teuthology.orchestra.run.smithi064.stdout:542 2023-10-14T12:33:41.518 INFO:teuthology.orchestra.run.smithi064.stdout:542.out 2023-10-14T12:33:41.518 INFO:teuthology.orchestra.run.smithi064.stdout:543 2023-10-14T12:33:41.518 INFO:teuthology.orchestra.run.smithi064.stdout:543.out 2023-10-14T12:33:41.518 INFO:teuthology.orchestra.run.smithi064.stdout:544 2023-10-14T12:33:41.519 INFO:teuthology.orchestra.run.smithi064.stdout:544.out 2023-10-14T12:33:41.519 INFO:teuthology.orchestra.run.smithi064.stdout:545 2023-10-14T12:33:41.519 INFO:teuthology.orchestra.run.smithi064.stdout:545.out 2023-10-14T12:33:41.519 INFO:teuthology.orchestra.run.smithi064.stdout:546 2023-10-14T12:33:41.519 INFO:teuthology.orchestra.run.smithi064.stdout:546.out 2023-10-14T12:33:41.519 INFO:teuthology.orchestra.run.smithi064.stdout:547 2023-10-14T12:33:41.520 INFO:teuthology.orchestra.run.smithi064.stdout:547.out 2023-10-14T12:33:41.520 INFO:teuthology.orchestra.run.smithi064.stdout:548 2023-10-14T12:33:41.520 INFO:teuthology.orchestra.run.smithi064.stdout:548.out 2023-10-14T12:33:41.520 INFO:teuthology.orchestra.run.smithi064.stdout:549 2023-10-14T12:33:41.520 INFO:teuthology.orchestra.run.smithi064.stdout:549.out 2023-10-14T12:33:41.521 INFO:teuthology.orchestra.run.smithi064.stdout:550 2023-10-14T12:33:41.521 INFO:teuthology.orchestra.run.smithi064.stdout:550.out 2023-10-14T12:33:41.521 INFO:teuthology.orchestra.run.smithi064.stdout:551 2023-10-14T12:33:41.521 INFO:teuthology.orchestra.run.smithi064.stdout:551.out 2023-10-14T12:33:41.521 INFO:teuthology.orchestra.run.smithi064.stdout:552 2023-10-14T12:33:41.521 INFO:teuthology.orchestra.run.smithi064.stdout:552.out 2023-10-14T12:33:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:553 2023-10-14T12:33:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:553.out 2023-10-14T12:33:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:554 2023-10-14T12:33:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:554.out 2023-10-14T12:33:41.522 INFO:teuthology.orchestra.run.smithi064.stdout:555 2023-10-14T12:33:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:555.out 2023-10-14T12:33:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:556 2023-10-14T12:33:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:556.out 2023-10-14T12:33:41.523 INFO:teuthology.orchestra.run.smithi064.stdout:557 2023-10-14T12:33:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:557.out 2023-10-14T12:33:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:558 2023-10-14T12:33:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:558.out 2023-10-14T12:33:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:559 2023-10-14T12:33:41.524 INFO:teuthology.orchestra.run.smithi064.stdout:559.out 2023-10-14T12:33:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:560 2023-10-14T12:33:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:560.out 2023-10-14T12:33:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:561 2023-10-14T12:33:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:561.out 2023-10-14T12:33:41.525 INFO:teuthology.orchestra.run.smithi064.stdout:562 2023-10-14T12:33:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:562.out 2023-10-14T12:33:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:563 2023-10-14T12:33:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:563.out 2023-10-14T12:33:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:564 2023-10-14T12:33:41.526 INFO:teuthology.orchestra.run.smithi064.stdout:564.out 2023-10-14T12:33:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:565 2023-10-14T12:33:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:565.out 2023-10-14T12:33:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:566 2023-10-14T12:33:41.527 INFO:teuthology.orchestra.run.smithi064.stdout:566.out 2023-10-14T12:33:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:567 2023-10-14T12:33:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:567.out 2023-10-14T12:33:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:568 2023-10-14T12:33:41.528 INFO:teuthology.orchestra.run.smithi064.stdout:568.out 2023-10-14T12:33:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:569 2023-10-14T12:33:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:569.out 2023-10-14T12:33:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:570 2023-10-14T12:33:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:570.out 2023-10-14T12:33:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:571 2023-10-14T12:33:41.529 INFO:teuthology.orchestra.run.smithi064.stdout:571.out 2023-10-14T12:33:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:572 2023-10-14T12:33:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:572.out 2023-10-14T12:33:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:573 2023-10-14T12:33:41.530 INFO:teuthology.orchestra.run.smithi064.stdout:573.out 2023-10-14T12:33:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:574 2023-10-14T12:33:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:574.out 2023-10-14T12:33:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:575 2023-10-14T12:33:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:575.out 2023-10-14T12:33:41.531 INFO:teuthology.orchestra.run.smithi064.stdout:576 2023-10-14T12:33:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:576.out 2023-10-14T12:33:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:577 2023-10-14T12:33:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:577.out 2023-10-14T12:33:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:578 2023-10-14T12:33:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:578.out 2023-10-14T12:33:41.532 INFO:teuthology.orchestra.run.smithi064.stdout:579 2023-10-14T12:33:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:579.out 2023-10-14T12:33:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:580 2023-10-14T12:33:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:580.out 2023-10-14T12:33:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:581 2023-10-14T12:33:41.533 INFO:teuthology.orchestra.run.smithi064.stdout:581.out 2023-10-14T12:33:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:582 2023-10-14T12:33:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:582.out 2023-10-14T12:33:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:583 2023-10-14T12:33:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:583.out 2023-10-14T12:33:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:584 2023-10-14T12:33:41.534 INFO:teuthology.orchestra.run.smithi064.stdout:584.out 2023-10-14T12:33:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:585 2023-10-14T12:33:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:585.out 2023-10-14T12:33:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:586 2023-10-14T12:33:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:586.out 2023-10-14T12:33:41.535 INFO:teuthology.orchestra.run.smithi064.stdout:587 2023-10-14T12:33:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:587.out 2023-10-14T12:33:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:588 2023-10-14T12:33:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:588.out 2023-10-14T12:33:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:589 2023-10-14T12:33:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:589.out 2023-10-14T12:33:41.536 INFO:teuthology.orchestra.run.smithi064.stdout:590 2023-10-14T12:33:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:590.out 2023-10-14T12:33:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:591 2023-10-14T12:33:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:591.out 2023-10-14T12:33:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:592 2023-10-14T12:33:41.537 INFO:teuthology.orchestra.run.smithi064.stdout:592.out 2023-10-14T12:33:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:593 2023-10-14T12:33:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:593.out 2023-10-14T12:33:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:594 2023-10-14T12:33:41.538 INFO:teuthology.orchestra.run.smithi064.stdout:594.out 2023-10-14T12:33:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:595 2023-10-14T12:33:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:595.out 2023-10-14T12:33:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:596 2023-10-14T12:33:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:596.out 2023-10-14T12:33:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:597 2023-10-14T12:33:41.539 INFO:teuthology.orchestra.run.smithi064.stdout:597.out 2023-10-14T12:33:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:598 2023-10-14T12:33:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:598.out 2023-10-14T12:33:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:599 2023-10-14T12:33:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:599.out 2023-10-14T12:33:41.540 INFO:teuthology.orchestra.run.smithi064.stdout:600 2023-10-14T12:33:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:600.out 2023-10-14T12:33:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:601 2023-10-14T12:33:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:601.out 2023-10-14T12:33:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:602 2023-10-14T12:33:41.541 INFO:teuthology.orchestra.run.smithi064.stdout:602.out 2023-10-14T12:33:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:603 2023-10-14T12:33:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:603.out 2023-10-14T12:33:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:604 2023-10-14T12:33:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:604.out 2023-10-14T12:33:41.542 INFO:teuthology.orchestra.run.smithi064.stdout:605 2023-10-14T12:33:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:605.out 2023-10-14T12:33:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:606 2023-10-14T12:33:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:606.out 2023-10-14T12:33:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:607 2023-10-14T12:33:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:607.out 2023-10-14T12:33:41.543 INFO:teuthology.orchestra.run.smithi064.stdout:608 2023-10-14T12:33:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:608.out 2023-10-14T12:33:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:609 2023-10-14T12:33:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:609.out 2023-10-14T12:33:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:610 2023-10-14T12:33:41.544 INFO:teuthology.orchestra.run.smithi064.stdout:610.out 2023-10-14T12:33:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:611 2023-10-14T12:33:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:611.out 2023-10-14T12:33:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:612 2023-10-14T12:33:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:612.out 2023-10-14T12:33:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:613 2023-10-14T12:33:41.545 INFO:teuthology.orchestra.run.smithi064.stdout:613.out 2023-10-14T12:33:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:614 2023-10-14T12:33:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:614.out 2023-10-14T12:33:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:615 2023-10-14T12:33:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:615.out 2023-10-14T12:33:41.546 INFO:teuthology.orchestra.run.smithi064.stdout:616 2023-10-14T12:33:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:616.out 2023-10-14T12:33:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:617 2023-10-14T12:33:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:617.out 2023-10-14T12:33:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:618 2023-10-14T12:33:41.547 INFO:teuthology.orchestra.run.smithi064.stdout:618.out 2023-10-14T12:33:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:619 2023-10-14T12:33:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:619.out 2023-10-14T12:33:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:620 2023-10-14T12:33:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:620.out 2023-10-14T12:33:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:621 2023-10-14T12:33:41.548 INFO:teuthology.orchestra.run.smithi064.stdout:621.out 2023-10-14T12:33:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:622 2023-10-14T12:33:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:622.out 2023-10-14T12:33:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:623 2023-10-14T12:33:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:623.out 2023-10-14T12:33:41.549 INFO:teuthology.orchestra.run.smithi064.stdout:624 2023-10-14T12:33:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:624.out 2023-10-14T12:33:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:625 2023-10-14T12:33:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:625.out 2023-10-14T12:33:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:626 2023-10-14T12:33:41.550 INFO:teuthology.orchestra.run.smithi064.stdout:626.out 2023-10-14T12:33:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:627 2023-10-14T12:33:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:627.out 2023-10-14T12:33:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:628 2023-10-14T12:33:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:628.out 2023-10-14T12:33:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:629 2023-10-14T12:33:41.551 INFO:teuthology.orchestra.run.smithi064.stdout:629.out 2023-10-14T12:33:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:630 2023-10-14T12:33:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:630.out 2023-10-14T12:33:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:631 2023-10-14T12:33:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:631.out 2023-10-14T12:33:41.552 INFO:teuthology.orchestra.run.smithi064.stdout:632 2023-10-14T12:33:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:632.out 2023-10-14T12:33:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:633 2023-10-14T12:33:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:633.out 2023-10-14T12:33:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:634 2023-10-14T12:33:41.553 INFO:teuthology.orchestra.run.smithi064.stdout:634.out 2023-10-14T12:33:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:635 2023-10-14T12:33:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:635.out 2023-10-14T12:33:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:636 2023-10-14T12:33:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:636.out 2023-10-14T12:33:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:637 2023-10-14T12:33:41.554 INFO:teuthology.orchestra.run.smithi064.stdout:637.out 2023-10-14T12:33:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:638 2023-10-14T12:33:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:638.out 2023-10-14T12:33:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:639 2023-10-14T12:33:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:639.out 2023-10-14T12:33:41.555 INFO:teuthology.orchestra.run.smithi064.stdout:640 2023-10-14T12:33:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:640.out 2023-10-14T12:33:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:641 2023-10-14T12:33:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:641.out 2023-10-14T12:33:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:642 2023-10-14T12:33:41.556 INFO:teuthology.orchestra.run.smithi064.stdout:642.out 2023-10-14T12:33:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:643 2023-10-14T12:33:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:643.out 2023-10-14T12:33:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:644 2023-10-14T12:33:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:644.out 2023-10-14T12:33:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:645 2023-10-14T12:33:41.557 INFO:teuthology.orchestra.run.smithi064.stdout:645.out 2023-10-14T12:33:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:646 2023-10-14T12:33:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:646.out 2023-10-14T12:33:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:647 2023-10-14T12:33:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:647.out 2023-10-14T12:33:41.558 INFO:teuthology.orchestra.run.smithi064.stdout:648 2023-10-14T12:33:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:648.out 2023-10-14T12:33:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:649 2023-10-14T12:33:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:649.out 2023-10-14T12:33:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:650 2023-10-14T12:33:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:650.out 2023-10-14T12:33:41.559 INFO:teuthology.orchestra.run.smithi064.stdout:651 2023-10-14T12:33:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:651.out 2023-10-14T12:33:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:652 2023-10-14T12:33:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:652.out 2023-10-14T12:33:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:653 2023-10-14T12:33:41.560 INFO:teuthology.orchestra.run.smithi064.stdout:653.out 2023-10-14T12:33:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:654 2023-10-14T12:33:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:654.out 2023-10-14T12:33:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:655 2023-10-14T12:33:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:655.out 2023-10-14T12:33:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:656 2023-10-14T12:33:41.561 INFO:teuthology.orchestra.run.smithi064.stdout:656.out 2023-10-14T12:33:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:657 2023-10-14T12:33:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:657.out 2023-10-14T12:33:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:658 2023-10-14T12:33:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:658.out 2023-10-14T12:33:41.562 INFO:teuthology.orchestra.run.smithi064.stdout:659 2023-10-14T12:33:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:659.out 2023-10-14T12:33:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:660 2023-10-14T12:33:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:660.out 2023-10-14T12:33:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:661 2023-10-14T12:33:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:661.out 2023-10-14T12:33:41.563 INFO:teuthology.orchestra.run.smithi064.stdout:662 2023-10-14T12:33:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:662.out 2023-10-14T12:33:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:663 2023-10-14T12:33:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:663.out 2023-10-14T12:33:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:664 2023-10-14T12:33:41.564 INFO:teuthology.orchestra.run.smithi064.stdout:664.out 2023-10-14T12:33:41.565 INFO:teuthology.orchestra.run.smithi064.stdout:665 2023-10-14T12:33:41.565 INFO:teuthology.orchestra.run.smithi064.stdout:665.out 2023-10-14T12:33:41.565 INFO:teuthology.orchestra.run.smithi064.stdout:666 2023-10-14T12:33:41.565 INFO:teuthology.orchestra.run.smithi064.stdout:666.out 2023-10-14T12:33:41.565 INFO:teuthology.orchestra.run.smithi064.stdout:667 2023-10-14T12:33:41.566 INFO:teuthology.orchestra.run.smithi064.stdout:667.out 2023-10-14T12:33:41.566 INFO:teuthology.orchestra.run.smithi064.stdout:668 2023-10-14T12:33:41.566 INFO:teuthology.orchestra.run.smithi064.stdout:668.out 2023-10-14T12:33:41.566 INFO:teuthology.orchestra.run.smithi064.stdout:669 2023-10-14T12:33:41.566 INFO:teuthology.orchestra.run.smithi064.stdout:669.out 2023-10-14T12:33:41.566 INFO:teuthology.orchestra.run.smithi064.stdout:670 2023-10-14T12:33:41.567 INFO:teuthology.orchestra.run.smithi064.stdout:670.out 2023-10-14T12:33:41.567 INFO:teuthology.orchestra.run.smithi064.stdout:671 2023-10-14T12:33:41.567 INFO:teuthology.orchestra.run.smithi064.stdout:671.out 2023-10-14T12:33:41.567 INFO:teuthology.orchestra.run.smithi064.stdout:672 2023-10-14T12:33:41.567 INFO:teuthology.orchestra.run.smithi064.stdout:672.out 2023-10-14T12:33:41.568 INFO:teuthology.orchestra.run.smithi064.stdout:673 2023-10-14T12:33:41.568 INFO:teuthology.orchestra.run.smithi064.stdout:673.out 2023-10-14T12:33:41.568 INFO:teuthology.orchestra.run.smithi064.stdout:674 2023-10-14T12:33:41.568 INFO:teuthology.orchestra.run.smithi064.stdout:674.out 2023-10-14T12:33:41.568 INFO:teuthology.orchestra.run.smithi064.stdout:675 2023-10-14T12:33:41.568 INFO:teuthology.orchestra.run.smithi064.stdout:675.out 2023-10-14T12:33:41.569 INFO:teuthology.orchestra.run.smithi064.stdout:676 2023-10-14T12:33:41.569 INFO:teuthology.orchestra.run.smithi064.stdout:676.out 2023-10-14T12:33:41.569 INFO:teuthology.orchestra.run.smithi064.stdout:677 2023-10-14T12:33:41.569 INFO:teuthology.orchestra.run.smithi064.stdout:677.out 2023-10-14T12:33:41.569 INFO:teuthology.orchestra.run.smithi064.stdout:678 2023-10-14T12:33:41.570 INFO:teuthology.orchestra.run.smithi064.stdout:678.out 2023-10-14T12:33:41.570 INFO:teuthology.orchestra.run.smithi064.stdout:679 2023-10-14T12:33:41.570 INFO:teuthology.orchestra.run.smithi064.stdout:679.out 2023-10-14T12:33:41.570 INFO:teuthology.orchestra.run.smithi064.stdout:680 2023-10-14T12:33:41.571 INFO:teuthology.orchestra.run.smithi064.stdout:680.out 2023-10-14T12:33:41.571 INFO:teuthology.orchestra.run.smithi064.stdout:681 2023-10-14T12:33:41.571 INFO:teuthology.orchestra.run.smithi064.stdout:681.out 2023-10-14T12:33:41.571 INFO:teuthology.orchestra.run.smithi064.stdout:682 2023-10-14T12:33:41.571 INFO:teuthology.orchestra.run.smithi064.stdout:682.out 2023-10-14T12:33:41.572 INFO:teuthology.orchestra.run.smithi064.stdout:683 2023-10-14T12:33:41.572 INFO:teuthology.orchestra.run.smithi064.stdout:683.out 2023-10-14T12:33:41.572 INFO:teuthology.orchestra.run.smithi064.stdout:684 2023-10-14T12:33:41.572 INFO:teuthology.orchestra.run.smithi064.stdout:684.out 2023-10-14T12:33:41.572 INFO:teuthology.orchestra.run.smithi064.stdout:685 2023-10-14T12:33:41.572 INFO:teuthology.orchestra.run.smithi064.stdout:685.out 2023-10-14T12:33:41.573 INFO:teuthology.orchestra.run.smithi064.stdout:686 2023-10-14T12:33:41.573 INFO:teuthology.orchestra.run.smithi064.stdout:686.out 2023-10-14T12:33:41.573 INFO:teuthology.orchestra.run.smithi064.stdout:687 2023-10-14T12:33:41.573 INFO:teuthology.orchestra.run.smithi064.stdout:687.out 2023-10-14T12:33:41.573 INFO:teuthology.orchestra.run.smithi064.stdout:688 2023-10-14T12:33:41.574 INFO:teuthology.orchestra.run.smithi064.stdout:688.out 2023-10-14T12:33:41.574 INFO:teuthology.orchestra.run.smithi064.stdout:689 2023-10-14T12:33:41.574 INFO:teuthology.orchestra.run.smithi064.stdout:689.out 2023-10-14T12:33:41.574 INFO:teuthology.orchestra.run.smithi064.stdout:690 2023-10-14T12:33:41.574 INFO:teuthology.orchestra.run.smithi064.stdout:690.out 2023-10-14T12:33:41.575 INFO:teuthology.orchestra.run.smithi064.stdout:691 2023-10-14T12:33:41.575 INFO:teuthology.orchestra.run.smithi064.stdout:691.out 2023-10-14T12:33:41.575 INFO:teuthology.orchestra.run.smithi064.stdout:692 2023-10-14T12:33:41.575 INFO:teuthology.orchestra.run.smithi064.stdout:692.out 2023-10-14T12:33:41.575 INFO:teuthology.orchestra.run.smithi064.stdout:693 2023-10-14T12:33:41.576 INFO:teuthology.orchestra.run.smithi064.stdout:693.out 2023-10-14T12:33:41.576 INFO:teuthology.orchestra.run.smithi064.stdout:694 2023-10-14T12:33:41.576 INFO:teuthology.orchestra.run.smithi064.stdout:694.out 2023-10-14T12:33:41.576 INFO:teuthology.orchestra.run.smithi064.stdout:695 2023-10-14T12:33:41.576 INFO:teuthology.orchestra.run.smithi064.stdout:695.out 2023-10-14T12:33:41.577 INFO:teuthology.orchestra.run.smithi064.stdout:696 2023-10-14T12:33:41.577 INFO:teuthology.orchestra.run.smithi064.stdout:696.out 2023-10-14T12:33:41.577 INFO:teuthology.orchestra.run.smithi064.stdout:697 2023-10-14T12:33:41.577 INFO:teuthology.orchestra.run.smithi064.stdout:697.out 2023-10-14T12:33:41.577 INFO:teuthology.orchestra.run.smithi064.stdout:698 2023-10-14T12:33:41.577 INFO:teuthology.orchestra.run.smithi064.stdout:698.out 2023-10-14T12:33:41.578 INFO:teuthology.orchestra.run.smithi064.stdout:699 2023-10-14T12:33:41.578 INFO:teuthology.orchestra.run.smithi064.stdout:699.out 2023-10-14T12:33:41.578 INFO:teuthology.orchestra.run.smithi064.stdout:700 2023-10-14T12:33:41.578 INFO:teuthology.orchestra.run.smithi064.stdout:700.out 2023-10-14T12:33:41.578 INFO:teuthology.orchestra.run.smithi064.stdout:701 2023-10-14T12:33:41.579 INFO:teuthology.orchestra.run.smithi064.stdout:701.out 2023-10-14T12:33:41.579 INFO:teuthology.orchestra.run.smithi064.stdout:702 2023-10-14T12:33:41.579 INFO:teuthology.orchestra.run.smithi064.stdout:702.out 2023-10-14T12:33:41.579 INFO:teuthology.orchestra.run.smithi064.stdout:703 2023-10-14T12:33:41.579 INFO:teuthology.orchestra.run.smithi064.stdout:703.out 2023-10-14T12:33:41.579 INFO:teuthology.orchestra.run.smithi064.stdout:704 2023-10-14T12:33:41.580 INFO:teuthology.orchestra.run.smithi064.stdout:704.out 2023-10-14T12:33:41.580 INFO:teuthology.orchestra.run.smithi064.stdout:705 2023-10-14T12:33:41.580 INFO:teuthology.orchestra.run.smithi064.stdout:705.out 2023-10-14T12:33:41.580 INFO:teuthology.orchestra.run.smithi064.stdout:706 2023-10-14T12:33:41.580 INFO:teuthology.orchestra.run.smithi064.stdout:706.out 2023-10-14T12:33:41.580 INFO:teuthology.orchestra.run.smithi064.stdout:707 2023-10-14T12:33:41.581 INFO:teuthology.orchestra.run.smithi064.stdout:707.out 2023-10-14T12:33:41.581 INFO:teuthology.orchestra.run.smithi064.stdout:708 2023-10-14T12:33:41.581 INFO:teuthology.orchestra.run.smithi064.stdout:708.out 2023-10-14T12:33:41.581 INFO:teuthology.orchestra.run.smithi064.stdout:709 2023-10-14T12:33:41.581 INFO:teuthology.orchestra.run.smithi064.stdout:709.out 2023-10-14T12:33:41.582 INFO:teuthology.orchestra.run.smithi064.stdout:710 2023-10-14T12:33:41.582 INFO:teuthology.orchestra.run.smithi064.stdout:710.out 2023-10-14T12:33:41.582 INFO:teuthology.orchestra.run.smithi064.stdout:711 2023-10-14T12:33:41.582 INFO:teuthology.orchestra.run.smithi064.stdout:711.out 2023-10-14T12:33:41.582 INFO:teuthology.orchestra.run.smithi064.stdout:712 2023-10-14T12:33:41.583 INFO:teuthology.orchestra.run.smithi064.stdout:712.out 2023-10-14T12:33:41.583 INFO:teuthology.orchestra.run.smithi064.stdout:713 2023-10-14T12:33:41.583 INFO:teuthology.orchestra.run.smithi064.stdout:713.out 2023-10-14T12:33:41.583 INFO:teuthology.orchestra.run.smithi064.stdout:714 2023-10-14T12:33:41.583 INFO:teuthology.orchestra.run.smithi064.stdout:714.out 2023-10-14T12:33:41.584 INFO:teuthology.orchestra.run.smithi064.stdout:715 2023-10-14T12:33:41.584 INFO:teuthology.orchestra.run.smithi064.stdout:715.out 2023-10-14T12:33:41.584 INFO:teuthology.orchestra.run.smithi064.stdout:716 2023-10-14T12:33:41.584 INFO:teuthology.orchestra.run.smithi064.stdout:716.out 2023-10-14T12:33:41.584 INFO:teuthology.orchestra.run.smithi064.stdout:717 2023-10-14T12:33:41.584 INFO:teuthology.orchestra.run.smithi064.stdout:717.out 2023-10-14T12:33:41.585 INFO:teuthology.orchestra.run.smithi064.stdout:718 2023-10-14T12:33:41.585 INFO:teuthology.orchestra.run.smithi064.stdout:718.out 2023-10-14T12:33:41.585 INFO:teuthology.orchestra.run.smithi064.stdout:719 2023-10-14T12:33:41.585 INFO:teuthology.orchestra.run.smithi064.stdout:719.out 2023-10-14T12:33:41.585 INFO:teuthology.orchestra.run.smithi064.stdout:720 2023-10-14T12:33:41.586 INFO:teuthology.orchestra.run.smithi064.stdout:720.out 2023-10-14T12:33:41.586 INFO:teuthology.orchestra.run.smithi064.stdout:721 2023-10-14T12:33:41.586 INFO:teuthology.orchestra.run.smithi064.stdout:721.out 2023-10-14T12:33:41.586 INFO:teuthology.orchestra.run.smithi064.stdout:722 2023-10-14T12:33:41.586 INFO:teuthology.orchestra.run.smithi064.stdout:722.out 2023-10-14T12:33:41.587 INFO:teuthology.orchestra.run.smithi064.stdout:723 2023-10-14T12:33:41.587 INFO:teuthology.orchestra.run.smithi064.stdout:723.out 2023-10-14T12:33:41.587 INFO:teuthology.orchestra.run.smithi064.stdout:724 2023-10-14T12:33:41.587 INFO:teuthology.orchestra.run.smithi064.stdout:724.out 2023-10-14T12:33:41.587 INFO:teuthology.orchestra.run.smithi064.stdout:725 2023-10-14T12:33:41.588 INFO:teuthology.orchestra.run.smithi064.stdout:725.out 2023-10-14T12:33:41.588 INFO:teuthology.orchestra.run.smithi064.stdout:726 2023-10-14T12:33:41.588 INFO:teuthology.orchestra.run.smithi064.stdout:726.out 2023-10-14T12:33:41.588 INFO:teuthology.orchestra.run.smithi064.stdout:727 2023-10-14T12:33:41.588 INFO:teuthology.orchestra.run.smithi064.stdout:727.out 2023-10-14T12:33:41.589 INFO:teuthology.orchestra.run.smithi064.stdout:728 2023-10-14T12:33:41.589 INFO:teuthology.orchestra.run.smithi064.stdout:728.out 2023-10-14T12:33:41.589 INFO:teuthology.orchestra.run.smithi064.stdout:729 2023-10-14T12:33:41.589 INFO:teuthology.orchestra.run.smithi064.stdout:729.out 2023-10-14T12:33:41.589 INFO:teuthology.orchestra.run.smithi064.stdout:730 2023-10-14T12:33:41.589 INFO:teuthology.orchestra.run.smithi064.stdout:730.out 2023-10-14T12:33:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:731 2023-10-14T12:33:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:731.out 2023-10-14T12:33:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:group.list 2023-10-14T12:33:41.590 INFO:teuthology.orchestra.run.smithi064.stdout:Makefile 2023-10-14T12:33:41.593 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-10-14T12:33:42.222 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:33:42.235 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:33:42.235 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:51.535 INFO:teuthology.orchestra.run.smithi064.stdout:generic/001 9s 2023-10-14T12:33:51.553 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/001 2023-10-14T12:33:51.553 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:33:51.562 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:51.567 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi064.stderr:ceph-fuse[102912]: fuse finished with error 0 and tester_r 0 2023-10-14T12:33:51.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:33:51.594 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-10-14T12:33:52.162 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:33:52.177 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:33:52.178 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:53.242 INFO:teuthology.orchestra.run.smithi064.stdout:generic/002 1s 2023-10-14T12:33:53.258 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/002 2023-10-14T12:33:53.259 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:33:53.266 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:53.299 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:33:53.300 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-10-14T12:33:53.803 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:33:53.816 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:33:53.816 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:54.247 INFO:teuthology.orchestra.run.smithi064.stdout:generic/003 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:33:54.262 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/003 2023-10-14T12:33:54.263 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/003 2023-10-14T12:33:54.263 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:33:54.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:54.307 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:33:54.308 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-10-14T12:33:54.846 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:33:54.886 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:33:54.886 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:55.277 INFO:teuthology.orchestra.run.smithi064.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-10-14T12:33:55.287 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/004 2023-10-14T12:33:55.288 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/004 2023-10-14T12:33:55.288 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:33:55.296 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:55.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:33:55.327 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-10-14T12:33:55.893 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:33:55.908 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:33:55.908 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:57.870 INFO:teuthology.orchestra.run.smithi064.stdout:generic/005 2s 2023-10-14T12:33:57.892 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/005 2023-10-14T12:33:57.892 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:33:57.904 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:33:57.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:33:57.952 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-10-14T12:33:58.466 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:33:58.480 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:33:58.480 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:34:11.595 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:34:11.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:34:41.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:34:41.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:11.515 INFO:teuthology.orchestra.run.smithi064.stdout:generic/006 73s 2023-10-14T12:35:11.541 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/006 2023-10-14T12:35:11.541 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:35:11.548 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:35:11.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:35:11.592 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-10-14T12:35:11.925 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:11.930 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:12.079 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:35:12.091 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:35:12.091 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:35:42.063 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:35:42.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:12.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:12.216 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:42.350 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:36:42.362 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:37:12.907 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:37:12.920 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:37:43.062 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:37:43.073 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:37:52.607 INFO:teuthology.orchestra.run.smithi064.stdout:generic/007 160s 2023-10-14T12:37:52.623 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/007 2023-10-14T12:37:52.625 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:37:52.631 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:37:52.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:37:52.670 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-10-14T12:37:53.175 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:37:53.191 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:37:53.191 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:37:57.329 INFO:teuthology.orchestra.run.smithi064.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-14T12:37:57.342 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/008 2023-10-14T12:37:57.343 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/008 2023-10-14T12:37:57.343 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:37:57.352 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:37:57.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:37:57.387 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-10-14T12:37:57.938 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:37:57.953 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:37:57.954 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:38:02.463 INFO:teuthology.orchestra.run.smithi064.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-14T12:38:02.475 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/009 2023-10-14T12:38:02.476 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/009 2023-10-14T12:38:02.476 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:38:02.485 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:38:02.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:38:02.518 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-10-14T12:38:03.053 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:38:03.068 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:38:03.068 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:38:03.501 INFO:teuthology.orchestra.run.smithi064.stdout:generic/010 [not run] /tmp/tmp.fHRpaBS5ywxfstests-dev/src/dbtest not built 2023-10-14T12:38:03.514 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/010 2023-10-14T12:38:03.514 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/010 2023-10-14T12:38:03.515 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:38:03.524 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:38:03.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:38:03.559 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-10-14T12:38:04.136 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:38:04.151 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:38:04.152 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:38:13.237 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:38:13.248 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:38:43.372 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:38:43.378 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:39:01.154 INFO:teuthology.orchestra.run.smithi064.stdout:generic/011 57s 2023-10-14T12:39:01.171 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/011 2023-10-14T12:39:01.171 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:39:01.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:39:01.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:39:01.208 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-10-14T12:39:01.739 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:39:01.754 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:39:01.754 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:39:06.048 INFO:teuthology.orchestra.run.smithi064.stdout:generic/012 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:39:06.061 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/012 2023-10-14T12:39:06.061 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/012 2023-10-14T12:39:06.062 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:39:06.073 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:39:06.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:39:06.113 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-10-14T12:39:06.608 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:39:06.620 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:39:06.620 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:39:13.494 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:39:13.501 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:39:44.905 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:39:44.913 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:40:15.802 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:40:15.809 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:40:46.110 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:40:46.116 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:41:17.155 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:41:17.161 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:41:17.398 INFO:teuthology.orchestra.run.smithi064.stdout:generic/013 131s 2023-10-14T12:41:19.272 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/013 2023-10-14T12:41:19.272 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:41:19.285 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:41:19.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:41:19.317 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-10-14T12:41:19.968 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:41:19.984 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:41:19.985 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:41:49.363 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:41:49.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:41:49.635 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T12:41:49.634+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149050) UID: 0 2023-10-14T12:41:49.636 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T12:41:49.634+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 149050) UID: 0 2023-10-14T12:45:12.434 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:45:12.440 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:45:43.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:45:43.802 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:46:13.950 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:46:13.963 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:46:17.742 INFO:teuthology.orchestra.run.smithi064.stdout:generic/014 297s 2023-10-14T12:46:17.781 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/014 2023-10-14T12:46:17.781 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:17.789 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:17.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:17.828 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-10-14T12:46:18.551 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:18.568 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:18.568 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:18.982 INFO:teuthology.orchestra.run.smithi064.stdout:generic/015 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:46:18.995 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/015 2023-10-14T12:46:18.995 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/015 2023-10-14T12:46:18.995 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:19.005 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:19.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:19.034 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-10-14T12:46:19.664 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:19.681 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:19.682 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:22.448 INFO:teuthology.orchestra.run.smithi064.stdout:generic/016 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:46:22.462 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/016 2023-10-14T12:46:22.463 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/016 2023-10-14T12:46:22.463 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:22.475 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:22.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:22.526 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-10-14T12:46:23.281 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:23.299 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:23.299 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:23.713 INFO:teuthology.orchestra.run.smithi064.stdout:generic/017 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:46:23.725 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/017 2023-10-14T12:46:23.726 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/017 2023-10-14T12:46:23.726 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:23.734 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:23.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:23.772 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-10-14T12:46:24.415 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:24.428 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:24.428 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:25.672 INFO:teuthology.orchestra.run.smithi064.stdout:generic/018 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:46:25.685 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/018 2023-10-14T12:46:25.686 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/018 2023-10-14T12:46:25.686 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:25.694 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:25.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:25.731 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-10-14T12:46:26.377 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:26.389 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:26.390 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:26.789 INFO:teuthology.orchestra.run.smithi064.stdout:generic/019 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:46:26.801 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/019 2023-10-14T12:46:26.801 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/019 2023-10-14T12:46:26.802 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:26.813 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:26.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:26.844 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-10-14T12:46:27.447 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:27.466 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:27.467 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:44.018 INFO:teuthology.orchestra.run.smithi064.stdout:generic/020 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/020.out.bad) 2023-10-14T12:46:44.028 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/020.out 2023-10-14 12:30:49.948660256 +0000 2023-10-14T12:46:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/020.out.bad 2023-10-14 12:46:44.013180925 +0000 2023-10-14T12:46:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -47,9 +47,13 @@ 2023-10-14T12:46:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: user.snrub="fish2\012" 2023-10-14T12:46:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:44.029 INFO:teuthology.orchestra.run.smithi064.stdout: *** really long value 2023-10-14T12:46:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: -0000000 00 2023-10-14T12:46:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: -* 2023-10-14T12:46:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: -ATTRSIZE 2023-10-14T12:46:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: +attr_set: No space left on device 2023-10-14T12:46:44.030 INFO:teuthology.orchestra.run.smithi064.stdout: +Could not set "long_attr" for 2023-10-14T12:46:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: +attr_get: No data available 2023-10-14T12:46:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: +Could not get "long_attr" for 2023-10-14T12:46:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: +0000000 2023-10-14T12:46:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: +attr_remove: No data available 2023-10-14T12:46:44.031 INFO:teuthology.orchestra.run.smithi064.stdout: +Could not remove "long_attr" for 2023-10-14T12:46:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: *** set/get/remove really long names (expect failure) 2023-10-14T12:46:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: attr_set: Invalid argument 2023-10-14T12:46:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: Could not set "XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX" for 2023-10-14T12:46:44.037 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/020 2023-10-14T12:46:44.037 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/020 2023-10-14T12:46:44.038 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T12:46:44.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:44.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T12:46:44.088 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T12:46:44.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T12:46:44.089 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-10-14T12:46:44.113 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:46:44.150 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:46:44.834 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:44.850 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:44.850 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:47.571 INFO:teuthology.orchestra.run.smithi064.stdout:generic/021 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:46:47.585 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/021 2023-10-14T12:46:47.585 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/021 2023-10-14T12:46:47.586 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:47.593 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:47.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:47.645 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-10-14T12:46:48.382 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:48.397 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:48.398 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:51.070 INFO:teuthology.orchestra.run.smithi064.stdout:generic/022 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:46:51.081 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/022 2023-10-14T12:46:51.082 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/022 2023-10-14T12:46:51.082 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:51.091 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:51.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:51.126 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-10-14T12:46:51.890 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:51.905 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:51.905 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:54.893 INFO:teuthology.orchestra.run.smithi064.stdout:generic/023 3s 2023-10-14T12:46:54.909 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/023 2023-10-14T12:46:54.910 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:54.921 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:54.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:54.970 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-10-14T12:46:55.710 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:55.728 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:55.728 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:56.191 INFO:teuthology.orchestra.run.smithi064.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-10-14T12:46:56.205 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/024 2023-10-14T12:46:56.205 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/024 2023-10-14T12:46:56.205 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:56.214 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:56.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:56.274 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-10-14T12:46:57.010 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:57.028 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:57.028 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:57.497 INFO:teuthology.orchestra.run.smithi064.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-10-14T12:46:57.512 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/025 2023-10-14T12:46:57.512 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/025 2023-10-14T12:46:57.512 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:57.521 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:57.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:57.574 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-10-14T12:46:58.328 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:58.343 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:58.343 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:59.165 INFO:teuthology.orchestra.run.smithi064.stdout:generic/026 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T12:46:59.177 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/026 2023-10-14T12:46:59.178 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/026 2023-10-14T12:46:59.178 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:46:59.189 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:46:59.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:46:59.224 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-10-14T12:46:59.865 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:46:59.881 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:46:59.882 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:00.291 INFO:teuthology.orchestra.run.smithi064.stdout:generic/027 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:00.307 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/027 2023-10-14T12:47:00.307 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/027 2023-10-14T12:47:00.307 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:00.316 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:00.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:00.348 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-10-14T12:47:00.957 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:00.976 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:00.976 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:06.563 INFO:teuthology.orchestra.run.smithi064.stdout:generic/028 6s 2023-10-14T12:47:06.584 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/028 2023-10-14T12:47:06.585 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:06.594 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:06.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:06.629 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-10-14T12:47:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:07.220 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:07.221 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:07.635 INFO:teuthology.orchestra.run.smithi064.stdout:generic/029 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:07.647 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/029 2023-10-14T12:47:07.647 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/029 2023-10-14T12:47:07.647 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:07.656 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:07.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:07.688 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-10-14T12:47:08.282 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:08.302 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:08.302 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:08.710 INFO:teuthology.orchestra.run.smithi064.stdout:generic/030 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:08.722 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/030 2023-10-14T12:47:08.722 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/030 2023-10-14T12:47:08.723 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:08.733 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:08.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:08.766 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-10-14T12:47:09.356 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:09.378 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:09.378 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:09.794 INFO:teuthology.orchestra.run.smithi064.stdout:generic/031 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:09.808 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/031 2023-10-14T12:47:09.808 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/031 2023-10-14T12:47:09.808 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:09.818 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:09.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:09.849 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-10-14T12:47:10.458 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:10.471 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:10.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:10.871 INFO:teuthology.orchestra.run.smithi064.stdout:generic/032 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:10.885 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/032 2023-10-14T12:47:10.885 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/032 2023-10-14T12:47:10.885 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:10.895 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:10.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:10.931 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-10-14T12:47:11.532 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:11.548 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:11.548 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:11.949 INFO:teuthology.orchestra.run.smithi064.stdout:generic/033 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:11.960 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/033 2023-10-14T12:47:11.960 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/033 2023-10-14T12:47:11.960 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:11.968 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:12.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:12.001 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-10-14T12:47:12.607 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:12.621 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:12.621 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:13.075 INFO:teuthology.orchestra.run.smithi064.stdout:generic/034 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:13.086 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/034 2023-10-14T12:47:13.086 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/034 2023-10-14T12:47:13.087 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:13.096 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:13.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:13.136 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-10-14T12:47:13.755 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:13.773 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:13.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:14.373 INFO:teuthology.orchestra.run.smithi064.stdout:generic/035 1s 2023-10-14T12:47:14.386 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:47:14.393 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:47:14.394 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/035 2023-10-14T12:47:14.395 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:14.401 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:14.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:14.447 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-10-14T12:47:15.244 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:15.260 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:15.260 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:25.872 INFO:teuthology.orchestra.run.smithi064.stdout:generic/036 10s 2023-10-14T12:47:25.895 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/036 2023-10-14T12:47:25.895 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:25.907 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:25.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:25.955 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-10-14T12:47:26.601 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:26.613 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:26.613 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:27.042 INFO:teuthology.orchestra.run.smithi064.stdout:generic/037 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:27.054 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/037 2023-10-14T12:47:27.055 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/037 2023-10-14T12:47:27.055 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:27.063 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:27.094 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:27.095 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-10-14T12:47:27.705 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:27.718 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:27.718 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:28.138 INFO:teuthology.orchestra.run.smithi064.stdout:generic/038 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:28.152 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/038 2023-10-14T12:47:28.152 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/038 2023-10-14T12:47:28.152 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:28.162 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:28.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:28.197 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-10-14T12:47:28.768 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:28.781 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:28.782 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:29.244 INFO:teuthology.orchestra.run.smithi064.stdout:generic/039 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:29.259 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/039 2023-10-14T12:47:29.260 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/039 2023-10-14T12:47:29.260 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:29.272 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:29.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:29.311 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-10-14T12:47:29.877 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:29.892 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:29.893 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:30.373 INFO:teuthology.orchestra.run.smithi064.stdout:generic/040 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/040 2023-10-14T12:47:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/040 2023-10-14T12:47:30.385 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:30.394 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:30.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:30.428 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-10-14T12:47:30.986 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:31.001 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:31.001 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:31.482 INFO:teuthology.orchestra.run.smithi064.stdout:generic/041 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:31.495 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/041 2023-10-14T12:47:31.496 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/041 2023-10-14T12:47:31.496 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:31.505 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:31.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:31.539 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-10-14T12:47:32.103 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:32.118 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:32.119 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:32.574 INFO:teuthology.orchestra.run.smithi064.stdout:generic/042 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:32.585 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/042 2023-10-14T12:47:32.585 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/042 2023-10-14T12:47:32.586 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:32.594 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:32.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:32.624 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-10-14T12:47:33.219 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:33.234 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:33.234 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:33.646 INFO:teuthology.orchestra.run.smithi064.stdout:generic/043 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:33.657 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/043 2023-10-14T12:47:33.658 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/043 2023-10-14T12:47:33.658 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:33.666 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:33.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:33.703 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-10-14T12:47:34.287 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:34.300 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:34.301 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:34.750 INFO:teuthology.orchestra.run.smithi064.stdout:generic/044 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:34.760 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/044 2023-10-14T12:47:34.761 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/044 2023-10-14T12:47:34.761 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:34.769 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:34.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:34.797 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-10-14T12:47:35.356 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:35.369 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:35.370 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:35.793 INFO:teuthology.orchestra.run.smithi064.stdout:generic/045 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:35.804 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/045 2023-10-14T12:47:35.804 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/045 2023-10-14T12:47:35.804 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:35.812 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:35.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:35.844 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-10-14T12:47:36.380 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:36.395 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:36.396 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:36.813 INFO:teuthology.orchestra.run.smithi064.stdout:generic/046 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:36.824 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/046 2023-10-14T12:47:36.824 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/046 2023-10-14T12:47:36.825 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:36.834 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:36.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:36.866 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-10-14T12:47:37.428 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:37.441 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:37.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:37.890 INFO:teuthology.orchestra.run.smithi064.stdout:generic/047 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:37.905 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/047 2023-10-14T12:47:37.906 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/047 2023-10-14T12:47:37.906 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:37.915 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:37.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:37.946 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-10-14T12:47:38.536 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:38.551 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:38.551 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:38.979 INFO:teuthology.orchestra.run.smithi064.stdout:generic/048 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:38.994 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/048 2023-10-14T12:47:38.995 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/048 2023-10-14T12:47:38.995 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:39.008 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:39.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:39.042 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-10-14T12:47:39.628 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:39.642 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:39.642 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:40.063 INFO:teuthology.orchestra.run.smithi064.stdout:generic/049 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:40.076 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/049 2023-10-14T12:47:40.076 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/049 2023-10-14T12:47:40.076 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:40.086 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:40.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:40.118 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-10-14T12:47:40.697 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:40.710 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:40.710 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:41.187 INFO:teuthology.orchestra.run.smithi064.stdout:generic/050 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:41.202 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/050 2023-10-14T12:47:41.203 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/050 2023-10-14T12:47:41.203 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:41.214 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:41.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:41.248 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-10-14T12:47:41.798 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:41.813 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:41.814 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:42.239 INFO:teuthology.orchestra.run.smithi064.stdout:generic/051 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:42.250 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/051 2023-10-14T12:47:42.250 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/051 2023-10-14T12:47:42.251 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:42.259 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:42.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:42.285 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-10-14T12:47:42.868 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:42.880 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:42.880 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:43.348 INFO:teuthology.orchestra.run.smithi064.stdout:generic/052 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:43.360 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/052 2023-10-14T12:47:43.361 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/052 2023-10-14T12:47:43.361 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:43.372 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:43.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:43.407 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-10-14T12:47:43.981 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:43.995 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:43.996 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:44.429 INFO:teuthology.orchestra.run.smithi064.stdout:generic/053 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:44.440 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/053 2023-10-14T12:47:44.441 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/053 2023-10-14T12:47:44.441 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:44.449 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:44.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:44.478 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-10-14T12:47:44.582 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:47:44.588 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:47:45.021 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:45.034 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:45.034 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:45.485 INFO:teuthology.orchestra.run.smithi064.stdout:generic/054 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:45.501 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/054 2023-10-14T12:47:45.501 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/054 2023-10-14T12:47:45.501 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:45.513 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:45.549 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:45.549 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-10-14T12:47:46.133 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:46.146 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:46.147 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:46.608 INFO:teuthology.orchestra.run.smithi064.stdout:generic/055 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:46.621 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/055 2023-10-14T12:47:46.622 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/055 2023-10-14T12:47:46.622 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:46.633 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:46.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:46.665 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-10-14T12:47:47.217 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:47.230 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:47.230 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:47.682 INFO:teuthology.orchestra.run.smithi064.stdout:generic/056 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:47.696 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/056 2023-10-14T12:47:47.696 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/056 2023-10-14T12:47:47.697 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:47.709 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:47.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:47.741 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-10-14T12:47:48.323 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:48.338 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:48.338 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:48.806 INFO:teuthology.orchestra.run.smithi064.stdout:generic/057 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:48.821 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/057 2023-10-14T12:47:48.821 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/057 2023-10-14T12:47:48.822 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:48.834 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:48.866 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:48.867 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-10-14T12:47:49.459 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:49.473 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:49.473 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:54.036 INFO:teuthology.orchestra.run.smithi064.stdout:generic/058 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:47:54.048 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/058 2023-10-14T12:47:54.048 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/058 2023-10-14T12:47:54.048 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:54.058 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:54.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:54.107 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-10-14T12:47:54.811 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:54.824 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:54.824 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:55.287 INFO:teuthology.orchestra.run.smithi064.stdout:generic/059 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:47:55.302 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/059 2023-10-14T12:47:55.302 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/059 2023-10-14T12:47:55.302 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:47:55.315 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:47:55.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:47:55.351 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-10-14T12:47:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:47:55.956 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:47:55.957 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:00.094 INFO:teuthology.orchestra.run.smithi064.stdout:generic/060 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:48:00.106 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/060 2023-10-14T12:48:00.106 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/060 2023-10-14T12:48:00.107 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:00.116 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:00.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:00.168 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-10-14T12:48:00.825 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:00.837 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:00.837 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:05.046 INFO:teuthology.orchestra.run.smithi064.stdout:generic/061 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:48:05.059 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/061 2023-10-14T12:48:05.059 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/061 2023-10-14T12:48:05.059 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:05.068 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:05.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:05.106 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-10-14T12:48:05.807 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:05.821 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:05.822 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:06.238 INFO:teuthology.orchestra.run.smithi064.stdout:generic/062 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:48:06.249 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/062 2023-10-14T12:48:06.250 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/062 2023-10-14T12:48:06.250 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:06.258 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:06.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:06.285 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-10-14T12:48:06.840 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:06.854 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:06.855 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:11.048 INFO:teuthology.orchestra.run.smithi064.stdout:generic/063 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T12:48:11.061 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/063 2023-10-14T12:48:11.062 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/063 2023-10-14T12:48:11.062 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:11.072 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:11.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:11.126 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-10-14T12:48:11.806 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:11.819 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:11.819 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:12.254 INFO:teuthology.orchestra.run.smithi064.stdout:generic/064 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:48:12.269 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/064 2023-10-14T12:48:12.269 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/064 2023-10-14T12:48:12.269 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:12.283 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:12.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:12.315 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-10-14T12:48:12.884 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:12.897 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:12.898 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:13.381 INFO:teuthology.orchestra.run.smithi064.stdout:generic/065 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:48:13.394 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/065 2023-10-14T12:48:13.394 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/065 2023-10-14T12:48:13.395 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:13.404 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:13.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:13.437 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-10-14T12:48:14.003 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:14.016 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:14.016 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:14.481 INFO:teuthology.orchestra.run.smithi064.stdout:generic/066 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:48:14.493 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/066 2023-10-14T12:48:14.493 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/066 2023-10-14T12:48:14.494 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:14.503 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:14.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:14.535 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-10-14T12:48:14.720 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:48:14.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:48:15.060 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:15.072 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:15.072 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:15.584 INFO:teuthology.orchestra.run.smithi064.stdout:generic/067 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:48:15.596 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/067 2023-10-14T12:48:15.596 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/067 2023-10-14T12:48:15.597 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:15.605 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:15.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:15.635 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-10-14T12:48:16.198 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:16.210 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:16.211 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:16.701 INFO:teuthology.orchestra.run.smithi064.stdout:generic/068 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:48:16.713 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/068 2023-10-14T12:48:16.714 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/068 2023-10-14T12:48:16.714 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:16.724 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:16.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:16.756 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-10-14T12:48:17.336 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:17.348 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:17.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:17.772 INFO:teuthology.orchestra.run.smithi064.stdout:generic/069 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:48:17.784 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/069 2023-10-14T12:48:17.784 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/069 2023-10-14T12:48:17.785 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:48:17.794 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:17.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:48:17.824 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-10-14T12:48:18.392 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:48:18.405 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:48:18.405 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:48:44.858 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:48:44.869 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:49:15.018 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:49:15.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:49:45.484 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:49:45.496 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:50:15.632 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:50:15.643 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:50:45.779 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:50:45.793 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:50:59.455 INFO:teuthology.orchestra.run.smithi064.stdout:generic/070 161s 2023-10-14T12:50:59.473 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/070 2023-10-14T12:50:59.473 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:50:59.484 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:50:59.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:50:59.531 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-10-14T12:51:00.290 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:51:00.307 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:51:00.308 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:51:00.705 INFO:teuthology.orchestra.run.smithi064.stdout:generic/071 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:51:00.717 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/071 2023-10-14T12:51:00.717 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/071 2023-10-14T12:51:00.717 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:51:00.729 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:51:00.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:51:00.755 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-10-14T12:51:01.336 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:51:01.354 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:51:01.354 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:51:03.907 INFO:teuthology.orchestra.run.smithi064.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-14T12:51:03.920 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/072 2023-10-14T12:51:03.920 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/072 2023-10-14T12:51:03.920 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:51:03.930 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:51:03.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:51:03.966 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-10-14T12:51:04.569 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:51:04.584 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:51:04.585 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:51:05.026 INFO:teuthology.orchestra.run.smithi064.stdout:generic/073 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T12:51:05.038 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/073 2023-10-14T12:51:05.038 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/073 2023-10-14T12:51:05.038 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T12:51:05.047 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:51:05.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T12:51:05.077 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-10-14T12:51:05.699 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T12:51:05.714 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T12:51:05.715 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T12:51:15.942 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:51:15.951 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:51:46.811 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:51:46.817 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:52:18.037 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:52:18.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:52:48.445 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:52:48.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:53:18.592 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:53:18.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:53:48.752 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:53:48.758 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:54:21.353 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:54:21.361 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:54:54.590 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:54:54.599 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:55:27.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:55:27.658 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:55:57.816 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:55:57.823 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:56:27.980 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:56:27.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:56:58.220 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:56:58.227 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:57:29.164 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:57:29.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T12:57:29.309 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T12:57:29.308+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95671) UID: 0 2023-10-14T12:57:29.310 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T12:57:29.308+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95671) UID: 0 2023-10-14T12:57:29.311 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T12:57:29.308+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95671) UID: 0 2023-10-14T12:57:29.311 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T12:57:29.308+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95671) UID: 0 2023-10-14T13:02:03.584 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:02:03.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:02:33.834 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:02:33.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:02:34.003 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T13:02:34.002+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95739) UID: 0 2023-10-14T13:02:34.005 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T13:02:34.004+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95739) UID: 0 2023-10-14T13:02:34.006 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T13:02:34.003+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95739) UID: 0 2023-10-14T13:02:34.009 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T13:02:34.004+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95739) UID: 0 2023-10-14T13:07:08.908 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:07:08.916 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:07:09.056 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T13:07:09.056+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95769) UID: 0 2023-10-14T13:07:09.057 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T13:07:09.056+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95769) UID: 0 2023-10-14T13:07:09.057 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T13:07:09.056+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95769) UID: 0 2023-10-14T13:07:09.058 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T13:07:09.056+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 95769) UID: 0 2023-10-14T13:07:09.074 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T13:07:09.074+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179016) UID: 0 2023-10-14T13:07:09.075 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T13:07:09.074+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179016) UID: 0 2023-10-14T13:07:09.075 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T13:07:09.074+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179016) UID: 0 2023-10-14T13:07:09.078 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T13:07:09.074+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179016) UID: 0 2023-10-14T13:22:29.952 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:22:29.965 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:22:30.159 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T13:22:30.158+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96050) UID: 0 2023-10-14T13:22:30.160 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T13:22:30.158+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96050) UID: 0 2023-10-14T13:22:30.160 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T13:22:30.158+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96050) UID: 0 2023-10-14T13:22:30.161 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T13:22:30.158+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 96050) UID: 0 2023-10-14T13:22:32.256 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T13:22:32.256+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179780) UID: 0 2023-10-14T13:22:32.257 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T13:22:32.257+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179780) UID: 0 2023-10-14T13:22:32.258 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T13:22:32.259+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179780) UID: 0 2023-10-14T13:22:32.259 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T13:22:32.260+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 179780) UID: 0 2023-10-14T13:25:18.894 INFO:teuthology.orchestra.run.smithi064.stdout:generic/074 2053s 2023-10-14T13:25:18.952 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/074 2023-10-14T13:25:18.953 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:25:18.965 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:25:19.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:25:19.005 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-10-14T13:25:20.661 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:25:20.677 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:25:20.677 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:00.320 INFO:teuthology.orchestra.run.smithi064.stdout:generic/075 100s 2023-10-14T13:27:00.339 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/075 2023-10-14T13:27:00.340 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:00.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:00.407 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:00.407 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-10-14T13:27:01.102 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:01.115 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:01.116 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:01.446 INFO:teuthology.orchestra.run.smithi064.stdout:generic/076 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T13:27:01.455 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/076 2023-10-14T13:27:01.455 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/076 2023-10-14T13:27:01.455 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:01.461 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:01.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:01.487 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-10-14T13:27:01.987 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:01.999 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:01.999 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:04.591 INFO:teuthology.orchestra.run.smithi064.stdout:generic/077 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T13:27:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/077 2023-10-14T13:27:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/077 2023-10-14T13:27:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:04.613 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:04.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:04.646 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-10-14T13:27:05.182 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:05.194 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:05.195 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:05.686 INFO:teuthology.orchestra.run.smithi064.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-10-14T13:27:05.699 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/078 2023-10-14T13:27:05.699 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/078 2023-10-14T13:27:05.699 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:05.714 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:05.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:05.755 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-10-14T13:27:06.460 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:06.471 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:06.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:06.942 INFO:teuthology.orchestra.run.smithi064.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-10-14T13:27:06.955 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/079 2023-10-14T13:27:06.955 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/079 2023-10-14T13:27:06.955 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:06.966 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:06.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:06.992 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-10-14T13:27:07.467 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:07.478 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:07.479 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:10.038 INFO:teuthology.orchestra.run.smithi064.stdout:generic/080 3s 2023-10-14T13:27:10.053 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/080 2023-10-14T13:27:10.053 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:10.061 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:10.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:10.088 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-10-14T13:27:10.702 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:10.717 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:10.717 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:11.155 INFO:teuthology.orchestra.run.smithi064.stdout:generic/081 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T13:27:11.165 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/081 2023-10-14T13:27:11.165 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/081 2023-10-14T13:27:11.166 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:11.172 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:11.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:11.195 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-10-14T13:27:11.685 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:11.698 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:11.698 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:12.107 INFO:teuthology.orchestra.run.smithi064.stdout:generic/082 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T13:27:12.119 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/082 2023-10-14T13:27:12.119 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/082 2023-10-14T13:27:12.119 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:12.126 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:12.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:12.154 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-10-14T13:27:12.707 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:12.719 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:12.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:13.149 INFO:teuthology.orchestra.run.smithi064.stdout:generic/083 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T13:27:13.161 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/083 2023-10-14T13:27:13.161 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/083 2023-10-14T13:27:13.162 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:13.171 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:13.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:13.202 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-10-14T13:27:13.740 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:13.752 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:13.752 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:14.146 INFO:teuthology.orchestra.run.smithi064.stdout:generic/084 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T13:27:14.155 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/084 2023-10-14T13:27:14.156 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/084 2023-10-14T13:27:14.156 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:14.164 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:14.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:14.191 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-10-14T13:27:14.727 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:14.738 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:14.739 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:15.175 INFO:teuthology.orchestra.run.smithi064.stdout:generic/085 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T13:27:15.188 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/085 2023-10-14T13:27:15.188 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/085 2023-10-14T13:27:15.188 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:15.197 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:15.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:15.225 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-10-14T13:27:15.766 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:15.776 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:15.777 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:31.344 INFO:teuthology.orchestra.run.smithi064.stdout:generic/086 16s 2023-10-14T13:27:31.418 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/086 2023-10-14T13:27:31.418 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:31.432 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:31.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:31.576 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-10-14T13:27:33.321 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:33.332 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:33.332 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:34.155 INFO:teuthology.orchestra.run.smithi064.stdout:generic/087 1s 2023-10-14T13:27:34.171 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/087 2023-10-14T13:27:34.171 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:34.179 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:34.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:34.224 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-10-14T13:27:34.913 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:34.927 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:34.927 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:35.476 INFO:teuthology.orchestra.run.smithi064.stdout:generic/088 1s 2023-10-14T13:27:35.499 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/088 2023-10-14T13:27:35.499 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T13:27:35.510 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:27:35.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T13:27:35.565 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-10-14T13:27:36.256 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T13:27:36.269 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T13:27:36.269 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T13:31:32.836 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:31:32.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:32:03.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:32:03.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:32:33.595 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:32:33.601 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:33:03.742 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:33:03.752 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:33:03.882 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T13:33:03.881+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187676) UID: 0 2023-10-14T13:33:03.883 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T13:33:03.881+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 187676) UID: 0 2023-10-14T13:36:16.148 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:36:16.158 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:36:46.288 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:36:46.299 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:37:16.463 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:37:16.474 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:37:47.086 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:37:47.096 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:38:17.233 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:38:17.243 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:38:47.367 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:38:47.373 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:39:17.522 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:39:17.534 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:39:47.669 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:39:47.680 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:39:47.781 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T13:39:47.781+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 188039) UID: 0 2023-10-14T13:39:47.781 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T13:39:47.781+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 188039) UID: 0 2023-10-14T13:42:37.639 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:42:37.649 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:43:07.992 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:43:08.001 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:43:41.760 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:43:41.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:44:11.927 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:44:11.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:44:42.072 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:44:42.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:45:12.328 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:45:12.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:45:42.603 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:45:42.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:46:13.074 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:46:13.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:46:43.749 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:46:43.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:47:13.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:47:13.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:47:44.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:47:44.050 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:47:44.147 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T13:47:44.146+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 188248) UID: 0 2023-10-14T13:47:44.147 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T13:47:44.146+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 188248) UID: 0 2023-10-14T13:50:02.985 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T13:50:02.985+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 190265) UID: 0 2023-10-14T13:50:02.986 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T13:50:02.985+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 190265) UID: 0 2023-10-14T13:50:02.986 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T13:50:02.985+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 190265) UID: 0 2023-10-14T13:50:02.986 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T13:50:02.985+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 190265) UID: 0 2023-10-14T13:53:59.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:53:59.805 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:54:30.400 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:54:30.413 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:55:00.552 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:55:00.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:55:30.698 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:55:30.708 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:55:30.828 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T13:55:30.826+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 190344) UID: 0 2023-10-14T13:55:30.829 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T13:55:30.826+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 190344) UID: 0 2023-10-14T13:58:18.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:58:18.114 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:58:48.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:58:48.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:59:18.643 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:59:18.653 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:59:48.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T13:59:48.799 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:00:19.082 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:00:19.092 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:00:49.281 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:00:49.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:00:56.337 INFO:teuthology.orchestra.run.smithi064.stdout:generic/089 2000s 2023-10-14T14:00:56.405 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/089 2023-10-14T14:00:56.406 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:00:56.419 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:00:56.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:00:56.454 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-10-14T14:00:57.460 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:00:57.476 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:00:57.476 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:00:58.079 INFO:teuthology.orchestra.run.smithi064.stdout:generic/090 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:00:58.094 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/090 2023-10-14T14:00:58.094 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/090 2023-10-14T14:00:58.095 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:00:58.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:00:58.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:00:58.143 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-10-14T14:00:58.752 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:00:58.765 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:00:58.766 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:01:19.445 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:01:19.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:01:19.571 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T14:01:19.570+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191367) UID: 0 2023-10-14T14:01:19.571 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T14:01:19.570+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191367) UID: 0 2023-10-14T14:01:19.571 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T14:01:19.570+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191367) UID: 0 2023-10-14T14:01:19.572 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T14:01:19.570+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 191367) UID: 0 2023-10-14T14:04:30.019 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:04:30.030 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:05:00.168 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:05:00.178 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:05:30.490 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:05:30.500 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:06:00.644 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:06:00.654 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:06:30.782 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:06:30.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:06:58.482 INFO:teuthology.orchestra.run.smithi064.stdout:generic/091 360s 2023-10-14T14:06:58.499 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/091 2023-10-14T14:06:58.500 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:06:58.508 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:06:58.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:06:58.548 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-10-14T14:06:59.275 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:06:59.288 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:06:59.288 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:06:59.871 INFO:teuthology.orchestra.run.smithi064.stdout:generic/092 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T14:06:59.884 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/092 2023-10-14T14:06:59.884 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/092 2023-10-14T14:06:59.884 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:06:59.894 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:06:59.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:06:59.932 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-10-14T14:07:00.635 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:00.648 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:00.648 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:01.113 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:07:01.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:07:02.530 INFO:teuthology.orchestra.run.smithi064.stdout:generic/093 2s 2023-10-14T14:07:02.548 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/093 2023-10-14T14:07:02.549 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:07:02.557 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:02.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:07:02.590 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-10-14T14:07:03.304 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:03.316 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:03.316 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:03.774 INFO:teuthology.orchestra.run.smithi064.stdout:generic/094 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:07:03.787 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/094 2023-10-14T14:07:03.787 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/094 2023-10-14T14:07:03.787 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:07:03.796 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:03.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:07:03.830 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-10-14T14:07:04.429 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:04.443 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:04.445 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:04.906 INFO:teuthology.orchestra.run.smithi064.stdout:generic/095 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:07:04.921 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/095 2023-10-14T14:07:04.921 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/095 2023-10-14T14:07:04.921 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:07:04.932 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:04.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:07:04.965 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-10-14T14:07:05.573 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:05.588 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:05.588 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:06.038 INFO:teuthology.orchestra.run.smithi064.stdout:generic/096 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:07:06.051 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/096 2023-10-14T14:07:06.051 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/096 2023-10-14T14:07:06.051 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:07:06.063 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:06.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:07:06.099 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-10-14T14:07:06.684 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:06.701 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:06.702 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:07.872 INFO:teuthology.orchestra.run.smithi064.stdout:generic/097 1s 2023-10-14T14:07:07.888 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/097 2023-10-14T14:07:07.889 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:07:07.899 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:07.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:07:07.923 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-10-14T14:07:08.449 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:08.461 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:08.461 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:08.915 INFO:teuthology.orchestra.run.smithi064.stdout:generic/098 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:07:08.925 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/098 2023-10-14T14:07:08.926 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/098 2023-10-14T14:07:08.926 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:07:08.936 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:08.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:07:08.971 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-10-14T14:07:09.582 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:09.595 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:09.595 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:10.167 INFO:teuthology.orchestra.run.smithi064.stdout:generic/099 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T14:07:10.182 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/099 2023-10-14T14:07:10.182 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/099 2023-10-14T14:07:10.182 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:07:10.194 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:10.229 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:07:10.230 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-10-14T14:07:10.814 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:07:10.829 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:07:10.829 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:07:31.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:07:31.323 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:08:01.457 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:08:01.469 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:08:31.607 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:08:31.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:09:01.756 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:09:01.767 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:09:15.258 INFO:teuthology.orchestra.run.smithi064.stdout:generic/100 125s 2023-10-14T14:09:15.282 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/100 2023-10-14T14:09:15.283 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:15.295 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:15.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:15.366 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-10-14T14:09:16.127 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:16.138 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:16.138 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:16.668 INFO:teuthology.orchestra.run.smithi064.stdout:generic/101 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:16.684 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/101 2023-10-14T14:09:16.684 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/101 2023-10-14T14:09:16.684 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:16.698 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:16.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:16.731 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-10-14T14:09:17.347 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:17.362 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:17.362 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:17.821 INFO:teuthology.orchestra.run.smithi064.stdout:generic/102 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:17.833 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/102 2023-10-14T14:09:17.833 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/102 2023-10-14T14:09:17.833 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:17.842 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:17.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:17.873 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-10-14T14:09:18.457 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:18.473 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:18.474 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:19.166 INFO:teuthology.orchestra.run.smithi064.stdout:generic/103 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:19.177 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/103 2023-10-14T14:09:19.177 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/103 2023-10-14T14:09:19.177 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:19.186 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:19.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:19.218 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-10-14T14:09:19.808 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:19.823 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:19.823 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:20.324 INFO:teuthology.orchestra.run.smithi064.stdout:generic/104 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:20.338 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/104 2023-10-14T14:09:20.338 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/104 2023-10-14T14:09:20.338 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:20.347 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:20.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:20.379 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-10-14T14:09:20.982 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:20.997 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:20.997 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:21.418 INFO:teuthology.orchestra.run.smithi064.stdout:generic/105 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:21.429 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/105 2023-10-14T14:09:21.429 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/105 2023-10-14T14:09:21.429 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:21.440 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:21.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:21.469 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-10-14T14:09:22.071 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:22.085 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:22.085 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:22.571 INFO:teuthology.orchestra.run.smithi064.stdout:generic/106 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:22.582 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/106 2023-10-14T14:09:22.583 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/106 2023-10-14T14:09:22.583 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:22.592 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:22.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:22.622 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-10-14T14:09:23.192 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:23.205 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:23.205 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:23.632 INFO:teuthology.orchestra.run.smithi064.stdout:generic/107 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:23.643 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/107 2023-10-14T14:09:23.643 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/107 2023-10-14T14:09:23.643 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:23.651 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:23.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:23.682 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-10-14T14:09:24.280 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:24.293 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:24.294 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:24.990 INFO:teuthology.orchestra.run.smithi064.stdout:generic/108 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:25.005 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/108 2023-10-14T14:09:25.006 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/108 2023-10-14T14:09:25.006 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:25.014 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:25.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:25.047 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-10-14T14:09:25.649 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:25.663 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:25.663 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:26.071 INFO:teuthology.orchestra.run.smithi064.stdout:generic/109 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:09:26.081 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/109 2023-10-14T14:09:26.081 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/109 2023-10-14T14:09:26.081 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:26.089 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:26.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:26.115 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-10-14T14:09:26.723 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:26.738 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:26.738 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:27.351 INFO:teuthology.orchestra.run.smithi064.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T14:09:27.364 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/110 2023-10-14T14:09:27.364 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/110 2023-10-14T14:09:27.364 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:27.374 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:27.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:27.406 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-10-14T14:09:28.124 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:28.138 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:28.138 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:28.728 INFO:teuthology.orchestra.run.smithi064.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T14:09:28.745 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/111 2023-10-14T14:09:28.745 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/111 2023-10-14T14:09:28.746 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:09:28.755 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:28.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:09:28.792 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-10-14T14:09:29.491 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:09:29.501 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:09:29.502 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:09:31.902 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:09:31.913 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:10:02.049 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:10:02.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:10:32.205 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:10:32.216 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:11:02.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:11:02.359 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:11:32.497 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:11:32.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:11:35.285 INFO:teuthology.orchestra.run.smithi064.stdout:generic/112 126s 2023-10-14T14:11:35.302 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/112 2023-10-14T14:11:35.302 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:11:35.309 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:11:35.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:11:35.341 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-10-14T14:11:36.076 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:11:36.088 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:11:36.089 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:02.651 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:12:02.660 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:12:02.772 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T14:12:02.772+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97225) UID: 0 2023-10-14T14:12:02.773 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T14:12:02.772+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97225) UID: 0 2023-10-14T14:12:02.773 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T14:12:02.772+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97225) UID: 0 2023-10-14T14:12:02.774 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T14:12:02.772+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97225) UID: 0 2023-10-14T14:12:30.688 INFO:teuthology.orchestra.run.smithi064.stdout:generic/113 54s 2023-10-14T14:12:30.709 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/113 2023-10-14T14:12:30.709 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:30.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:30.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:30.772 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-10-14T14:12:31.517 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:31.532 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:31.532 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:32.113 INFO:teuthology.orchestra.run.smithi064.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-10-14T14:12:32.128 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/114 2023-10-14T14:12:32.128 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/114 2023-10-14T14:12:32.129 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:32.141 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:32.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:32.176 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-10-14T14:12:32.753 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:32.767 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:32.767 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:33.345 INFO:teuthology.orchestra.run.smithi064.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T14:12:33.360 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/115 2023-10-14T14:12:33.361 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/115 2023-10-14T14:12:33.361 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:33.373 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:33.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:33.428 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-10-14T14:12:34.131 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:34.143 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:34.143 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:34.696 INFO:teuthology.orchestra.run.smithi064.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T14:12:34.710 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/116 2023-10-14T14:12:34.710 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/116 2023-10-14T14:12:34.711 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:34.721 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:34.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:34.771 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-10-14T14:12:35.466 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:35.479 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:35.479 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:35.896 INFO:teuthology.orchestra.run.smithi064.stdout:generic/117 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:12:35.911 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/117 2023-10-14T14:12:35.912 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/117 2023-10-14T14:12:35.912 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:35.925 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:35.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:35.960 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-10-14T14:12:36.554 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:36.572 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:36.572 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:37.197 INFO:teuthology.orchestra.run.smithi064.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T14:12:37.211 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/118 2023-10-14T14:12:37.212 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/118 2023-10-14T14:12:37.212 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:37.223 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:37.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:37.269 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-10-14T14:12:37.959 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:37.974 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:37.974 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:38.532 INFO:teuthology.orchestra.run.smithi064.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T14:12:38.543 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/119 2023-10-14T14:12:38.544 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/119 2023-10-14T14:12:38.544 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:38.553 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:38.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:38.590 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-10-14T14:12:39.283 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:39.294 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:39.294 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:39.698 INFO:teuthology.orchestra.run.smithi064.stdout:generic/120 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:12:39.709 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/120 2023-10-14T14:12:39.710 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/120 2023-10-14T14:12:39.710 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:39.718 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:39.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:39.747 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-10-14T14:12:40.332 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:40.347 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:40.347 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:40.953 INFO:teuthology.orchestra.run.smithi064.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T14:12:40.966 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/121 2023-10-14T14:12:40.967 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/121 2023-10-14T14:12:40.967 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:40.976 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:41.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:41.020 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-10-14T14:12:41.726 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:41.739 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:41.740 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:42.297 INFO:teuthology.orchestra.run.smithi064.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T14:12:42.308 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/122 2023-10-14T14:12:42.308 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/122 2023-10-14T14:12:42.308 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:42.316 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:42.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:42.362 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-10-14T14:12:43.037 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:43.049 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:43.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:44.246 INFO:teuthology.orchestra.run.smithi064.stdout:generic/123 1s 2023-10-14T14:12:44.265 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/123 2023-10-14T14:12:44.266 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:44.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:44.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:44.309 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-10-14T14:12:45.026 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:45.038 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:45.038 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:45.475 INFO:teuthology.orchestra.run.smithi064.stdout:generic/124 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:12:45.486 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/124 2023-10-14T14:12:45.486 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/124 2023-10-14T14:12:45.486 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:12:45.494 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:12:45.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:12:45.521 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-10-14T14:12:46.036 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:12:46.047 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:12:46.048 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:13:48.020 INFO:teuthology.orchestra.run.smithi064.stdout:generic/125 61s 2023-10-14T14:13:48.039 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/125 2023-10-14T14:13:48.040 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:13:48.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:13:48.097 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:13:48.098 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-10-14T14:13:48.778 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:13:48.790 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:13:48.790 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:13:50.459 INFO:teuthology.orchestra.run.smithi064.stdout:generic/126 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/126.out.bad) 2023-10-14T14:13:50.465 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/126.out 2023-10-14 12:30:49.966659903 +0000 2023-10-14T14:13:50.466 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/126.out.bad 2023-10-14 14:13:50.455183349 +0000 2023-10-14T14:13:50.466 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,7 +1,7 @@ 2023-10-14T14:13:50.467 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 126 2023-10-14T14:13:50.467 INFO:teuthology.orchestra.run.smithi064.stdout: -x a 001 file owned by (99/99) as user/group(12/100) PASS 2023-10-14T14:13:50.467 INFO:teuthology.orchestra.run.smithi064.stdout: -x a 010 file owned by (99/99) as user/group(200/99) PASS 2023-10-14T14:13:50.468 INFO:teuthology.orchestra.run.smithi064.stdout: -x a 100 file owned by (99/99) as user/group(99/500) PASS 2023-10-14T14:13:50.468 INFO:teuthology.orchestra.run.smithi064.stdout: +x a 001 file owned by (99/99) as user/group(12/100) FAIL 2023-10-14T14:13:50.469 INFO:teuthology.orchestra.run.smithi064.stdout: +x a 010 file owned by (99/99) as user/group(200/99) FAIL 2023-10-14T14:13:50.469 INFO:teuthology.orchestra.run.smithi064.stdout: +x a 100 file owned by (99/99) as user/group(99/500) FAIL 2023-10-14T14:13:50.469 INFO:teuthology.orchestra.run.smithi064.stdout: w a 002 file owned by (99/99) as user/group(12/100) PASS 2023-10-14T14:13:50.470 INFO:teuthology.orchestra.run.smithi064.stdout: w a 020 file owned by (99/99) as user/group(200/99) PASS 2023-10-14T14:13:50.470 INFO:teuthology.orchestra.run.smithi064.stdout: w a 200 file owned by (99/99) as user/group(99/500) PASS 2023-10-14T14:13:50.473 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/126 2023-10-14T14:13:50.474 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/126 2023-10-14T14:13:50.474 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T14:13:50.481 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:13:50.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T14:13:50.507 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T14:13:50.507 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T14:13:50.507 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-10-14T14:13:51.231 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:13:51.246 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:13:51.246 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:14:58.385 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:14:58.396 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:15:28.533 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:15:28.544 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:15:58.676 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:15:58.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:16:28.822 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:16:28.833 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:16:58.961 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:16:58.971 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:17:29.119 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:17:29.130 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:17:59.270 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:17:59.280 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:18:29.399 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:18:29.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:18:59.547 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:18:59.557 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:19:29.751 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:19:29.762 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:19:59.929 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:19:59.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:20:30.074 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:20:30.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:21:00.216 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:21:00.226 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:21:30.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:21:30.380 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:22:00.515 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:22:00.525 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:22:31.081 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:22:31.091 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:23:01.234 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:23:01.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:23:31.382 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:23:31.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:24:01.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:24:01.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:24:01.680 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T14:24:01.679+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97576) UID: 0 2023-10-14T14:24:01.681 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T14:24:01.679+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97576) UID: 0 2023-10-14T14:24:01.681 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T14:24:01.679+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97576) UID: 0 2023-10-14T14:24:01.682 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T14:24:01.679+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 97576) UID: 0 2023-10-14T14:26:58.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:26:58.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:27:28.405 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:27:28.415 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:27:58.536 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:27:58.549 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:28:28.690 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:28:28.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:28:58.837 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:28:58.848 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:29:28.974 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:29:28.983 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:29:59.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:29:59.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:30:29.260 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:30:29.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:30:59.404 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:30:59.414 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:31:29.551 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:31:29.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:31:59.699 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:31:59.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:32:29.835 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:32:29.847 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:33:00.017 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:33:00.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:33:30.456 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:33:30.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:34:00.600 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:34:00.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:34:30.754 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:34:30.764 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:35:01.626 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:35:01.637 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:35:31.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:35:31.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:36:01.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:36:01.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:36:02.032 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T14:36:02.031+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 222748) UID: 0 2023-10-14T14:36:02.032 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T14:36:02.031+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 222748) UID: 0 2023-10-14T14:36:02.033 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T14:36:02.031+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 222748) UID: 0 2023-10-14T14:36:02.033 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T14:36:02.031+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 222748) UID: 0 2023-10-14T14:39:14.643 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:39:14.654 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:39:45.053 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:39:45.064 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:40:15.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:40:15.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:40:45.348 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:40:45.358 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:41:15.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:41:15.518 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:41:45.638 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:41:45.647 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:42:15.785 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:42:15.796 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:42:45.941 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:42:45.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:43:16.095 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:43:16.106 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:43:46.241 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:43:46.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:44:16.385 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:44:16.396 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:44:46.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:44:46.536 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:45:16.673 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:45:16.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:45:46.819 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:45:46.830 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:46:16.974 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:46:16.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:46:47.113 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:46:47.123 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:47:17.276 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:47:17.286 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:47:47.413 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:47:47.425 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:48:17.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:48:17.562 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:48:47.702 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:48:47.712 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:49:18.621 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:49:18.632 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:49:18.762 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T14:49:18.762+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 223143) UID: 0 2023-10-14T14:49:18.763 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T14:49:18.761+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 223143) UID: 0 2023-10-14T14:52:12.423 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:52:12.433 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:52:42.670 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:52:42.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:53:12.819 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:53:12.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:53:42.967 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:53:42.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:54:01.208 INFO:teuthology.orchestra.run.smithi064.stdout:generic/127 2410s 2023-10-14T14:54:01.232 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/127 2023-10-14T14:54:01.232 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:54:01.255 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:01.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:54:01.303 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-10-14T14:54:02.084 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:54:02.101 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:54:02.102 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:02.606 INFO:teuthology.orchestra.run.smithi064.stdout:generic/128 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:54:02.618 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/128 2023-10-14T14:54:02.619 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/128 2023-10-14T14:54:02.619 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:54:02.628 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:02.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:54:02.705 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-10-14T14:54:03.313 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:54:03.327 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:54:03.327 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:03.761 INFO:teuthology.orchestra.run.smithi064.stdout:generic/129 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:54:03.773 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/129 2023-10-14T14:54:03.774 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/129 2023-10-14T14:54:03.774 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:54:03.783 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:03.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:54:03.812 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-10-14T14:54:04.429 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:54:04.442 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:54:04.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:04.887 INFO:teuthology.orchestra.run.smithi064.stdout:generic/130 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:54:04.900 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/130 2023-10-14T14:54:04.900 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/130 2023-10-14T14:54:04.900 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:54:04.910 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:04.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:54:04.943 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-10-14T14:54:05.545 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:54:05.560 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:54:05.561 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:07.567 INFO:teuthology.orchestra.run.smithi064.stdout:generic/131 2s 2023-10-14T14:54:07.586 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/131 2023-10-14T14:54:07.587 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:54:07.596 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:07.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:54:07.627 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-10-14T14:54:08.361 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:54:08.373 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:54:08.374 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:08.792 INFO:teuthology.orchestra.run.smithi064.stdout:generic/132 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T14:54:08.804 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/132 2023-10-14T14:54:08.804 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/132 2023-10-14T14:54:08.804 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T14:54:08.814 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:08.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T14:54:08.846 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-10-14T14:54:09.454 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T14:54:09.466 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T14:54:09.467 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T14:54:13.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:54:13.122 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:54:43.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:54:43.278 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:55:13.419 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:55:13.429 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:55:43.576 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:55:43.586 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:56:13.775 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:56:13.789 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:56:43.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:56:43.940 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:57:14.078 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:57:14.088 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:57:44.226 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:57:44.236 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:58:14.368 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:58:14.377 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:58:44.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:58:44.573 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:59:14.829 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:59:14.838 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:59:44.977 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T14:59:44.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:00:15.112 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:00:15.123 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:00:45.264 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:00:45.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:01:15.429 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:01:15.439 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:01:45.579 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:01:45.590 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:02:15.737 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:02:15.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:02:46.080 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:02:46.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:03:16.231 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:03:16.242 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:03:46.379 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:03:46.392 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:04:16.534 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:04:16.544 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:04:46.691 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:04:46.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:05:08.687 INFO:teuthology.orchestra.run.smithi064.stdout:generic/133 659s 2023-10-14T15:05:08.712 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/133 2023-10-14T15:05:08.712 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:08.725 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:08.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:08.786 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-10-14T15:05:09.545 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:09.556 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:09.556 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:10.175 INFO:teuthology.orchestra.run.smithi064.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:10.187 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/134 2023-10-14T15:05:10.187 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/134 2023-10-14T15:05:10.187 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:10.196 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:10.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:10.239 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-10-14T15:05:10.947 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:10.958 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:10.959 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:11.485 INFO:teuthology.orchestra.run.smithi064.stdout:generic/135 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:11.498 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/135 2023-10-14T15:05:11.498 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/135 2023-10-14T15:05:11.498 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:11.509 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:11.540 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:11.541 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-10-14T15:05:12.094 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:12.106 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:12.106 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:12.688 INFO:teuthology.orchestra.run.smithi064.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:12.702 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/136 2023-10-14T15:05:12.702 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/136 2023-10-14T15:05:12.703 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:12.714 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:12.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:12.758 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-10-14T15:05:13.457 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:13.470 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:13.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:14.009 INFO:teuthology.orchestra.run.smithi064.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:14.021 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/137 2023-10-14T15:05:14.021 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/137 2023-10-14T15:05:14.021 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:14.030 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:14.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:14.077 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-10-14T15:05:14.769 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:14.781 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:14.781 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:15.319 INFO:teuthology.orchestra.run.smithi064.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:15.332 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/138 2023-10-14T15:05:15.332 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/138 2023-10-14T15:05:15.332 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:15.342 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:15.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:15.388 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-10-14T15:05:16.070 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:16.081 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:16.082 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:16.677 INFO:teuthology.orchestra.run.smithi064.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:16.689 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/139 2023-10-14T15:05:16.689 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/139 2023-10-14T15:05:16.689 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:16.699 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:16.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:16.752 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-10-14T15:05:16.836 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:05:16.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:05:17.453 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:17.464 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:17.465 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:18.014 INFO:teuthology.orchestra.run.smithi064.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:18.029 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/140 2023-10-14T15:05:18.029 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/140 2023-10-14T15:05:18.030 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:18.042 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:18.087 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:18.087 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-10-14T15:05:18.786 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:18.798 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:18.798 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:19.220 INFO:teuthology.orchestra.run.smithi064.stdout:generic/141 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:19.232 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/141 2023-10-14T15:05:19.232 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/141 2023-10-14T15:05:19.232 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:19.241 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:19.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:19.271 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-10-14T15:05:19.843 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:19.856 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:19.857 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:20.435 INFO:teuthology.orchestra.run.smithi064.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/142 2023-10-14T15:05:20.449 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/142 2023-10-14T15:05:20.450 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:20.461 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:20.511 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:20.512 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-10-14T15:05:21.220 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:21.233 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:21.233 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:21.805 INFO:teuthology.orchestra.run.smithi064.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:21.818 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/143 2023-10-14T15:05:21.818 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/143 2023-10-14T15:05:21.818 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:21.828 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:21.868 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:21.869 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-10-14T15:05:22.565 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:22.578 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:22.578 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:23.130 INFO:teuthology.orchestra.run.smithi064.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:23.142 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/144 2023-10-14T15:05:23.143 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/144 2023-10-14T15:05:23.143 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:23.152 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:23.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:23.193 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-10-14T15:05:23.884 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:23.896 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:23.896 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:24.455 INFO:teuthology.orchestra.run.smithi064.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:24.470 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/145 2023-10-14T15:05:24.471 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/145 2023-10-14T15:05:24.471 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:24.483 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:24.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:24.535 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-10-14T15:05:25.225 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:25.238 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:25.238 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:25.774 INFO:teuthology.orchestra.run.smithi064.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:25.786 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/146 2023-10-14T15:05:25.786 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/146 2023-10-14T15:05:25.787 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:25.796 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:25.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:25.840 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-10-14T15:05:26.529 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:26.543 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:26.544 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:27.125 INFO:teuthology.orchestra.run.smithi064.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:27.137 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/147 2023-10-14T15:05:27.138 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/147 2023-10-14T15:05:27.138 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:27.148 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:27.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:27.189 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-10-14T15:05:27.871 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:27.883 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:27.883 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:28.413 INFO:teuthology.orchestra.run.smithi064.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:28.426 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/148 2023-10-14T15:05:28.427 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/148 2023-10-14T15:05:28.427 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:28.438 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:28.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:28.480 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-10-14T15:05:29.182 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:29.193 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:29.193 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:29.740 INFO:teuthology.orchestra.run.smithi064.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:29.756 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/149 2023-10-14T15:05:29.757 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/149 2023-10-14T15:05:29.757 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:29.770 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:29.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:29.818 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-10-14T15:05:30.522 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:30.533 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:30.534 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:31.120 INFO:teuthology.orchestra.run.smithi064.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:31.131 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/150 2023-10-14T15:05:31.132 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/150 2023-10-14T15:05:31.132 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:31.140 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:31.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:31.189 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-10-14T15:05:31.866 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:31.878 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:31.878 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:32.418 INFO:teuthology.orchestra.run.smithi064.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:32.433 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/151 2023-10-14T15:05:32.434 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/151 2023-10-14T15:05:32.434 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:32.446 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:32.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:32.498 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-10-14T15:05:33.201 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:33.213 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:33.213 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:33.744 INFO:teuthology.orchestra.run.smithi064.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:33.759 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/152 2023-10-14T15:05:33.759 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/152 2023-10-14T15:05:33.760 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:33.772 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:33.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:33.820 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-10-14T15:05:34.536 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:34.548 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:34.548 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:35.112 INFO:teuthology.orchestra.run.smithi064.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:35.128 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/153 2023-10-14T15:05:35.129 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/153 2023-10-14T15:05:35.129 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:35.142 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:35.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:35.193 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-10-14T15:05:35.868 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:35.879 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:35.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:36.586 INFO:teuthology.orchestra.run.smithi064.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:36.597 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/154 2023-10-14T15:05:36.597 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/154 2023-10-14T15:05:36.597 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:36.606 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:36.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:36.644 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-10-14T15:05:37.338 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:37.350 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:37.351 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:37.888 INFO:teuthology.orchestra.run.smithi064.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:37.900 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/155 2023-10-14T15:05:37.900 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/155 2023-10-14T15:05:37.901 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:37.909 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:37.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:37.958 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-10-14T15:05:38.659 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:38.672 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:38.673 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:39.233 INFO:teuthology.orchestra.run.smithi064.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:39.248 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/156 2023-10-14T15:05:39.249 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/156 2023-10-14T15:05:39.249 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:39.261 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:39.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:39.319 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-10-14T15:05:40.004 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:40.015 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:40.016 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:40.592 INFO:teuthology.orchestra.run.smithi064.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:40.606 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/157 2023-10-14T15:05:40.606 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/157 2023-10-14T15:05:40.606 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:40.615 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:40.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:40.655 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-10-14T15:05:41.344 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:41.356 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:41.356 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:41.934 INFO:teuthology.orchestra.run.smithi064.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T15:05:41.946 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/158 2023-10-14T15:05:41.947 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/158 2023-10-14T15:05:41.947 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:41.957 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:42.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:42.005 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-10-14T15:05:42.703 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:42.714 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:42.714 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:43.206 INFO:teuthology.orchestra.run.smithi064.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-10-14T15:05:43.219 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/159 2023-10-14T15:05:43.219 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/159 2023-10-14T15:05:43.219 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:43.229 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:43.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:43.262 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-10-14T15:05:43.786 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:43.799 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:43.800 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:44.296 INFO:teuthology.orchestra.run.smithi064.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-10-14T15:05:44.306 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/160 2023-10-14T15:05:44.307 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/160 2023-10-14T15:05:44.307 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:44.314 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:44.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:44.340 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-10-14T15:05:44.916 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:44.931 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:44.931 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:45.399 INFO:teuthology.orchestra.run.smithi064.stdout:generic/161 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:45.411 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/161 2023-10-14T15:05:45.411 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/161 2023-10-14T15:05:45.412 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:45.420 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:45.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:45.452 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-10-14T15:05:46.029 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:46.042 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:46.043 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:46.486 INFO:teuthology.orchestra.run.smithi064.stdout:generic/162 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:46.500 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/162 2023-10-14T15:05:46.500 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/162 2023-10-14T15:05:46.500 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:46.511 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:46.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:46.542 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-10-14T15:05:47.049 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:05:47.056 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:05:47.144 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:47.156 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:47.156 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:47.566 INFO:teuthology.orchestra.run.smithi064.stdout:generic/163 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:47.579 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/163 2023-10-14T15:05:47.579 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/163 2023-10-14T15:05:47.580 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:47.589 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:47.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:47.622 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-10-14T15:05:48.258 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:48.274 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:48.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:48.736 INFO:teuthology.orchestra.run.smithi064.stdout:generic/164 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:48.748 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/164 2023-10-14T15:05:48.749 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/164 2023-10-14T15:05:48.749 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:48.760 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:48.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:48.795 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-10-14T15:05:49.384 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:49.396 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:49.396 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:49.819 INFO:teuthology.orchestra.run.smithi064.stdout:generic/165 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:49.830 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/165 2023-10-14T15:05:49.830 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/165 2023-10-14T15:05:49.831 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:49.839 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:49.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:49.871 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-10-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:50.472 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:50.472 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:50.931 INFO:teuthology.orchestra.run.smithi064.stdout:generic/166 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:50.941 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/166 2023-10-14T15:05:50.942 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/166 2023-10-14T15:05:50.942 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:50.950 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:50.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:50.980 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-10-14T15:05:51.537 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:51.551 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:51.552 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:52.002 INFO:teuthology.orchestra.run.smithi064.stdout:generic/167 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:52.015 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/167 2023-10-14T15:05:52.016 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/167 2023-10-14T15:05:52.016 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:52.027 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:52.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:52.062 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-10-14T15:05:52.662 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:52.676 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:52.676 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:53.137 INFO:teuthology.orchestra.run.smithi064.stdout:generic/168 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:53.152 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/168 2023-10-14T15:05:53.153 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/168 2023-10-14T15:05:53.153 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:53.166 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:53.202 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:53.202 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-10-14T15:05:53.760 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:53.773 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:53.774 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:54.190 INFO:teuthology.orchestra.run.smithi064.stdout:generic/169 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:54.201 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/169 2023-10-14T15:05:54.202 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/169 2023-10-14T15:05:54.202 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:54.210 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:54.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:54.244 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-10-14T15:05:54.821 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:54.833 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:54.834 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:55.304 INFO:teuthology.orchestra.run.smithi064.stdout:generic/170 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:55.317 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/170 2023-10-14T15:05:55.317 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/170 2023-10-14T15:05:55.318 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:55.327 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:55.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:55.361 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-10-14T15:05:55.940 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:55.953 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:55.953 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:56.397 INFO:teuthology.orchestra.run.smithi064.stdout:generic/171 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:56.410 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/171 2023-10-14T15:05:56.410 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/171 2023-10-14T15:05:56.411 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:56.421 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:56.454 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:56.455 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-10-14T15:05:57.020 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:57.033 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:57.034 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:57.502 INFO:teuthology.orchestra.run.smithi064.stdout:generic/172 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:57.517 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/172 2023-10-14T15:05:57.517 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/172 2023-10-14T15:05:57.517 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:57.529 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:57.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:57.563 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-10-14T15:05:58.116 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:58.132 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:58.132 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:58.569 INFO:teuthology.orchestra.run.smithi064.stdout:generic/173 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:58.583 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/173 2023-10-14T15:05:58.583 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/173 2023-10-14T15:05:58.584 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:58.591 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:58.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:58.622 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-10-14T15:05:59.202 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:05:59.215 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:05:59.215 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:59.683 INFO:teuthology.orchestra.run.smithi064.stdout:generic/174 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:05:59.696 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/174 2023-10-14T15:05:59.696 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/174 2023-10-14T15:05:59.696 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:05:59.707 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:05:59.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:05:59.739 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-10-14T15:06:00.315 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:00.330 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:00.330 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:00.752 INFO:teuthology.orchestra.run.smithi064.stdout:generic/175 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:00.767 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/175 2023-10-14T15:06:00.767 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/175 2023-10-14T15:06:00.767 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:00.777 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:00.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:00.811 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-10-14T15:06:01.365 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:01.378 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:01.379 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:01.832 INFO:teuthology.orchestra.run.smithi064.stdout:generic/176 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:01.847 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/176 2023-10-14T15:06:01.847 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/176 2023-10-14T15:06:01.847 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:01.857 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:01.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:01.893 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-10-14T15:06:02.478 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:02.491 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:02.491 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:03.114 INFO:teuthology.orchestra.run.smithi064.stdout:generic/177 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:03.130 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/177 2023-10-14T15:06:03.130 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/177 2023-10-14T15:06:03.131 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:03.143 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:03.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:03.184 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-10-14T15:06:03.765 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:03.779 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:03.780 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:04.351 INFO:teuthology.orchestra.run.smithi064.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:06:04.363 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/178 2023-10-14T15:06:04.363 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/178 2023-10-14T15:06:04.363 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:04.372 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:04.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:04.416 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-10-14T15:06:05.115 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:05.127 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:05.127 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:05.739 INFO:teuthology.orchestra.run.smithi064.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:06:05.755 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/179 2023-10-14T15:06:05.755 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/179 2023-10-14T15:06:05.755 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:05.768 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:05.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:05.835 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-10-14T15:06:06.507 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:06.520 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:06.520 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:07.060 INFO:teuthology.orchestra.run.smithi064.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:06:07.074 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/180 2023-10-14T15:06:07.075 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/180 2023-10-14T15:06:07.075 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:07.088 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:07.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:07.132 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-10-14T15:06:07.829 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:07.842 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:07.842 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:08.508 INFO:teuthology.orchestra.run.smithi064.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:06:08.520 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/181 2023-10-14T15:06:08.520 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/181 2023-10-14T15:06:08.520 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:08.529 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:08.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:08.586 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-10-14T15:06:09.276 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:09.289 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:09.289 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:09.903 INFO:teuthology.orchestra.run.smithi064.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T15:06:09.915 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/182 2023-10-14T15:06:09.915 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/182 2023-10-14T15:06:09.915 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:09.924 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:09.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:09.962 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-10-14T15:06:10.646 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:10.658 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:10.659 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:11.101 INFO:teuthology.orchestra.run.smithi064.stdout:generic/183 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:11.112 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/183 2023-10-14T15:06:11.112 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/183 2023-10-14T15:06:11.113 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:11.121 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:11.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:11.155 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-10-14T15:06:11.749 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:11.763 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:11.763 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:12.315 INFO:teuthology.orchestra.run.smithi064.stdout:generic/184 [failed, exit status 1]- output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/184.out.bad) 2023-10-14T15:06:12.322 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/184.out 2023-10-14 12:30:49.977659687 +0000 2023-10-14T15:06:12.322 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/184.out.bad 2023-10-14 15:06:12.312326619 +0000 2023-10-14T15:06:12.323 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1 +1,2 @@ 2023-10-14T15:06:12.323 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 184 2023-10-14T15:06:12.323 INFO:teuthology.orchestra.run.smithi064.stdout: +/tmp/tmp.fHRpaBS5ywxfstests-dev/tests/generic/184: line 23: /tmp/tmp.LYaLaNSY2Vtest/null: Permission denied 2023-10-14T15:06:12.330 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/184 2023-10-14T15:06:12.330 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/184 2023-10-14T15:06:12.331 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:06:12.340 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:12.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:06:12.371 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:06:12.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:06:12.372 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-10-14T15:06:12.953 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:12.966 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:12.967 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:13.395 INFO:teuthology.orchestra.run.smithi064.stdout:generic/185 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:13.407 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/185 2023-10-14T15:06:13.408 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/185 2023-10-14T15:06:13.408 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:13.416 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:13.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:13.443 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-10-14T15:06:14.003 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:14.016 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:14.017 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:14.481 INFO:teuthology.orchestra.run.smithi064.stdout:generic/186 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:14.494 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/186 2023-10-14T15:06:14.494 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/186 2023-10-14T15:06:14.494 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:14.506 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:14.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:14.538 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-10-14T15:06:15.111 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:15.124 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:15.124 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:15.542 INFO:teuthology.orchestra.run.smithi064.stdout:generic/187 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:15.554 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/187 2023-10-14T15:06:15.555 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/187 2023-10-14T15:06:15.555 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:15.564 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:15.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:15.595 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-10-14T15:06:16.165 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:16.179 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:16.179 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:16.640 INFO:teuthology.orchestra.run.smithi064.stdout:generic/188 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:16.655 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/188 2023-10-14T15:06:16.656 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/188 2023-10-14T15:06:16.656 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:16.668 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:16.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:16.701 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-10-14T15:06:17.187 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:06:17.193 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:06:17.292 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:17.306 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:17.306 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:17.729 INFO:teuthology.orchestra.run.smithi064.stdout:generic/189 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:17.742 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/189 2023-10-14T15:06:17.742 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/189 2023-10-14T15:06:17.743 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:17.753 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:17.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:17.792 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-10-14T15:06:18.429 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:18.442 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:18.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:18.876 INFO:teuthology.orchestra.run.smithi064.stdout:generic/190 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:18.889 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/190 2023-10-14T15:06:18.889 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/190 2023-10-14T15:06:18.889 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:18.900 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:18.932 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:18.933 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-10-14T15:06:19.536 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:19.551 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:19.552 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:20.029 INFO:teuthology.orchestra.run.smithi064.stdout:generic/191 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:20.042 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/191 2023-10-14T15:06:20.042 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/191 2023-10-14T15:06:20.043 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:20.054 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:20.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:20.093 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-10-14T15:06:20.673 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:20.686 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:20.687 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:21.158 INFO:teuthology.orchestra.run.smithi064.stdout:generic/192 [not run] atime not maintained by ceph-fuse 2023-10-14T15:06:21.168 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/192 2023-10-14T15:06:21.168 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/192 2023-10-14T15:06:21.169 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:21.176 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:21.204 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:21.205 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-10-14T15:06:21.786 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:21.802 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:21.802 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:24.388 INFO:teuthology.orchestra.run.smithi064.stdout:generic/193 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/193.out.bad) 2023-10-14T15:06:24.396 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/193.out 2023-10-14 12:30:49.978659668 +0000 2023-10-14T15:06:24.396 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/193.out.bad 2023-10-14 15:06:24.385086716 +0000 2023-10-14T15:06:24.397 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -24,7 +24,6 @@ 2023-10-14T15:06:24.397 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:24.397 INFO:teuthology.orchestra.run.smithi064.stdout: user: chmod a+r on qa_user owned file (should succeed) 2023-10-14T15:06:24.397 INFO:teuthology.orchestra.run.smithi064.stdout: user: chmod a+r on root owned file (should fail) 2023-10-14T15:06:24.397 INFO:teuthology.orchestra.run.smithi064.stdout: -chmod: changing permissions of 'test.root': Operation not permitted 2023-10-14T15:06:24.398 INFO:teuthology.orchestra.run.smithi064.stdout: check that the sgid bit is cleared 2023-10-14T15:06:24.398 INFO:teuthology.orchestra.run.smithi064.stdout: -rw-rw-rw- 2023-10-14T15:06:24.398 INFO:teuthology.orchestra.run.smithi064.stdout: check that suid bit is not cleared 2023-10-14T15:06:24.404 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/193 2023-10-14T15:06:24.405 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/193 2023-10-14T15:06:24.405 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:06:24.413 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:24.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:06:24.451 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:06:24.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:06:24.452 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-10-14T15:06:25.153 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:25.167 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:25.167 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:25.553 INFO:teuthology.orchestra.run.smithi064.stdout:generic/194 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:25.566 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/194 2023-10-14T15:06:25.566 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/194 2023-10-14T15:06:25.566 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:25.576 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:25.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:25.607 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-10-14T15:06:26.223 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:26.239 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:26.239 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:26.686 INFO:teuthology.orchestra.run.smithi064.stdout:generic/195 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:26.698 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/195 2023-10-14T15:06:26.698 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/195 2023-10-14T15:06:26.699 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:26.707 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:26.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:26.740 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-10-14T15:06:27.310 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:27.324 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:27.324 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:27.806 INFO:teuthology.orchestra.run.smithi064.stdout:generic/196 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:27.817 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/196 2023-10-14T15:06:27.818 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/196 2023-10-14T15:06:27.818 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:27.827 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:27.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:27.856 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-10-14T15:06:28.452 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:28.466 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:28.467 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:28.923 INFO:teuthology.orchestra.run.smithi064.stdout:generic/197 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:28.933 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/197 2023-10-14T15:06:28.934 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/197 2023-10-14T15:06:28.934 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:28.942 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:28.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:28.974 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-10-14T15:06:29.533 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:29.546 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:29.548 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:31.881 INFO:teuthology.orchestra.run.smithi064.stdout:generic/198 2s 2023-10-14T15:06:31.901 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/198 2023-10-14T15:06:31.902 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:31.913 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:31.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:31.946 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-10-14T15:06:32.705 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:32.717 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:32.717 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:33.120 INFO:teuthology.orchestra.run.smithi064.stdout:generic/199 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:33.131 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/199 2023-10-14T15:06:33.132 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/199 2023-10-14T15:06:33.132 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:33.140 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:33.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:33.169 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-10-14T15:06:33.751 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:33.765 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:33.765 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:34.165 INFO:teuthology.orchestra.run.smithi064.stdout:generic/200 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:34.175 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/200 2023-10-14T15:06:34.175 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/200 2023-10-14T15:06:34.176 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:34.183 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:34.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:34.208 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-10-14T15:06:34.770 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:34.785 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:34.785 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:35.196 INFO:teuthology.orchestra.run.smithi064.stdout:generic/201 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:35.208 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/201 2023-10-14T15:06:35.209 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/201 2023-10-14T15:06:35.209 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:35.219 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:35.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:35.254 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-10-14T15:06:35.877 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:35.891 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:35.891 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:36.310 INFO:teuthology.orchestra.run.smithi064.stdout:generic/202 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:36.324 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/202 2023-10-14T15:06:36.324 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/202 2023-10-14T15:06:36.324 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:36.337 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:36.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:36.376 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-10-14T15:06:36.957 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:36.973 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:36.973 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:37.443 INFO:teuthology.orchestra.run.smithi064.stdout:generic/203 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:37.456 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/203 2023-10-14T15:06:37.456 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/203 2023-10-14T15:06:37.456 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:37.466 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:37.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:37.497 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-10-14T15:06:38.068 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:38.081 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:38.082 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:38.968 INFO:teuthology.orchestra.run.smithi064.stdout:generic/204 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:38.984 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/204 2023-10-14T15:06:38.984 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/204 2023-10-14T15:06:38.984 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:38.997 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:39.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:39.037 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-10-14T15:06:39.651 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:39.666 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:39.666 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:40.077 INFO:teuthology.orchestra.run.smithi064.stdout:generic/205 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:40.088 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/205 2023-10-14T15:06:40.089 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/205 2023-10-14T15:06:40.089 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:40.098 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:40.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:40.129 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-10-14T15:06:40.684 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:40.699 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:40.699 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:41.153 INFO:teuthology.orchestra.run.smithi064.stdout:generic/206 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:06:41.168 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/206 2023-10-14T15:06:41.168 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/206 2023-10-14T15:06:41.169 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:06:41.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:41.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:06:41.217 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-10-14T15:06:41.802 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:06:41.816 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:06:41.817 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:06:47.330 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:06:47.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:07:17.498 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:07:17.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:07:30.070 INFO:teuthology.orchestra.run.smithi064.stdout:generic/207 49s 2023-10-14T15:07:30.089 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/207 2023-10-14T15:07:30.090 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:07:30.098 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:07:30.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:07:30.143 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-10-14T15:07:30.830 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:07:30.843 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:07:30.844 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:07:47.691 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:07:47.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:08:17.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:08:17.834 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:08:47.978 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:08:47.988 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:09:18.120 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:09:18.131 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:09:48.262 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:09:48.272 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:10:18.403 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:10:18.413 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:10:48.573 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:10:48.582 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:10:51.509 INFO:teuthology.orchestra.run.smithi064.stdout:generic/208 201s 2023-10-14T15:10:51.525 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/208 2023-10-14T15:10:51.525 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:10:51.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:10:51.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:10:51.588 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-10-14T15:10:52.286 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:10:52.297 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:10:52.297 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:17.963 INFO:teuthology.orchestra.run.smithi064.stdout:generic/209 [failed, exit status 1]- output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/209.out.bad) 2023-10-14T15:11:17.980 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/209.out 2023-10-14 12:30:49.981659609 +0000 2023-10-14T15:11:17.981 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/209.out.bad 2023-10-14 15:11:17.947190894 +0000 2023-10-14T15:11:17.981 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,2 +1,2 @@ 2023-10-14T15:11:17.981 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 209 2023-10-14T15:11:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: -test ran for 30 seconds without error 2023-10-14T15:11:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: +reader found old byte at pos 4096 2023-10-14T15:11:17.982 INFO:teuthology.orchestra.run.smithi064.stdout: \ No newline at end of file 2023-10-14T15:11:18.006 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/209 2023-10-14T15:11:18.006 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/209 2023-10-14T15:11:18.006 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:11:18.018 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:18.070 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:11:18.071 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:11:18.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:11:18.072 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-10-14T15:11:18.635 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:18.648 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:18.648 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:19.080 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:11:19.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:11:19.253 INFO:teuthology.orchestra.run.smithi064.stdout:generic/210 1s 2023-10-14T15:11:19.268 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/210 2023-10-14T15:11:19.269 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:19.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:19.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:19.316 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-10-14T15:11:20.064 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:20.075 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:20.075 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:21.046 INFO:teuthology.orchestra.run.smithi064.stdout:generic/211 1s 2023-10-14T15:11:21.062 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/211 2023-10-14T15:11:21.062 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:21.069 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:21.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:21.103 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-10-14T15:11:21.702 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:21.717 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:21.717 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:22.355 INFO:teuthology.orchestra.run.smithi064.stdout:generic/212 1s 2023-10-14T15:11:22.374 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/212 2023-10-14T15:11:22.375 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:22.383 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:22.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:22.417 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-10-14T15:11:22.980 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:22.992 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:22.992 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:23.828 INFO:teuthology.orchestra.run.smithi064.stdout:generic/213 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/213.out.bad) 2023-10-14T15:11:23.834 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/213.out 2023-10-14 12:30:49.982659590 +0000 2023-10-14T15:11:23.835 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/213.out.bad 2023-10-14 15:11:23.826073040 +0000 2023-10-14T15:11:23.835 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,4 +1,3 @@ 2023-10-14T15:11:23.835 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 213 2023-10-14T15:11:23.835 INFO:teuthology.orchestra.run.smithi064.stdout: We should get: fallocate: No space left on device 2023-10-14T15:11:23.835 INFO:teuthology.orchestra.run.smithi064.stdout: Strangely, xfs_io sometimes says "Success" when something went wrong, FYI 2023-10-14T15:11:23.836 INFO:teuthology.orchestra.run.smithi064.stdout: -fallocate: No space left on device 2023-10-14T15:11:23.841 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/213 2023-10-14T15:11:23.841 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/213 2023-10-14T15:11:23.841 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:11:23.848 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:23.908 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:11:23.909 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:11:23.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:11:23.910 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-10-14T15:11:24.561 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:24.573 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:24.574 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:25.574 INFO:teuthology.orchestra.run.smithi064.stdout:generic/214 1s 2023-10-14T15:11:25.596 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/214 2023-10-14T15:11:25.596 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:25.604 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:25.642 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:25.643 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-10-14T15:11:26.468 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:26.481 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:26.482 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:30.526 INFO:teuthology.orchestra.run.smithi064.stdout:generic/215 4s 2023-10-14T15:11:30.547 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/215 2023-10-14T15:11:30.548 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:30.556 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:30.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:30.595 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-10-14T15:11:31.219 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:31.237 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:31.237 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:31.648 INFO:teuthology.orchestra.run.smithi064.stdout:generic/216 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:31.661 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/216 2023-10-14T15:11:31.661 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/216 2023-10-14T15:11:31.661 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:31.672 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:31.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:31.702 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-10-14T15:11:32.288 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:32.304 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:32.305 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:32.705 INFO:teuthology.orchestra.run.smithi064.stdout:generic/217 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:32.719 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/217 2023-10-14T15:11:32.720 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/217 2023-10-14T15:11:32.720 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:32.728 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:32.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:32.762 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-10-14T15:11:33.373 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:33.391 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:33.391 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:33.792 INFO:teuthology.orchestra.run.smithi064.stdout:generic/218 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:33.806 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/218 2023-10-14T15:11:33.806 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/218 2023-10-14T15:11:33.806 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:33.816 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:33.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:33.849 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-10-14T15:11:34.446 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:34.462 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:34.463 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:34.863 INFO:teuthology.orchestra.run.smithi064.stdout:generic/219 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/219 2023-10-14T15:11:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/219 2023-10-14T15:11:34.877 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:34.886 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:34.919 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:34.919 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-10-14T15:11:35.529 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:35.544 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:35.544 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:35.937 INFO:teuthology.orchestra.run.smithi064.stdout:generic/220 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:35.950 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/220 2023-10-14T15:11:35.950 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/220 2023-10-14T15:11:35.950 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:35.960 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:35.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:35.996 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-10-14T15:11:36.618 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:36.630 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:36.631 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:38.119 INFO:teuthology.orchestra.run.smithi064.stdout:generic/221 2s 2023-10-14T15:11:38.138 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/221 2023-10-14T15:11:38.138 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:38.144 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:38.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:38.178 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-10-14T15:11:38.777 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:38.790 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:38.790 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:39.182 INFO:teuthology.orchestra.run.smithi064.stdout:generic/222 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:39.192 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/222 2023-10-14T15:11:39.192 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/222 2023-10-14T15:11:39.192 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:39.203 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:39.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:39.236 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-10-14T15:11:39.830 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:39.847 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:39.848 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:40.254 INFO:teuthology.orchestra.run.smithi064.stdout:generic/223 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:40.265 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/223 2023-10-14T15:11:40.266 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/223 2023-10-14T15:11:40.266 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:40.275 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:40.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:40.309 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-10-14T15:11:40.916 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:40.933 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:40.933 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:41.347 INFO:teuthology.orchestra.run.smithi064.stdout:generic/224 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:41.360 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/224 2023-10-14T15:11:41.361 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/224 2023-10-14T15:11:41.361 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:41.368 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:41.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:41.402 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-10-14T15:11:41.991 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:42.004 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:42.004 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:42.405 INFO:teuthology.orchestra.run.smithi064.stdout:generic/225 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/225 2023-10-14T15:11:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/225 2023-10-14T15:11:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:42.426 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:42.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:42.459 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-10-14T15:11:43.082 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:43.097 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:43.098 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:43.519 INFO:teuthology.orchestra.run.smithi064.stdout:generic/226 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:43.531 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/226 2023-10-14T15:11:43.531 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/226 2023-10-14T15:11:43.531 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:43.539 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:43.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:43.574 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-10-14T15:11:44.174 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:44.190 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:44.190 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:44.574 INFO:teuthology.orchestra.run.smithi064.stdout:generic/227 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:44.587 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/227 2023-10-14T15:11:44.587 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/227 2023-10-14T15:11:44.587 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:44.595 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:44.623 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:44.624 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-10-14T15:11:45.206 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:45.221 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:45.221 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:46.007 INFO:teuthology.orchestra.run.smithi064.stdout:generic/228 0s 2023-10-14T15:11:46.033 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/228 2023-10-14T15:11:46.033 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:46.045 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:46.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:46.090 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-10-14T15:11:46.914 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:46.930 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:46.930 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:47.438 INFO:teuthology.orchestra.run.smithi064.stdout:generic/229 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:47.450 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/229 2023-10-14T15:11:47.451 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/229 2023-10-14T15:11:47.451 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:47.460 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:47.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:47.493 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-10-14T15:11:48.045 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:48.062 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:48.063 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:48.553 INFO:teuthology.orchestra.run.smithi064.stdout:generic/230 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:48.564 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/230 2023-10-14T15:11:48.565 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/230 2023-10-14T15:11:48.565 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:48.574 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:48.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:48.607 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-10-14T15:11:49.223 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:11:49.224 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:49.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:11:49.240 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:49.240 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:49.670 INFO:teuthology.orchestra.run.smithi064.stdout:generic/231 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:49.681 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/231 2023-10-14T15:11:49.681 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/231 2023-10-14T15:11:49.681 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:49.692 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:49.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:49.726 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-10-14T15:11:50.338 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:50.354 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:50.354 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:50.767 INFO:teuthology.orchestra.run.smithi064.stdout:generic/232 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:50.779 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/232 2023-10-14T15:11:50.779 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/232 2023-10-14T15:11:50.779 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:50.788 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:50.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:50.819 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-10-14T15:11:51.441 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:51.456 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:51.456 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:51.868 INFO:teuthology.orchestra.run.smithi064.stdout:generic/233 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:51.881 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/233 2023-10-14T15:11:51.882 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/233 2023-10-14T15:11:51.882 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:51.891 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:51.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:51.923 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-10-14T15:11:52.533 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:52.548 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:52.548 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:52.965 INFO:teuthology.orchestra.run.smithi064.stdout:generic/234 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:52.978 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/234 2023-10-14T15:11:52.979 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/234 2023-10-14T15:11:52.979 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:52.988 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:53.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:53.016 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-10-14T15:11:53.618 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:53.634 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:53.634 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:54.040 INFO:teuthology.orchestra.run.smithi064.stdout:generic/235 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:54.052 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/235 2023-10-14T15:11:54.053 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/235 2023-10-14T15:11:54.053 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:54.061 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:54.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:54.094 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-10-14T15:11:54.695 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:54.710 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:54.710 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:56.283 INFO:teuthology.orchestra.run.smithi064.stdout:generic/236 2s 2023-10-14T15:11:56.305 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/236 2023-10-14T15:11:56.306 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:56.317 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:56.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:56.385 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-10-14T15:11:57.173 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:57.188 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:57.188 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:57.689 INFO:teuthology.orchestra.run.smithi064.stdout:generic/237 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T15:11:57.700 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/237 2023-10-14T15:11:57.701 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/237 2023-10-14T15:11:57.701 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:57.708 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:57.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:57.742 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-10-14T15:11:58.379 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:58.396 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:58.396 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:58.791 INFO:teuthology.orchestra.run.smithi064.stdout:generic/238 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:11:58.804 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/238 2023-10-14T15:11:58.804 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/238 2023-10-14T15:11:58.804 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:11:58.814 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:11:58.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:11:58.847 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-10-14T15:11:59.433 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:11:59.444 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:11:59.445 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:12:19.370 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:12:19.380 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:12:49.548 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:12:49.554 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:13:20.688 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:13:20.701 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:13:51.126 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:13:51.135 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:13:51.333 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T15:13:51.332+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99168) UID: 0 2023-10-14T15:13:51.333 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T15:13:51.332+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99168) UID: 0 2023-10-14T15:13:51.334 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T15:13:51.333+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99168) UID: 0 2023-10-14T15:13:51.334 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T15:13:51.332+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99168) UID: 0 2023-10-14T15:14:29.797 INFO:teuthology.orchestra.run.smithi064.stdout:generic/239 150s 2023-10-14T15:14:29.817 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/239 2023-10-14T15:14:29.818 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:14:29.828 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:14:29.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:14:29.871 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-10-14T15:14:30.626 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:14:30.641 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:14:30.641 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:14:34.709 INFO:teuthology.orchestra.run.smithi064.stdout:generic/240 4s 2023-10-14T15:14:35.126 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/240 2023-10-14T15:14:35.127 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:14:35.136 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:14:35.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:14:35.177 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-10-14T15:14:35.978 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:14:35.994 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:14:35.994 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:51.692 INFO:teuthology.orchestra.run.smithi064.stdout:generic/241 75s 2023-10-14T15:15:51.752 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/241 2023-10-14T15:15:51.752 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:15:51.761 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:51.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:15:51.800 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-10-14T15:15:53.848 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:15:53.862 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:15:53.862 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:54.266 INFO:teuthology.orchestra.run.smithi064.stdout:generic/242 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:15:54.277 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/242 2023-10-14T15:15:54.277 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/242 2023-10-14T15:15:54.277 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:15:54.288 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:54.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:15:54.317 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-10-14T15:15:54.907 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:15:54.924 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:15:54.924 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:55.320 INFO:teuthology.orchestra.run.smithi064.stdout:generic/243 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/243 2023-10-14T15:15:55.333 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/243 2023-10-14T15:15:55.334 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:15:55.344 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:55.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:15:55.377 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-10-14T15:15:55.985 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:15:55.998 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:15:55.999 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:56.393 INFO:teuthology.orchestra.run.smithi064.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T15:15:56.408 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/244 2023-10-14T15:15:56.408 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/244 2023-10-14T15:15:56.408 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:15:56.417 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:56.451 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:15:56.452 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-10-14T15:15:57.046 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:15:57.059 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:15:57.059 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:57.676 INFO:teuthology.orchestra.run.smithi064.stdout:generic/245 0s 2023-10-14T15:15:57.693 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/245 2023-10-14T15:15:57.694 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:15:57.702 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:57.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:15:57.726 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-10-14T15:15:58.491 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:15:58.506 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:15:58.506 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:59.014 INFO:teuthology.orchestra.run.smithi064.stdout:generic/246 0s 2023-10-14T15:15:59.036 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/246 2023-10-14T15:15:59.037 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:15:59.046 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:15:59.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:15:59.086 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-10-14T15:16:00.112 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:16:00.129 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:16:00.130 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:16:53.065 INFO:teuthology.orchestra.run.smithi064.stdout:generic/247 53s 2023-10-14T15:16:53.089 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/247 2023-10-14T15:16:53.090 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:16:53.098 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:16:53.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:16:53.127 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-10-14T15:16:53.759 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:16:53.779 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:16:53.779 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:16:54.341 INFO:teuthology.orchestra.run.smithi064.stdout:generic/248 1s 2023-10-14T15:16:54.358 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/248 2023-10-14T15:16:54.359 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:16:54.366 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:16:54.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:16:54.403 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-10-14T15:16:55.016 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:16:55.032 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:16:55.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:16:59.613 INFO:teuthology.orchestra.run.smithi064.stdout:generic/249 4s 2023-10-14T15:16:59.635 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/249 2023-10-14T15:16:59.636 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:16:59.647 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:16:59.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:16:59.679 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-10-14T15:17:00.522 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:00.540 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:00.540 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:03.832 INFO:teuthology.orchestra.run.smithi064.stdout:generic/250 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:03.842 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/250 2023-10-14T15:17:03.842 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/250 2023-10-14T15:17:03.842 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:03.852 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:03.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:03.885 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-10-14T15:17:04.486 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:04.504 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:04.505 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:04.948 INFO:teuthology.orchestra.run.smithi064.stdout:generic/251 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:04.960 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/251 2023-10-14T15:17:04.961 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/251 2023-10-14T15:17:04.961 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:04.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:05.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:05.004 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-10-14T15:17:05.639 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:05.655 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:05.656 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:06.103 INFO:teuthology.orchestra.run.smithi064.stdout:generic/252 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:06.112 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/252 2023-10-14T15:17:06.113 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/252 2023-10-14T15:17:06.113 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:06.120 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:06.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:06.150 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-10-14T15:17:06.750 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:06.766 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:06.767 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:07.190 INFO:teuthology.orchestra.run.smithi064.stdout:generic/253 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:07.203 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/253 2023-10-14T15:17:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/253 2023-10-14T15:17:07.204 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:07.214 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:07.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:07.244 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-10-14T15:17:07.864 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:07.881 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:07.882 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:08.261 INFO:teuthology.orchestra.run.smithi064.stdout:generic/254 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:08.274 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/254 2023-10-14T15:17:08.274 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/254 2023-10-14T15:17:08.275 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:08.283 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:08.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:08.316 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-10-14T15:17:08.932 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:08.947 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:08.947 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:11.666 INFO:teuthology.orchestra.run.smithi064.stdout:generic/255 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T15:17:11.679 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/255 2023-10-14T15:17:11.679 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/255 2023-10-14T15:17:11.679 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:11.690 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:11.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:11.722 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-10-14T15:17:12.525 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:12.543 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:12.543 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:15.213 INFO:teuthology.orchestra.run.smithi064.stdout:generic/256 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:15.228 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/256 2023-10-14T15:17:15.228 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/256 2023-10-14T15:17:15.229 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:15.238 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:15.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:15.266 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-10-14T15:17:15.873 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:15.890 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:15.891 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:18.360 INFO:teuthology.orchestra.run.smithi064.stdout:generic/257 3s 2023-10-14T15:17:18.384 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/257 2023-10-14T15:17:18.385 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:18.395 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:18.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:18.433 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-10-14T15:17:19.292 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:19.310 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:19.311 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:19.844 INFO:teuthology.orchestra.run.smithi064.stdout:generic/258 [failed, exit status 1]- output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/258.out.bad) 2023-10-14T15:17:19.853 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/258.out 2023-10-14 12:30:49.990659433 +0000 2023-10-14T15:17:19.854 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/258.out.bad 2023-10-14 15:17:19.839985947 +0000 2023-10-14T15:17:19.854 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,5 +1,6 @@ 2023-10-14T15:17:19.854 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 258 2023-10-14T15:17:19.854 INFO:teuthology.orchestra.run.smithi064.stdout: Creating file with timestamp of Jan 1, 1960 2023-10-14T15:17:19.854 INFO:teuthology.orchestra.run.smithi064.stdout: Testing for negative seconds since epoch 2023-10-14T15:17:19.855 INFO:teuthology.orchestra.run.smithi064.stdout: -Remounting to flush cache 2023-10-14T15:17:19.855 INFO:teuthology.orchestra.run.smithi064.stdout: -Testing for negative seconds since epoch 2023-10-14T15:17:19.855 INFO:teuthology.orchestra.run.smithi064.stdout: +Timestamp wrapped: 3979351756 2023-10-14T15:17:19.855 INFO:teuthology.orchestra.run.smithi064.stdout: +Timestamp wrapped 2023-10-14T15:17:19.855 INFO:teuthology.orchestra.run.smithi064.stdout: +(see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/258.full for details) 2023-10-14T15:17:19.861 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/258 2023-10-14T15:17:19.862 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/258 2023-10-14T15:17:19.862 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:17:19.870 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:19.899 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:17:19.900 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:17:19.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:17:19.901 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-10-14T15:17:20.524 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:20.536 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:20.537 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:20.952 INFO:teuthology.orchestra.run.smithi064.stdout:generic/259 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:20.965 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/259 2023-10-14T15:17:20.966 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/259 2023-10-14T15:17:20.966 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:20.976 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:21.013 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:21.013 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-10-14T15:17:21.634 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:21.649 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:21.649 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:22.061 INFO:teuthology.orchestra.run.smithi064.stdout:generic/260 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:22.074 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/260 2023-10-14T15:17:22.075 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/260 2023-10-14T15:17:22.076 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:22.084 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:22.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:22.116 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-10-14T15:17:22.547 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:17:22.554 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:17:22.759 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:22.772 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:22.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:23.208 INFO:teuthology.orchestra.run.smithi064.stdout:generic/261 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:23.223 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/261 2023-10-14T15:17:23.224 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/261 2023-10-14T15:17:23.224 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:23.232 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:23.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:23.263 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-10-14T15:17:23.859 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:23.874 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:23.875 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:24.306 INFO:teuthology.orchestra.run.smithi064.stdout:generic/262 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:17:24.319 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/262 2023-10-14T15:17:24.319 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/262 2023-10-14T15:17:24.319 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:17:24.330 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:24.361 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:17:24.362 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-10-14T15:17:24.977 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:17:24.991 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:17:24.991 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:17:53.095 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:17:53.106 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:18:23.252 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:18:23.262 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:18:53.396 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:18:53.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:19:23.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:19:23.538 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:19:35.204 INFO:teuthology.orchestra.run.smithi064.stdout:generic/263 130s 2023-10-14T15:19:35.223 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/263 2023-10-14T15:19:35.224 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:35.235 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:35.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:35.288 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-10-14T15:19:36.002 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:36.014 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:36.014 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:36.442 INFO:teuthology.orchestra.run.smithi064.stdout:generic/264 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:36.456 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/264 2023-10-14T15:19:36.456 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/264 2023-10-14T15:19:36.457 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:36.468 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:36.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:36.500 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-10-14T15:19:37.121 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:37.135 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:37.135 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:37.670 INFO:teuthology.orchestra.run.smithi064.stdout:generic/265 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:37.683 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/265 2023-10-14T15:19:37.683 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/265 2023-10-14T15:19:37.683 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:37.693 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:37.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:37.725 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-10-14T15:19:38.318 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:38.333 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:38.333 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:38.810 INFO:teuthology.orchestra.run.smithi064.stdout:generic/266 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:38.825 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/266 2023-10-14T15:19:38.825 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/266 2023-10-14T15:19:38.825 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:38.838 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:38.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:38.871 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-10-14T15:19:39.455 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:39.470 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:39.471 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:39.956 INFO:teuthology.orchestra.run.smithi064.stdout:generic/267 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:39.968 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/267 2023-10-14T15:19:39.968 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/267 2023-10-14T15:19:39.968 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:39.978 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:40.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:40.008 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-10-14T15:19:40.584 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:40.598 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:40.598 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:41.066 INFO:teuthology.orchestra.run.smithi064.stdout:generic/268 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:41.080 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/268 2023-10-14T15:19:41.080 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/268 2023-10-14T15:19:41.081 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:41.092 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:41.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:41.126 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-10-14T15:19:41.719 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:41.732 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:41.732 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:42.171 INFO:teuthology.orchestra.run.smithi064.stdout:generic/269 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:42.183 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/269 2023-10-14T15:19:42.183 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/269 2023-10-14T15:19:42.184 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:42.192 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:42.223 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:42.224 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-10-14T15:19:42.802 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:42.815 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:42.815 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:43.245 INFO:teuthology.orchestra.run.smithi064.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T15:19:43.256 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/270 2023-10-14T15:19:43.256 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/270 2023-10-14T15:19:43.256 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:43.265 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:43.292 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:43.293 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-10-14T15:19:43.896 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:43.910 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:43.910 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:44.382 INFO:teuthology.orchestra.run.smithi064.stdout:generic/271 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:44.398 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/271 2023-10-14T15:19:44.398 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/271 2023-10-14T15:19:44.399 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:44.411 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:44.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:44.446 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-10-14T15:19:45.013 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:45.026 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:45.027 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:45.539 INFO:teuthology.orchestra.run.smithi064.stdout:generic/272 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:45.552 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/272 2023-10-14T15:19:45.552 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/272 2023-10-14T15:19:45.552 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:45.562 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:45.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:45.595 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-10-14T15:19:46.164 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:46.179 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:46.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:46.633 INFO:teuthology.orchestra.run.smithi064.stdout:generic/273 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:46.645 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/273 2023-10-14T15:19:46.646 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/273 2023-10-14T15:19:46.646 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:46.656 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:46.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:46.685 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-10-14T15:19:47.289 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:47.305 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:47.305 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:47.772 INFO:teuthology.orchestra.run.smithi064.stdout:generic/274 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:47.786 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/274 2023-10-14T15:19:47.786 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/274 2023-10-14T15:19:47.786 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:47.799 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:47.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:47.835 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-10-14T15:19:48.427 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:48.443 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:48.443 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:48.890 INFO:teuthology.orchestra.run.smithi064.stdout:generic/275 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:48.900 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/275 2023-10-14T15:19:48.900 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/275 2023-10-14T15:19:48.900 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:48.909 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:48.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:48.942 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-10-14T15:19:49.511 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:49.524 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:49.524 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:50.030 INFO:teuthology.orchestra.run.smithi064.stdout:generic/276 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:50.043 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/276 2023-10-14T15:19:50.043 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/276 2023-10-14T15:19:50.043 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:50.052 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:50.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:50.084 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-10-14T15:19:50.662 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:50.675 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:50.675 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:51.130 INFO:teuthology.orchestra.run.smithi064.stdout:generic/277 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:51.144 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/277 2023-10-14T15:19:51.145 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/277 2023-10-14T15:19:51.145 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:51.157 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:51.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:51.193 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-10-14T15:19:51.818 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:51.832 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:51.832 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:52.295 INFO:teuthology.orchestra.run.smithi064.stdout:generic/278 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:52.307 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/278 2023-10-14T15:19:52.307 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/278 2023-10-14T15:19:52.307 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:52.317 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:52.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:52.347 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-10-14T15:19:52.906 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:52.919 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:52.919 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:53.373 INFO:teuthology.orchestra.run.smithi064.stdout:generic/279 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:53.385 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/279 2023-10-14T15:19:53.385 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/279 2023-10-14T15:19:53.385 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:53.395 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:53.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:53.432 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-10-14T15:19:53.679 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:19:53.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:19:53.985 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:54.000 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:54.000 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:54.485 INFO:teuthology.orchestra.run.smithi064.stdout:generic/280 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:54.499 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/280 2023-10-14T15:19:54.499 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/280 2023-10-14T15:19:54.499 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:54.510 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:54.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:54.547 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-10-14T15:19:55.137 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:55.151 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:55.152 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:55.655 INFO:teuthology.orchestra.run.smithi064.stdout:generic/281 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:55.666 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/281 2023-10-14T15:19:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/281 2023-10-14T15:19:55.667 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:55.680 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:55.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:55.717 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-10-14T15:19:56.318 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:56.332 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:56.333 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:56.806 INFO:teuthology.orchestra.run.smithi064.stdout:generic/282 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:56.819 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/282 2023-10-14T15:19:56.819 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/282 2023-10-14T15:19:56.820 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:56.829 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:56.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:56.866 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-10-14T15:19:57.457 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:57.469 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:57.469 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:57.973 INFO:teuthology.orchestra.run.smithi064.stdout:generic/283 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:57.984 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/283 2023-10-14T15:19:57.985 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/283 2023-10-14T15:19:57.985 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:57.995 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:58.026 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:58.026 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-10-14T15:19:58.632 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:58.645 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:58.646 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:59.098 INFO:teuthology.orchestra.run.smithi064.stdout:generic/284 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:19:59.110 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/284 2023-10-14T15:19:59.110 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/284 2023-10-14T15:19:59.110 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:19:59.118 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:19:59.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:19:59.151 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-10-14T15:19:59.739 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:19:59.753 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:19:59.754 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:20:05.552 INFO:teuthology.orchestra.run.smithi064.stdout:generic/285 6s 2023-10-14T15:20:05.570 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/285 2023-10-14T15:20:05.570 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:20:05.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:20:05.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:20:05.610 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-10-14T15:20:06.454 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:20:06.471 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:20:06.472 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:20:23.925 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:20:23.938 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:20:54.080 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:20:54.089 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:21:24.235 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:21:24.246 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:21:54.415 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:21:54.427 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:22:24.561 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:22:24.573 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:22:54.707 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:22:54.718 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:22:55.652 INFO:teuthology.orchestra.run.smithi064.stdout:generic/286 169s 2023-10-14T15:22:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/286 2023-10-14T15:22:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:22:55.682 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:22:55.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:22:55.716 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-10-14T15:22:56.549 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:22:56.559 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:22:56.560 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:22:56.985 INFO:teuthology.orchestra.run.smithi064.stdout:generic/287 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:22:56.996 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/287 2023-10-14T15:22:56.996 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/287 2023-10-14T15:22:56.996 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:22:57.005 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:22:57.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:22:57.036 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-10-14T15:22:57.641 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:22:57.655 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:22:57.655 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:22:58.082 INFO:teuthology.orchestra.run.smithi064.stdout:generic/288 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:22:58.093 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/288 2023-10-14T15:22:58.094 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/288 2023-10-14T15:22:58.094 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:22:58.102 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:22:58.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:22:58.131 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-10-14T15:22:58.712 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:22:58.727 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:22:58.727 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:22:59.174 INFO:teuthology.orchestra.run.smithi064.stdout:generic/289 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:22:59.191 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/289 2023-10-14T15:22:59.192 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/289 2023-10-14T15:22:59.192 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:22:59.204 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:22:59.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:22:59.237 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-10-14T15:22:59.820 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:22:59.835 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:22:59.835 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:00.291 INFO:teuthology.orchestra.run.smithi064.stdout:generic/290 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:00.304 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/290 2023-10-14T15:23:00.304 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/290 2023-10-14T15:23:00.304 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:00.314 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:00.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:00.347 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-10-14T15:23:00.959 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:00.972 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:00.972 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:01.414 INFO:teuthology.orchestra.run.smithi064.stdout:generic/291 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:01.424 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/291 2023-10-14T15:23:01.425 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/291 2023-10-14T15:23:01.425 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:01.434 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:01.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:01.463 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-10-14T15:23:02.012 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:02.025 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:02.026 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:02.428 INFO:teuthology.orchestra.run.smithi064.stdout:generic/292 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:02.440 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/292 2023-10-14T15:23:02.440 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/292 2023-10-14T15:23:02.440 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:02.449 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:02.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:02.482 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-10-14T15:23:03.047 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:03.060 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:03.060 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:03.508 INFO:teuthology.orchestra.run.smithi064.stdout:generic/293 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:03.522 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/293 2023-10-14T15:23:03.522 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/293 2023-10-14T15:23:03.522 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:03.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:03.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:03.570 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-10-14T15:23:04.153 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:04.169 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:04.169 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:04.604 INFO:teuthology.orchestra.run.smithi064.stdout:generic/294 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:04.619 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/294 2023-10-14T15:23:04.620 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/294 2023-10-14T15:23:04.620 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:04.632 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:04.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:04.666 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-10-14T15:23:05.261 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:05.278 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:05.278 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:05.751 INFO:teuthology.orchestra.run.smithi064.stdout:generic/295 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:05.764 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/295 2023-10-14T15:23:05.764 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/295 2023-10-14T15:23:05.764 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:05.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:05.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:05.802 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-10-14T15:23:06.388 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:06.402 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:06.402 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:06.844 INFO:teuthology.orchestra.run.smithi064.stdout:generic/296 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:06.856 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/296 2023-10-14T15:23:06.857 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/296 2023-10-14T15:23:06.857 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:06.865 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:06.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:06.894 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-10-14T15:23:07.469 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:07.484 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:07.484 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:07.973 INFO:teuthology.orchestra.run.smithi064.stdout:generic/297 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:07.985 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/297 2023-10-14T15:23:07.985 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/297 2023-10-14T15:23:07.985 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:07.995 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:08.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:08.029 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-10-14T15:23:08.607 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:08.621 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:08.622 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:09.107 INFO:teuthology.orchestra.run.smithi064.stdout:generic/298 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:09.120 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/298 2023-10-14T15:23:09.121 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/298 2023-10-14T15:23:09.121 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:09.131 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:09.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:09.166 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-10-14T15:23:09.741 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:09.754 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:09.754 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:10.199 INFO:teuthology.orchestra.run.smithi064.stdout:generic/299 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:10.210 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/299 2023-10-14T15:23:10.211 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/299 2023-10-14T15:23:10.211 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:10.220 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:10.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:10.252 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-10-14T15:23:10.850 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:10.864 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:10.864 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:11.357 INFO:teuthology.orchestra.run.smithi064.stdout:generic/300 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:11.369 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/300 2023-10-14T15:23:11.369 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/300 2023-10-14T15:23:11.369 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:11.378 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:11.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:11.412 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-10-14T15:23:12.035 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:12.050 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:12.050 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:12.526 INFO:teuthology.orchestra.run.smithi064.stdout:generic/301 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:12.537 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/301 2023-10-14T15:23:12.537 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/301 2023-10-14T15:23:12.537 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:12.549 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:12.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:12.582 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-10-14T15:23:13.147 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:13.159 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:13.160 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:13.577 INFO:teuthology.orchestra.run.smithi064.stdout:generic/302 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:13.588 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/302 2023-10-14T15:23:13.588 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/302 2023-10-14T15:23:13.588 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:13.597 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:13.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:13.633 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-10-14T15:23:14.238 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:14.251 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:14.251 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:14.785 INFO:teuthology.orchestra.run.smithi064.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:23:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/303 2023-10-14T15:23:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/303 2023-10-14T15:23:14.800 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:14.812 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:14.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:14.872 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-10-14T15:23:15.590 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:15.603 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:15.604 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:16.176 INFO:teuthology.orchestra.run.smithi064.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T15:23:16.189 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/304 2023-10-14T15:23:16.189 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/304 2023-10-14T15:23:16.189 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:16.202 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:16.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:16.249 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-10-14T15:23:16.948 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:16.960 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:16.961 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:17.353 INFO:teuthology.orchestra.run.smithi064.stdout:generic/305 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:17.363 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/305 2023-10-14T15:23:17.364 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/305 2023-10-14T15:23:17.364 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:17.371 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:17.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:17.400 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-10-14T15:23:17.956 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:17.969 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:17.970 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:18.578 INFO:teuthology.orchestra.run.smithi064.stdout:generic/306 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:18.590 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/306 2023-10-14T15:23:18.591 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/306 2023-10-14T15:23:18.591 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:18.600 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:18.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:18.630 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-10-14T15:23:19.224 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:19.238 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:19.238 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:19.696 INFO:teuthology.orchestra.run.smithi064.stdout:generic/307 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:23:19.708 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/307 2023-10-14T15:23:19.709 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/307 2023-10-14T15:23:19.709 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:19.719 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:19.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:19.751 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-10-14T15:23:20.364 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:20.376 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:20.377 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:20.958 INFO:teuthology.orchestra.run.smithi064.stdout:generic/308 0s 2023-10-14T15:23:20.975 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/308 2023-10-14T15:23:20.975 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:20.982 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:21.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:21.011 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-10-14T15:23:21.610 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:21.625 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:21.625 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:23.208 INFO:teuthology.orchestra.run.smithi064.stdout:generic/309 2s 2023-10-14T15:23:23.225 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/309 2023-10-14T15:23:23.225 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:23:23.234 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:23.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:23:23.272 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-10-14T15:23:23.960 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:23:23.974 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:23:23.974 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:23:24.956 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:23:24.962 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:23:55.100 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:23:55.114 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:24:25.246 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:24:25.253 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:24:55.393 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:24:55.404 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:25:15.841 INFO:teuthology.orchestra.run.smithi064.stdout:generic/310 112s 2023-10-14T15:25:15.854 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/310 2023-10-14T15:25:15.854 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:15.861 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:15.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:15.911 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-10-14T15:25:16.867 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:16.877 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:16.878 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:17.286 INFO:teuthology.orchestra.run.smithi064.stdout:generic/311 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:25:17.300 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/311 2023-10-14T15:25:17.300 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/311 2023-10-14T15:25:17.300 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:17.312 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:17.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:17.347 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-10-14T15:25:17.906 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:17.921 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:17.921 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:18.430 INFO:teuthology.orchestra.run.smithi064.stdout:generic/312 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:25:18.442 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/312 2023-10-14T15:25:18.442 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/312 2023-10-14T15:25:18.443 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:18.453 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:18.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:18.483 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-10-14T15:25:19.056 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:19.068 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:19.069 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:23.674 INFO:teuthology.orchestra.run.smithi064.stdout:generic/313 4s 2023-10-14T15:25:23.694 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/313 2023-10-14T15:25:23.695 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:23.704 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:23.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:23.737 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-10-14T15:25:24.316 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:24.330 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:24.330 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:25.603 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:25:25.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:25:25.717 INFO:teuthology.orchestra.run.smithi064.stdout:generic/314 1s 2023-10-14T15:25:25.732 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/314 2023-10-14T15:25:25.732 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:25.740 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:25.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:25.768 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-10-14T15:25:26.324 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:26.335 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:26.336 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:29.978 INFO:teuthology.orchestra.run.smithi064.stdout:generic/315 3s 2023-10-14T15:25:29.994 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/315 2023-10-14T15:25:29.995 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:30.002 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:30.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:30.028 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-10-14T15:25:30.775 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:30.786 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:30.786 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:35.061 INFO:teuthology.orchestra.run.smithi064.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T15:25:35.075 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/316 2023-10-14T15:25:35.076 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/316 2023-10-14T15:25:35.076 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:35.088 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:35.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:35.138 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-10-14T15:25:35.860 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:35.871 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:35.871 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:36.249 INFO:teuthology.orchestra.run.smithi064.stdout:generic/317 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:25:36.261 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/317 2023-10-14T15:25:36.261 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/317 2023-10-14T15:25:36.261 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:36.269 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:36.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:36.297 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-10-14T15:25:36.850 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:36.864 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:36.864 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:37.300 INFO:teuthology.orchestra.run.smithi064.stdout:generic/318 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:25:37.310 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/318 2023-10-14T15:25:37.311 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/318 2023-10-14T15:25:37.311 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:37.319 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:37.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:37.347 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-10-14T15:25:37.926 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:37.941 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:37.941 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:38.427 INFO:teuthology.orchestra.run.smithi064.stdout:generic/319 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T15:25:38.439 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/319 2023-10-14T15:25:38.439 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/319 2023-10-14T15:25:38.439 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:38.447 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:38.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:38.482 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-10-14T15:25:39.088 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:39.102 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:39.102 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:39.547 INFO:teuthology.orchestra.run.smithi064.stdout:generic/320 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:25:39.559 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/320 2023-10-14T15:25:39.559 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/320 2023-10-14T15:25:39.559 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:39.569 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:39.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:39.600 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-10-14T15:25:40.167 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:40.180 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:40.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:40.694 INFO:teuthology.orchestra.run.smithi064.stdout:generic/321 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:25:40.709 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/321 2023-10-14T15:25:40.709 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/321 2023-10-14T15:25:40.709 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:40.722 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:40.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:40.756 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-10-14T15:25:41.325 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:41.337 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:41.338 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:41.781 INFO:teuthology.orchestra.run.smithi064.stdout:generic/322 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:25:41.791 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/322 2023-10-14T15:25:41.792 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/322 2023-10-14T15:25:41.792 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:25:41.801 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:41.828 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:25:41.828 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-10-14T15:25:42.399 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:25:42.417 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:25:42.417 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:25:55.785 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:25:55.792 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:26:25.973 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:26:25.980 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:26:56.187 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:26:56.193 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:27:27.158 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:27:27.165 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:27:27.294 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T15:27:27.294+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347956) UID: 0 2023-10-14T15:27:27.295 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T15:27:27.294+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347956) UID: 0 2023-10-14T15:27:27.295 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T15:27:27.294+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347956) UID: 0 2023-10-14T15:27:27.295 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T15:27:27.294+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 347956) UID: 0 2023-10-14T15:27:45.020 INFO:teuthology.orchestra.run.smithi064.stdout:generic/323 122s 2023-10-14T15:27:45.035 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/323 2023-10-14T15:27:45.035 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:45.042 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:45.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:45.084 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-10-14T15:27:45.812 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:45.824 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:45.824 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:46.272 INFO:teuthology.orchestra.run.smithi064.stdout:generic/324 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:27:46.284 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/324 2023-10-14T15:27:46.284 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/324 2023-10-14T15:27:46.284 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:46.292 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:46.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:46.320 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-10-14T15:27:46.844 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:46.855 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:46.856 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:50.021 INFO:teuthology.orchestra.run.smithi064.stdout:generic/325 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:27:50.036 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/325 2023-10-14T15:27:50.037 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/325 2023-10-14T15:27:50.037 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:50.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:50.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:50.081 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-10-14T15:27:50.605 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:50.618 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:50.619 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:51.113 INFO:teuthology.orchestra.run.smithi064.stdout:generic/326 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:27:51.125 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/326 2023-10-14T15:27:51.126 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/326 2023-10-14T15:27:51.126 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:51.135 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:51.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:51.169 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-10-14T15:27:52.174 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:52.186 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:52.186 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:54.214 INFO:teuthology.orchestra.run.smithi064.stdout:generic/327 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:27:54.227 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/327 2023-10-14T15:27:54.228 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/327 2023-10-14T15:27:54.228 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:54.240 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:54.273 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:54.274 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-10-14T15:27:55.125 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:55.138 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:55.138 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:57.280 INFO:teuthology.orchestra.run.smithi064.stdout:generic/328 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:27:57.294 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/328 2023-10-14T15:27:57.294 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/328 2023-10-14T15:27:57.294 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:57.304 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:57.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:57.338 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-10-14T15:27:57.914 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:57.929 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:57.929 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:58.417 INFO:teuthology.orchestra.run.smithi064.stdout:generic/329 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:27:58.429 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/329 2023-10-14T15:27:58.429 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/329 2023-10-14T15:27:58.429 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:58.438 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:58.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:58.472 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-10-14T15:27:58.982 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:58.993 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:58.993 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:59.366 INFO:teuthology.orchestra.run.smithi064.stdout:generic/330 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:27:59.376 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/330 2023-10-14T15:27:59.377 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/330 2023-10-14T15:27:59.377 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:27:59.384 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:27:59.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:27:59.409 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-10-14T15:27:59.909 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:27:59.921 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:27:59.921 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:00.336 INFO:teuthology.orchestra.run.smithi064.stdout:generic/331 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:00.349 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/331 2023-10-14T15:28:00.350 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/331 2023-10-14T15:28:00.350 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:00.360 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:00.387 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:00.387 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-10-14T15:28:00.902 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:00.911 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:00.912 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:01.286 INFO:teuthology.orchestra.run.smithi064.stdout:generic/332 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:01.297 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/332 2023-10-14T15:28:01.297 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/332 2023-10-14T15:28:01.298 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:01.306 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:01.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:01.333 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-10-14T15:28:01.845 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:01.857 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:01.858 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:02.260 INFO:teuthology.orchestra.run.smithi064.stdout:generic/333 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:02.272 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/333 2023-10-14T15:28:02.272 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/333 2023-10-14T15:28:02.272 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:02.284 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:02.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:02.313 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-10-14T15:28:02.859 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:02.873 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:02.873 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:03.289 INFO:teuthology.orchestra.run.smithi064.stdout:generic/334 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:03.298 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/334 2023-10-14T15:28:03.299 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/334 2023-10-14T15:28:03.299 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:03.306 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:03.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:03.338 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-10-14T15:28:03.846 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:03.857 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:03.858 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:04.386 INFO:teuthology.orchestra.run.smithi064.stdout:generic/335 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:04.398 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/335 2023-10-14T15:28:04.398 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/335 2023-10-14T15:28:04.398 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:04.407 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:04.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:04.435 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-10-14T15:28:04.967 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:04.979 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:04.979 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:05.433 INFO:teuthology.orchestra.run.smithi064.stdout:generic/336 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:05.445 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/336 2023-10-14T15:28:05.446 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/336 2023-10-14T15:28:05.446 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:05.455 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:05.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:05.484 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-10-14T15:28:06.001 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:06.013 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:06.013 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:06.427 INFO:teuthology.orchestra.run.smithi064.stdout:generic/337 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:06.438 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/337 2023-10-14T15:28:06.439 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/337 2023-10-14T15:28:06.439 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:06.448 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:06.475 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:06.476 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-10-14T15:28:07.031 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:07.045 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:07.045 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:07.498 INFO:teuthology.orchestra.run.smithi064.stdout:generic/338 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:07.508 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/338 2023-10-14T15:28:07.508 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/338 2023-10-14T15:28:07.508 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:07.517 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:07.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:07.544 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-10-14T15:28:08.057 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:08.070 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:08.070 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:08.471 INFO:teuthology.orchestra.run.smithi064.stdout:generic/339 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:08.482 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/339 2023-10-14T15:28:08.482 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/339 2023-10-14T15:28:08.483 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:08.492 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:08.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:08.518 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-10-14T15:28:09.071 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:09.082 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:09.082 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:09.454 INFO:teuthology.orchestra.run.smithi064.stdout:generic/340 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:09.466 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/340 2023-10-14T15:28:09.466 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/340 2023-10-14T15:28:09.466 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:09.475 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:09.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:09.505 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-10-14T15:28:10.042 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:10.053 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:10.053 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:10.490 INFO:teuthology.orchestra.run.smithi064.stdout:generic/341 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:10.504 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/341 2023-10-14T15:28:10.504 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/341 2023-10-14T15:28:10.504 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:10.514 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:10.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:10.546 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-10-14T15:28:11.080 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:11.094 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:11.094 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:11.535 INFO:teuthology.orchestra.run.smithi064.stdout:generic/342 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:11.551 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/342 2023-10-14T15:28:11.551 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/342 2023-10-14T15:28:11.552 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:11.567 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:11.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:11.597 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-10-14T15:28:12.127 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:12.139 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:12.140 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:12.555 INFO:teuthology.orchestra.run.smithi064.stdout:generic/343 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:12.566 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/343 2023-10-14T15:28:12.566 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/343 2023-10-14T15:28:12.567 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:12.575 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:12.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:12.602 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-10-14T15:28:13.085 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:13.096 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:13.097 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:13.481 INFO:teuthology.orchestra.run.smithi064.stdout:generic/344 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:13.490 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/344 2023-10-14T15:28:13.490 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/344 2023-10-14T15:28:13.491 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:13.498 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:13.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:13.525 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-10-14T15:28:14.032 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:14.045 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:14.045 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:14.447 INFO:teuthology.orchestra.run.smithi064.stdout:generic/345 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:14.458 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/345 2023-10-14T15:28:14.459 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/345 2023-10-14T15:28:14.459 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:14.467 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:14.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:14.498 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-10-14T15:28:15.047 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:15.059 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:15.060 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:15.441 INFO:teuthology.orchestra.run.smithi064.stdout:generic/346 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:15.450 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/346 2023-10-14T15:28:15.450 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/346 2023-10-14T15:28:15.451 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:15.458 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:15.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:15.483 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-10-14T15:28:16.002 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:16.015 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:16.015 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:16.636 INFO:teuthology.orchestra.run.smithi064.stdout:generic/347 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:16.647 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/347 2023-10-14T15:28:16.647 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/347 2023-10-14T15:28:16.647 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:16.656 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:16.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:16.682 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-10-14T15:28:17.182 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:17.193 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:17.194 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:17.613 INFO:teuthology.orchestra.run.smithi064.stdout:generic/348 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:17.629 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/348 2023-10-14T15:28:17.629 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/348 2023-10-14T15:28:17.629 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:17.639 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:17.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:17.672 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-10-14T15:28:18.187 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:18.199 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:18.199 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:22.138 INFO:teuthology.orchestra.run.smithi064.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-14T15:28:22.149 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/349 2023-10-14T15:28:22.149 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/349 2023-10-14T15:28:22.150 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:22.158 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:22.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:22.187 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-10-14T15:28:22.713 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:22.726 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:22.726 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:26.714 INFO:teuthology.orchestra.run.smithi064.stdout:generic/350 4s 2023-10-14T15:28:26.730 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/350 2023-10-14T15:28:26.731 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:26.738 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:26.764 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:26.764 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-10-14T15:28:27.311 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:27.323 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:27.324 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:30.597 INFO:teuthology.orchestra.run.smithi064.stdout:generic/351 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-14T15:28:30.608 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/351 2023-10-14T15:28:30.608 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/351 2023-10-14T15:28:30.608 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:30.616 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:30.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:30.645 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-10-14T15:28:31.384 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:31.395 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:31.395 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:31.830 INFO:teuthology.orchestra.run.smithi064.stdout:generic/352 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:31.842 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/352 2023-10-14T15:28:31.842 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/352 2023-10-14T15:28:31.842 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:31.852 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:31.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:31.887 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-10-14T15:28:32.402 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:32.414 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:32.415 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:32.757 INFO:teuthology.orchestra.run.smithi064.stdout:generic/353 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:32.766 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/353 2023-10-14T15:28:32.767 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/353 2023-10-14T15:28:32.767 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:32.774 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:32.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:32.800 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-10-14T15:28:33.290 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:33.304 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:33.304 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:33.732 INFO:teuthology.orchestra.run.smithi064.stdout:generic/354 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:33.743 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/354 2023-10-14T15:28:33.743 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/354 2023-10-14T15:28:33.743 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:33.751 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:33.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:33.777 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-10-14T15:28:34.310 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:34.325 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:34.325 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:36.680 INFO:teuthology.orchestra.run.smithi064.stdout:generic/355 2s 2023-10-14T15:28:36.696 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/355 2023-10-14T15:28:36.697 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:36.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:36.733 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-10-14T15:28:37.522 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:37.535 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:37.535 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:38.013 INFO:teuthology.orchestra.run.smithi064.stdout:generic/356 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:38.024 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/356 2023-10-14T15:28:38.025 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/356 2023-10-14T15:28:38.025 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:38.035 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:38.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:38.064 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-10-14T15:28:38.603 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:38.614 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:38.615 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:39.068 INFO:teuthology.orchestra.run.smithi064.stdout:generic/357 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:39.081 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/357 2023-10-14T15:28:39.081 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/357 2023-10-14T15:28:39.082 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:39.091 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:39.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:39.124 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-10-14T15:28:39.644 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:39.655 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:39.655 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:40.046 INFO:teuthology.orchestra.run.smithi064.stdout:generic/358 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:40.055 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/358 2023-10-14T15:28:40.056 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/358 2023-10-14T15:28:40.056 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:40.063 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:40.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:40.091 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-10-14T15:28:40.613 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:40.625 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:40.625 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:41.021 INFO:teuthology.orchestra.run.smithi064.stdout:generic/359 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:41.033 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/359 2023-10-14T15:28:41.033 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/359 2023-10-14T15:28:41.034 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:41.043 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:41.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:41.074 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-10-14T15:28:41.617 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:41.629 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:41.629 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:42.635 INFO:teuthology.orchestra.run.smithi064.stdout:generic/360 1s 2023-10-14T15:28:42.654 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/360 2023-10-14T15:28:42.654 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:42.664 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:42.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:42.697 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-10-14T15:28:43.241 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:43.254 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:43.254 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:43.782 INFO:teuthology.orchestra.run.smithi064.stdout:generic/361 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:43.796 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/361 2023-10-14T15:28:43.797 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/361 2023-10-14T15:28:43.797 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:43.809 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:43.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:43.845 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-10-14T15:28:44.381 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:44.393 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:44.394 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:44.786 INFO:teuthology.orchestra.run.smithi064.stdout:generic/362 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:44.797 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/362 2023-10-14T15:28:44.797 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/362 2023-10-14T15:28:44.798 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:44.806 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:44.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:44.832 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-10-14T15:28:45.365 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:45.375 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:45.376 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:45.780 INFO:teuthology.orchestra.run.smithi064.stdout:generic/363 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:45.789 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/363 2023-10-14T15:28:45.790 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/363 2023-10-14T15:28:45.790 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:45.798 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:45.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:45.828 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-10-14T15:28:46.348 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:46.361 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:46.361 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:46.760 INFO:teuthology.orchestra.run.smithi064.stdout:generic/364 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:46.775 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/364 2023-10-14T15:28:46.775 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/364 2023-10-14T15:28:46.775 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:46.784 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:46.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:46.814 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-10-14T15:28:47.314 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:47.326 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:47.326 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:47.689 INFO:teuthology.orchestra.run.smithi064.stdout:generic/365 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:47.701 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/365 2023-10-14T15:28:47.701 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/365 2023-10-14T15:28:47.701 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:47.709 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:47.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:47.737 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-10-14T15:28:48.279 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:48.291 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:48.292 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:48.675 INFO:teuthology.orchestra.run.smithi064.stdout:generic/366 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:48.687 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/366 2023-10-14T15:28:48.687 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/366 2023-10-14T15:28:48.687 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:48.695 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:48.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:48.722 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-10-14T15:28:49.251 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:49.265 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:49.265 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:49.687 INFO:teuthology.orchestra.run.smithi064.stdout:generic/367 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:49.698 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/367 2023-10-14T15:28:49.699 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/367 2023-10-14T15:28:49.699 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:49.707 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:49.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:49.735 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-10-14T15:28:50.269 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:50.283 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:50.283 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:50.683 INFO:teuthology.orchestra.run.smithi064.stdout:generic/368 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:50.693 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/368 2023-10-14T15:28:50.693 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/368 2023-10-14T15:28:50.693 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:50.700 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:50.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:50.729 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-10-14T15:28:51.243 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:51.256 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:51.257 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:51.626 INFO:teuthology.orchestra.run.smithi064.stdout:generic/369 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:51.635 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/369 2023-10-14T15:28:51.636 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/369 2023-10-14T15:28:51.636 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:51.643 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:51.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:51.667 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-10-14T15:28:52.168 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:52.179 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:52.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:52.576 INFO:teuthology.orchestra.run.smithi064.stdout:generic/370 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:52.586 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/370 2023-10-14T15:28:52.586 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/370 2023-10-14T15:28:52.586 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:52.594 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:52.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:52.621 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-10-14T15:28:53.145 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:53.157 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:53.158 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:53.559 INFO:teuthology.orchestra.run.smithi064.stdout:generic/371 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:53.569 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/371 2023-10-14T15:28:53.570 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/371 2023-10-14T15:28:53.570 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:53.574 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:53.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:53.598 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-10-14T15:28:54.088 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:54.100 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:54.100 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:54.501 INFO:teuthology.orchestra.run.smithi064.stdout:generic/372 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:54.513 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/372 2023-10-14T15:28:54.514 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/372 2023-10-14T15:28:54.514 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:54.522 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:54.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:54.551 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-10-14T15:28:55.074 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:55.086 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:55.086 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:55.475 INFO:teuthology.orchestra.run.smithi064.stdout:generic/373 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:55.487 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/373 2023-10-14T15:28:55.488 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/373 2023-10-14T15:28:55.488 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:55.497 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:55.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:55.523 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-10-14T15:28:56.042 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:56.055 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:56.055 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:56.440 INFO:teuthology.orchestra.run.smithi064.stdout:generic/374 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:56.453 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/374 2023-10-14T15:28:56.453 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/374 2023-10-14T15:28:56.453 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:56.462 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:56.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:56.496 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-10-14T15:28:57.055 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:57.069 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:57.069 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:57.657 INFO:teuthology.orchestra.run.smithi064.stdout:generic/375 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T15:28:57.669 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/375 2023-10-14T15:28:57.669 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/375 2023-10-14T15:28:57.669 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:57.681 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:57.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:57.713 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-10-14T15:28:58.234 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:58.245 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:58.245 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:58.689 INFO:teuthology.orchestra.run.smithi064.stdout:generic/376 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:58.701 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/376 2023-10-14T15:28:58.701 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/376 2023-10-14T15:28:58.701 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:58.710 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:58.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:58.736 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-10-14T15:28:59.213 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:28:59.226 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:28:59.226 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:59.545 INFO:teuthology.orchestra.run.smithi064.stdout:generic/377 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:28:59.557 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/377 2023-10-14T15:28:59.558 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/377 2023-10-14T15:28:59.558 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:28:59.568 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:28:59.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:28:59.594 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-10-14T15:29:00.098 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:00.109 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:00.110 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:01.276 INFO:teuthology.orchestra.run.smithi064.stdout:generic/378 1s 2023-10-14T15:29:01.291 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/378 2023-10-14T15:29:01.291 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:01.299 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:01.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:01.332 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-10-14T15:29:02.071 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:02.083 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:02.083 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:02.494 INFO:teuthology.orchestra.run.smithi064.stdout:generic/379 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:02.507 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/379 2023-10-14T15:29:02.508 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/379 2023-10-14T15:29:02.508 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:02.519 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:02.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:02.551 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-10-14T15:29:03.081 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:03.094 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:03.095 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:03.485 INFO:teuthology.orchestra.run.smithi064.stdout:generic/380 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:03.496 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/380 2023-10-14T15:29:03.497 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/380 2023-10-14T15:29:03.497 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:03.506 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:03.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:03.532 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-10-14T15:29:04.050 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:04.061 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:04.061 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:04.427 INFO:teuthology.orchestra.run.smithi064.stdout:generic/381 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:04.436 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/381 2023-10-14T15:29:04.437 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/381 2023-10-14T15:29:04.437 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:04.444 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:04.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:04.472 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-10-14T15:29:04.983 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:05.025 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:05.025 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:05.385 INFO:teuthology.orchestra.run.smithi064.stdout:generic/382 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:05.398 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/382 2023-10-14T15:29:05.398 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/382 2023-10-14T15:29:05.398 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:05.407 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:05.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:05.438 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-10-14T15:29:05.959 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:05.971 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:05.971 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:06.360 INFO:teuthology.orchestra.run.smithi064.stdout:generic/383 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:06.372 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/383 2023-10-14T15:29:06.373 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/383 2023-10-14T15:29:06.373 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:06.382 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:06.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:06.414 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-10-14T15:29:06.966 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:06.978 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:06.978 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:07.369 INFO:teuthology.orchestra.run.smithi064.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T15:29:07.379 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/384 2023-10-14T15:29:07.379 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/384 2023-10-14T15:29:07.379 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:07.388 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:07.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:07.412 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-10-14T15:29:07.913 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:07.925 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:07.926 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:08.306 INFO:teuthology.orchestra.run.smithi064.stdout:generic/385 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:08.316 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/385 2023-10-14T15:29:08.316 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/385 2023-10-14T15:29:08.316 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:08.323 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:08.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:08.352 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-10-14T15:29:08.872 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:08.885 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:08.886 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:09.281 INFO:teuthology.orchestra.run.smithi064.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T15:29:09.293 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/386 2023-10-14T15:29:09.293 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/386 2023-10-14T15:29:09.293 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:09.302 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:09.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:09.335 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-10-14T15:29:09.862 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:09.875 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:09.876 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:10.247 INFO:teuthology.orchestra.run.smithi064.stdout:generic/387 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:10.258 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/387 2023-10-14T15:29:10.258 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/387 2023-10-14T15:29:10.258 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:10.268 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:10.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:10.293 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-10-14T15:29:10.818 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:10.830 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:10.830 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:11.230 INFO:teuthology.orchestra.run.smithi064.stdout:generic/388 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:11.242 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/388 2023-10-14T15:29:11.243 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/388 2023-10-14T15:29:11.243 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:11.251 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:11.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:11.278 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-10-14T15:29:11.767 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:11.779 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:11.779 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:12.225 INFO:teuthology.orchestra.run.smithi064.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-10-14T15:29:12.237 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/389 2023-10-14T15:29:12.237 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/389 2023-10-14T15:29:12.237 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:12.246 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:12.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:12.278 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-10-14T15:29:12.796 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:12.808 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:12.808 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:13.178 INFO:teuthology.orchestra.run.smithi064.stdout:generic/390 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:29:13.190 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/390 2023-10-14T15:29:13.191 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/390 2023-10-14T15:29:13.191 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:29:13.201 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:29:13.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:29:13.225 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-10-14T15:29:13.748 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:29:13.760 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:29:13.761 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:26.624 INFO:teuthology.orchestra.run.smithi064.stdout:generic/391 73s 2023-10-14T15:30:26.707 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/391 2023-10-14T15:30:26.707 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:26.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:26.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:26.853 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-10-14T15:30:28.390 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:28.404 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:28.404 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:28.858 INFO:teuthology.orchestra.run.smithi064.stdout:generic/392 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:28.871 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/392 2023-10-14T15:30:28.872 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/392 2023-10-14T15:30:28.872 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:28.880 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:28.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:28.911 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-10-14T15:30:29.517 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:29.533 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:29.534 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:29.934 INFO:teuthology.orchestra.run.smithi064.stdout:generic/393 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:29.947 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/393 2023-10-14T15:30:29.948 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/393 2023-10-14T15:30:29.948 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:29.955 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:29.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:29.990 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-10-14T15:30:30.443 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:30.458 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:30.458 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:31.060 INFO:teuthology.orchestra.run.smithi064.stdout:generic/394 1s 2023-10-14T15:30:31.078 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/394 2023-10-14T15:30:31.078 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:31.087 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:31.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:31.123 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-10-14T15:30:31.843 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:31.853 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:31.854 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:32.356 INFO:teuthology.orchestra.run.smithi064.stdout:generic/395 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:32.366 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/395 2023-10-14T15:30:32.366 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/395 2023-10-14T15:30:32.367 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:32.377 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:32.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:32.409 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-10-14T15:30:32.954 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:32.965 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:32.966 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:33.494 INFO:teuthology.orchestra.run.smithi064.stdout:generic/396 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:33.507 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/396 2023-10-14T15:30:33.507 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/396 2023-10-14T15:30:33.507 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:33.517 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:33.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:33.549 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-10-14T15:30:34.181 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:34.196 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:34.196 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:34.627 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:30:34.634 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:30:34.760 INFO:teuthology.orchestra.run.smithi064.stdout:generic/397 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:34.773 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/397 2023-10-14T15:30:34.773 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/397 2023-10-14T15:30:34.773 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:34.785 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:34.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:34.816 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-10-14T15:30:35.480 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:35.495 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:35.495 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:36.033 INFO:teuthology.orchestra.run.smithi064.stdout:generic/398 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:36.049 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/398 2023-10-14T15:30:36.049 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/398 2023-10-14T15:30:36.050 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:36.062 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:36.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:36.091 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-10-14T15:30:36.691 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:36.704 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:36.704 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:37.262 INFO:teuthology.orchestra.run.smithi064.stdout:generic/399 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:37.278 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/399 2023-10-14T15:30:37.278 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/399 2023-10-14T15:30:37.279 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:37.291 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:37.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:37.323 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-10-14T15:30:37.924 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:37.938 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:37.939 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:38.411 INFO:teuthology.orchestra.run.smithi064.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T15:30:38.425 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/400 2023-10-14T15:30:38.425 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/400 2023-10-14T15:30:38.426 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:38.437 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:38.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:38.473 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-10-14T15:30:39.098 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:39.113 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:39.113 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:39.552 INFO:teuthology.orchestra.run.smithi064.stdout:generic/401 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:39.566 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/401 2023-10-14T15:30:39.566 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/401 2023-10-14T15:30:39.567 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:39.579 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:39.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:39.614 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-10-14T15:30:40.234 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:40.248 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:40.249 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:40.734 INFO:teuthology.orchestra.run.smithi064.stdout:generic/402 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:40.746 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/402 2023-10-14T15:30:40.746 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/402 2023-10-14T15:30:40.746 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:40.758 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:40.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:40.791 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-10-14T15:30:41.377 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:41.390 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:41.390 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:41.845 INFO:teuthology.orchestra.run.smithi064.stdout:generic/403 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:41.858 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/403 2023-10-14T15:30:41.859 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/403 2023-10-14T15:30:41.859 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:41.872 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:41.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:41.907 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-10-14T15:30:42.499 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:42.512 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:42.512 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:46.477 INFO:teuthology.orchestra.run.smithi064.stdout:generic/404 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-14T15:30:46.489 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/404 2023-10-14T15:30:46.489 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/404 2023-10-14T15:30:46.490 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:46.499 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:46.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:46.530 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-10-14T15:30:47.276 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:47.289 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:47.289 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:47.869 INFO:teuthology.orchestra.run.smithi064.stdout:generic/405 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:47.883 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/405 2023-10-14T15:30:47.883 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/405 2023-10-14T15:30:47.883 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:47.895 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:47.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:47.935 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-10-14T15:30:48.517 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:48.533 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:48.533 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:48.976 INFO:teuthology.orchestra.run.smithi064.stdout:generic/406 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:48.990 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/406 2023-10-14T15:30:48.991 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/406 2023-10-14T15:30:48.991 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:49.003 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:49.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:49.035 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-10-14T15:30:49.639 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:49.655 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:49.655 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:50.292 INFO:teuthology.orchestra.run.smithi064.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:30:50.304 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/407 2023-10-14T15:30:50.304 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/407 2023-10-14T15:30:50.305 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:50.314 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:50.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:50.347 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-10-14T15:30:51.075 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:51.089 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:51.090 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:51.677 INFO:teuthology.orchestra.run.smithi064.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T15:30:51.691 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/408 2023-10-14T15:30:51.691 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/408 2023-10-14T15:30:51.692 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:51.705 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:51.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:51.743 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-10-14T15:30:52.439 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:52.450 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:52.450 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:52.888 INFO:teuthology.orchestra.run.smithi064.stdout:generic/409 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:52.898 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/409 2023-10-14T15:30:52.898 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/409 2023-10-14T15:30:52.899 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:52.906 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:52.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:52.932 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-10-14T15:30:53.491 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:53.505 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:53.506 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:53.952 INFO:teuthology.orchestra.run.smithi064.stdout:generic/410 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:53.963 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/410 2023-10-14T15:30:53.963 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/410 2023-10-14T15:30:53.963 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:53.971 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:53.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:53.999 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-10-14T15:30:54.574 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:54.589 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:54.589 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:55.039 INFO:teuthology.orchestra.run.smithi064.stdout:generic/411 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:55.049 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/411 2023-10-14T15:30:55.049 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/411 2023-10-14T15:30:55.049 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:55.058 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:55.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:55.088 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-10-14T15:30:55.660 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:55.673 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:55.673 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:56.111 INFO:teuthology.orchestra.run.smithi064.stdout:generic/412 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:56.121 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/412 2023-10-14T15:30:56.121 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/412 2023-10-14T15:30:56.121 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:56.129 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:56.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:56.154 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-10-14T15:30:56.688 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:56.700 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:56.700 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:57.091 INFO:teuthology.orchestra.run.smithi064.stdout:generic/413 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:57.100 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/413 2023-10-14T15:30:57.100 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/413 2023-10-14T15:30:57.101 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:57.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:57.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:57.130 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-10-14T15:30:57.627 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:57.641 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:57.641 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:58.066 INFO:teuthology.orchestra.run.smithi064.stdout:generic/414 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:58.081 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/414 2023-10-14T15:30:58.081 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/414 2023-10-14T15:30:58.082 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:58.094 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:58.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:58.128 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-10-14T15:30:58.757 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:58.771 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:58.771 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:59.210 INFO:teuthology.orchestra.run.smithi064.stdout:generic/415 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:30:59.223 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/415 2023-10-14T15:30:59.223 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/415 2023-10-14T15:30:59.223 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:30:59.232 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:30:59.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:30:59.263 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-10-14T15:30:59.849 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:30:59.862 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:30:59.863 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:00.311 INFO:teuthology.orchestra.run.smithi064.stdout:generic/416 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:31:00.326 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/416 2023-10-14T15:31:00.326 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/416 2023-10-14T15:31:00.327 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:00.338 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:00.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:00.375 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-10-14T15:31:00.965 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:00.979 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:00.979 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:01.402 INFO:teuthology.orchestra.run.smithi064.stdout:generic/417 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:31:01.416 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/417 2023-10-14T15:31:01.416 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/417 2023-10-14T15:31:01.416 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:01.427 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:01.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:01.456 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-10-14T15:31:02.047 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:02.060 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:02.060 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:02.618 INFO:teuthology.orchestra.run.smithi064.stdout:generic/418 [not run] require ceph-fuse to be valid block disk 2023-10-14T15:31:02.632 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/418 2023-10-14T15:31:02.633 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/418 2023-10-14T15:31:02.633 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:02.646 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:02.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:02.681 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-10-14T15:31:03.265 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:03.279 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:03.279 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:03.871 INFO:teuthology.orchestra.run.smithi064.stdout:generic/419 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:31:03.884 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/419 2023-10-14T15:31:03.884 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/419 2023-10-14T15:31:03.885 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:03.894 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:03.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:03.931 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-10-14T15:31:04.513 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:04.525 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:04.525 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:04.861 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:31:04.869 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:31:08.590 INFO:teuthology.orchestra.run.smithi064.stdout:generic/420 4s 2023-10-14T15:31:08.607 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/420 2023-10-14T15:31:08.607 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:08.615 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:08.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:08.645 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-10-14T15:31:09.389 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:09.405 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:09.405 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:09.964 INFO:teuthology.orchestra.run.smithi064.stdout:generic/421 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:31:09.978 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/421 2023-10-14T15:31:09.978 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/421 2023-10-14T15:31:09.979 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:09.987 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:10.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:10.020 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-10-14T15:31:10.598 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:10.612 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:10.612 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:11.068 INFO:teuthology.orchestra.run.smithi064.stdout:generic/422 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:31:11.080 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/422 2023-10-14T15:31:11.080 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/422 2023-10-14T15:31:11.080 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:11.089 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:11.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:11.120 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-10-14T15:31:11.707 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:11.721 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:11.721 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:12.545 INFO:teuthology.orchestra.run.smithi064.stdout:generic/423 1s 2023-10-14T15:31:12.562 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/423 2023-10-14T15:31:12.563 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:12.570 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:12.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:12.598 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-10-14T15:31:13.335 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:13.348 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:13.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:13.872 INFO:teuthology.orchestra.run.smithi064.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-10-14T15:31:13.885 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/424 2023-10-14T15:31:13.885 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/424 2023-10-14T15:31:13.886 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:13.895 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:13.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:13.924 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-10-14T15:31:14.478 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:14.491 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:14.491 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:14.936 INFO:teuthology.orchestra.run.smithi064.stdout:generic/425 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:31:14.947 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/425 2023-10-14T15:31:14.947 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/425 2023-10-14T15:31:14.947 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:31:14.955 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:14.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:31:14.983 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-10-14T15:31:15.577 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:31:15.591 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:31:15.592 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:31:35.024 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:31:35.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:32:05.970 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:32:05.979 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:32:36.739 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:32:36.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:32:39.976 INFO:teuthology.orchestra.run.smithi064.stdout:generic/426 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/426.out.bad) 2023-10-14T15:32:40.003 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/426.out 2023-10-14 12:30:50.019658864 +0000 2023-10-14T15:32:40.003 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/426.out.bad 2023-10-14 15:32:39.957957682 +0000 2023-10-14T15:32:40.003 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,5 +1,61 @@ 2023-10-14T15:32:40.003 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 426 2023-10-14T15:32:40.004 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/426-dir -d 2023-10-14T15:32:40.004 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000167) opened an unlinked file! 2023-10-14T15:32:40.004 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000168) opened an unlinked file! 2023-10-14T15:32:40.004 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000169) opened an unlinked file! 2023-10-14T15:32:40.004 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000170) opened an unlinked file! 2023-10-14T15:32:40.005 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000171) opened an unlinked file! 2023-10-14T15:32:40.005 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000172) opened an unlinked file! 2023-10-14T15:32:40.005 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000173) opened an unlinked file! 2023-10-14T15:32:40.005 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000174) opened an unlinked file! 2023-10-14T15:32:40.005 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000175) opened an unlinked file! 2023-10-14T15:32:40.006 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000176) opened an unlinked file! 2023-10-14T15:32:40.006 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000177) opened an unlinked file! 2023-10-14T15:32:40.006 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000178) opened an unlinked file! 2023-10-14T15:32:40.006 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000179) opened an unlinked file! 2023-10-14T15:32:40.006 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000180) opened an unlinked file! 2023-10-14T15:32:40.007 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000181) opened an unlinked file! 2023-10-14T15:32:40.007 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000182) opened an unlinked file! 2023-10-14T15:32:40.007 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000183) opened an unlinked file! 2023-10-14T15:32:40.007 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000184) opened an unlinked file! 2023-10-14T15:32:40.007 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000185) opened an unlinked file! 2023-10-14T15:32:40.008 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000186) opened an unlinked file! 2023-10-14T15:32:40.008 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000187) opened an unlinked file! 2023-10-14T15:32:40.008 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000188) opened an unlinked file! 2023-10-14T15:32:40.008 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000189) opened an unlinked file! 2023-10-14T15:32:40.008 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000190) opened an unlinked file! 2023-10-14T15:32:40.009 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000191) opened an unlinked file! 2023-10-14T15:32:40.009 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000192) opened an unlinked file! 2023-10-14T15:32:40.009 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000193) opened an unlinked file! 2023-10-14T15:32:40.009 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000194) opened an unlinked file! 2023-10-14T15:32:40.009 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000195) opened an unlinked file! 2023-10-14T15:32:40.010 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000196) opened an unlinked file! 2023-10-14T15:32:40.010 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000197) opened an unlinked file! 2023-10-14T15:32:40.010 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000198) opened an unlinked file! 2023-10-14T15:32:40.010 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000199) opened an unlinked file! 2023-10-14T15:32:40.010 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000200) opened an unlinked file! 2023-10-14T15:32:40.011 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000201) opened an unlinked file! 2023-10-14T15:32:40.011 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000202) opened an unlinked file! 2023-10-14T15:32:40.011 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000203) opened an unlinked file! 2023-10-14T15:32:40.011 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000204) opened an unlinked file! 2023-10-14T15:32:40.011 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000205) opened an unlinked file! 2023-10-14T15:32:40.012 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000206) opened an unlinked file! 2023-10-14T15:32:40.012 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000207) opened an unlinked file! 2023-10-14T15:32:40.012 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000208) opened an unlinked file! 2023-10-14T15:32:40.012 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000209) opened an unlinked file! 2023-10-14T15:32:40.012 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000210) opened an unlinked file! 2023-10-14T15:32:40.012 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000211) opened an unlinked file! 2023-10-14T15:32:40.013 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000212) opened an unlinked file! 2023-10-14T15:32:40.013 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000213) opened an unlinked file! 2023-10-14T15:32:40.013 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000214) opened an unlinked file! 2023-10-14T15:32:40.013 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000215) opened an unlinked file! 2023-10-14T15:32:40.013 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000216) opened an unlinked file! 2023-10-14T15:32:40.014 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000217) opened an unlinked file! 2023-10-14T15:32:40.014 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000218) opened an unlinked file! 2023-10-14T15:32:40.014 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000219) opened an unlinked file! 2023-10-14T15:32:40.014 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000220) opened an unlinked file! 2023-10-14T15:32:40.014 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000221) opened an unlinked file! 2023-10-14T15:32:40.015 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/426-dir/file000222) opened an unlinked file! 2023-10-14T15:32:40.015 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/426-dir 2023-10-14T15:32:40.015 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/426-dir -l 2023-10-14T15:32:40.015 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/426-dir -u 2023-10-14T15:32:40.027 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/426 2023-10-14T15:32:40.027 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/426 2023-10-14T15:32:40.028 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:32:40.072 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:40.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:32:40.136 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:32:40.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:32:40.137 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-10-14T15:32:41.346 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:41.360 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:41.360 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:41.997 INFO:teuthology.orchestra.run.smithi064.stdout:generic/427 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:32:42.012 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/427 2023-10-14T15:32:42.012 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/427 2023-10-14T15:32:42.012 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:42.027 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:42.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:42.060 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-10-14T15:32:42.654 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:42.667 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:42.668 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:43.277 INFO:teuthology.orchestra.run.smithi064.stdout:generic/428 1s 2023-10-14T15:32:43.302 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/428 2023-10-14T15:32:43.302 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:43.314 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:43.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:43.348 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-10-14T15:32:43.924 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:43.939 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:43.939 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:44.508 INFO:teuthology.orchestra.run.smithi064.stdout:generic/429 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:32:44.520 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/429 2023-10-14T15:32:44.520 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/429 2023-10-14T15:32:44.521 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:44.530 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:44.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:44.564 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-10-14T15:32:45.142 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:45.157 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:45.157 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:45.958 INFO:teuthology.orchestra.run.smithi064.stdout:generic/430 0s 2023-10-14T15:32:45.977 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/430 2023-10-14T15:32:45.977 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:45.986 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:46.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:46.020 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-10-14T15:32:46.749 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:46.760 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:46.760 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:47.478 INFO:teuthology.orchestra.run.smithi064.stdout:generic/431 1s 2023-10-14T15:32:47.497 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/431 2023-10-14T15:32:47.497 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:47.506 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:47.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:47.537 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-10-14T15:32:48.238 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:48.249 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:48.249 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:49.008 INFO:teuthology.orchestra.run.smithi064.stdout:generic/432 0s 2023-10-14T15:32:49.024 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/432 2023-10-14T15:32:49.024 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:49.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:49.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:49.062 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-10-14T15:32:49.796 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:49.808 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:49.808 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:50.475 INFO:teuthology.orchestra.run.smithi064.stdout:generic/433 1s 2023-10-14T15:32:50.492 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/433 2023-10-14T15:32:50.493 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:50.501 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:50.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:50.531 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-10-14T15:32:51.260 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:51.272 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:51.273 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:51.873 INFO:teuthology.orchestra.run.smithi064.stdout:generic/434 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/434.out.bad) 2023-10-14T15:32:51.880 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/434.out 2023-10-14 12:30:50.021658825 +0000 2023-10-14T15:32:51.881 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/434.out.bad 2023-10-14 15:32:51.869725607 +0000 2023-10-14T15:32:51.881 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -9,6 +9,6 @@ 2023-10-14T15:32:51.881 INFO:teuthology.orchestra.run.smithi064.stdout: copy_range: Bad file descriptor 2023-10-14T15:32:51.881 INFO:teuthology.orchestra.run.smithi064.stdout: d41d8cd98f00b204e9800998ecf8427e TEST_DIR/test-434/copy 2023-10-14T15:32:51.882 INFO:teuthology.orchestra.run.smithi064.stdout: Try to copy to a device 2023-10-14T15:32:51.882 INFO:teuthology.orchestra.run.smithi064.stdout: -copy_range: Invalid argument 2023-10-14T15:32:51.882 INFO:teuthology.orchestra.run.smithi064.stdout: +/tmp/tmp.LYaLaNSY2Vtest/test-434/dev1: Permission denied 2023-10-14T15:32:51.882 INFO:teuthology.orchestra.run.smithi064.stdout: Try to copy to a fifo 2023-10-14T15:32:51.882 INFO:teuthology.orchestra.run.smithi064.stdout: copy_range: Invalid argument 2023-10-14T15:32:51.887 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/434 2023-10-14T15:32:51.888 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/434 2023-10-14T15:32:51.888 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:32:51.895 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:51.926 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:32:51.927 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:32:51.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:32:51.928 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-10-14T15:32:52.611 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:52.623 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:52.623 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:53.168 INFO:teuthology.orchestra.run.smithi064.stdout:generic/435 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:32:53.183 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/435 2023-10-14T15:32:53.183 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/435 2023-10-14T15:32:53.184 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:53.196 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:53.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:53.235 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-10-14T15:32:53.806 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:53.819 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:53.819 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:56.720 INFO:teuthology.orchestra.run.smithi064.stdout:generic/436 3s 2023-10-14T15:32:56.737 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/436 2023-10-14T15:32:56.738 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:56.745 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:56.780 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:56.781 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-10-14T15:32:57.498 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:57.513 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:57.513 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:58.980 INFO:teuthology.orchestra.run.smithi064.stdout:generic/437 1s 2023-10-14T15:32:58.999 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/437 2023-10-14T15:32:58.999 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:32:59.009 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:32:59.040 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:32:59.040 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-10-14T15:32:59.631 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:32:59.646 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:32:59.646 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:33:09.479 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:33:09.485 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:33:40.178 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:33:40.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:34:10.489 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:34:10.499 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:34:40.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:34:40.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:35:10.773 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:35:10.779 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:35:40.919 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:35:40.926 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:35:41.041 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T15:35:41.040+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 417615) UID: 0 2023-10-14T15:35:41.041 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T15:35:41.040+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 417615) UID: 0 2023-10-14T15:35:41.042 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T15:35:41.040+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 417615) UID: 0 2023-10-14T15:35:41.042 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T15:35:41.040+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 417615) UID: 0 2023-10-14T15:37:33.801 INFO:teuthology.orchestra.run.smithi064.stdout:generic/438 274s 2023-10-14T15:37:33.821 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/438 2023-10-14T15:37:33.822 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:33.831 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:33.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:33.862 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-10-14T15:37:34.356 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:34.369 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:34.370 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:34.758 INFO:teuthology.orchestra.run.smithi064.stdout:generic/439 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:34.767 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/439 2023-10-14T15:37:34.768 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/439 2023-10-14T15:37:34.768 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:34.774 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:34.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:34.798 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-10-14T15:37:35.307 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:35.319 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:35.319 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:35.825 INFO:teuthology.orchestra.run.smithi064.stdout:generic/440 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:35.838 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/440 2023-10-14T15:37:35.838 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/440 2023-10-14T15:37:35.838 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:35.847 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:35.877 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:35.878 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-10-14T15:37:36.405 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:36.417 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:36.417 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:37.060 INFO:teuthology.orchestra.run.smithi064.stdout:generic/441 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:37.076 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/441 2023-10-14T15:37:37.077 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/441 2023-10-14T15:37:37.077 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:37.088 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:37.121 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:37.125 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-10-14T15:37:37.635 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:37.646 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:37.647 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:38.095 INFO:teuthology.orchestra.run.smithi064.stdout:generic/442 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:38.108 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/442 2023-10-14T15:37:38.108 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/442 2023-10-14T15:37:38.109 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:38.120 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:38.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:38.151 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-10-14T15:37:38.684 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:38.696 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:38.696 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:39.155 INFO:teuthology.orchestra.run.smithi064.stdout:generic/443 1s 2023-10-14T15:37:39.171 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/443 2023-10-14T15:37:39.171 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:39.183 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:39.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:39.209 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-10-14T15:37:39.739 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:39.751 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:39.751 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:40.204 INFO:teuthology.orchestra.run.smithi064.stdout:generic/444 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T15:37:40.214 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/444 2023-10-14T15:37:40.215 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/444 2023-10-14T15:37:40.215 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:40.222 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:40.248 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:40.249 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-10-14T15:37:40.796 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:40.807 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:40.807 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:43.087 INFO:teuthology.orchestra.run.smithi064.stdout:generic/445 3s 2023-10-14T15:37:43.103 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/445 2023-10-14T15:37:43.103 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:43.113 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:43.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:43.141 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-10-14T15:37:43.901 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:43.912 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:43.912 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:44.324 INFO:teuthology.orchestra.run.smithi064.stdout:generic/446 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:44.337 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/446 2023-10-14T15:37:44.337 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/446 2023-10-14T15:37:44.337 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:44.347 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:44.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:44.377 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-10-14T15:37:44.891 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:44.903 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:44.903 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:45.325 INFO:teuthology.orchestra.run.smithi064.stdout:generic/447 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:45.336 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/447 2023-10-14T15:37:45.337 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/447 2023-10-14T15:37:45.337 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:45.345 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:45.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:45.376 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-10-14T15:37:45.930 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:45.943 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:45.943 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:48.260 INFO:teuthology.orchestra.run.smithi064.stdout:generic/448 3s 2023-10-14T15:37:48.279 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/448 2023-10-14T15:37:48.279 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:48.287 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:48.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:48.337 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-10-14T15:37:49.091 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:49.103 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:49.103 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:49.508 INFO:teuthology.orchestra.run.smithi064.stdout:generic/449 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:49.518 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/449 2023-10-14T15:37:49.519 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/449 2023-10-14T15:37:49.519 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:49.527 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:49.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:49.556 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-10-14T15:37:50.074 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:50.086 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:50.086 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:53.265 INFO:teuthology.orchestra.run.smithi064.stdout:generic/450 3s 2023-10-14T15:37:53.288 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/450 2023-10-14T15:37:53.288 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:53.297 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:53.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:53.338 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-10-14T15:37:54.049 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:54.060 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:54.060 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:54.828 INFO:teuthology.orchestra.run.smithi064.stdout:generic/451 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/451.out.bad) 2023-10-14T15:37:54.834 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/451.out 2023-10-14 12:30:50.023658786 +0000 2023-10-14T15:37:54.835 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/451.out.bad 2023-10-14 15:37:54.824757066 +0000 2023-10-14T15:37:54.835 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,2 +1,5 @@ 2023-10-14T15:37:54.835 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 451 2023-10-14T15:37:54.835 INFO:teuthology.orchestra.run.smithi064.stdout: +get stale data from buffer read 2023-10-14T15:37:54.836 INFO:teuthology.orchestra.run.smithi064.stdout: +00000000 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 2023-10-14T15:37:54.836 INFO:teuthology.orchestra.run.smithi064.stdout: +000a0000 2023-10-14T15:37:54.836 INFO:teuthology.orchestra.run.smithi064.stdout: Silence is golden 2023-10-14T15:37:54.840 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/451 2023-10-14T15:37:54.840 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/451 2023-10-14T15:37:54.840 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:37:54.847 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:54.868 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:37:54.869 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:37:54.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:37:54.870 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-10-14T15:37:55.691 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:55.711 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:55.712 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:56.022 INFO:teuthology.orchestra.run.smithi064.stdout:generic/452 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:56.032 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/452 2023-10-14T15:37:56.032 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/452 2023-10-14T15:37:56.033 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:56.040 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:56.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:56.069 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-10-14T15:37:56.591 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:56.603 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:56.603 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:57.641 INFO:teuthology.orchestra.run.smithi064.stdout:generic/453 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:57.653 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/453 2023-10-14T15:37:57.653 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/453 2023-10-14T15:37:57.653 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:57.662 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:57.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:57.689 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-10-14T15:37:58.195 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:58.206 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:58.207 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:58.574 INFO:teuthology.orchestra.run.smithi064.stdout:generic/454 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:58.583 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/454 2023-10-14T15:37:58.583 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/454 2023-10-14T15:37:58.583 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:58.590 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:58.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:58.613 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-10-14T15:37:59.118 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:37:59.131 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:37:59.132 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:59.739 INFO:teuthology.orchestra.run.smithi064.stdout:generic/455 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:37:59.751 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/455 2023-10-14T15:37:59.752 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/455 2023-10-14T15:37:59.752 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:37:59.764 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:37:59.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:37:59.796 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-10-14T15:38:00.344 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:00.357 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:00.358 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:00.763 INFO:teuthology.orchestra.run.smithi064.stdout:generic/456 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:00.776 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/456 2023-10-14T15:38:00.776 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/456 2023-10-14T15:38:00.776 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:00.786 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:00.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:00.816 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-10-14T15:38:01.332 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:01.345 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:01.345 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:01.869 INFO:teuthology.orchestra.run.smithi064.stdout:generic/457 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:01.880 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/457 2023-10-14T15:38:01.881 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/457 2023-10-14T15:38:01.881 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:01.889 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:01.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:01.921 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-10-14T15:38:02.430 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:02.441 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:02.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:02.834 INFO:teuthology.orchestra.run.smithi064.stdout:generic/458 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:02.847 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/458 2023-10-14T15:38:02.847 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/458 2023-10-14T15:38:02.847 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:02.857 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:02.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:02.894 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-10-14T15:38:03.385 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:03.398 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:03.398 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:04.355 INFO:teuthology.orchestra.run.smithi064.stdout:generic/459 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:04.368 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/459 2023-10-14T15:38:04.368 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/459 2023-10-14T15:38:04.368 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:04.378 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:04.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:04.410 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-10-14T15:38:04.937 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:04.951 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:04.951 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:05.375 INFO:teuthology.orchestra.run.smithi064.stdout:generic/460 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:05.392 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/460 2023-10-14T15:38:05.393 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/460 2023-10-14T15:38:05.393 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:05.397 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:05.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:05.427 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-10-14T15:38:05.947 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:05.960 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:05.960 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:06.336 INFO:teuthology.orchestra.run.smithi064.stdout:generic/461 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:06.346 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/461 2023-10-14T15:38:06.346 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/461 2023-10-14T15:38:06.346 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:06.356 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:06.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:06.396 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-10-14T15:38:06.920 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:06.933 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:06.933 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:07.323 INFO:teuthology.orchestra.run.smithi064.stdout:generic/462 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:07.330 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/462 2023-10-14T15:38:07.331 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/462 2023-10-14T15:38:07.331 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:07.339 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:07.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:07.366 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-10-14T15:38:07.884 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:07.899 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:07.899 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:08.434 INFO:teuthology.orchestra.run.smithi064.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T15:38:08.445 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/463 2023-10-14T15:38:08.445 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/463 2023-10-14T15:38:08.445 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:08.454 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:08.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:08.496 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-10-14T15:38:09.225 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:09.237 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:09.237 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:09.618 INFO:teuthology.orchestra.run.smithi064.stdout:generic/464 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:09.628 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/464 2023-10-14T15:38:09.628 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/464 2023-10-14T15:38:09.628 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:09.635 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:09.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:09.661 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-10-14T15:38:10.187 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:10.196 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:10.196 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:37.593 INFO:teuthology.orchestra.run.smithi064.stdout:generic/465 27s 2023-10-14T15:38:37.629 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/465 2023-10-14T15:38:37.630 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:37.647 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:37.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:37.689 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-10-14T15:38:38.334 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:38.348 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:38.348 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:38.786 INFO:teuthology.orchestra.run.smithi064.stdout:generic/466 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:38.801 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/466 2023-10-14T15:38:38.802 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/466 2023-10-14T15:38:38.802 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:38.810 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:38.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:38.841 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-10-14T15:38:39.428 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:39.442 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:39.443 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:48.833 INFO:teuthology.orchestra.run.smithi064.stdout:generic/467 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/467.out.bad) 2023-10-14T15:38:48.850 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/467.out 2023-10-14 12:30:50.026658727 +0000 2023-10-14T15:38:48.850 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/467.out.bad 2023-10-14 15:38:48.802665494 +0000 2023-10-14T15:38:48.851 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,5 +1,15 @@ 2023-10-14T15:38:48.851 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 467 2023-10-14T15:38:48.851 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/467-dir -dp 2023-10-14T15:38:48.851 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000000) opened an unlinked file! 2023-10-14T15:38:48.851 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000001) opened an unlinked file! 2023-10-14T15:38:48.852 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000002) opened an unlinked file! 2023-10-14T15:38:48.852 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000003) opened an unlinked file! 2023-10-14T15:38:48.852 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000004) opened an unlinked file! 2023-10-14T15:38:48.852 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000005) opened an unlinked file! 2023-10-14T15:38:48.852 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000006) opened an unlinked file! 2023-10-14T15:38:48.853 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000007) opened an unlinked file! 2023-10-14T15:38:48.853 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000008) opened an unlinked file! 2023-10-14T15:38:48.853 INFO:teuthology.orchestra.run.smithi064.stdout: +open_by_handle(/tmp/tmp.LYaLaNSY2Vtest/467-dir/file000009) opened an unlinked file! 2023-10-14T15:38:48.853 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/467-dir -rp 2023-10-14T15:38:48.853 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/467-dir -dkr 2023-10-14T15:38:48.853 INFO:teuthology.orchestra.run.smithi064.stdout: test_file_handles TEST_DIR/467-dir -lr 2023-10-14T15:38:48.875 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/467 2023-10-14T15:38:48.875 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/467 2023-10-14T15:38:48.876 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:38:48.915 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:49.065 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:38:49.066 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:38:49.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:38:49.067 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-10-14T15:38:50.679 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:50.695 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:50.695 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:51.262 INFO:teuthology.orchestra.run.smithi064.stdout:generic/468 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:38:51.274 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/468 2023-10-14T15:38:51.274 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/468 2023-10-14T15:38:51.275 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:38:51.285 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:38:51.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:38:51.318 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-10-14T15:38:51.914 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:38:51.928 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:38:51.929 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:39:00.371 INFO:teuthology.orchestra.run.smithi064.stdout:generic/469 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-14T15:39:00.385 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/469 2023-10-14T15:39:00.385 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/469 2023-10-14T15:39:00.385 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:39:00.396 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:39:00.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:39:00.447 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-10-14T15:39:01.184 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:39:01.198 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:39:01.199 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:39:01.703 INFO:teuthology.orchestra.run.smithi064.stdout:generic/470 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:39:01.718 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/470 2023-10-14T15:39:01.718 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/470 2023-10-14T15:39:01.718 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:39:01.727 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:39:01.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:39:01.762 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-10-14T15:39:02.338 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:39:02.352 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:39:02.353 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:39:06.848 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:39:06.854 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:39:37.033 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:39:37.044 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:40:07.200 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:40:07.210 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:40:37.396 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:40:37.406 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:41:00.955 INFO:teuthology.orchestra.run.smithi064.stdout:generic/471 118s 2023-10-14T15:41:00.985 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/471 2023-10-14T15:41:00.985 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:00.998 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:01.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:01.035 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-10-14T15:41:02.017 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:02.028 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:02.028 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:02.427 INFO:teuthology.orchestra.run.smithi064.stdout:generic/472 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:02.439 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/472 2023-10-14T15:41:02.440 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/472 2023-10-14T15:41:02.440 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:02.450 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:02.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:02.483 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-10-14T15:41:03.083 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:03.098 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:03.098 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:03.694 INFO:teuthology.orchestra.run.smithi064.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T15:41:03.710 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/473 2023-10-14T15:41:03.710 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/473 2023-10-14T15:41:03.710 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:03.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:03.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:03.754 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-10-14T15:41:04.368 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:04.381 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:04.382 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:04.775 INFO:teuthology.orchestra.run.smithi064.stdout:generic/474 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:04.787 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/474 2023-10-14T15:41:04.787 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/474 2023-10-14T15:41:04.787 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:04.796 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:04.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:04.827 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-10-14T15:41:05.424 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:05.438 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:05.438 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:05.966 INFO:teuthology.orchestra.run.smithi064.stdout:generic/475 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:05.981 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/475 2023-10-14T15:41:05.981 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/475 2023-10-14T15:41:05.982 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:05.994 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:06.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:06.030 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-10-14T15:41:06.626 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:06.640 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:06.640 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:07.106 INFO:teuthology.orchestra.run.smithi064.stdout:generic/476 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:07.118 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/476 2023-10-14T15:41:07.118 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/476 2023-10-14T15:41:07.119 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:07.128 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:07.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:07.161 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-10-14T15:41:07.772 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:07.787 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:07.788 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:08.597 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:41:08.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:41:21.143 INFO:teuthology.orchestra.run.smithi064.stdout:generic/477 14s 2023-10-14T15:41:21.229 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/477 2023-10-14T15:41:21.230 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:21.261 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:21.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:21.342 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-10-14T15:41:22.958 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:22.975 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:22.975 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:35.275 INFO:teuthology.orchestra.run.smithi064.stdout:generic/478 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/478.out.bad) 2023-10-14T15:41:35.283 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/478.out 2023-10-14 12:30:50.028658688 +0000 2023-10-14T15:41:35.283 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/478.out.bad 2023-10-14 15:41:35.271343221 +0000 2023-10-14T15:41:35.283 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -10,7 +10,7 @@ 2023-10-14T15:41:35.283 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.284 INFO:teuthology.orchestra.run.smithi064.stdout: get wrlck 2023-10-14T15:41:35.284 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.284 INFO:teuthology.orchestra.run.smithi064.stdout: -lock could be placed 2023-10-14T15:41:35.284 INFO:teuthology.orchestra.run.smithi064.stdout: +get wrlck 2023-10-14T15:41:35.284 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.285 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.285 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.285 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -25,7 +25,7 @@ 2023-10-14T15:41:35.285 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.285 INFO:teuthology.orchestra.run.smithi064.stdout: get wrlck 2023-10-14T15:41:35.286 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.286 INFO:teuthology.orchestra.run.smithi064.stdout: -lock could be placed 2023-10-14T15:41:35.286 INFO:teuthology.orchestra.run.smithi064.stdout: +get wrlck 2023-10-14T15:41:35.286 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.286 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.287 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.287 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -37,7 +37,7 @@ 2023-10-14T15:41:35.287 INFO:teuthology.orchestra.run.smithi064.stdout: get rdlck 2023-10-14T15:41:35.288 INFO:teuthology.orchestra.run.smithi064.stdout: get rdlck 2023-10-14T15:41:35.288 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.288 INFO:teuthology.orchestra.run.smithi064.stdout: -lock could be placed 2023-10-14T15:41:35.288 INFO:teuthology.orchestra.run.smithi064.stdout: +get rdlck 2023-10-14T15:41:35.288 INFO:teuthology.orchestra.run.smithi064.stdout: get rdlck 2023-10-14T15:41:35.289 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.289 INFO:teuthology.orchestra.run.smithi064.stdout: get rdlck 2023-10-14T15:41:35.289 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -46,7 +46,7 @@ 2023-10-14T15:41:35.289 INFO:teuthology.orchestra.run.smithi064.stdout: get rdlck 2023-10-14T15:41:35.289 INFO:teuthology.orchestra.run.smithi064.stdout: get rdlck 2023-10-14T15:41:35.290 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.290 INFO:teuthology.orchestra.run.smithi064.stdout: -lock could be placed 2023-10-14T15:41:35.290 INFO:teuthology.orchestra.run.smithi064.stdout: +get rdlck 2023-10-14T15:41:35.290 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.290 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.291 INFO:teuthology.orchestra.run.smithi064.stdout: lock could be placed 2023-10-14T15:41:35.291 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/478 2023-10-14T15:41:35.291 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/478 2023-10-14T15:41:35.292 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:41:35.301 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:35.328 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:41:35.328 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:41:35.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:41:35.329 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-10-14T15:41:35.897 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:35.911 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:35.911 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:36.498 INFO:teuthology.orchestra.run.smithi064.stdout:generic/479 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:36.514 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/479 2023-10-14T15:41:36.514 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/479 2023-10-14T15:41:36.514 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:36.527 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:36.562 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:36.563 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-10-14T15:41:37.151 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:37.165 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:37.166 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:37.627 INFO:teuthology.orchestra.run.smithi064.stdout:generic/480 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:37.639 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/480 2023-10-14T15:41:37.639 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/480 2023-10-14T15:41:37.640 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:37.648 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:37.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:37.678 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-10-14T15:41:38.300 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:38.315 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:38.316 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:38.827 INFO:teuthology.orchestra.run.smithi064.stdout:generic/481 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:38.841 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/481 2023-10-14T15:41:38.841 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/481 2023-10-14T15:41:38.842 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:38.857 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:38.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:38.889 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-10-14T15:41:39.486 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:39.499 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:39.500 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:39.563 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:41:39.569 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:41:40.048 INFO:teuthology.orchestra.run.smithi064.stdout:generic/482 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:40.061 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/482 2023-10-14T15:41:40.062 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/482 2023-10-14T15:41:40.062 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:40.073 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:40.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:40.105 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-10-14T15:41:40.726 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:40.741 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:40.742 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:41.224 INFO:teuthology.orchestra.run.smithi064.stdout:generic/483 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:41.236 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/483 2023-10-14T15:41:41.237 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/483 2023-10-14T15:41:41.237 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:41.246 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:41.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:41.280 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-10-14T15:41:41.866 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:41.879 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:41.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:42.360 INFO:teuthology.orchestra.run.smithi064.stdout:generic/484 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:42.374 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/484 2023-10-14T15:41:42.374 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/484 2023-10-14T15:41:42.375 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:42.384 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:42.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:42.416 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-10-14T15:41:42.978 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:42.992 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:42.993 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:47.458 INFO:teuthology.orchestra.run.smithi064.stdout:generic/485 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-14T15:41:47.472 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/485 2023-10-14T15:41:47.473 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/485 2023-10-14T15:41:47.473 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:47.483 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:47.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:47.514 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-10-14T15:41:48.252 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:48.263 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:48.264 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:48.717 INFO:teuthology.orchestra.run.smithi064.stdout:generic/486 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:48.732 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/486 2023-10-14T15:41:48.732 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/486 2023-10-14T15:41:48.733 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:48.745 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:48.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:48.779 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-10-14T15:41:49.375 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:49.389 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:49.390 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:49.875 INFO:teuthology.orchestra.run.smithi064.stdout:generic/487 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:49.888 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/487 2023-10-14T15:41:49.888 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/487 2023-10-14T15:41:49.889 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:49.898 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:49.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:49.931 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-10-14T15:41:50.516 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:50.529 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:50.529 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:50.953 INFO:teuthology.orchestra.run.smithi064.stdout:generic/488 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:50.965 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/488 2023-10-14T15:41:50.965 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/488 2023-10-14T15:41:50.965 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:50.974 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:51.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:51.005 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-10-14T15:41:51.586 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:51.599 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:51.599 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:52.129 INFO:teuthology.orchestra.run.smithi064.stdout:generic/489 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:52.145 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/489 2023-10-14T15:41:52.146 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/489 2023-10-14T15:41:52.146 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:52.158 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:52.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:52.191 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-10-14T15:41:52.776 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:52.788 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:52.789 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:55.678 INFO:teuthology.orchestra.run.smithi064.stdout:generic/490 3s 2023-10-14T15:41:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/490 2023-10-14T15:41:55.694 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:55.702 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:55.729 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:55.730 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-10-14T15:41:56.457 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:56.468 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:56.468 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:56.908 INFO:teuthology.orchestra.run.smithi064.stdout:generic/491 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:56.921 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/491 2023-10-14T15:41:56.922 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/491 2023-10-14T15:41:56.922 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:56.931 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:56.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:56.963 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-10-14T15:41:57.509 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:57.524 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:57.524 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:57.983 INFO:teuthology.orchestra.run.smithi064.stdout:generic/492 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:57.995 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/492 2023-10-14T15:41:57.995 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/492 2023-10-14T15:41:57.995 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:58.004 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:58.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:58.035 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-10-14T15:41:58.621 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:58.634 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:58.635 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:59.122 INFO:teuthology.orchestra.run.smithi064.stdout:generic/493 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:41:59.136 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/493 2023-10-14T15:41:59.137 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/493 2023-10-14T15:41:59.137 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:41:59.149 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:41:59.186 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:41:59.187 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-10-14T15:41:59.764 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:41:59.776 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:41:59.777 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:00.236 INFO:teuthology.orchestra.run.smithi064.stdout:generic/494 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:00.250 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/494 2023-10-14T15:42:00.250 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/494 2023-10-14T15:42:00.251 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:00.262 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:00.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:00.296 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-10-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi064.stdout:generic/495 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/495 2023-10-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/495 2023-10-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:01.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:01.418 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-10-14T15:42:02.033 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:02.048 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:02.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:02.506 INFO:teuthology.orchestra.run.smithi064.stdout:generic/496 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:02.518 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/496 2023-10-14T15:42:02.518 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/496 2023-10-14T15:42:02.518 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:02.526 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:02.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:02.557 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-10-14T15:42:03.166 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:03.182 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:03.183 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:03.633 INFO:teuthology.orchestra.run.smithi064.stdout:generic/497 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:03.648 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/497 2023-10-14T15:42:03.648 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/497 2023-10-14T15:42:03.649 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:03.660 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:03.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:03.692 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-10-14T15:42:04.299 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:04.312 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:04.313 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:04.779 INFO:teuthology.orchestra.run.smithi064.stdout:generic/498 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:04.793 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/498 2023-10-14T15:42:04.793 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/498 2023-10-14T15:42:04.793 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:04.802 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:04.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:04.832 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-10-14T15:42:05.435 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:05.450 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:05.450 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:05.997 INFO:teuthology.orchestra.run.smithi064.stdout:generic/499 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:06.011 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/499 2023-10-14T15:42:06.012 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/499 2023-10-14T15:42:06.012 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:06.024 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:06.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:06.057 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-10-14T15:42:06.658 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:06.670 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:06.671 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:07.254 INFO:teuthology.orchestra.run.smithi064.stdout:generic/500 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:07.271 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/500 2023-10-14T15:42:07.271 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/500 2023-10-14T15:42:07.271 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:07.279 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:07.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:07.312 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-10-14T15:42:07.893 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:07.907 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:07.908 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:08.425 INFO:teuthology.orchestra.run.smithi064.stdout:generic/501 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:08.440 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/501 2023-10-14T15:42:08.441 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/501 2023-10-14T15:42:08.441 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:08.454 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:08.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:08.494 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-10-14T15:42:09.080 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:09.094 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:09.094 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:09.601 INFO:teuthology.orchestra.run.smithi064.stdout:generic/502 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:09.617 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/502 2023-10-14T15:42:09.617 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/502 2023-10-14T15:42:09.617 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:09.630 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:09.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:09.665 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-10-14T15:42:09.745 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:42:09.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:42:10.177 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:10.190 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:10.190 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:10.640 INFO:teuthology.orchestra.run.smithi064.stdout:generic/503 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:10.652 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/503 2023-10-14T15:42:10.652 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/503 2023-10-14T15:42:10.653 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:10.661 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:10.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:10.691 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-10-14T15:42:11.275 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:11.288 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:11.289 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:11.839 INFO:teuthology.orchestra.run.smithi064.stdout:generic/504 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/504.out.bad) 2023-10-14T15:42:11.846 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/504.out 2023-10-14 12:30:50.033658590 +0000 2023-10-14T15:42:11.847 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/504.out.bad 2023-10-14 15:42:11.834629399 +0000 2023-10-14T15:42:11.847 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,2 +1,3 @@ 2023-10-14T15:42:11.847 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 504 2023-10-14T15:42:11.847 INFO:teuthology.orchestra.run.smithi064.stdout: +lock info not found 2023-10-14T15:42:11.848 INFO:teuthology.orchestra.run.smithi064.stdout: Silence is golden 2023-10-14T15:42:11.855 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/504 2023-10-14T15:42:11.855 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/504 2023-10-14T15:42:11.855 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T15:42:11.864 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:11.895 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T15:42:11.896 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T15:42:11.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T15:42:11.896 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-10-14T15:42:12.490 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:12.503 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:12.504 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:12.945 INFO:teuthology.orchestra.run.smithi064.stdout:generic/505 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:12.956 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/505 2023-10-14T15:42:12.956 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/505 2023-10-14T15:42:12.957 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:12.966 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:12.994 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:12.995 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-10-14T15:42:13.615 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:13.629 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:13.630 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:14.094 INFO:teuthology.orchestra.run.smithi064.stdout:generic/506 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:14.109 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/506 2023-10-14T15:42:14.110 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/506 2023-10-14T15:42:14.110 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:14.122 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:14.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:14.156 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-10-14T15:42:14.756 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:14.769 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:14.770 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:15.325 INFO:teuthology.orchestra.run.smithi064.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-10-14T15:42:15.338 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/507 2023-10-14T15:42:15.338 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/507 2023-10-14T15:42:15.339 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:15.349 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:15.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:15.386 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-10-14T15:42:16.049 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:16.065 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:16.065 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:16.548 INFO:teuthology.orchestra.run.smithi064.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph-fuse 2023-10-14T15:42:16.564 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/508 2023-10-14T15:42:16.565 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/508 2023-10-14T15:42:16.565 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:16.578 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:16.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:16.613 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-10-14T15:42:17.231 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:17.245 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:17.246 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:17.728 INFO:teuthology.orchestra.run.smithi064.stdout:generic/509 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:17.741 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/509 2023-10-14T15:42:17.741 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/509 2023-10-14T15:42:17.741 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:17.751 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:17.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:17.783 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-10-14T15:42:18.407 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:18.421 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:18.421 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:18.903 INFO:teuthology.orchestra.run.smithi064.stdout:generic/510 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/510 2023-10-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/510 2023-10-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:18.925 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:18.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:18.955 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-10-14T15:42:19.596 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:19.611 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:19.611 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:20.092 INFO:teuthology.orchestra.run.smithi064.stdout:generic/511 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:20.104 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/511 2023-10-14T15:42:20.104 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/511 2023-10-14T15:42:20.104 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:20.114 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:20.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:20.145 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-10-14T15:42:20.751 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:20.766 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:20.767 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:21.280 INFO:teuthology.orchestra.run.smithi064.stdout:generic/512 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:21.293 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/512 2023-10-14T15:42:21.293 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/512 2023-10-14T15:42:21.293 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:21.303 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:21.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:21.336 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-10-14T15:42:21.968 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:21.983 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:21.983 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:22.440 INFO:teuthology.orchestra.run.smithi064.stdout:generic/513 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:22.454 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/513 2023-10-14T15:42:22.454 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/513 2023-10-14T15:42:22.455 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:22.468 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:22.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:22.500 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-10-14T15:42:23.073 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:23.088 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:23.089 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:23.509 INFO:teuthology.orchestra.run.smithi064.stdout:generic/514 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:23.521 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/514 2023-10-14T15:42:23.521 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/514 2023-10-14T15:42:23.521 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:23.530 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:23.559 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:23.560 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-10-14T15:42:24.108 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:24.121 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:24.122 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:24.582 INFO:teuthology.orchestra.run.smithi064.stdout:generic/515 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:24.597 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/515 2023-10-14T15:42:24.597 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/515 2023-10-14T15:42:24.598 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:24.610 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:24.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:24.644 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-10-14T15:42:25.266 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:25.281 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:25.281 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:25.937 INFO:teuthology.orchestra.run.smithi064.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph-fuse 2023-10-14T15:42:25.948 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/516 2023-10-14T15:42:25.949 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/516 2023-10-14T15:42:25.949 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:25.959 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:25.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:25.992 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-10-14T15:42:26.725 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:26.737 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:26.737 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi064.stdout:generic/517 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/517 2023-10-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/517 2023-10-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:27.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:27.184 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-10-14T15:42:27.797 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:27.809 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:27.809 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:28.272 INFO:teuthology.orchestra.run.smithi064.stdout:generic/518 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:28.287 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/518 2023-10-14T15:42:28.288 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/518 2023-10-14T15:42:28.288 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:28.301 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:28.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:28.337 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-10-14T15:42:28.948 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:28.964 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:28.964 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:29.403 INFO:teuthology.orchestra.run.smithi064.stdout:generic/519 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:29.417 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/519 2023-10-14T15:42:29.417 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/519 2023-10-14T15:42:29.418 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:29.428 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:29.460 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:29.461 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-10-14T15:42:30.048 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:30.061 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:30.062 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:30.528 INFO:teuthology.orchestra.run.smithi064.stdout:generic/520 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T15:42:30.540 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/520 2023-10-14T15:42:30.541 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/520 2023-10-14T15:42:30.541 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T15:42:30.552 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:30.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T15:42:30.585 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-10-14T15:42:31.200 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T15:42:31.214 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T15:42:31.215 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T15:42:39.906 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:42:39.919 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:43:10.061 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:43:10.071 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:43:40.201 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:43:40.212 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:44:10.357 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:44:10.368 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:44:40.498 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:44:40.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:45:10.653 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:45:10.664 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:45:40.827 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:45:40.839 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:46:10.963 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:46:10.974 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:46:41.110 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:46:41.120 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:47:11.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:47:11.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:47:41.402 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:47:41.412 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:48:11.551 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:48:11.564 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:48:41.695 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:48:41.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:49:11.832 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:49:11.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:49:41.980 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:49:41.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:50:12.134 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:50:12.145 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:50:42.286 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:50:42.298 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:51:12.440 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:51:12.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:51:42.598 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:51:42.608 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:52:12.738 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:52:12.753 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:52:42.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:52:42.888 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:53:13.028 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:53:13.040 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:53:43.165 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:53:43.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:54:13.313 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:54:13.325 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:54:43.457 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:54:43.469 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:55:13.592 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:55:13.602 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:55:43.885 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:55:43.896 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:56:14.038 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:56:14.048 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:56:44.188 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:56:44.198 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:57:14.331 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:57:14.341 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:57:44.468 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:57:44.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:58:14.611 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:58:14.623 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:58:44.754 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:58:44.764 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:59:14.901 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:59:14.911 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:59:45.046 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T15:59:45.057 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:00:15.192 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:00:15.202 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:00:45.673 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:00:45.686 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:01:15.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:01:15.836 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:01:46.208 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:01:46.219 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:02:16.375 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:02:16.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:02:46.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:02:46.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:03:16.820 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:03:16.831 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:03:47.000 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:03:47.011 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:04:17.266 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:04:17.276 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:04:47.401 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:04:47.411 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:05:17.546 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:05:17.557 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:05:47.685 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:05:47.696 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:06:17.852 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:06:17.862 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:06:48.011 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:06:48.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:07:18.224 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:07:18.235 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:07:48.396 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:07:48.408 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:08:18.541 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:08:18.551 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:08:48.687 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:08:48.697 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:09:18.847 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:09:18.864 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:09:49.007 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:09:49.018 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:10:19.181 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:10:19.192 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:10:49.361 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:10:49.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:11:19.616 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:11:19.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:11:49.776 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:11:49.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:12:19.937 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:12:19.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:12:50.086 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:12:50.095 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:13:20.233 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:13:20.247 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:13:50.374 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:13:50.384 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:14:20.516 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:14:20.526 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:14:50.662 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:14:50.676 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:15:20.801 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:15:20.811 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:15:51.005 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:15:51.017 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:16:21.177 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:16:21.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:16:51.764 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:16:51.775 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:17:21.919 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:17:21.930 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:17:52.174 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:17:52.186 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:18:22.330 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:18:22.341 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:18:52.467 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:18:52.481 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:19:22.612 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:19:22.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:19:52.763 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:19:52.775 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:20:23.011 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:20:23.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:20:53.193 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:20:53.204 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:21:23.331 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:21:23.341 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:21:53.583 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:21:53.593 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:22:23.733 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:22:23.743 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:22:53.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:22:53.887 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:23:24.018 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:23:24.028 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:23:54.155 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:23:54.166 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:24:24.297 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:24:24.308 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:24:54.454 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:24:54.465 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:25:24.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:25:24.604 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:25:54.724 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:25:54.734 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:26:24.869 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:26:24.879 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:26:55.222 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:26:55.232 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:27:25.386 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:27:25.397 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:27:55.543 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:27:55.556 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:28:25.680 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:28:25.690 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:28:55.823 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:28:55.832 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:29:26.122 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:29:26.133 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:29:56.269 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:29:56.279 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:30:26.431 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:30:26.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:30:56.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:30:56.596 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:31:26.749 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:31:26.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:31:56.894 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:31:56.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:32:27.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:32:27.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:32:57.188 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:32:57.199 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:33:27.360 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:33:27.370 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:33:57.722 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:33:57.733 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:34:27.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:34:27.888 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:34:58.035 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:34:58.047 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:35:28.179 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:35:28.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:35:58.315 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:35:58.326 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:36:28.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:36:28.476 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:36:28.611 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T16:36:28.610+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 465640) UID: 0 2023-10-14T16:36:28.611 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T16:36:28.609+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 465640) UID: 0 2023-10-14T16:39:21.846 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:39:21.857 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:39:52.321 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:39:52.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:40:22.470 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:40:22.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:40:52.611 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:40:52.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:41:22.749 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:41:22.760 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:41:52.884 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:41:52.895 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:42:23.032 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:42:23.044 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:42:23.147 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T16:42:23.145+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 465776) UID: 0 2023-10-14T16:42:23.147 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T16:42:23.145+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 465776) UID: 0 2023-10-14T16:42:23.148 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T16:42:23.145+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 465776) UID: 0 2023-10-14T16:42:23.148 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T16:42:23.145+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 465776) UID: 0 2023-10-14T16:45:28.138 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:45:28.152 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:45:58.353 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:45:58.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:46:28.501 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:46:28.513 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:46:58.647 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:46:58.657 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:47:29.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:47:29.026 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:47:59.157 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:47:59.169 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:48:29.316 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:48:29.327 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:48:59.455 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:48:59.466 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:49:29.640 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:49:29.651 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:49:59.775 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:49:59.786 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:50:29.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:50:29.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:51:00.049 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:51:00.059 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:51:30.203 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:51:30.213 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:52:00.344 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:52:00.354 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:52:30.501 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:52:30.510 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:53:00.677 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:53:00.688 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:53:30.831 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:53:30.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:00.996 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:01.006 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:31.150 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:54:31.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:01.300 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:01.310 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:31.449 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:55:31.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:01.587 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:01.598 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:31.735 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:56:31.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:01.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:01.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:32.060 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:57:32.071 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:02.213 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:02.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:32.353 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:58:32.364 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:02.500 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:02.511 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:32.635 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T16:59:32.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:02.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:02.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:32.944 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:00:32.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:03.084 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:03.094 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:33.230 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:01:33.241 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:02:03.372 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:02:03.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:02:33.517 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:02:33.528 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:03:03.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:03:03.673 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:03:33.809 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:03:33.820 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:04:03.948 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:04:03.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:04:34.092 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:04:34.102 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:05:04.230 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:05:04.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:05:34.744 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:05:34.754 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:06:04.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:06:04.899 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:06:35.035 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:06:35.045 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:07:05.187 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:07:05.202 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:07:35.334 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:07:35.345 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:08:05.482 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:08:05.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:08:35.637 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:08:35.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:09:05.809 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:09:05.820 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:09:35.954 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:09:35.965 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:10:06.108 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:10:06.119 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:10:36.264 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:10:36.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:11:06.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:11:06.421 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:11:36.556 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:11:36.567 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:12:06.694 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:12:06.705 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:12:36.841 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:12:36.852 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:13:06.998 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:13:07.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:13:37.143 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:13:37.153 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:14:07.296 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:14:07.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:14:37.444 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:14:37.456 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:15:07.591 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:15:07.602 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:15:37.736 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:15:37.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:16:07.883 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:16:07.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:16:38.030 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:16:38.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:17:08.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:17:08.180 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:17:38.314 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:17:38.325 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:17:38.450 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T17:17:38.449+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103275) UID: 0 2023-10-14T17:17:38.451 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T17:17:38.449+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103275) UID: 0 2023-10-14T17:17:38.451 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T17:17:38.449+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103275) UID: 0 2023-10-14T17:17:38.451 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T17:17:38.449+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103275) UID: 0 2023-10-14T17:20:18.655 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:20:18.665 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:20:48.817 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:20:48.828 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:21:18.959 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:21:18.970 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:21:49.103 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:21:49.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:22:19.432 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:22:19.444 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:22:49.588 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:22:49.598 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:23:19.744 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:23:19.755 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:23:49.883 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:23:49.894 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:24:20.024 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:24:20.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:24:50.172 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:24:50.184 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:25:20.320 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:25:20.331 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:25:50.461 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:25:50.471 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:26:20.599 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:26:20.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:26:50.735 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:26:50.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:27:20.870 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:27:20.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:27:51.027 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:27:51.039 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:28:21.166 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:28:21.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:28:51.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:28:51.314 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:29:21.454 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:29:21.464 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:29:51.595 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:29:51.605 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:30:21.751 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:30:21.763 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:30:51.899 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:30:51.914 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:31:22.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:31:22.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:31:52.193 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:31:52.204 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:32:22.330 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:32:22.341 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:32:52.458 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:32:52.468 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:33:22.605 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:33:22.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:33:52.781 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:33:52.793 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:34:22.923 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:34:22.934 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:34:53.061 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:34:53.072 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:35:23.207 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:35:23.218 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:35:53.347 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:35:53.358 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:36:23.508 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:36:23.519 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:36:53.662 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:36:53.673 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:37:23.802 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:37:23.812 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:37:53.944 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:37:53.956 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:38:24.114 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:38:24.125 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:38:54.283 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:38:54.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:39:24.479 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:39:24.489 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:39:54.626 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:39:54.636 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:40:24.771 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:40:24.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:40:54.909 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:40:54.920 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:41:25.045 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:41:25.057 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:41:55.186 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:41:55.200 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:42:25.340 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:42:25.352 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:42:55.512 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:42:55.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:43:25.662 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:43:25.674 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:43:55.802 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:43:55.812 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:44:25.942 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:44:25.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:44:26.077 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T17:44:26.076+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467887) UID: 0 2023-10-14T17:44:26.078 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T17:44:26.076+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467887) UID: 0 2023-10-14T17:44:26.078 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T17:44:26.076+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467887) UID: 0 2023-10-14T17:44:26.079 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T17:44:26.076+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 467887) UID: 0 2023-10-14T17:46:52.277 INFO:teuthology.orchestra.run.smithi064.stdout:generic/521 7461s 2023-10-14T17:46:52.326 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/521 2023-10-14T17:46:52.326 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T17:46:52.337 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T17:46:52.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T17:46:52.443 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-10-14T17:46:54.031 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T17:46:54.042 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T17:46:54.042 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T17:47:27.560 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:47:27.572 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:47:57.748 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:47:57.759 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:48:27.894 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:48:27.904 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:48:58.065 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:48:58.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:49:28.202 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:49:28.215 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:49:58.351 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:49:58.363 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:50:28.498 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:50:28.508 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:50:58.638 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:50:58.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:50:58.758 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T17:50:58.758+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104333) UID: 0 2023-10-14T17:50:58.759 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T17:50:58.758+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104333) UID: 0 2023-10-14T17:50:58.759 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T17:50:58.758+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104333) UID: 0 2023-10-14T17:50:58.760 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T17:50:58.758+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104333) UID: 0 2023-10-14T17:54:05.776 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:54:05.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:54:35.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:54:35.942 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:55:06.070 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:55:06.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:55:36.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:55:36.274 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:56:06.410 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:56:06.420 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:56:36.574 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:56:36.584 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:57:06.727 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:57:06.736 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:57:36.864 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:57:36.877 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:58:07.016 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:58:07.026 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:58:37.258 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:58:37.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:59:07.396 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:59:07.407 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:59:37.563 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T17:59:37.575 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:00:07.721 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:00:07.732 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:00:37.885 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:00:37.896 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:01:08.032 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:01:08.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:01:38.178 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:01:38.189 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:02:08.315 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:02:08.326 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:02:38.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:02:38.487 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:03:08.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:03:08.646 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:03:38.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:03:38.800 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:04:08.936 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:04:08.947 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:04:39.079 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:04:39.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:05:09.223 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:05:09.232 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:05:39.776 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:05:39.787 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:06:10.024 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:06:10.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:06:40.177 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:06:40.187 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:07:10.324 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:07:10.335 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:07:40.488 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:07:40.498 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:08:10.629 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:08:10.639 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:08:40.770 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:08:40.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:09:10.919 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:09:10.929 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:09:41.066 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:09:41.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:10:11.407 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:10:11.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:10:41.543 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:10:41.553 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:11:11.686 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:11:11.697 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:11:41.833 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:11:41.844 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:12:11.975 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:12:11.985 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:12:42.123 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:12:42.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:13:12.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:13:12.273 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:13:42.404 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:13:42.415 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:14:12.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:14:12.564 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:14:42.695 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:14:42.706 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:15:12.849 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:15:12.862 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:15:43.010 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:15:43.020 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:16:13.154 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:16:13.166 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:16:43.307 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:16:43.318 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:17:13.457 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:17:13.467 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:17:43.591 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:17:43.602 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:18:13.755 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:18:13.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:18:43.902 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:18:43.914 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:19:14.408 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:19:14.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:19:44.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:19:44.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:20:14.691 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:20:14.702 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:20:44.836 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:20:44.846 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:21:14.995 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:21:15.005 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:21:45.141 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:21:45.154 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:22:15.293 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:22:15.304 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:22:45.449 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:22:45.459 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:23:15.587 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:23:15.602 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:23:45.877 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:23:45.888 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:24:16.032 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:24:16.043 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:24:46.177 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:24:46.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:25:16.320 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:25:16.330 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:25:46.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:25:46.480 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:26:16.615 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:26:16.626 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:26:46.771 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:26:46.781 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:27:16.934 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:27:16.945 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:27:47.080 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:27:47.090 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:28:17.229 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:28:17.239 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:28:47.377 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:28:47.387 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:29:17.526 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:29:17.536 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:29:47.671 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:29:47.681 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:30:17.814 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:30:17.823 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:30:48.009 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:30:48.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:31:18.186 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:31:18.197 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:31:48.341 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:31:48.352 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:32:18.477 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:32:18.487 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:32:48.618 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:32:48.628 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:33:18.768 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:33:18.778 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:33:48.915 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:33:48.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:34:19.096 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:34:19.106 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:34:49.235 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:34:49.245 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:35:19.368 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:35:19.379 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:35:49.517 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:35:49.527 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:36:19.666 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:36:19.678 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:36:49.830 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:36:49.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:37:19.968 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:37:19.979 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:37:50.497 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:37:50.507 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:38:20.643 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:38:20.654 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:38:50.890 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:38:50.901 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:39:21.036 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:39:21.048 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:39:51.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:39:51.313 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:40:21.450 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:40:21.461 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:40:51.593 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:40:51.603 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:41:21.746 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:41:21.756 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:41:51.896 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:41:51.906 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:42:22.052 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:42:22.063 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:42:52.217 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:42:52.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:43:22.364 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:43:22.375 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:43:52.663 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:43:52.673 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:22.801 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:22.812 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:52.942 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:44:52.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:23.090 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:23.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:53.240 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:45:53.250 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:23.379 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:23.389 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:53.794 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:46:53.804 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:47:23.967 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:47:23.978 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:47:54.300 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:47:54.310 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:24.455 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:24.465 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:54.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:48:54.605 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:24.743 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:24.754 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:54.903 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:49:54.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:25.044 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:25.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:55.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:50:55.191 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:25.330 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:25.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:55.466 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:51:55.477 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:52:25.622 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:52:25.633 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:52:55.756 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:52:55.766 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:25.898 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:25.908 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:56.043 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:53:56.054 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:26.192 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:26.201 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:56.329 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:54:56.344 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:26.494 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:26.505 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:56.736 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:55:56.747 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:27.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:27.015 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:57.150 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:56:57.161 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:27.290 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:27.303 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:57.428 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:57:57.438 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:58:27.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:58:27.605 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:58:57.730 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:58:57.740 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:59:27.864 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:59:27.875 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:59:58.003 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T18:59:58.013 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:00:28.144 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:00:28.155 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:00:58.285 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:00:58.295 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:01:28.449 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:01:28.462 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:01:58.605 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:01:58.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:28.762 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:29.291 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:59.427 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:02:59.439 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:29.570 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:29.582 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:59.714 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:03:59.724 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:04:29.873 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:04:29.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:00.008 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:00.018 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:30.156 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:05:30.169 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:00.305 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:00.316 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:30.436 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:06:30.447 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:00.580 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:00.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:30.722 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:07:30.732 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:00.856 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:00.869 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:31.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:08:31.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:09:01.159 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:09:01.169 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:09:01.287 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T19:09:01.287+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107154) UID: 0 2023-10-14T19:09:01.288 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T19:09:01.287+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107154) UID: 0 2023-10-14T19:09:01.288 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T19:09:01.287+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107154) UID: 0 2023-10-14T19:09:01.289 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T19:09:01.287+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107154) UID: 0 2023-10-14T19:11:56.259 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:11:56.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:12:26.420 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:12:26.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:12:56.625 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:12:56.640 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:26.776 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:26.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:56.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:13:56.924 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:27.062 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:27.072 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:57.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:14:57.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:27.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:27.369 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:57.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:15:57.521 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:16:27.680 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:16:27.689 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:16:57.825 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:16:57.835 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:17:27.976 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:17:27.986 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:17:58.115 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:17:58.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:18:28.255 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:18:28.266 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:18:58.407 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:18:58.418 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:19:28.586 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:19:28.597 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:19:58.733 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:19:58.743 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:19:58.865 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T19:19:58.864+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 471599) UID: 0 2023-10-14T19:19:58.865 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T19:19:58.864+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 471599) UID: 0 2023-10-14T19:22:44.886 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:22:44.896 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:23:15.070 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:23:15.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:23:45.209 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:23:45.220 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:24:15.357 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:24:15.368 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:24:45.521 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:24:45.531 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:25:01.970 INFO:teuthology.orchestra.run.smithi064.stdout:generic/522 5887s 2023-10-14T19:25:01.990 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/522 2023-10-14T19:25:01.990 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:01.999 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:02.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:02.040 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-10-14T19:25:02.652 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:02.666 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:02.666 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:03.122 INFO:teuthology.orchestra.run.smithi064.stdout:generic/523 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:03.136 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/523 2023-10-14T19:25:03.137 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/523 2023-10-14T19:25:03.137 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:03.148 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:03.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:03.177 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-10-14T19:25:03.730 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:03.745 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:03.745 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:04.160 INFO:teuthology.orchestra.run.smithi064.stdout:generic/524 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:04.171 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/524 2023-10-14T19:25:04.171 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/524 2023-10-14T19:25:04.171 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:04.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:04.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:04.210 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-10-14T19:25:04.785 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:04.797 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:04.798 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:05.289 INFO:teuthology.orchestra.run.smithi064.stdout:generic/525 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:05.304 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/525 2023-10-14T19:25:05.305 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/525 2023-10-14T19:25:05.305 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:05.318 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:05.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:05.352 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-10-14T19:25:05.931 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:05.945 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:05.946 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:06.456 INFO:teuthology.orchestra.run.smithi064.stdout:generic/526 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:06.470 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/526 2023-10-14T19:25:06.471 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/526 2023-10-14T19:25:06.471 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:06.484 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:06.519 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:06.519 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-10-14T19:25:07.105 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:07.119 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:07.120 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:07.623 INFO:teuthology.orchestra.run.smithi064.stdout:generic/527 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:07.634 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/527 2023-10-14T19:25:07.634 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/527 2023-10-14T19:25:07.634 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:07.643 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:07.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:07.672 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-10-14T19:25:08.255 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:08.270 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:08.270 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:08.752 INFO:teuthology.orchestra.run.smithi064.stdout:generic/528 [not run] inode creation time not supported by this filesystem 2023-10-14T19:25:08.763 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/528 2023-10-14T19:25:08.764 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/528 2023-10-14T19:25:08.764 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:08.773 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:08.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:08.804 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-10-14T19:25:09.391 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:09.407 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:09.407 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:09.930 INFO:teuthology.orchestra.run.smithi064.stdout:generic/529 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T19:25:09.941 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/529 2023-10-14T19:25:09.942 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/529 2023-10-14T19:25:09.942 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:09.951 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:09.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:09.986 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-10-14T19:25:10.552 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:10.565 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:10.565 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:11.027 INFO:teuthology.orchestra.run.smithi064.stdout:generic/530 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:11.039 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/530 2023-10-14T19:25:11.040 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/530 2023-10-14T19:25:11.040 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:11.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:11.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:11.082 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-10-14T19:25:11.689 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:11.703 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:11.703 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:12.150 INFO:teuthology.orchestra.run.smithi064.stdout:generic/531 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:12.161 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/531 2023-10-14T19:25:12.161 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/531 2023-10-14T19:25:12.161 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:12.170 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:12.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:12.204 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-10-14T19:25:12.765 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:12.778 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:12.778 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:13.319 INFO:teuthology.orchestra.run.smithi064.stdout:generic/532 1s 2023-10-14T19:25:13.338 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/532 2023-10-14T19:25:13.338 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:13.346 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:13.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:13.380 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-10-14T19:25:13.975 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:13.988 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:13.988 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:14.962 INFO:teuthology.orchestra.run.smithi064.stdout:generic/533 0s 2023-10-14T19:25:14.977 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/533 2023-10-14T19:25:14.977 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:14.984 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:15.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:15.007 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-10-14T19:25:15.569 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:15.582 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:15.583 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:15.679 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:25:15.685 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:25:15.990 INFO:teuthology.orchestra.run.smithi064.stdout:generic/534 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:16.001 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/534 2023-10-14T19:25:16.002 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/534 2023-10-14T19:25:16.002 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:16.011 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:16.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:16.043 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-10-14T19:25:16.604 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:16.618 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:16.618 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:17.080 INFO:teuthology.orchestra.run.smithi064.stdout:generic/535 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:17.094 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/535 2023-10-14T19:25:17.094 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/535 2023-10-14T19:25:17.094 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:17.107 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:17.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:17.142 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-10-14T19:25:17.717 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:17.731 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:17.732 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:18.158 INFO:teuthology.orchestra.run.smithi064.stdout:generic/536 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:18.171 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/536 2023-10-14T19:25:18.171 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/536 2023-10-14T19:25:18.172 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:18.181 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:18.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:18.212 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-10-14T19:25:18.803 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:18.818 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:18.818 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:19.297 INFO:teuthology.orchestra.run.smithi064.stdout:generic/537 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T19:25:19.309 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/537 2023-10-14T19:25:19.310 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/537 2023-10-14T19:25:19.310 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T19:25:19.319 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:19.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T19:25:19.349 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-10-14T19:25:19.897 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T19:25:19.909 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T19:25:19.910 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T19:25:45.816 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:25:45.826 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:26:15.979 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:26:15.990 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:26:46.117 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:26:46.129 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:27:16.281 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:27:16.293 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:27:46.428 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:27:46.439 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:28:16.581 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:28:16.592 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:28:46.736 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:28:46.746 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:29:16.894 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:29:16.904 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:29:47.032 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:29:47.042 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:30:17.193 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:30:17.206 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:30:47.389 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:30:47.400 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:31:17.537 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:31:17.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:31:17.660 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T19:31:17.659+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107822) UID: 0 2023-10-14T19:31:17.660 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T19:31:17.659+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107822) UID: 0 2023-10-14T19:31:17.661 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T19:31:17.659+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107822) UID: 0 2023-10-14T19:31:17.661 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T19:31:17.659+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107822) UID: 0 2023-10-14T19:34:08.947 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:34:08.957 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:34:39.107 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:34:39.118 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:35:09.255 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:35:09.269 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:35:39.412 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:35:39.422 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:36:09.593 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:36:09.603 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:36:39.741 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:36:39.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:37:09.897 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:37:09.907 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:37:40.041 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:37:40.055 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:38:10.190 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:38:10.202 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:38:40.341 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:38:40.351 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:39:10.483 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:39:10.494 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:39:40.623 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:39:40.854 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:40:10.990 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:40:11.000 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:40:41.146 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:40:41.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:41:11.292 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:41:11.303 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:41:41.443 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:41:41.454 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:42:11.585 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:42:11.596 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:42:41.741 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:42:41.751 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:43:11.881 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:43:11.893 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:43:42.024 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:43:42.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:44:12.170 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:44:12.180 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:44:42.318 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:44:42.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:45:12.479 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:45:12.490 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:45:42.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:45:42.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:46:12.780 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:46:12.791 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:46:42.921 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:46:42.931 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:47:13.069 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:47:13.080 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:47:43.219 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:47:43.229 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:48:13.365 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:48:13.382 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:48:43.515 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:48:43.525 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:49:13.754 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:49:13.765 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:49:43.903 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:49:43.914 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:50:14.069 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:50:14.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:50:44.708 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:50:44.719 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:51:14.858 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:51:14.868 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:51:44.996 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:51:45.007 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:52:15.136 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:52:15.146 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:52:45.300 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:52:45.311 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:53:15.443 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:53:15.453 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:53:45.589 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:53:45.600 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:54:15.778 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:54:15.789 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:54:45.925 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:54:45.936 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:55:16.066 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:55:16.076 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:55:46.214 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:55:46.225 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:56:16.361 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:56:16.374 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:56:46.502 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:56:46.515 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:57:16.657 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:57:16.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:57:46.920 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:57:46.932 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:58:17.065 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:58:17.077 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:58:47.204 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:58:47.214 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:59:17.338 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:59:17.348 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:59:47.486 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T19:59:47.496 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:00:17.634 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:00:17.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:00:47.789 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:00:47.800 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:01:17.931 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:01:17.941 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:01:48.072 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:01:48.083 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:02:18.218 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:02:18.228 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:02:48.369 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:02:48.381 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:03:18.516 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:03:18.526 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:03:48.656 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:03:48.666 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:04:18.796 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:04:18.808 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:04:48.944 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:04:48.954 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:04:49.070 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T20:04:49.069+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 108978) UID: 0 2023-10-14T20:04:49.071 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T20:04:49.069+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 108978) UID: 0 2023-10-14T20:04:49.071 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T20:04:49.069+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 108978) UID: 0 2023-10-14T20:04:49.071 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T20:04:49.069+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 108978) UID: 0 2023-10-14T20:07:47.522 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:07:47.533 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:08:17.681 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:08:17.690 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:08:47.818 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:08:47.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:09:17.966 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:09:17.977 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:09:48.105 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:09:48.117 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:10:18.260 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:10:18.270 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:10:48.420 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:10:48.431 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:11:18.560 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:11:18.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:11:48.717 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:11:48.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:12:18.872 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:12:18.882 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:12:49.019 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:12:49.031 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:13:19.174 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:13:19.184 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:13:49.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:13:49.338 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:14:19.492 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:14:19.503 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:14:49.930 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:14:49.941 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:15:20.073 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:15:20.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:15:50.239 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:15:50.249 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:16:20.383 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:16:20.394 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:16:50.552 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:16:50.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:17:20.702 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:17:20.717 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:17:50.866 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:17:50.876 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:18:21.012 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:18:21.023 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:18:51.152 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:18:51.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:19:21.310 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:19:21.320 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:19:51.457 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:19:51.468 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:20:21.599 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:20:21.609 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:20:51.745 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:20:51.757 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:21:21.889 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:21:21.900 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:21:52.151 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:21:52.163 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:22:22.299 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:22:22.310 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:22:52.458 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:22:52.468 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:23:22.605 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:23:22.617 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:23:52.875 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:23:52.885 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:24:23.011 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:24:23.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:24:53.166 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:24:53.176 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:25:23.306 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:25:23.317 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:25:53.476 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:25:53.488 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:26:23.664 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:26:23.675 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:26:53.811 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:26:53.821 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:27:23.958 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:27:23.970 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:27:54.120 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:27:54.130 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:28:24.394 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:28:24.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:28:54.538 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:28:54.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:29:24.692 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:29:24.703 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:29:54.840 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:29:54.850 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:30:24.997 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:30:25.010 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:30:55.151 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:30:55.161 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:31:25.303 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:31:25.311 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:31:55.504 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:31:55.514 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:32:25.656 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:32:25.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:32:55.865 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:32:55.876 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:33:26.002 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:33:26.014 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:33:56.164 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:33:56.175 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:34:26.327 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:34:26.339 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:34:56.474 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:34:56.486 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:35:26.630 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:35:26.644 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:35:56.778 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:35:56.788 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:35:56.912 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T20:35:56.911+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485261) UID: 0 2023-10-14T20:35:56.912 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T20:35:56.911+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485261) UID: 0 2023-10-14T20:35:56.913 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T20:35:56.911+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485261) UID: 0 2023-10-14T20:35:56.913 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T20:35:56.911+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 485261) UID: 0 2023-10-14T20:39:07.922 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:39:07.932 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:39:38.074 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:39:38.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:40:08.217 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:40:08.227 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:40:38.372 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:40:38.382 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:41:08.532 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:41:08.542 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:41:38.677 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:41:38.690 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:42:08.820 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:42:08.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:42:38.986 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:42:38.997 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:43:09.132 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:43:09.143 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:43:39.280 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:43:39.290 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:44:09.428 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:44:09.441 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:44:09.547 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T20:44:09.547+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 110239) UID: 0 2023-10-14T20:44:09.548 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T20:44:09.547+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 110239) UID: 0 2023-10-14T20:44:09.549 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T20:44:09.547+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 110239) UID: 0 2023-10-14T20:44:09.549 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T20:44:09.547+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 110239) UID: 0 2023-10-14T20:47:11.098 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:47:11.108 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:47:41.255 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:47:41.265 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:48:11.395 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:48:11.405 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:48:41.544 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:48:41.555 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:49:11.700 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:49:11.710 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:49:41.841 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:49:41.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:50:11.993 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:50:12.003 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:50:42.131 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:50:42.142 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:51:12.268 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:51:12.278 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:51:42.434 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:51:42.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:51:42.581 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T20:51:42.579+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 486585) UID: 0 2023-10-14T20:51:42.582 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T20:51:42.580+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 486585) UID: 0 2023-10-14T20:51:42.582 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T20:51:42.579+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 486585) UID: 0 2023-10-14T20:51:42.582 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T20:51:42.580+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 486585) UID: 0 2023-10-14T20:54:52.596 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:54:52.606 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:55:22.772 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:55:22.782 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:55:53.029 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:55:53.040 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:56:23.176 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:56:23.186 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:56:53.317 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:56:53.327 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:57:23.481 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:57:23.491 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:57:53.620 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:57:53.628 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:58:23.765 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:58:23.777 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:58:53.912 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:58:53.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:59:24.059 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:59:24.071 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:59:54.204 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T20:59:54.218 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:00:24.359 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:00:24.371 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:00:54.497 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:00:54.507 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:01:24.635 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:01:24.645 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:01:54.791 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:01:54.802 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:02:24.942 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:02:24.952 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:02:55.091 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:02:55.101 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:03:25.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:03:25.257 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:03:55.449 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:03:55.460 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:04:25.600 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:04:25.610 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:04:55.758 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:04:55.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:05:25.898 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:05:25.908 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:05:56.046 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:05:56.052 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:06:26.186 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:06:26.198 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:06:56.345 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:06:56.356 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:07:26.492 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:07:26.502 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:07:56.740 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:07:56.750 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:08:26.878 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:08:26.891 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:08:57.033 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:08:57.044 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:09:27.500 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:09:27.510 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:09:57.650 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:09:57.660 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:10:27.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:10:27.808 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:10:57.946 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:10:57.960 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:11:01.567 INFO:teuthology.orchestra.run.smithi064.stdout:generic/538 6342s 2023-10-14T21:11:01.618 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/538 2023-10-14T21:11:01.618 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:01.632 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:01.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:01.674 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-10-14T21:11:02.871 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:02.883 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:02.883 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:09.156 INFO:teuthology.orchestra.run.smithi064.stdout:generic/539 7s 2023-10-14T21:11:09.174 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/539 2023-10-14T21:11:09.175 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:09.183 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:09.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:09.213 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-10-14T21:11:09.960 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:09.972 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:09.973 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:10.426 INFO:teuthology.orchestra.run.smithi064.stdout:generic/540 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:10.440 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/540 2023-10-14T21:11:10.440 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/540 2023-10-14T21:11:10.441 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:10.453 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:10.487 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:10.487 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-10-14T21:11:11.081 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:11.095 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:11.095 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:11.534 INFO:teuthology.orchestra.run.smithi064.stdout:generic/541 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:11.546 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/541 2023-10-14T21:11:11.547 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/541 2023-10-14T21:11:11.547 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:11.556 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:11.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:11.588 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-10-14T21:11:12.197 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:12.211 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:12.211 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:12.622 INFO:teuthology.orchestra.run.smithi064.stdout:generic/542 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:12.634 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/542 2023-10-14T21:11:12.635 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/542 2023-10-14T21:11:12.635 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:12.644 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:12.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:12.676 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-10-14T21:11:13.275 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:13.287 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:13.287 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:13.740 INFO:teuthology.orchestra.run.smithi064.stdout:generic/543 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:13.753 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/543 2023-10-14T21:11:13.753 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/543 2023-10-14T21:11:13.753 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:13.764 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:13.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:13.795 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-10-14T21:11:14.427 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:14.442 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:14.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:14.925 INFO:teuthology.orchestra.run.smithi064.stdout:generic/544 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:14.938 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/544 2023-10-14T21:11:14.939 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/544 2023-10-14T21:11:14.939 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:14.949 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:14.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:14.981 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-10-14T21:11:15.557 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:15.574 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:15.574 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:16.182 INFO:teuthology.orchestra.run.smithi064.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-10-14T21:11:16.198 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/545 2023-10-14T21:11:16.198 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/545 2023-10-14T21:11:16.198 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:16.210 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:16.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:16.247 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-10-14T21:11:16.835 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:16.849 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:16.849 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:17.502 INFO:teuthology.orchestra.run.smithi064.stdout:generic/546 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:17.517 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/546 2023-10-14T21:11:17.517 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/546 2023-10-14T21:11:17.517 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:17.527 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:17.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:17.561 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-10-14T21:11:18.178 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:18.190 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:18.191 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:18.679 INFO:teuthology.orchestra.run.smithi064.stdout:generic/547 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:18.689 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/547 2023-10-14T21:11:18.689 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/547 2023-10-14T21:11:18.690 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:18.698 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:18.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:18.727 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-10-14T21:11:19.321 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:19.333 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:19.334 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:19.922 INFO:teuthology.orchestra.run.smithi064.stdout:generic/548 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:19.934 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/548 2023-10-14T21:11:19.934 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/548 2023-10-14T21:11:19.934 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:19.943 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:19.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:19.980 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-10-14T21:11:20.587 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:20.599 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:20.599 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:21.139 INFO:teuthology.orchestra.run.smithi064.stdout:generic/549 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:21.150 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/549 2023-10-14T21:11:21.150 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/549 2023-10-14T21:11:21.151 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:21.160 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:21.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:21.191 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-10-14T21:11:21.812 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:21.826 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:21.826 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:22.404 INFO:teuthology.orchestra.run.smithi064.stdout:generic/550 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:22.420 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/550 2023-10-14T21:11:22.420 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/550 2023-10-14T21:11:22.420 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:22.432 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:22.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:22.467 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-10-14T21:11:23.059 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:23.073 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:23.074 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:23.534 INFO:teuthology.orchestra.run.smithi064.stdout:generic/551 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:23.546 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/551 2023-10-14T21:11:23.546 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/551 2023-10-14T21:11:23.547 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:23.556 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:23.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:23.589 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-10-14T21:11:24.170 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:24.185 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:24.186 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:24.635 INFO:teuthology.orchestra.run.smithi064.stdout:generic/552 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:24.650 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/552 2023-10-14T21:11:24.650 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/552 2023-10-14T21:11:24.651 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:24.662 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:24.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:24.703 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-10-14T21:11:25.337 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:25.360 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:25.360 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:25.985 INFO:teuthology.orchestra.run.smithi064.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs/bad args?) 2023-10-14T21:11:25.999 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/553 2023-10-14T21:11:26.000 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/553 2023-10-14T21:11:26.000 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:26.012 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:26.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:26.047 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-10-14T21:11:26.789 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:26.802 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:26.802 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:27.215 INFO:teuthology.orchestra.run.smithi064.stdout:generic/554 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:27.227 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/554 2023-10-14T21:11:27.227 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/554 2023-10-14T21:11:27.228 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:27.238 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:27.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:27.269 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-10-14T21:11:27.888 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:27.903 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:27.903 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:28.099 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:11:28.107 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:11:28.215 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T21:11:28.215+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495821) UID: 0 2023-10-14T21:11:28.216 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T21:11:28.215+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495821) UID: 0 2023-10-14T21:11:28.216 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T21:11:28.215+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495821) UID: 0 2023-10-14T21:11:28.217 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T21:11:28.215+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 495821) UID: 0 2023-10-14T21:11:28.389 INFO:teuthology.orchestra.run.smithi064.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs/bad args?) 2023-10-14T21:11:28.398 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/555 2023-10-14T21:11:28.398 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/555 2023-10-14T21:11:28.398 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:28.406 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:28.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:28.435 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-10-14T21:11:29.206 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:29.217 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:29.217 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:29.604 INFO:teuthology.orchestra.run.smithi064.stdout:generic/556 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:29.618 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/556 2023-10-14T21:11:29.618 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/556 2023-10-14T21:11:29.619 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:29.630 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:29.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:29.660 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-10-14T21:11:30.223 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:30.235 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:30.235 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:30.663 INFO:teuthology.orchestra.run.smithi064.stdout:generic/557 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:30.674 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/557 2023-10-14T21:11:30.675 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/557 2023-10-14T21:11:30.675 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:30.683 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:30.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:30.707 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-10-14T21:11:31.193 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:31.205 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:31.205 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:31.635 INFO:teuthology.orchestra.run.smithi064.stdout:generic/558 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:31.648 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/558 2023-10-14T21:11:31.649 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/558 2023-10-14T21:11:31.649 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:31.658 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:31.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:31.697 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-10-14T21:11:32.220 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:32.232 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:32.232 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:32.620 INFO:teuthology.orchestra.run.smithi064.stdout:generic/559 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:32.630 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/559 2023-10-14T21:11:32.631 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/559 2023-10-14T21:11:32.631 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:32.638 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:32.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:32.664 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-10-14T21:11:33.219 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:33.231 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:33.232 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:33.763 INFO:teuthology.orchestra.run.smithi064.stdout:generic/560 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:33.774 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/560 2023-10-14T21:11:33.775 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/560 2023-10-14T21:11:33.775 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:33.783 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:33.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:33.811 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-10-14T21:11:34.305 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:34.318 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:34.318 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:34.731 INFO:teuthology.orchestra.run.smithi064.stdout:generic/561 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:34.746 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/561 2023-10-14T21:11:34.747 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/561 2023-10-14T21:11:34.747 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:34.756 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:34.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:34.785 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-10-14T21:11:35.306 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:35.319 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:35.319 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:35.721 INFO:teuthology.orchestra.run.smithi064.stdout:generic/562 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:35.731 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/562 2023-10-14T21:11:35.731 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/562 2023-10-14T21:11:35.732 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:35.740 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:35.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:35.768 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-10-14T21:11:36.322 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:36.335 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:36.335 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:36.861 INFO:teuthology.orchestra.run.smithi064.stdout:generic/563 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:36.876 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/563 2023-10-14T21:11:36.877 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/563 2023-10-14T21:11:36.877 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:36.889 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:36.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:36.924 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-10-14T21:11:37.453 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:37.466 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:37.466 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:38.871 INFO:teuthology.orchestra.run.smithi064.stdout:generic/564 1s 2023-10-14T21:11:38.894 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/564 2023-10-14T21:11:38.894 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:38.906 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:38.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:38.937 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-10-14T21:11:39.732 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:39.743 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:39.743 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:40.140 INFO:teuthology.orchestra.run.smithi064.stdout:generic/565 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:40.150 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/565 2023-10-14T21:11:40.150 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/565 2023-10-14T21:11:40.150 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:40.158 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:40.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:40.184 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-10-14T21:11:40.701 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:40.713 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:40.713 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:41.163 INFO:teuthology.orchestra.run.smithi064.stdout:generic/566 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:41.174 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/566 2023-10-14T21:11:41.175 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/566 2023-10-14T21:11:41.175 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:41.184 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:41.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:41.208 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-10-14T21:11:41.733 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:41.744 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:41.745 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:42.129 INFO:teuthology.orchestra.run.smithi064.stdout:generic/567 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:42.138 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/567 2023-10-14T21:11:42.138 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/567 2023-10-14T21:11:42.138 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:42.146 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:42.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:42.168 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-10-14T21:11:42.647 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:42.660 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:42.660 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:43.278 INFO:teuthology.orchestra.run.smithi064.stdout:generic/568 1s 2023-10-14T21:11:43.339 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/568 2023-10-14T21:11:43.340 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:43.352 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:43.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:43.404 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-10-14T21:11:44.019 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:44.032 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:44.032 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:44.534 INFO:teuthology.orchestra.run.smithi064.stdout:generic/569 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:44.548 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/569 2023-10-14T21:11:44.548 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/569 2023-10-14T21:11:44.549 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:44.560 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:44.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:44.594 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-10-14T21:11:45.123 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:45.136 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:45.136 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:45.513 INFO:teuthology.orchestra.run.smithi064.stdout:generic/570 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:45.522 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/570 2023-10-14T21:11:45.522 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/570 2023-10-14T21:11:45.522 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:45.529 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:45.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:45.553 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-10-14T21:11:46.083 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:46.096 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:46.096 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:52.816 INFO:teuthology.orchestra.run.smithi064.stdout:generic/571 6s 2023-10-14T21:11:52.834 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/571 2023-10-14T21:11:52.835 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:52.843 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:52.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:52.870 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-10-14T21:11:53.630 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:53.642 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:53.642 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:53.983 INFO:teuthology.orchestra.run.smithi064.stdout:generic/572 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:53.994 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/572 2023-10-14T21:11:53.994 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/572 2023-10-14T21:11:53.994 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:54.003 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:54.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:54.032 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-10-14T21:11:54.564 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:54.576 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:54.576 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:54.979 INFO:teuthology.orchestra.run.smithi064.stdout:generic/573 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:54.991 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/573 2023-10-14T21:11:54.991 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/573 2023-10-14T21:11:54.991 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:55.000 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:55.030 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:55.030 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-10-14T21:11:55.604 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:55.618 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:55.618 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:56.021 INFO:teuthology.orchestra.run.smithi064.stdout:generic/574 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:56.031 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/574 2023-10-14T21:11:56.070 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/574 2023-10-14T21:11:56.070 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:56.071 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:56.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:56.072 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-10-14T21:11:56.585 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:56.597 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:56.598 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:56.990 INFO:teuthology.orchestra.run.smithi064.stdout:generic/575 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:57.000 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/575 2023-10-14T21:11:57.001 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/575 2023-10-14T21:11:57.001 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:57.008 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:57.031 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:57.032 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-10-14T21:11:57.530 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:57.543 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:57.544 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:58.011 INFO:teuthology.orchestra.run.smithi064.stdout:generic/576 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:58.023 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/576 2023-10-14T21:11:58.023 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/576 2023-10-14T21:11:58.024 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:58.033 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:58.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:58.062 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-10-14T21:11:58.564 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:58.575 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:58.576 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:58.962 INFO:teuthology.orchestra.run.smithi064.stdout:generic/577 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:11:58.976 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/577 2023-10-14T21:11:58.976 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/577 2023-10-14T21:11:58.977 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:11:58.988 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:11:59.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:11:59.016 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-10-14T21:11:59.539 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:11:59.552 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:11:59.553 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:00.065 INFO:teuthology.orchestra.run.smithi064.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-10-14T21:12:00.077 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/578 2023-10-14T21:12:00.077 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/578 2023-10-14T21:12:00.077 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:00.086 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:00.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:00.115 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-10-14T21:12:00.638 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:00.651 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:00.652 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:01.052 INFO:teuthology.orchestra.run.smithi064.stdout:generic/579 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:01.061 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/579 2023-10-14T21:12:01.062 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/579 2023-10-14T21:12:01.062 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:01.070 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:01.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:01.096 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-10-14T21:12:01.634 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:01.646 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:01.646 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:02.105 INFO:teuthology.orchestra.run.smithi064.stdout:generic/580 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:02.115 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/580 2023-10-14T21:12:02.115 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/580 2023-10-14T21:12:02.115 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:02.122 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:02.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:02.148 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-10-14T21:12:02.683 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:02.697 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:02.697 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:04.718 INFO:teuthology.orchestra.run.smithi064.stdout:generic/581 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:04.732 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/581 2023-10-14T21:12:04.732 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/581 2023-10-14T21:12:04.732 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:04.741 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:04.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:04.773 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-10-14T21:12:05.309 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:05.322 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:05.322 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:05.829 INFO:teuthology.orchestra.run.smithi064.stdout:generic/582 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:05.843 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/582 2023-10-14T21:12:05.844 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/582 2023-10-14T21:12:05.844 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:05.855 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:05.886 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:05.887 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-10-14T21:12:06.402 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:06.414 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:06.415 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:06.929 INFO:teuthology.orchestra.run.smithi064.stdout:generic/583 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:06.939 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/583 2023-10-14T21:12:06.939 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/583 2023-10-14T21:12:06.939 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:06.948 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:06.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:06.976 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-10-14T21:12:07.504 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:07.516 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:07.516 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:08.012 INFO:teuthology.orchestra.run.smithi064.stdout:generic/584 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:08.022 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/584 2023-10-14T21:12:08.023 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/584 2023-10-14T21:12:08.023 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:08.031 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:08.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:08.059 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-10-14T21:12:08.583 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:08.595 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:08.596 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:09.042 INFO:teuthology.orchestra.run.smithi064.stdout:generic/585 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:09.056 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/585 2023-10-14T21:12:09.056 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/585 2023-10-14T21:12:09.057 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:09.068 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:09.098 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:09.099 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-10-14T21:12:09.644 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:09.656 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:09.656 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:52.467 INFO:teuthology.orchestra.run.smithi064.stdout:generic/586 43s 2023-10-14T21:12:52.485 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/586 2023-10-14T21:12:52.486 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:52.495 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:52.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:52.524 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-10-14T21:12:53.274 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:53.285 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:53.286 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:54.018 INFO:teuthology.orchestra.run.smithi064.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T21:12:54.032 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/587 2023-10-14T21:12:54.032 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/587 2023-10-14T21:12:54.033 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:54.044 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:54.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:54.072 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-10-14T21:12:54.616 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:54.627 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:54.627 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:55.021 INFO:teuthology.orchestra.run.smithi064.stdout:generic/588 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:55.034 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/588 2023-10-14T21:12:55.034 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/588 2023-10-14T21:12:55.035 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:55.044 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:55.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:55.077 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-10-14T21:12:55.618 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:55.630 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:55.630 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:56.040 INFO:teuthology.orchestra.run.smithi064.stdout:generic/589 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:56.051 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/589 2023-10-14T21:12:56.051 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/589 2023-10-14T21:12:56.051 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:56.059 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:56.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:56.086 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-10-14T21:12:56.579 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:56.592 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:56.592 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:56.977 INFO:teuthology.orchestra.run.smithi064.stdout:generic/590 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:56.986 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/590 2023-10-14T21:12:56.986 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/590 2023-10-14T21:12:56.986 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:56.993 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:57.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:57.018 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-10-14T21:12:57.540 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:57.552 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:57.552 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:58.361 INFO:teuthology.orchestra.run.smithi064.stdout:generic/591 1s 2023-10-14T21:12:58.379 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/591 2023-10-14T21:12:58.379 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:58.388 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:58.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:58.418 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-10-14T21:12:59.166 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:12:59.178 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:12:59.178 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:59.639 INFO:teuthology.orchestra.run.smithi064.stdout:generic/592 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:12:59.651 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/592 2023-10-14T21:12:59.651 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/592 2023-10-14T21:12:59.651 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:12:59.660 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:12:59.689 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:12:59.690 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-10-14T21:13:00.196 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:00.209 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:00.209 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:00.669 INFO:teuthology.orchestra.run.smithi064.stdout:generic/593 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:00.681 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/593 2023-10-14T21:13:00.681 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/593 2023-10-14T21:13:00.681 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:00.689 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:00.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:00.718 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-10-14T21:13:01.263 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:01.276 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:01.276 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:01.690 INFO:teuthology.orchestra.run.smithi064.stdout:generic/594 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:01.702 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/594 2023-10-14T21:13:01.702 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/594 2023-10-14T21:13:01.703 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:01.710 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:01.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:01.740 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-10-14T21:13:02.264 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:02.277 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:02.277 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:02.766 INFO:teuthology.orchestra.run.smithi064.stdout:generic/595 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:02.778 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/595 2023-10-14T21:13:02.778 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/595 2023-10-14T21:13:02.778 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:02.787 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:02.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:02.814 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-10-14T21:13:03.356 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:03.368 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:03.368 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:03.902 INFO:teuthology.orchestra.run.smithi064.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-10-14T21:13:03.913 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/596 2023-10-14T21:13:03.913 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/596 2023-10-14T21:13:03.913 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:03.921 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:03.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:03.951 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-10-14T21:13:04.442 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:04.453 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:04.454 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:07.516 INFO:teuthology.orchestra.run.smithi064.stdout:generic/597 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/597.out.bad) 2023-10-14T21:13:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/597.out 2023-10-14 12:30:50.050658256 +0000 2023-10-14T21:13:07.523 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/597.out.bad 2023-10-14 21:13:07.513141250 +0000 2023-10-14T21:13:07.524 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -4,11 +4,11 @@ 2023-10-14T21:13:07.524 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_symlinks = 0 2023-10-14T21:13:07.524 INFO:teuthology.orchestra.run.smithi064.stdout: successfully followed symlink 2023-10-14T21:13:07.524 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_symlinks = 1 2023-10-14T21:13:07.524 INFO:teuthology.orchestra.run.smithi064.stdout: -Permission denied 2023-10-14T21:13:07.525 INFO:teuthology.orchestra.run.smithi064.stdout: +successfully followed symlink 2023-10-14T21:13:07.525 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:07.525 INFO:teuthology.orchestra.run.smithi064.stdout: == Test hardlink create protection when 2023-10-14T21:13:07.525 INFO:teuthology.orchestra.run.smithi064.stdout: == process != target owner and process cannot read target 2023-10-14T21:13:07.525 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_hardlinks = 0 2023-10-14T21:13:07.526 INFO:teuthology.orchestra.run.smithi064.stdout: -successfully created hardlink 2023-10-14T21:13:07.526 INFO:teuthology.orchestra.run.smithi064.stdout: +Permission denied 2023-10-14T21:13:07.526 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_hardlinks = 1 2023-10-14T21:13:07.526 INFO:teuthology.orchestra.run.smithi064.stdout: -ln: failed to create hard link 'TEST_DIR/597/sticky_dir/hardlink' => 'TEST_DIR/597/target': Operation not permitted 2023-10-14T21:13:07.526 INFO:teuthology.orchestra.run.smithi064.stdout: +Permission denied 2023-10-14T21:13:07.530 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/597 2023-10-14T21:13:07.530 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/597 2023-10-14T21:13:07.531 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T21:13:07.538 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:07.562 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T21:13:07.563 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T21:13:07.563 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T21:13:07.564 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-10-14T21:13:08.319 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:08.330 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:08.330 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:09.769 INFO:teuthology.orchestra.run.smithi064.stdout:generic/598 - output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/598.out.bad) 2023-10-14T21:13:09.777 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/598.out 2023-10-14 12:30:50.050658256 +0000 2023-10-14T21:13:09.777 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/598.out.bad 2023-10-14 21:13:09.765096315 +0000 2023-10-14T21:13:09.777 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -5,13 +5,10 @@ 2023-10-14T21:13:09.777 INFO:teuthology.orchestra.run.smithi064.stdout: = only group writable dir 2023-10-14T21:13:09.777 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_regular = 1 2023-10-14T21:13:09.778 INFO:teuthology.orchestra.run.smithi064.stdout: = group & world writable dir 2023-10-14T21:13:09.778 INFO:teuthology.orchestra.run.smithi064.stdout: -Permission denied 2023-10-14T21:13:09.778 INFO:teuthology.orchestra.run.smithi064.stdout: = only group writable dir 2023-10-14T21:13:09.778 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_regular = 2 2023-10-14T21:13:09.779 INFO:teuthology.orchestra.run.smithi064.stdout: = group & world writable dir 2023-10-14T21:13:09.779 INFO:teuthology.orchestra.run.smithi064.stdout: -Permission denied 2023-10-14T21:13:09.780 INFO:teuthology.orchestra.run.smithi064.stdout: = only group writable dir 2023-10-14T21:13:09.780 INFO:teuthology.orchestra.run.smithi064.stdout: -Permission denied 2023-10-14T21:13:09.780 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:09.780 INFO:teuthology.orchestra.run.smithi064.stdout: == Test fifo open when owned by another and fifo owner != dir owner 2023-10-14T21:13:09.781 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_fifos = 0 2023-10-14T21:13:09.781 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -19,10 +16,7 @@ 2023-10-14T21:13:09.781 INFO:teuthology.orchestra.run.smithi064.stdout: = only group writable dir 2023-10-14T21:13:09.781 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_fifos = 1 2023-10-14T21:13:09.781 INFO:teuthology.orchestra.run.smithi064.stdout: = group & world writable dir 2023-10-14T21:13:09.782 INFO:teuthology.orchestra.run.smithi064.stdout: -Permission denied 2023-10-14T21:13:09.782 INFO:teuthology.orchestra.run.smithi064.stdout: = only group writable dir 2023-10-14T21:13:09.782 INFO:teuthology.orchestra.run.smithi064.stdout: fs.protected_fifos = 2 2023-10-14T21:13:09.782 INFO:teuthology.orchestra.run.smithi064.stdout: = group & world writable dir 2023-10-14T21:13:09.782 INFO:teuthology.orchestra.run.smithi064.stdout: -Permission denied 2023-10-14T21:13:09.783 INFO:teuthology.orchestra.run.smithi064.stdout: = only group writable dir 2023-10-14T21:13:09.783 INFO:teuthology.orchestra.run.smithi064.stdout: -Permission denied 2023-10-14T21:13:09.784 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/598 2023-10-14T21:13:09.785 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/598 2023-10-14T21:13:09.785 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T21:13:09.793 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:09.822 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T21:13:09.823 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T21:13:09.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T21:13:09.824 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-10-14T21:13:10.629 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:10.641 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:10.642 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:11.040 INFO:teuthology.orchestra.run.smithi064.stdout:generic/599 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:11.050 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/599 2023-10-14T21:13:11.050 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/599 2023-10-14T21:13:11.050 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:11.057 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:11.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:11.083 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-10-14T21:13:11.607 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:11.619 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:11.619 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:12.033 INFO:teuthology.orchestra.run.smithi064.stdout:generic/600 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:12.042 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/600 2023-10-14T21:13:12.042 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/600 2023-10-14T21:13:12.042 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:12.049 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:12.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:12.078 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-10-14T21:13:12.597 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:12.611 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:12.611 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:13.028 INFO:teuthology.orchestra.run.smithi064.stdout:generic/601 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:13.039 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/601 2023-10-14T21:13:13.040 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/601 2023-10-14T21:13:13.040 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:13.048 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:13.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:13.079 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-10-14T21:13:13.616 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:13.627 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:13.627 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:14.098 INFO:teuthology.orchestra.run.smithi064.stdout:generic/602 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:14.111 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/602 2023-10-14T21:13:14.111 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/602 2023-10-14T21:13:14.111 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:14.119 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:14.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:14.148 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-10-14T21:13:14.679 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:14.691 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:14.691 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:15.098 INFO:teuthology.orchestra.run.smithi064.stdout:generic/603 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:15.107 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/603 2023-10-14T21:13:15.107 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/603 2023-10-14T21:13:15.108 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:15.114 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:15.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:15.140 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-10-14T21:13:15.659 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:15.672 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:15.672 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:16.089 INFO:teuthology.orchestra.run.smithi064.stdout:generic/604 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:16.099 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/604 2023-10-14T21:13:16.100 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/604 2023-10-14T21:13:16.100 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:16.110 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:16.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:16.148 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-10-14T21:13:16.679 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:16.693 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:16.693 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:17.076 INFO:teuthology.orchestra.run.smithi064.stdout:generic/605 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:17.086 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/605 2023-10-14T21:13:17.087 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/605 2023-10-14T21:13:17.087 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:17.095 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:17.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:17.123 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-10-14T21:13:17.641 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:17.655 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:17.655 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:18.078 INFO:teuthology.orchestra.run.smithi064.stdout:generic/606 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:18.091 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/606 2023-10-14T21:13:18.091 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/606 2023-10-14T21:13:18.091 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:18.100 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:18.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:18.130 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-10-14T21:13:18.627 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:18.641 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:18.641 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:18.989 INFO:teuthology.orchestra.run.smithi064.stdout:generic/607 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:19.000 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/607 2023-10-14T21:13:19.001 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/607 2023-10-14T21:13:19.001 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:19.009 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:19.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:19.035 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-10-14T21:13:19.548 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:19.560 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:19.560 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:19.919 INFO:teuthology.orchestra.run.smithi064.stdout:generic/608 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:19.929 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/608 2023-10-14T21:13:19.929 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/608 2023-10-14T21:13:19.930 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:19.937 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:19.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:19.962 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-10-14T21:13:20.474 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:20.487 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:20.487 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:21.448 INFO:teuthology.orchestra.run.smithi064.stdout:generic/609 1s 2023-10-14T21:13:21.463 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/609 2023-10-14T21:13:21.463 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:21.470 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:21.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:21.493 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-10-14T21:13:22.250 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:22.261 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:22.261 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:22.635 INFO:teuthology.orchestra.run.smithi064.stdout:generic/610 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:22.647 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/610 2023-10-14T21:13:22.647 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/610 2023-10-14T21:13:22.647 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:22.656 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:22.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:22.684 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-10-14T21:13:23.237 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:23.249 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:23.250 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:23.590 INFO:teuthology.orchestra.run.smithi064.stdout:generic/611 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:23.600 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/611 2023-10-14T21:13:23.600 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/611 2023-10-14T21:13:23.601 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:23.609 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:23.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:23.634 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-10-14T21:13:24.107 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:24.119 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:24.119 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:24.627 INFO:teuthology.orchestra.run.smithi064.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T21:13:24.641 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/612 2023-10-14T21:13:24.642 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/612 2023-10-14T21:13:24.642 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:24.653 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:24.687 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:24.688 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-10-14T21:13:25.416 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:25.428 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:25.429 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:25.889 INFO:teuthology.orchestra.run.smithi064.stdout:generic/613 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:25.901 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/613 2023-10-14T21:13:25.901 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/613 2023-10-14T21:13:25.901 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:25.910 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:25.942 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:25.942 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-10-14T21:13:26.470 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:26.482 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:26.482 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:26.858 INFO:teuthology.orchestra.run.smithi064.stdout:generic/614 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:26.867 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/614 2023-10-14T21:13:26.868 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/614 2023-10-14T21:13:26.868 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:26.875 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:26.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:26.901 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-10-14T21:13:27.409 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:27.422 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:27.423 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:27.821 INFO:teuthology.orchestra.run.smithi064.stdout:generic/615 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:27.833 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/615 2023-10-14T21:13:27.833 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/615 2023-10-14T21:13:27.833 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:27.842 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:27.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:27.872 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-10-14T21:13:28.379 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:28.391 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:28.391 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:28.764 INFO:teuthology.orchestra.run.smithi064.stdout:generic/616 [not run] kernel does not support IO_URING 2023-10-14T21:13:28.773 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/616 2023-10-14T21:13:28.774 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/616 2023-10-14T21:13:28.774 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:28.782 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:28.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:28.805 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-10-14T21:13:29.350 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:29.363 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:29.364 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:29.882 INFO:teuthology.orchestra.run.smithi064.stdout:generic/617 [not run] kernel does not support IO_URING 2023-10-14T21:13:29.894 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/617 2023-10-14T21:13:29.894 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/617 2023-10-14T21:13:29.894 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:29.903 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:29.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:29.934 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-10-14T21:13:30.455 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:30.467 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:30.467 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:30.847 INFO:teuthology.orchestra.run.smithi064.stdout:generic/618 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:30.857 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/618 2023-10-14T21:13:30.858 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/618 2023-10-14T21:13:30.858 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:30.868 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:30.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:30.895 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-10-14T21:13:31.407 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:31.419 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:31.420 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:31.787 INFO:teuthology.orchestra.run.smithi064.stdout:generic/619 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:31.797 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/619 2023-10-14T21:13:31.798 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/619 2023-10-14T21:13:31.798 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:31.805 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:31.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:31.832 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-10-14T21:13:32.349 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:32.361 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:32.361 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:32.802 INFO:teuthology.orchestra.run.smithi064.stdout:generic/620 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:32.816 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/620 2023-10-14T21:13:32.816 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/620 2023-10-14T21:13:32.817 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:32.828 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:32.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:32.859 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-10-14T21:13:33.411 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:33.425 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:33.425 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:33.921 INFO:teuthology.orchestra.run.smithi064.stdout:generic/621 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:33.933 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/621 2023-10-14T21:13:33.933 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/621 2023-10-14T21:13:33.933 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:33.946 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:33.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:33.980 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-10-14T21:13:34.530 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:34.542 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:34.542 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:34.934 INFO:teuthology.orchestra.run.smithi064.stdout:generic/622 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:34.947 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/622 2023-10-14T21:13:34.947 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/622 2023-10-14T21:13:34.947 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:34.960 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:34.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:34.990 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-10-14T21:13:35.514 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:35.525 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:35.525 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:35.920 INFO:teuthology.orchestra.run.smithi064.stdout:generic/623 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:35.932 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/623 2023-10-14T21:13:35.932 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/623 2023-10-14T21:13:35.932 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:35.941 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:35.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:35.975 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-10-14T21:13:36.502 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:36.515 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:36.515 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:36.918 INFO:teuthology.orchestra.run.smithi064.stdout:generic/624 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:36.929 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/624 2023-10-14T21:13:36.930 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/624 2023-10-14T21:13:36.930 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:36.938 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:36.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:36.965 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-10-14T21:13:37.485 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:37.496 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:37.496 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:37.857 INFO:teuthology.orchestra.run.smithi064.stdout:generic/625 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:37.868 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/625 2023-10-14T21:13:37.868 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/625 2023-10-14T21:13:37.869 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:37.879 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:37.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:37.905 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-10-14T21:13:38.390 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:38.403 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:38.403 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:39.254 INFO:teuthology.orchestra.run.smithi064.stdout:generic/626 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:39.265 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/626 2023-10-14T21:13:39.266 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/626 2023-10-14T21:13:39.266 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:39.274 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:39.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:39.301 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-10-14T21:13:39.824 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:39.835 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:39.836 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:40.220 INFO:teuthology.orchestra.run.smithi064.stdout:generic/627 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:40.230 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/627 2023-10-14T21:13:40.230 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/627 2023-10-14T21:13:40.230 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:40.237 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:40.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:40.262 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-10-14T21:13:40.765 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:40.778 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:40.778 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:41.225 INFO:teuthology.orchestra.run.smithi064.stdout:generic/628 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:41.237 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/628 2023-10-14T21:13:41.237 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/628 2023-10-14T21:13:41.237 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:41.246 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:41.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:41.275 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-10-14T21:13:41.821 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:41.834 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:41.834 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:42.262 INFO:teuthology.orchestra.run.smithi064.stdout:generic/629 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:42.274 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/629 2023-10-14T21:13:42.274 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/629 2023-10-14T21:13:42.274 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:42.283 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:42.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:42.313 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-10-14T21:13:42.840 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:42.853 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:42.853 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:43.249 INFO:teuthology.orchestra.run.smithi064.stdout:generic/630 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:43.260 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/630 2023-10-14T21:13:43.261 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/630 2023-10-14T21:13:43.261 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:43.269 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:43.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:43.296 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-10-14T21:13:43.822 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:43.834 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:43.835 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:44.214 INFO:teuthology.orchestra.run.smithi064.stdout:generic/631 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:13:44.225 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/631 2023-10-14T21:13:44.226 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/631 2023-10-14T21:13:44.226 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:13:44.237 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:13:44.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:13:44.268 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-10-14T21:13:44.794 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:13:44.805 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:13:44.806 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:02.597 INFO:teuthology.orchestra.run.smithi064.stdout:generic/632 18s 2023-10-14T21:14:02.617 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/632 2023-10-14T21:14:02.617 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:02.627 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:02.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:02.656 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-10-14T21:14:03.278 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:03.292 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:03.292 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:04.529 INFO:teuthology.orchestra.run.smithi064.stdout:generic/633 [failed, exit status 1]- output mismatch (see /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/633.out.bad) 2023-10-14T21:14:04.569 INFO:teuthology.orchestra.run.smithi064.stdout: --- tests/generic/633.out 2023-10-14 12:30:50.056658139 +0000 2023-10-14T21:14:04.570 INFO:teuthology.orchestra.run.smithi064.stdout: +++ /tmp/tmp.fHRpaBS5ywxfstests-dev/results//generic/633.out.bad 2023-10-14 21:14:04.522006453 +0000 2023-10-14T21:14:04.570 INFO:teuthology.orchestra.run.smithi064.stdout: @@ -1,2 +1,3 @@ 2023-10-14T21:14:04.570 INFO:teuthology.orchestra.run.smithi064.stdout: QA output created by 633 2023-10-14T21:14:04.571 INFO:teuthology.orchestra.run.smithi064.stdout: Silence is golden 2023-10-14T21:14:04.571 INFO:teuthology.orchestra.run.smithi064.stdout: +vfstest.c: 2418: run_test - Success - failure: setid binaries on regular mounts 2023-10-14T21:14:04.590 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/633 2023-10-14T21:14:04.590 INFO:teuthology.orchestra.run.smithi064.stdout:Failures: generic/633 2023-10-14T21:14:04.590 INFO:teuthology.orchestra.run.smithi064.stdout:Failed 1 of 1 tests 2023-10-14T21:14:04.601 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:04.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T21:14:04.654 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-10-14T21:14:04.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-10-14T21:14:04.655 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-10-14T21:14:05.285 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:05.296 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:05.296 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:05.681 INFO:teuthology.orchestra.run.smithi064.stdout:generic/634 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:05.695 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/634 2023-10-14T21:14:05.695 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/634 2023-10-14T21:14:05.696 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:05.705 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:05.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:05.737 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-10-14T21:14:06.338 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:06.353 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:06.353 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:06.774 INFO:teuthology.orchestra.run.smithi064.stdout:generic/635 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:06.786 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/635 2023-10-14T21:14:06.786 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/635 2023-10-14T21:14:06.787 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:06.795 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:06.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:06.827 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-10-14T21:14:07.427 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:07.443 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:07.443 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:07.878 INFO:teuthology.orchestra.run.smithi064.stdout:generic/636 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:07.890 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/636 2023-10-14T21:14:07.890 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/636 2023-10-14T21:14:07.891 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:07.899 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:07.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:07.936 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-10-14T21:14:08.531 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:08.546 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:08.547 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:11.906 INFO:teuthology.orchestra.run.smithi064.stdout:generic/637 3s 2023-10-14T21:14:11.927 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/637 2023-10-14T21:14:11.927 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:11.937 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:11.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:11.968 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-10-14T21:14:12.709 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:12.720 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:12.721 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:13.268 INFO:teuthology.orchestra.run.smithi064.stdout:generic/638 1s 2023-10-14T21:14:13.286 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/638 2023-10-14T21:14:13.286 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:13.294 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:13.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:13.324 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-10-14T21:14:13.907 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:13.921 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:13.922 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:17.282 INFO:teuthology.orchestra.run.smithi064.stdout:generic/639 4s 2023-10-14T21:14:17.302 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/639 2023-10-14T21:14:17.302 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:17.312 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:17.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:17.342 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-10-14T21:14:17.919 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:17.932 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:17.932 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:18.396 INFO:teuthology.orchestra.run.smithi064.stdout:generic/640 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:18.408 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/640 2023-10-14T21:14:18.408 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/640 2023-10-14T21:14:18.409 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:18.417 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:18.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:18.450 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-10-14T21:14:19.057 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:19.071 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:19.071 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:19.533 INFO:teuthology.orchestra.run.smithi064.stdout:generic/641 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:19.544 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/641 2023-10-14T21:14:19.545 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/641 2023-10-14T21:14:19.545 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:19.553 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:19.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:19.582 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-10-14T21:14:20.191 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:20.204 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:20.204 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:20.647 INFO:teuthology.orchestra.run.smithi064.stdout:generic/642 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:20.662 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/642 2023-10-14T21:14:20.662 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/642 2023-10-14T21:14:20.663 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:20.675 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:20.715 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:20.715 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-10-14T21:14:21.322 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:21.334 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:21.335 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:21.795 INFO:teuthology.orchestra.run.smithi064.stdout:generic/643 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:21.809 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/643 2023-10-14T21:14:21.810 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/643 2023-10-14T21:14:21.810 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:21.823 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:21.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:21.859 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-10-14T21:14:22.446 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:22.460 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:22.461 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:22.972 INFO:teuthology.orchestra.run.smithi064.stdout:generic/644 [not run] vfstest not support by ceph-fuse 2023-10-14T21:14:22.987 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/644 2023-10-14T21:14:22.988 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/644 2023-10-14T21:14:22.988 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:23.000 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:23.033 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:23.034 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-10-14T21:14:23.633 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:23.648 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:23.648 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:24.091 INFO:teuthology.orchestra.run.smithi064.stdout:generic/645 [not run] vfstest not support by ceph-fuse 2023-10-14T21:14:24.106 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/645 2023-10-14T21:14:24.106 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/645 2023-10-14T21:14:24.106 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:24.120 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:24.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:24.155 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-10-14T21:14:24.743 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:24.755 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:24.756 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:25.195 INFO:teuthology.orchestra.run.smithi064.stdout:generic/646 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:25.209 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/646 2023-10-14T21:14:25.209 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/646 2023-10-14T21:14:25.209 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:25.220 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:25.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:25.250 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-10-14T21:14:25.857 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:25.872 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:25.872 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:26.753 INFO:teuthology.orchestra.run.smithi064.stdout:generic/647 1s 2023-10-14T21:14:26.773 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/647 2023-10-14T21:14:26.773 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:26.782 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:26.831 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:26.831 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-10-14T21:14:27.573 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:27.587 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:27.587 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:28.117 INFO:teuthology.orchestra.run.smithi064.stdout:generic/648 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T21:14:28.132 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/648 2023-10-14T21:14:28.133 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/648 2023-10-14T21:14:28.133 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:28.145 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:28.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:28.180 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-10-14T21:14:28.784 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:28.798 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:28.798 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:29.427 INFO:teuthology.orchestra.run.smithi064.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph-fuse 2023-10-14T21:14:29.439 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/649 2023-10-14T21:14:29.439 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/649 2023-10-14T21:14:29.439 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T21:14:29.449 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:14:29.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T21:14:29.494 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-10-14T21:14:29.843 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:14:29.851 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:14:30.223 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T21:14:30.235 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T21:14:30.235 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T21:15:00.094 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:15:00.110 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:15:30.470 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:15:30.475 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:16:00.610 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:16:00.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:16:31.001 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:16:31.014 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:17:01.181 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:17:01.188 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:17:31.325 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:17:31.335 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:18:02.073 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:18:02.082 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:18:32.263 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:18:32.281 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:19:03.133 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:19:03.144 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:19:33.586 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:19:33.597 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:20:03.928 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:20:03.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:20:34.302 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:20:34.317 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:21:04.653 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:21:04.661 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:21:34.826 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:21:34.834 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:22:05.139 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:22:05.155 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:22:35.404 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:22:35.410 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:23:05.539 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:23:05.546 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:23:05.643 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T21:23:05.642+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111421) UID: 0 2023-10-14T21:23:05.644 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T21:23:05.642+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111421) UID: 0 2023-10-14T21:23:05.644 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T21:23:05.642+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111421) UID: 0 2023-10-14T21:23:05.645 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T21:23:05.642+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111421) UID: 0 2023-10-14T21:26:46.337 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:26:46.352 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:27:16.543 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:27:16.552 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:27:46.705 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:27:46.714 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:28:16.849 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:28:16.855 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:28:16.952 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T21:28:16.951+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111503) UID: 0 2023-10-14T21:28:16.953 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T21:28:16.951+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111503) UID: 0 2023-10-14T21:28:16.953 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T21:28:16.951+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111503) UID: 0 2023-10-14T21:28:16.954 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T21:28:16.951+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111503) UID: 0 2023-10-14T21:31:48.817 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:31:48.829 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:32:19.354 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:32:19.363 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:32:49.559 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:32:49.567 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:33:19.761 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:33:19.770 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:33:51.202 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:33:51.211 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:33:51.428 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T21:33:51.427+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542034) UID: 0 2023-10-14T21:33:51.452 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T21:33:51.435+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542034) UID: 0 2023-10-14T21:33:51.456 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T21:33:51.447+0000 7fccb98af640 -1 Fail to open '/proc/542034/cmdline' error = (2) No such file or directory 2023-10-14T21:33:51.456 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T21:33:51.447+0000 7fccb98af640 -1 received signal: Hangup from (PID: 542034) UID: 0 2023-10-14T21:33:51.471 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T21:33:51.460+0000 7fbebb8a2640 -1 Fail to open '/proc/542034/cmdline' error = (2) No such file or directory 2023-10-14T21:33:51.471 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T21:33:51.460+0000 7fbebb8a2640 -1 received signal: Hangup from (PID: 542034) UID: 0 2023-10-14T21:39:08.978 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:39:08.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:39:09.201 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T21:39:09.200+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543036) UID: 0 2023-10-14T21:39:09.202 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T21:39:09.200+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543036) UID: 0 2023-10-14T21:45:38.720 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:45:38.739 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:46:09.006 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:46:09.017 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:46:39.648 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:46:39.655 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:47:09.783 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:47:09.797 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:47:40.054 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:47:40.066 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:48:10.320 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:48:10.328 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:48:40.483 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:48:40.492 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:48:40.609 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T21:48:40.608+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111782) UID: 0 2023-10-14T21:48:40.609 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T21:48:40.608+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111782) UID: 0 2023-10-14T21:48:40.610 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T21:48:40.608+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111782) UID: 0 2023-10-14T21:48:40.610 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T21:48:40.608+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111782) UID: 0 2023-10-14T21:52:26.152 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:52:26.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:52:56.448 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:52:56.504 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:53:26.658 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:53:26.667 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:53:57.296 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:53:57.309 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:54:27.918 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:54:27.931 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:54:58.078 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:54:58.085 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:55:28.247 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:55:28.263 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:55:58.436 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:55:58.445 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T21:55:58.552 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T21:55:58.550+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 546792) UID: 0 2023-10-14T21:55:58.552 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T21:55:58.550+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 546792) UID: 0 2023-10-14T21:55:58.553 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T21:55:58.550+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 546792) UID: 0 2023-10-14T21:55:58.553 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T21:55:58.551+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 546792) UID: 0 2023-10-14T22:01:33.683 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:01:33.693 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:01:33.803 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T22:01:33.801+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111982) UID: 0 2023-10-14T22:01:33.803 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T22:01:33.801+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111982) UID: 0 2023-10-14T22:01:33.804 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T22:01:33.801+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111982) UID: 0 2023-10-14T22:01:33.804 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T22:01:33.802+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 111982) UID: 0 2023-10-14T22:01:33.807 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T22:01:33.806+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 547848) UID: 0 2023-10-14T22:01:33.811 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T22:01:33.810+0000 7fccb98af640 -1 Fail to open '/proc/547848/cmdline' error = (2) No such file or directory 2023-10-14T22:01:33.812 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T22:01:33.810+0000 7fccb98af640 -1 received signal: Hangup from (PID: 547848) UID: 0 2023-10-14T22:01:33.815 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T22:01:33.814+0000 7fb5d0d8c640 -1 Fail to open '/proc/547848/cmdline' error = (2) No such file or directory 2023-10-14T22:01:33.815 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T22:01:33.814+0000 7fb5d0d8c640 -1 received signal: Hangup from (PID: 547848) UID: 0 2023-10-14T22:01:33.815 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T22:01:33.814+0000 7fbebb8a2640 -1 Fail to open '/proc/547848/cmdline' error = (2) No such file or directory 2023-10-14T22:01:33.816 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T22:01:33.814+0000 7fbebb8a2640 -1 received signal: Hangup from (PID: 547848) UID: 0 2023-10-14T22:13:08.910 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:13:08.915 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:13:09.113 INFO:tasks.ceph.osd.4.smithi177.stderr:2023-10-14T22:13:09.111+0000 7f28026f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112023) UID: 0 2023-10-14T22:13:09.114 INFO:tasks.ceph.osd.6.smithi177.stderr:2023-10-14T22:13:09.111+0000 7f710298c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112023) UID: 0 2023-10-14T22:13:09.114 INFO:tasks.ceph.osd.5.smithi177.stderr:2023-10-14T22:13:09.111+0000 7f5d218f4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112023) UID: 0 2023-10-14T22:13:09.114 INFO:tasks.ceph.osd.7.smithi177.stderr:2023-10-14T22:13:09.111+0000 7fbc0d5f1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 112023) UID: 0 2023-10-14T22:13:09.115 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T22:13:09.112+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 549890) UID: 0 2023-10-14T22:13:09.115 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T22:13:09.112+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 549890) UID: 0 2023-10-14T22:15:19.074 INFO:teuthology.orchestra.run.smithi064.stdout:generic/650 3648s 2023-10-14T22:15:19.155 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/650 2023-10-14T22:15:19.155 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:19.164 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:19.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:19.202 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2023-10-14T22:15:20.138 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:20.155 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:20.156 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:20.660 INFO:teuthology.orchestra.run.smithi064.stdout:generic/651 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:20.673 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/651 2023-10-14T22:15:20.673 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/651 2023-10-14T22:15:20.673 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:20.685 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:20.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:20.769 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2023-10-14T22:15:21.442 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:21.457 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:21.458 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:22.761 INFO:teuthology.orchestra.run.smithi064.stdout:generic/652 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:22.772 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/652 2023-10-14T22:15:22.773 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/652 2023-10-14T22:15:22.773 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:22.781 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:22.818 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:22.818 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2023-10-14T22:15:23.474 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:23.496 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:23.497 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:24.010 INFO:teuthology.orchestra.run.smithi064.stdout:generic/653 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:24.025 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/653 2023-10-14T22:15:24.026 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/653 2023-10-14T22:15:24.026 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:24.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:24.078 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:24.079 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2023-10-14T22:15:24.673 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:24.689 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:24.689 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:25.247 INFO:teuthology.orchestra.run.smithi064.stdout:generic/654 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/654 2023-10-14T22:15:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/654 2023-10-14T22:15:25.260 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:25.273 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:25.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:25.307 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2023-10-14T22:15:25.966 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:25.978 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:25.978 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:26.736 INFO:teuthology.orchestra.run.smithi064.stdout:generic/655 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:26.748 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/655 2023-10-14T22:15:26.748 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/655 2023-10-14T22:15:26.749 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:26.762 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:26.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:26.798 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2023-10-14T22:15:27.464 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:27.480 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:27.480 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:28.060 INFO:teuthology.orchestra.run.smithi064.stdout:generic/656 [not run] vfstest not support by ceph-fuse 2023-10-14T22:15:28.071 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/656 2023-10-14T22:15:28.072 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/656 2023-10-14T22:15:28.072 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:28.084 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:28.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:28.121 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2023-10-14T22:15:28.716 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:28.732 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:28.732 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:29.165 INFO:teuthology.orchestra.run.smithi064.stdout:generic/657 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:29.182 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/657 2023-10-14T22:15:29.183 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/657 2023-10-14T22:15:29.183 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:29.194 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:29.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:29.229 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2023-10-14T22:15:29.887 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:29.904 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:29.904 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:30.306 INFO:teuthology.orchestra.run.smithi064.stdout:generic/658 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/658 2023-10-14T22:15:30.319 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/658 2023-10-14T22:15:30.320 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:30.331 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:30.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:30.363 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2023-10-14T22:15:30.991 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:31.008 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:31.009 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:31.417 INFO:teuthology.orchestra.run.smithi064.stdout:generic/659 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:31.434 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/659 2023-10-14T22:15:31.434 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/659 2023-10-14T22:15:31.434 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:31.442 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:31.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:31.481 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2023-10-14T22:15:32.166 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:32.186 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:32.186 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:32.712 INFO:teuthology.orchestra.run.smithi064.stdout:generic/660 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:32.730 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/660 2023-10-14T22:15:32.731 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/660 2023-10-14T22:15:32.731 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:32.740 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:32.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:32.775 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2023-10-14T22:15:33.427 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:33.440 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:33.440 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:33.891 INFO:teuthology.orchestra.run.smithi064.stdout:generic/661 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:33.909 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/661 2023-10-14T22:15:33.909 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/661 2023-10-14T22:15:33.910 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:33.918 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:33.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:33.962 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2023-10-14T22:15:34.688 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:34.713 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:34.713 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:35.143 INFO:teuthology.orchestra.run.smithi064.stdout:generic/662 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:35.157 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/662 2023-10-14T22:15:35.157 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/662 2023-10-14T22:15:35.157 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:35.165 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:35.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:35.201 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2023-10-14T22:15:35.793 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:35.810 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:35.810 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:36.289 INFO:teuthology.orchestra.run.smithi064.stdout:generic/663 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:36.301 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/663 2023-10-14T22:15:36.301 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/663 2023-10-14T22:15:36.301 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:36.310 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:36.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:36.335 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2023-10-14T22:15:36.961 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:36.979 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:36.980 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:37.420 INFO:teuthology.orchestra.run.smithi064.stdout:generic/664 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:37.430 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/664 2023-10-14T22:15:37.431 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/664 2023-10-14T22:15:37.431 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:37.441 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:37.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:37.489 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2023-10-14T22:15:38.157 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:38.175 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:38.176 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:38.611 INFO:teuthology.orchestra.run.smithi064.stdout:generic/665 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:38.629 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/665 2023-10-14T22:15:38.629 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/665 2023-10-14T22:15:38.630 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:38.637 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:38.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:38.678 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2023-10-14T22:15:39.306 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:39.326 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:39.327 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:39.769 INFO:teuthology.orchestra.run.smithi064.stdout:generic/666 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:39.782 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/666 2023-10-14T22:15:39.783 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/666 2023-10-14T22:15:39.783 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:39.793 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:39.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:39.824 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2023-10-14T22:15:40.449 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:40.465 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:40.465 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:41.064 INFO:teuthology.orchestra.run.smithi064.stdout:generic/667 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:41.077 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/667 2023-10-14T22:15:41.078 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/667 2023-10-14T22:15:41.079 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:41.090 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:41.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:41.131 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2023-10-14T22:15:41.811 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:41.826 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:41.827 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:42.232 INFO:teuthology.orchestra.run.smithi064.stdout:generic/668 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:42.245 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/668 2023-10-14T22:15:42.245 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/668 2023-10-14T22:15:42.246 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:42.253 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:42.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:42.287 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2023-10-14T22:15:42.904 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:42.926 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:42.926 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:43.371 INFO:teuthology.orchestra.run.smithi064.stdout:generic/669 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:43.382 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/669 2023-10-14T22:15:43.382 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/669 2023-10-14T22:15:43.382 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:43.390 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:43.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:43.427 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2023-10-14T22:15:44.097 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:44.112 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:44.112 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:44.562 INFO:teuthology.orchestra.run.smithi064.stdout:generic/670 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:44.576 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/670 2023-10-14T22:15:44.577 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/670 2023-10-14T22:15:44.577 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:44.585 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:44.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:44.626 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2023-10-14T22:15:45.291 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:45.312 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:45.312 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:45.761 INFO:teuthology.orchestra.run.smithi064.stdout:generic/671 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:45.771 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/671 2023-10-14T22:15:45.772 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/671 2023-10-14T22:15:45.772 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:45.783 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:45.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:45.820 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2023-10-14T22:15:46.497 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:46.513 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:46.513 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:46.994 INFO:teuthology.orchestra.run.smithi064.stdout:generic/672 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:47.008 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/672 2023-10-14T22:15:47.008 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/672 2023-10-14T22:15:47.009 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:47.018 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:47.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:47.060 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2023-10-14T22:15:47.689 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:47.703 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:47.703 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:49.326 INFO:teuthology.orchestra.run.smithi064.stdout:generic/673 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:49.339 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/673 2023-10-14T22:15:49.340 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/673 2023-10-14T22:15:49.340 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:49.352 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:49.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:49.393 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2023-10-14T22:15:50.010 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:50.026 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:50.026 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:50.611 INFO:teuthology.orchestra.run.smithi064.stdout:generic/674 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:50.622 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/674 2023-10-14T22:15:50.622 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/674 2023-10-14T22:15:50.622 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:50.634 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:50.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:50.672 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2023-10-14T22:15:51.347 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:51.364 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:51.365 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:51.972 INFO:teuthology.orchestra.run.smithi064.stdout:generic/675 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:15:51.989 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/675 2023-10-14T22:15:51.990 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/675 2023-10-14T22:15:51.990 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:15:52.000 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:15:52.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:15:52.035 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2023-10-14T22:15:52.714 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:15:52.731 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:15:52.731 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:22:35.616 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:22:35.621 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:22:35.769 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T22:22:35.766+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560880) UID: 0 2023-10-14T22:22:35.769 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T22:22:35.767+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560880) UID: 0 2023-10-14T22:31:47.799 DEBUG:teuthology.orchestra.run.smithi064:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:31:47.806 DEBUG:teuthology.orchestra.run.smithi177:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-14T22:31:48.280 INFO:tasks.ceph.mds.a.smithi064.stderr:2023-10-14T22:31:48.278+0000 7ff3acd40640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560906) UID: 0 2023-10-14T22:31:48.283 INFO:tasks.ceph.mds.c.smithi064.stderr:2023-10-14T22:31:48.279+0000 7f90096dd640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560906) UID: 0 2023-10-14T22:41:28.710 INFO:tasks.ceph.osd.1.smithi064.stderr:2023-10-14T22:41:28.707+0000 7f84bc052640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560917) UID: 0 2023-10-14T22:41:28.711 INFO:tasks.ceph.osd.2.smithi064.stderr:2023-10-14T22:41:28.707+0000 7fbebb8a2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560917) UID: 0 2023-10-14T22:41:28.711 INFO:tasks.ceph.osd.3.smithi064.stderr:2023-10-14T22:41:28.708+0000 7fb5d0d8c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560917) UID: 0 2023-10-14T22:41:28.712 INFO:tasks.ceph.osd.0.smithi064.stderr:2023-10-14T22:41:28.707+0000 7fccb98af640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560917) UID: 0 2023-10-14T22:42:18.029 INFO:teuthology.orchestra.run.smithi064.stdout:generic/676 1585s 2023-10-14T22:42:18.100 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/676 2023-10-14T22:42:18.100 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:18.112 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:18.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:18.145 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2023-10-14T22:42:19.573 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:19.592 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:19.592 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:20.212 INFO:teuthology.orchestra.run.smithi064.stdout:generic/677 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:42:20.223 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/677 2023-10-14T22:42:20.224 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/677 2023-10-14T22:42:20.224 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:20.231 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:20.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:20.271 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2023-10-14T22:42:20.957 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:20.971 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:20.971 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:21.548 INFO:teuthology.orchestra.run.smithi064.stdout:generic/678 [not run] kernel does not support IO_URING 2023-10-14T22:42:21.560 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/678 2023-10-14T22:42:21.560 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/678 2023-10-14T22:42:21.560 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:21.572 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:21.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:21.603 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2023-10-14T22:42:22.314 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:22.330 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:22.330 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:22.752 INFO:teuthology.orchestra.run.smithi064.stdout:generic/679 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:42:22.769 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/679 2023-10-14T22:42:22.769 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/679 2023-10-14T22:42:22.769 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:22.779 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:22.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:22.811 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2023-10-14T22:42:23.427 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:23.443 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:23.444 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:25.230 INFO:teuthology.orchestra.run.smithi064.stdout:generic/680 2s 2023-10-14T22:42:25.253 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/680 2023-10-14T22:42:25.254 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:25.264 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:25.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:25.309 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2023-10-14T22:42:26.247 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:26.261 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:26.261 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:26.748 INFO:teuthology.orchestra.run.smithi064.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T22:42:26.767 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/681 2023-10-14T22:42:26.768 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/681 2023-10-14T22:42:26.768 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:26.779 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:26.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:26.828 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2023-10-14T22:42:27.580 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:27.599 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:27.599 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:28.095 INFO:teuthology.orchestra.run.smithi064.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph-fuse 2023-10-14T22:42:28.107 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/682 2023-10-14T22:42:28.108 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/682 2023-10-14T22:42:28.108 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:28.118 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:28.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:28.162 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2023-10-14T22:42:30.156 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:30.174 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:30.175 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:32.082 INFO:teuthology.orchestra.run.smithi064.stdout:generic/683 [not run] /tmp/tmp.LYaLaNSY2Vtest: file alloc unit 4194304 larger than op length 65536 2023-10-14T22:42:32.097 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/683 2023-10-14T22:42:32.097 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/683 2023-10-14T22:42:32.097 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:32.105 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:32.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:32.138 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2023-10-14T22:42:32.765 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:32.779 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:32.779 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:35.983 INFO:teuthology.orchestra.run.smithi064.stdout:generic/684 [not run] /tmp/tmp.LYaLaNSY2Vtest: file alloc unit 4194304 larger than op length 65536 2023-10-14T22:42:35.997 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/684 2023-10-14T22:42:35.997 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/684 2023-10-14T22:42:35.998 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:36.006 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:36.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:36.044 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2023-10-14T22:42:36.711 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:36.728 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:36.729 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:39.626 INFO:teuthology.orchestra.run.smithi064.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-10-14T22:42:39.644 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/685 2023-10-14T22:42:39.645 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/685 2023-10-14T22:42:39.645 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:39.657 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:39.697 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:39.697 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2023-10-14T22:42:40.394 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:40.412 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:40.412 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:43.376 INFO:teuthology.orchestra.run.smithi064.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2023-10-14T22:42:43.393 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/686 2023-10-14T22:42:43.393 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/686 2023-10-14T22:42:43.394 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:43.405 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:43.442 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:43.443 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2023-10-14T22:42:44.114 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:44.130 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:44.130 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:47.707 INFO:teuthology.orchestra.run.smithi064.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-10-14T22:42:47.719 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/687 2023-10-14T22:42:47.720 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/687 2023-10-14T22:42:47.720 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:48.074 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:48.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:48.116 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2023-10-14T22:42:48.758 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:48.774 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:48.774 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:49.609 INFO:teuthology.orchestra.run.smithi064.stdout:generic/688 [not run] /tmp/tmp.LYaLaNSY2Vtest: file alloc unit 4194304 larger than op length 65536 2023-10-14T22:42:49.624 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/688 2023-10-14T22:42:49.625 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/688 2023-10-14T22:42:49.625 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:49.637 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:49.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:49.706 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2023-10-14T22:42:50.427 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:50.448 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:50.449 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:51.703 INFO:teuthology.orchestra.run.smithi064.stdout:generic/689 [not run] vfstest not support by ceph-fuse 2023-10-14T22:42:51.717 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/689 2023-10-14T22:42:51.717 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/689 2023-10-14T22:42:51.718 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:51.728 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:51.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:51.764 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2023-10-14T22:42:52.450 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:52.464 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:52.464 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:53.110 INFO:teuthology.orchestra.run.smithi064.stdout:generic/690 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:42:53.122 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/690 2023-10-14T22:42:53.122 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/690 2023-10-14T22:42:53.123 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:53.134 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:53.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:53.167 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2023-10-14T22:42:53.826 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:53.843 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:53.843 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:54.277 INFO:teuthology.orchestra.run.smithi064.stdout:generic/691 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:42:54.289 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/691 2023-10-14T22:42:54.290 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/691 2023-10-14T22:42:54.290 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:54.301 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:54.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:54.330 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2023-10-14T22:42:55.019 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:55.034 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:55.035 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:55.546 INFO:teuthology.orchestra.run.smithi064.stdout:generic/692 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:42:55.559 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/692 2023-10-14T22:42:55.560 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/692 2023-10-14T22:42:55.560 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:55.571 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:55.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:55.610 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2023-10-14T22:42:56.284 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:56.302 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:56.303 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:57.408 INFO:teuthology.orchestra.run.smithi064.stdout:generic/693 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:42:57.422 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/693 2023-10-14T22:42:57.423 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/693 2023-10-14T22:42:57.423 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:57.436 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:57.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:57.472 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2023-10-14T22:42:58.146 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:42:58.162 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:42:58.162 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:59.297 INFO:teuthology.orchestra.run.smithi064.stdout:generic/694 1s 2023-10-14T22:42:59.323 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/694 2023-10-14T22:42:59.323 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:42:59.334 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:42:59.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:42:59.372 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2023-10-14T22:43:00.027 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:00.041 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:00.042 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:01.316 INFO:teuthology.orchestra.run.smithi064.stdout:generic/695 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:01.331 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/695 2023-10-14T22:43:01.332 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/695 2023-10-14T22:43:01.332 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:01.342 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:01.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:01.375 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2023-10-14T22:43:02.010 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:02.031 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:02.031 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:02.541 INFO:teuthology.orchestra.run.smithi064.stdout:generic/696 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:02.552 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/696 2023-10-14T22:43:02.553 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/696 2023-10-14T22:43:02.553 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:02.561 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:02.593 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:02.594 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2023-10-14T22:43:03.273 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:03.288 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:03.289 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:03.860 INFO:teuthology.orchestra.run.smithi064.stdout:generic/697 [not run] ACLs not supported by this filesystem type: ceph-fuse 2023-10-14T22:43:03.876 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/697 2023-10-14T22:43:03.876 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/697 2023-10-14T22:43:03.876 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:03.888 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:03.918 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:03.919 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2023-10-14T22:43:04.589 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:04.602 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:04.602 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:05.151 INFO:teuthology.orchestra.run.smithi064.stdout:generic/698 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:05.162 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/698 2023-10-14T22:43:05.162 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/698 2023-10-14T22:43:05.163 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:05.169 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:05.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:05.204 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2023-10-14T22:43:05.853 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:05.871 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:05.872 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:07.182 INFO:teuthology.orchestra.run.smithi064.stdout:generic/699 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/699 2023-10-14T22:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/699 2023-10-14T22:43:07.195 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:07.205 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:07.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:07.246 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2023-10-14T22:43:07.922 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:07.941 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:07.942 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:08.471 INFO:teuthology.orchestra.run.smithi064.stdout:generic/700 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:08.484 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/700 2023-10-14T22:43:08.484 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/700 2023-10-14T22:43:08.485 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:08.495 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:08.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:08.527 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2023-10-14T22:43:09.242 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:09.258 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:09.259 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:10.165 INFO:teuthology.orchestra.run.smithi064.stdout:generic/701 1s 2023-10-14T22:43:10.194 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/701 2023-10-14T22:43:10.195 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:10.208 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:10.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:10.263 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2023-10-14T22:43:11.132 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:11.153 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:11.153 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:11.631 INFO:teuthology.orchestra.run.smithi064.stdout:generic/702 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:11.645 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/702 2023-10-14T22:43:11.645 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/702 2023-10-14T22:43:11.645 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:11.654 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:11.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:11.690 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2023-10-14T22:43:12.389 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:12.411 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:12.411 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:13.016 INFO:teuthology.orchestra.run.smithi064.stdout:generic/703 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:13.026 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/703 2023-10-14T22:43:13.027 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/703 2023-10-14T22:43:13.027 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:13.036 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:13.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:13.071 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2023-10-14T22:43:13.733 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:13.752 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:13.752 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:14.436 INFO:teuthology.orchestra.run.smithi064.stdout:generic/704 [not run] require ceph-fuse to be valid block disk 2023-10-14T22:43:14.447 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/704 2023-10-14T22:43:14.448 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/704 2023-10-14T22:43:14.448 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:14.456 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:14.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:14.493 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2023-10-14T22:43:15.168 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:15.185 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:15.186 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:15.709 INFO:teuthology.orchestra.run.smithi064.stdout:generic/705 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:15.721 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/705 2023-10-14T22:43:15.722 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/705 2023-10-14T22:43:15.722 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:15.736 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:15.763 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:15.763 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2023-10-14T22:43:16.429 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:16.446 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:16.446 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:19.575 INFO:teuthology.orchestra.run.smithi064.stdout:generic/706 3s 2023-10-14T22:43:19.592 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/706 2023-10-14T22:43:19.592 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:19.600 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:19.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:19.644 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2023-10-14T22:43:20.506 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:20.520 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:20.520 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:20.965 INFO:teuthology.orchestra.run.smithi064.stdout:generic/707 [not run] this test requires a valid $SCRATCH_DEV 2023-10-14T22:43:20.978 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/707 2023-10-14T22:43:20.978 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/707 2023-10-14T22:43:20.978 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:20.992 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:21.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:21.026 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2023-10-14T22:43:21.711 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:21.727 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:21.728 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:23.037 INFO:teuthology.orchestra.run.smithi064.stdout:generic/708 2s 2023-10-14T22:43:23.059 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/708 2023-10-14T22:43:23.059 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:23.070 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:23.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:23.106 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2023-10-14T22:43:24.010 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:24.033 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:24.033 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:24.662 INFO:teuthology.orchestra.run.smithi064.stdout:generic/709 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:24.673 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/709 2023-10-14T22:43:24.673 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/709 2023-10-14T22:43:24.673 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:24.683 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:24.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:24.728 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2023-10-14T22:43:25.595 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:25.610 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:25.610 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:26.242 INFO:teuthology.orchestra.run.smithi064.stdout:generic/710 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:26.409 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/710 2023-10-14T22:43:26.409 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/710 2023-10-14T22:43:26.409 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:26.410 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:26.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:26.410 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2023-10-14T22:43:27.164 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:27.180 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:27.180 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:27.803 INFO:teuthology.orchestra.run.smithi064.stdout:generic/711 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:27.816 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/711 2023-10-14T22:43:27.817 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/711 2023-10-14T22:43:27.817 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:27.829 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:27.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:27.859 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2023-10-14T22:43:28.742 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:28.759 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:28.759 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:29.396 INFO:teuthology.orchestra.run.smithi064.stdout:generic/712 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:29.406 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/712 2023-10-14T22:43:29.407 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/712 2023-10-14T22:43:29.407 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:29.415 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:29.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:29.465 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2023-10-14T22:43:30.322 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:30.344 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:30.344 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:31.089 INFO:teuthology.orchestra.run.smithi064.stdout:generic/713 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-10-14T22:43:31.098 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/713 2023-10-14T22:43:31.099 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/713 2023-10-14T22:43:31.099 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:31.106 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:31.154 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:31.155 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2023-10-14T22:43:32.050 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:32.069 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:32.069 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:32.637 INFO:teuthology.orchestra.run.smithi064.stdout:generic/714 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:32.650 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/714 2023-10-14T22:43:32.651 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/714 2023-10-14T22:43:32.651 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:32.660 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:32.695 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:32.696 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2023-10-14T22:43:33.574 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:33.591 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:33.591 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:34.263 INFO:teuthology.orchestra.run.smithi064.stdout:generic/715 [not run] xfs_io swapext -v vfs -s 64k -l 64k not supported on ceph-fuse 2023-10-14T22:43:34.277 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/715 2023-10-14T22:43:34.277 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/715 2023-10-14T22:43:34.277 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:34.285 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:34.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:34.313 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2023-10-14T22:43:35.187 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:35.203 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:35.203 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:35.826 INFO:teuthology.orchestra.run.smithi064.stdout:generic/716 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:35.838 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/716 2023-10-14T22:43:35.839 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/716 2023-10-14T22:43:35.839 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:35.849 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:35.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:35.902 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2023-10-14T22:43:36.713 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:36.724 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:36.725 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:37.374 INFO:teuthology.orchestra.run.smithi064.stdout:generic/717 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:37.384 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/717 2023-10-14T22:43:37.385 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/717 2023-10-14T22:43:37.385 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:37.393 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:37.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:37.418 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2023-10-14T22:43:38.316 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:38.333 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:38.334 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:38.959 INFO:teuthology.orchestra.run.smithi064.stdout:generic/718 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:38.970 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/718 2023-10-14T22:43:38.970 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/718 2023-10-14T22:43:38.970 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:38.980 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:39.011 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:39.011 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2023-10-14T22:43:39.873 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:39.893 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:39.893 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:40.481 INFO:teuthology.orchestra.run.smithi064.stdout:generic/719 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:40.495 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/719 2023-10-14T22:43:40.495 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/719 2023-10-14T22:43:40.495 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:40.504 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:40.538 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:40.539 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2023-10-14T22:43:41.420 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:41.436 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:41.437 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:42.312 INFO:teuthology.orchestra.run.smithi064.stdout:generic/720 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:42.330 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/720 2023-10-14T22:43:42.331 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/720 2023-10-14T22:43:42.331 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:42.338 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:42.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:42.392 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2023-10-14T22:43:43.292 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:43.310 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:43.310 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:43.865 INFO:teuthology.orchestra.run.smithi064.stdout:generic/721 [not run] xfs_io startupdate support is missing 2023-10-14T22:43:43.880 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/721 2023-10-14T22:43:43.881 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/721 2023-10-14T22:43:43.881 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:43.893 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:43.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:43.935 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2023-10-14T22:43:44.623 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:44.637 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:44.638 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:45.201 INFO:teuthology.orchestra.run.smithi064.stdout:generic/722 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-14T22:43:45.214 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/722 2023-10-14T22:43:45.214 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/722 2023-10-14T22:43:45.214 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:45.225 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:45.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:45.258 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2023-10-14T22:43:46.154 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:46.170 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:46.170 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:46.747 INFO:teuthology.orchestra.run.smithi064.stdout:generic/723 [not run] xfs_io swapext -v vfs not supported on ceph-fuse 2023-10-14T22:43:46.762 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/723 2023-10-14T22:43:46.762 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/723 2023-10-14T22:43:46.763 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:46.774 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:46.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:46.818 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2023-10-14T22:43:47.706 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:47.719 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:47.720 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:48.477 INFO:teuthology.orchestra.run.smithi064.stdout:generic/724 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-14T22:43:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/724 2023-10-14T22:43:48.487 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/724 2023-10-14T22:43:48.488 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:48.498 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:48.536 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:48.537 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2023-10-14T22:43:49.415 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:49.430 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:49.431 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:50.000 INFO:teuthology.orchestra.run.smithi064.stdout:generic/725 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-14T22:43:50.015 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/725 2023-10-14T22:43:50.015 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/725 2023-10-14T22:43:50.015 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:50.027 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:50.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:50.073 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2023-10-14T22:43:50.933 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:50.948 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:50.949 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:52.932 INFO:teuthology.orchestra.run.smithi064.stdout:generic/726 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-14T22:43:52.946 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/726 2023-10-14T22:43:52.949 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/726 2023-10-14T22:43:52.949 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:52.958 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:52.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:53.000 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2023-10-14T22:43:53.896 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:53.915 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:53.915 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:54.637 INFO:teuthology.orchestra.run.smithi064.stdout:generic/727 [not run] xfs_io swapext -v vfs -a not supported on ceph-fuse 2023-10-14T22:43:54.651 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/727 2023-10-14T22:43:54.652 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/727 2023-10-14T22:43:54.652 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:43:54.663 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:43:54.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:43:54.713 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2023-10-14T22:43:55.625 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:43:55.641 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:43:55.641 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:00.541 INFO:teuthology.orchestra.run.smithi064.stdout:generic/728 5s 2023-10-14T22:44:00.558 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/728 2023-10-14T22:44:00.558 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:44:00.569 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:00.608 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:44:00.609 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2023-10-14T22:44:01.302 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:44:01.320 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:44:01.320 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:03.083 INFO:teuthology.orchestra.run.smithi064.stdout:generic/729 2s 2023-10-14T22:44:03.107 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/729 2023-10-14T22:44:03.107 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:44:03.123 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:03.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:44:03.173 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2023-10-14T22:44:04.065 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:44:04.082 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:44:04.083 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:04.659 INFO:teuthology.orchestra.run.smithi064.stdout:generic/730 [not run] require ceph-fuse to be valid block disk 2023-10-14T22:44:04.670 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/730 2023-10-14T22:44:04.670 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/730 2023-10-14T22:44:04.670 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:44:04.681 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:04.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:44:04.719 DEBUG:teuthology.orchestra.run.smithi064:> (cd /tmp/tmp.fHRpaBS5ywxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2023-10-14T22:44:05.398 INFO:teuthology.orchestra.run.smithi064.stdout:FSTYP -- ceph-fuse 2023-10-14T22:44:05.415 INFO:teuthology.orchestra.run.smithi064.stdout:PLATFORM -- Linux/x86_64 smithi064 6.6.0-rc5-g47672119149b #1 SMP PREEMPT_DYNAMIC Tue Oct 10 21:48:44 UTC 2023 2023-10-14T22:44:05.415 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:05.890 INFO:teuthology.orchestra.run.smithi064.stdout:generic/731 [not run] require ceph-fuse to be valid block disk 2023-10-14T22:44:05.900 INFO:teuthology.orchestra.run.smithi064.stdout:Ran: generic/731 2023-10-14T22:44:05.900 INFO:teuthology.orchestra.run.smithi064.stdout:Not run: generic/731 2023-10-14T22:44:05.900 INFO:teuthology.orchestra.run.smithi064.stdout:Passed all 1 tests 2023-10-14T22:44:05.910 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:05.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-10-14T22:44:05.946 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 16========================================================= 2023-10-14T22:44:05.946 DEBUG:teuthology.orchestra.run.smithi064:> sudo userdel --force --remove fsgqa 2023-10-14T22:44:08.915 DEBUG:teuthology.orchestra.run.smithi064:> sudo userdel --force --remove 123456-fsgqa 2023-10-14T22:44:10.063 DEBUG:teuthology.orchestra.run.smithi064:> sudo groupdel fsgqa 2023-10-14T22:44:10.244 INFO:teuthology.orchestra.run.smithi064.stderr:groupdel: group 'fsgqa' does not exist 2023-10-14T22:44:10.248 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-10-14T22:44:10.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:10.249 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.fHRpaBS5ywxfstests-dev/results) 2023-10-14T22:44:10.302 INFO:teuthology.orchestra.run.smithi064.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied 2023-10-14T22:44:10.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T22:44:10.303 INFO:tasks.cephfs.xfstests_dev:xfstests-dev repo contains not directory named "results". repo location: /tmp/tmp.fHRpaBS5ywxfstests-dev 2023-10-14T22:44:10.304 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf /tmp/tmp.fHRpaBS5ywxfstests-dev 2023-10-14T22:44:11.147 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-14T22:44:11.148 DEBUG:teuthology.orchestra.run.smithi064:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T22:44:11.482 DEBUG:teuthology.orchestra.run.smithi177:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-14T22:44:12.535 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-14T22:44:12.536 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T22:44:12.536 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:12.641 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054305,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249416k,nr_inodes=812354,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T22:44:12.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T22:44:12.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:12.642 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-14T22:44:12.731 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T22:44:12.732 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:12.803 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T22:44:12.804 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T22:44:12.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:12.805 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-14T22:44:12.866 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-10-14T22:44:12.866 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T22:44:12.867 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T22:44:12.868 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:12.924 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054305,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249416k,nr_inodes=812354,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T22:44:12.925 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T22:44:12.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:12.925 DEBUG:teuthology.orchestra.run.smithi064:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-14T22:44:12.979 INFO:teuthology.orchestra.run.smithi064.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-14T22:44:12.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T22:44:12.981 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T22:44:12.981 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:13.034 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T22:44:13.034 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T22:44:13.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:13.035 DEBUG:teuthology.orchestra.run.smithi177:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-14T22:44:13.129 INFO:teuthology.orchestra.run.smithi177.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-14T22:44:13.131 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-14T22:44:13.132 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T22:44:14.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.716+0000 7f4f9806f640 1 Processor -- start 2023-10-14T22:44:14.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.716+0000 7f4f9806f640 1 -- start start 2023-10-14T22:44:14.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.718+0000 7f4f9806f640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4f900c9e70 0x7f4f900ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:14.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.718+0000 7f4f9806f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9006a4f0 0x7f4f900cd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:14.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.718+0000 7f4f9806f640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f90161250 con 0x7f4f9015ca80 2023-10-14T22:44:14.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.718+0000 7f4f9806f640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f901614f0 con 0x7f4f900c9e70 2023-10-14T22:44:14.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.718+0000 7f4f9806f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f90071ed0 con 0x7f4f9006a4f0 2023-10-14T22:44:14.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.719+0000 7f4f95e0b640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f4f9015ca80 0x7f4f90069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:35980/0 (socket says 172.21.15.64:35980) 2023-10-14T22:44:14.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.719+0000 7f4f95e0b640 1 -- 172.21.15.64:0/3516148555 learned_addr learned my addr 172.21.15.64:0/3516148555 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:14.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.719+0000 7f4f9560a640 1 --2- 172.21.15.64:0/3516148555 >> v2:172.21.15.64:3300/0 conn(0x7f4f900c9e70 0x7f4f900ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:14.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.719+0000 7f4f94e09640 1 -- 172.21.15.64:0/3516148555 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2114567844 0 0) 0x7f4f90161250 con 0x7f4f9015ca80 2023-10-14T22:44:14.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.720+0000 7f4f94e09640 1 -- 172.21.15.64:0/3516148555 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f7c003520 con 0x7f4f9015ca80 2023-10-14T22:44:14.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.720+0000 7f4f9660c640 1 --2- 172.21.15.64:0/3516148555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9006a4f0 0x7f4f900cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:14.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.720+0000 7f4f9560a640 1 -- 172.21.15.64:0/3516148555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9006a4f0 msgr2=0x7f4f900cd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:14.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.720+0000 7f4f9560a640 1 --2- 172.21.15.64:0/3516148555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9006a4f0 0x7f4f900cd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:14.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.720+0000 7f4f9560a640 1 -- 172.21.15.64:0/3516148555 >> v1:172.21.15.177:6789/0 conn(0x7f4f9015ca80 legacy=0x7f4f90069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:14.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.720+0000 7f4f9560a640 1 -- 172.21.15.64:0/3516148555 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f900721b0 con 0x7f4f900c9e70 2023-10-14T22:44:14.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.721+0000 7f4f9560a640 1 --2- 172.21.15.64:0/3516148555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900ccbb0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f8002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ac95b49e816c3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:14.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.722+0000 7f4f94e09640 1 -- 172.21.15.64:0/3516148555 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8002d040 con 0x7f4f900c9e70 2023-10-14T22:44:14.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.722+0000 7f4f94e09640 1 -- 172.21.15.64:0/3516148555 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80031810 con 0x7f4f900c9e70 2023-10-14T22:44:14.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.722+0000 7f4f94e09640 1 -- 172.21.15.64:0/3516148555 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80031ba0 con 0x7f4f900c9e70 2023-10-14T22:44:14.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.723+0000 7f4f9806f640 1 -- 172.21.15.64:0/3516148555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 msgr2=0x7f4f900ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:14.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.723+0000 7f4f9806f640 1 --2- 172.21.15.64:0/3516148555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900ccbb0 secure :-1 s=READY pgs=2220 cs=0 l=1 rev1=1 crypto rx=0x7f4f800097a0 tx=0x7f4f8002b8b0 comp rx=0 tx=0).stop 2023-10-14T22:44:14.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.723+0000 7f4f9806f640 1 -- 172.21.15.64:0/3516148555 shutdown_connections 2023-10-14T22:44:14.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.723+0000 7f4f9806f640 1 --2- 172.21.15.64:0/3516148555 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9006a4f0 0x7f4f900cd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:14.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.723+0000 7f4f9806f640 1 --2- 172.21.15.64:0/3516148555 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900ccbb0 unknown :-1 s=CLOSED pgs=2220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:14.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.723+0000 7f4f9806f640 1 -- 172.21.15.64:0/3516148555 >> 172.21.15.64:0/3516148555 conn(0x7f4f900cc0c0 msgr2=0x7f4f900cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:14.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.723+0000 7f4f9806f640 1 -- 172.21.15.64:0/3516148555 shutdown_connections 2023-10-14T22:44:14.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.724+0000 7f4f9806f640 1 -- 172.21.15.64:0/3516148555 wait complete. 2023-10-14T22:44:14.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.725+0000 7f4f9806f640 1 Processor -- start 2023-10-14T22:44:14.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.726+0000 7f4f9806f640 1 -- start start 2023-10-14T22:44:14.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9806f640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f9006a4f0 0x7f4f900b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:14.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9806f640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900b3a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:14.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9806f640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9015ca80 0x7f4f901f57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:14.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9806f640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9015e560 con 0x7f4f900c9e70 2023-10-14T22:44:14.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9806f640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9015d950 con 0x7f4f9006a4f0 2023-10-14T22:44:14.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9806f640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9015dc30 con 0x7f4f9015ca80 2023-10-14T22:44:14.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9560a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900b3a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:14.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9560a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900b3a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:39736/0 (socket says 172.21.15.64:39736) 2023-10-14T22:44:14.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.727+0000 7f4f9560a640 1 -- 172.21.15.64:0/3118781229 learned_addr learned my addr 172.21.15.64:0/3118781229 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:14.732 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.728+0000 7f4f9660c640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9015ca80 0x7f4f901f57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:14.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.728+0000 7f4f95e0b640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f9006a4f0 0x7f4f900b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:14.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.728+0000 7f4f9560a640 1 -- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9015ca80 msgr2=0x7f4f901f57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:14.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.728+0000 7f4f9560a640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9015ca80 0x7f4f901f57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:14.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.728+0000 7f4f9560a640 1 -- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f9006a4f0 msgr2=0x7f4f900b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:14.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.728+0000 7f4f9560a640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f9006a4f0 0x7f4f900b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:14.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.728+0000 7f4f9560a640 1 -- 172.21.15.64:0/3118781229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009400 con 0x7f4f900c9e70 2023-10-14T22:44:14.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.729+0000 7f4f9560a640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900b3a20 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f4f800098c0 tx=0x7f4f800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:14.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.741+0000 7f4f867fc640 1 -- 172.21.15.64:0/3118781229 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8003ad50 con 0x7f4f900c9e70 2023-10-14T22:44:14.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.741+0000 7f4f867fc640 1 -- 172.21.15.64:0/3118781229 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f80044400 con 0x7f4f900c9e70 2023-10-14T22:44:14.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.741+0000 7f4f867fc640 1 -- 172.21.15.64:0/3118781229 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800447b0 con 0x7f4f900c9e70 2023-10-14T22:44:14.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.741+0000 7f4f9806f640 1 -- 172.21.15.64:0/3118781229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9015df10 con 0x7f4f900c9e70 2023-10-14T22:44:14.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.744+0000 7f4f9806f640 1 -- 172.21.15.64:0/3118781229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9015e9f0 con 0x7f4f900c9e70 2023-10-14T22:44:14.748 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.746+0000 7f4f867fc640 1 -- 172.21.15.64:0/3118781229 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4f800433a0 con 0x7f4f900c9e70 2023-10-14T22:44:14.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.747+0000 7f4f867fc640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4f7406aec0 0x7f4f7406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:14.750 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.747+0000 7f4f867fc640 1 -- 172.21.15.64:0/3118781229 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f4f800ab390 con 0x7f4f900c9e70 2023-10-14T22:44:14.751 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.748+0000 7f4f95e0b640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4f7406aec0 0x7f4f7406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:14.774 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.747+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c005250 con 0x7f4f900c9e70 2023-10-14T22:44:14.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.774+0000 7f4f95e0b640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4f7406aec0 0x7f4f7406d380 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0011e0 tx=0x7f4f8c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:14.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:14.778+0000 7f4f867fc640 1 -- 172.21.15.64:0/3118781229 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4f800762c0 con 0x7f4f900c9e70 2023-10-14T22:44:15.165 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.161+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f6c005500 con 0x7f4f900c9e70 2023-10-14T22:44:15.166 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.162+0000 7f4f867fc640 1 -- 172.21.15.64:0/3118781229 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f4f80035070 con 0x7f4f900c9e70 2023-10-14T22:44:15.166 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:15.166 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2123710189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2123710189},{"type":"v1","addr":"172.21.15.177:6837","nonce":2123710189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1971405270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1971405270},{"type":"v1","addr":"172.21.15.177:6836","nonce":1971405270}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/47775465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":47775465},{"type":"v1","addr":"172.21.15.64:6833","nonce":47775465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:30:33.786154+0000","modified":"2023-10-14T12:30:36.843227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5457":{"gid":5457,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3900287009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3900287009},{"type":"v1","addr":"172.21.15.64:6835","nonce":3900287009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T22:44:15.167 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2023-10-14T22:44:15.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4f7406aec0 msgr2=0x7f4f7406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4f7406aec0 0x7f4f7406d380 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c0011e0 tx=0x7f4f8c009040 comp rx=0 tx=0).stop 2023-10-14T22:44:15.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 msgr2=0x7f4f900b3a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900b3a20 secure :-1 s=READY pgs=2221 cs=0 l=1 rev1=1 crypto rx=0x7f4f800098c0 tx=0x7f4f800046c0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.170 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 shutdown_connections 2023-10-14T22:44:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4f7406aec0 0x7f4f7406d380 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4f9015ca80 0x7f4f901f57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4f900c9e70 0x7f4f900b3a20 unknown :-1 s=CLOSED pgs=2221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 --2- 172.21.15.64:0/3118781229 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4f9006a4f0 0x7f4f900b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.167+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 >> 172.21.15.64:0/3118781229 conn(0x7f4f900cc0c0 msgr2=0x7f4f900b01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.168+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 shutdown_connections 2023-10-14T22:44:15.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.168+0000 7f4f73fff640 1 -- 172.21.15.64:0/3118781229 wait complete. 2023-10-14T22:44:15.197 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T22:44:15.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.457+0000 7f36f4821640 1 Processor -- start 2023-10-14T22:44:15.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.458+0000 7f36f4821640 1 -- start start 2023-10-14T22:44:15.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36f4821640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36f015ca80 0x7f36f00cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:15.461 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36f4821640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ce60 0x7f36f00b0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36f4821640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36f00cd500 con 0x7f36f00b0550 2023-10-14T22:44:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36f4821640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36f00b09c0 con 0x7f36f015ca80 2023-10-14T22:44:15.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36f4821640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f0161620 con 0x7f36f015ce60 2023-10-14T22:44:15.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36ee59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36f015ca80 0x7f36f00cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:15.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36eed9d640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f36f00b0550 0x7f36f00c8be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34612/0 (socket says 172.21.15.64:34612) 2023-10-14T22:44:15.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36eed9d640 1 -- 172.21.15.64:0/3371628196 learned_addr learned my addr 172.21.15.64:0/3371628196 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:15.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36ee59c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f36f015ca80 0x7f36f00cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:37812/0 (socket says 172.21.15.64:37812) 2023-10-14T22:44:15.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.459+0000 7f36edd9b640 1 --2- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ce60 0x7f36f00b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:15.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.460+0000 7f36ee59c640 1 -- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ce60 msgr2=0x7f36f00b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:15.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.460+0000 7f36ee59c640 1 --2- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ce60 0x7f36f00b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.460+0000 7f36ee59c640 1 -- 172.21.15.64:0/3371628196 >> v1:172.21.15.64:6789/0 conn(0x7f36f00b0550 legacy=0x7f36f00c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.460+0000 7f36ee59c640 1 -- 172.21.15.64:0/3371628196 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36f00cafa0 con 0x7f36f015ca80 2023-10-14T22:44:15.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.460+0000 7f36ed59a640 1 -- 172.21.15.64:0/3371628196 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254170949 0 0) 0x7f36f00cd500 con 0x7f36f00b0550 2023-10-14T22:44:15.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.462+0000 7f36ee59c640 1 --2- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f015ca80 0x7f36f00cddf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f36e00097a0 tx=0x7f36e002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6794da569cc312ff server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:15.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.462+0000 7f36ed59a640 1 -- 172.21.15.64:0/3371628196 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e002d040 con 0x7f36f015ca80 2023-10-14T22:44:15.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.462+0000 7f36ed59a640 1 -- 172.21.15.64:0/3371628196 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e0031810 con 0x7f36f015ca80 2023-10-14T22:44:15.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.463+0000 7f36f4821640 1 -- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f015ca80 msgr2=0x7f36f00cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.463+0000 7f36f4821640 1 --2- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f015ca80 0x7f36f00cddf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f36e00097a0 tx=0x7f36e002b8b0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.463+0000 7f36f4821640 1 -- 172.21.15.64:0/3371628196 shutdown_connections 2023-10-14T22:44:15.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.463+0000 7f36f4821640 1 --2- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ce60 0x7f36f00b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.463+0000 7f36f4821640 1 --2- 172.21.15.64:0/3371628196 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f015ca80 0x7f36f00cddf0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.464+0000 7f36f4821640 1 -- 172.21.15.64:0/3371628196 >> 172.21.15.64:0/3371628196 conn(0x7f36f006c1c0 msgr2=0x7f36f006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:15.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.464+0000 7f36f4821640 1 -- 172.21.15.64:0/3371628196 shutdown_connections 2023-10-14T22:44:15.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.464+0000 7f36f4821640 1 -- 172.21.15.64:0/3371628196 wait complete. 2023-10-14T22:44:15.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.467+0000 7f36f4821640 1 Processor -- start 2023-10-14T22:44:15.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.467+0000 7f36f4821640 1 -- start start 2023-10-14T22:44:15.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.468+0000 7f36f4821640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f00b0550 0x7f36f00c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:15.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.468+0000 7f36f4821640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ca80 0x7f36f015aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.468+0000 7f36f4821640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36f015ce60 0x7f36f015afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.468+0000 7f36f4821640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00c4020 con 0x7f36f015ce60 2023-10-14T22:44:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.468+0000 7f36f4821640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00c33a0 con 0x7f36f00b0550 2023-10-14T22:44:15.472 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.469+0000 7f36f4821640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36f00c3680 con 0x7f36f015ca80 2023-10-14T22:44:15.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.469+0000 7f36edd9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ca80 0x7f36f015aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:15.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.469+0000 7f36edd9b640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ca80 0x7f36f015aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:53366/0 (socket says 172.21.15.64:53366) 2023-10-14T22:44:15.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.469+0000 7f36edd9b640 1 -- 172.21.15.64:0/677737385 learned_addr learned my addr 172.21.15.64:0/677737385 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:15.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.469+0000 7f36ee59c640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f00b0550 0x7f36f00c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:15.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.469+0000 7f36edd9b640 1 -- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f00b0550 msgr2=0x7f36f00c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36edd9b640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f00b0550 0x7f36f00c4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36edd9b640 1 -- 172.21.15.64:0/677737385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36f015ce60 msgr2=0x7f36f015afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36edd9b640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36f015ce60 0x7f36f015afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36edd9b640 1 -- 172.21.15.64:0/677737385 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36e0009400 con 0x7f36f015ca80 2023-10-14T22:44:15.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36edd9b640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ca80 0x7f36f015aa60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e870 tx=0x7f36e400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:15.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36deffd640 1 -- 172.21.15.64:0/677737385 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e40094f0 con 0x7f36f015ca80 2023-10-14T22:44:15.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36deffd640 1 -- 172.21.15.64:0/677737385 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36e400c940 con 0x7f36f015ca80 2023-10-14T22:44:15.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.470+0000 7f36deffd640 1 -- 172.21.15.64:0/677737385 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36e400ccf0 con 0x7f36f015ca80 2023-10-14T22:44:15.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.471+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36f00c3960 con 0x7f36f015ca80 2023-10-14T22:44:15.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.472+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36f00c4e40 con 0x7f36f015ca80 2023-10-14T22:44:15.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.474+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36f0071500 con 0x7f36f015ca80 2023-10-14T22:44:15.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.476+0000 7f36deffd640 1 -- 172.21.15.64:0/677737385 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f36e4013470 con 0x7f36f015ca80 2023-10-14T22:44:15.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.477+0000 7f36deffd640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36d006ae70 0x7f36d006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:15.480 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.478+0000 7f36deffd640 1 -- 172.21.15.64:0/677737385 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f36e4089840 con 0x7f36f015ca80 2023-10-14T22:44:15.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.480+0000 7f36ee59c640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36d006ae70 0x7f36d006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:15.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.481+0000 7f36ee59c640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36d006ae70 0x7f36d006d330 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f36e0036000 tx=0x7f36e003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:15.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.559+0000 7f36deffd640 1 -- 172.21.15.64:0/677737385 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f36e4054770 con 0x7f36f015ca80 2023-10-14T22:44:15.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.882+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f36f0073ef0 con 0x7f36f015ca80 2023-10-14T22:44:15.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.886+0000 7f36deffd640 1 -- 172.21.15.64:0/677737385 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f36e4057d90 con 0x7f36f015ca80 2023-10-14T22:44:15.889 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:15.889 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":43,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:31:32.842217+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:30:31.794557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:30:32.797876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T22:44:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36d006ae70 msgr2=0x7f36d006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36d006ae70 0x7f36d006d330 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f36e0036000 tx=0x7f36e003c040 comp rx=0 tx=0).stop 2023-10-14T22:44:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ca80 msgr2=0x7f36f015aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ca80 0x7f36f015aa60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f36e400e870 tx=0x7f36e400ed30 comp rx=0 tx=0).stop 2023-10-14T22:44:15.892 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 shutdown_connections 2023-10-14T22:44:15.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f36d006ae70 0x7f36d006d330 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f36f015ce60 0x7f36f015afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f36f015ca80 0x7f36f015aa60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 --2- 172.21.15.64:0/677737385 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f36f00b0550 0x7f36f00c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:15.893 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 >> 172.21.15.64:0/677737385 conn(0x7f36f006c1c0 msgr2=0x7f36f0070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:15.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.889+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 shutdown_connections 2023-10-14T22:44:15.894 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:15.890+0000 7f36f4821640 1 -- 172.21.15.64:0/677737385 wait complete. 2023-10-14T22:44:15.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-14T12:28:39.804498+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'testcephfs1_metadata', 'create_time': '2023-10-14T12:30:31.794557+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'testcephfs1_data', 'create_time': '2023-10-14T12:30:32.797876+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'testcephfs1'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-10-14T22:44:15.919 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-14T22:44:16.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.185+0000 7fce270bb640 1 Processor -- start 2023-10-14T22:44:16.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.186+0000 7fce270bb640 1 -- start start 2023-10-14T22:44:16.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.188+0000 7fce270bb640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fce200c8b50 0x7fce20071360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.188+0000 7fce270bb640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce20159140 con 0x7fce200c9010 2023-10-14T22:44:16.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.188+0000 7fce270bb640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce200ad760 con 0x7fce20158d60 2023-10-14T22:44:16.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.188+0000 7fce270bb640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce200ada40 con 0x7fce200c8b50 2023-10-14T22:44:16.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.188+0000 7fce25658640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fce200c9010 0x7fce200c9560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:39000/0 (socket says 172.21.15.64:39000) 2023-10-14T22:44:16.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.188+0000 7fce25658640 1 -- 172.21.15.64:0/1431596900 learned_addr learned my addr 172.21.15.64:0/1431596900 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:16.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.188+0000 7fce1ffff640 1 --2- 172.21.15.64:0/1431596900 >> v2:172.21.15.64:3300/0 conn(0x7fce200c8b50 0x7fce20071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.189+0000 7fce1f7fe640 1 -- 172.21.15.64:0/1431596900 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976505322 0 0) 0x7fce20159140 con 0x7fce200c9010 2023-10-14T22:44:16.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.189+0000 7fce1f7fe640 1 -- 172.21.15.64:0/1431596900 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce10003520 con 0x7fce200c9010 2023-10-14T22:44:16.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.189+0000 7fce1ffff640 1 -- 172.21.15.64:0/1431596900 >> v1:172.21.15.177:6789/0 conn(0x7fce20158d60 legacy=0x7fce200cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:16.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.189+0000 7fce1ffff640 1 -- 172.21.15.64:0/1431596900 >> v1:172.21.15.64:6789/0 conn(0x7fce200c9010 legacy=0x7fce200c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.189+0000 7fce1ffff640 1 -- 172.21.15.64:0/1431596900 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20070b60 con 0x7fce200c8b50 2023-10-14T22:44:16.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.191+0000 7fce1ffff640 1 --2- 172.21.15.64:0/1431596900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce200c8b50 0x7fce20071360 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0097a0 tx=0x7fce0c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=446fdac40548d574 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:16.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.192+0000 7fce1f7fe640 1 -- 172.21.15.64:0/1431596900 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c02e070 con 0x7fce200c8b50 2023-10-14T22:44:16.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.192+0000 7fce1f7fe640 1 -- 172.21.15.64:0/1431596900 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c0315a0 con 0x7fce200c8b50 2023-10-14T22:44:16.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.192+0000 7fce1f7fe640 1 -- 172.21.15.64:0/1431596900 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c031910 con 0x7fce200c8b50 2023-10-14T22:44:16.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.193+0000 7fce270bb640 1 -- 172.21.15.64:0/1431596900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce200c8b50 msgr2=0x7fce20071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.193+0000 7fce270bb640 1 --2- 172.21.15.64:0/1431596900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce200c8b50 0x7fce20071360 secure :-1 s=READY pgs=2224 cs=0 l=1 rev1=1 crypto rx=0x7fce0c0097a0 tx=0x7fce0c02b840 comp rx=0 tx=0).stop 2023-10-14T22:44:16.196 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.193+0000 7fce270bb640 1 -- 172.21.15.64:0/1431596900 shutdown_connections 2023-10-14T22:44:16.196 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.193+0000 7fce270bb640 1 --2- 172.21.15.64:0/1431596900 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce200c8b50 0x7fce20071360 unknown :-1 s=CLOSED pgs=2224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.196 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.193+0000 7fce270bb640 1 -- 172.21.15.64:0/1431596900 >> 172.21.15.64:0/1431596900 conn(0x7fce2006c130 msgr2=0x7fce2006c510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:16.198 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.193+0000 7fce270bb640 1 -- 172.21.15.64:0/1431596900 shutdown_connections 2023-10-14T22:44:16.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.193+0000 7fce270bb640 1 -- 172.21.15.64:0/1431596900 wait complete. 2023-10-14T22:44:16.199 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.197+0000 7fce270bb640 1 Processor -- start 2023-10-14T22:44:16.200 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.197+0000 7fce270bb640 1 -- start start 2023-10-14T22:44:16.201 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.199+0000 7fce270bb640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce200c8b50 0x7fce201592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.199+0000 7fce270bb640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200c9010 0x7fce2014db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.199+0000 7fce270bb640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce20158d60 0x7fce200af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.202 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.199+0000 7fce270bb640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20159c90 con 0x7fce20158d60 2023-10-14T22:44:16.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.199+0000 7fce270bb640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce20154df0 con 0x7fce200c9010 2023-10-14T22:44:16.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.199+0000 7fce270bb640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce2014ce10 con 0x7fce200c8b50 2023-10-14T22:44:16.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.200+0000 7fce24e57640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce200c8b50 0x7fce201592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.200+0000 7fce24e57640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce200c8b50 0x7fce201592d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:56650/0 (socket says 172.21.15.64:56650) 2023-10-14T22:44:16.203 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.200+0000 7fce24e57640 1 -- 172.21.15.64:0/3522429039 learned_addr learned my addr 172.21.15.64:0/3522429039 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:16.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.201+0000 7fce25658640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce20158d60 0x7fce200af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.201+0000 7fce1ffff640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200c9010 0x7fce2014db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.204 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.202+0000 7fce1ffff640 1 -- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce200c8b50 msgr2=0x7fce201592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.202+0000 7fce1ffff640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce200c8b50 0x7fce201592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.202+0000 7fce1ffff640 1 -- 172.21.15.64:0/3522429039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce20158d60 msgr2=0x7fce200af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.205 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.203+0000 7fce1ffff640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce20158d60 0x7fce200af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.203+0000 7fce1ffff640 1 -- 172.21.15.64:0/3522429039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0c009400 con 0x7fce200c9010 2023-10-14T22:44:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.203+0000 7fce25658640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce20158d60 0x7fce200af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T22:44:16.206 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.203+0000 7fce1ffff640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200c9010 0x7fce2014db00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fce0c033000 tx=0x7fce0c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:16.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.204+0000 7fce1d7fa640 1 -- 172.21.15.64:0/3522429039 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c003810 con 0x7fce200c9010 2023-10-14T22:44:16.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.204+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2014d670 con 0x7fce200c9010 2023-10-14T22:44:16.207 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.204+0000 7fce1d7fa640 1 -- 172.21.15.64:0/3522429039 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0c040070 con 0x7fce200c9010 2023-10-14T22:44:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.204+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2014d020 con 0x7fce200c9010 2023-10-14T22:44:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.205+0000 7fce1d7fa640 1 -- 172.21.15.64:0/3522429039 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0c003b70 con 0x7fce200c9010 2023-10-14T22:44:16.208 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.206+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2006fca0 con 0x7fce200c9010 2023-10-14T22:44:16.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.208+0000 7fce1d7fa640 1 -- 172.21.15.64:0/3522429039 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fce0c003cd0 con 0x7fce200c9010 2023-10-14T22:44:16.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.210+0000 7fce1d7fa640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0406aed0 0x7fce0406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.210+0000 7fce1d7fa640 1 -- 172.21.15.64:0/3522429039 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7fce0c042070 con 0x7fce200c9010 2023-10-14T22:44:16.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.211+0000 7fce24e57640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0406aed0 0x7fce0406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.212+0000 7fce24e57640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0406aed0 0x7fce0406d390 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fce14006fd0 tx=0x7fce14008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:16.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.220+0000 7fce1d7fa640 1 -- 172.21.15.64:0/3522429039 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fce0c076cb0 con 0x7fce200c9010 2023-10-14T22:44:16.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.517+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fce20067820 con 0x7fce200c9010 2023-10-14T22:44:16.520 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.518+0000 7fce1d7fa640 1 -- 172.21.15.64:0/3522429039 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fce0c04c020 con 0x7fce200c9010 2023-10-14T22:44:16.521 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 1 2023-10-14T22:44:16.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0406aed0 msgr2=0x7fce0406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0406aed0 0x7fce0406d390 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fce14006fd0 tx=0x7fce14008040 comp rx=0 tx=0).stop 2023-10-14T22:44:16.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200c9010 msgr2=0x7fce2014db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200c9010 0x7fce2014db00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fce0c033000 tx=0x7fce0c0046c0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 shutdown_connections 2023-10-14T22:44:16.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fce0406aed0 0x7fce0406d390 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fce20158d60 0x7fce200af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fce200c9010 0x7fce2014db00 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 --2- 172.21.15.64:0/3522429039 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fce200c8b50 0x7fce201592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 >> 172.21.15.64:0/3522429039 conn(0x7fce2006c130 msgr2=0x7fce200c94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:16.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 shutdown_connections 2023-10-14T22:44:16.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.522+0000 7fce270bb640 1 -- 172.21.15.64:0/3522429039 wait complete. 2023-10-14T22:44:16.553 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_metadata pg_num 2023-10-14T22:44:16.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.808+0000 7f90df9f5640 1 Processor -- start 2023-10-14T22:44:16.811 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.808+0000 7f90df9f5640 1 -- start start 2023-10-14T22:44:16.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.811+0000 7f90df9f5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d815cbf0 0x7f90d80d29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.811+0000 7f90df9f5640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f90d80b8400 0x7f90d80d11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.811+0000 7f90df9f5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d815cfd0 con 0x7f90d80b4410 2023-10-14T22:44:16.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.811+0000 7f90df9f5640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80d0dc0 con 0x7f90d80b8400 2023-10-14T22:44:16.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.811+0000 7f90df9f5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d80d30b0 con 0x7f90d815cbf0 2023-10-14T22:44:16.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.812+0000 7f90dcf90640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f90d80b8400 0x7f90d80d11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.812+0000 7f90dd791640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d815cbf0 0x7f90d80d29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.812+0000 7f90dd791640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f90d815cbf0 0x7f90d80d29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36298/0 (socket says 172.21.15.64:36298) 2023-10-14T22:44:16.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.812+0000 7f90dd791640 1 -- 172.21.15.64:0/310537476 learned_addr learned my addr 172.21.15.64:0/310537476 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:16.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.813+0000 7f90dd791640 1 -- 172.21.15.64:0/310537476 >> v2:172.21.15.64:3300/0 conn(0x7f90d80b8400 msgr2=0x7f90d80d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:16.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.813+0000 7f90dd791640 1 --2- 172.21.15.64:0/310537476 >> v2:172.21.15.64:3300/0 conn(0x7f90d80b8400 0x7f90d80d11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.813+0000 7f90dd791640 1 -- 172.21.15.64:0/310537476 >> v1:172.21.15.64:6789/0 conn(0x7f90d80b4410 legacy=0x7f90d80b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:16.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.813+0000 7f90dd791640 1 -- 172.21.15.64:0/310537476 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d80d0700 con 0x7f90d815cbf0 2023-10-14T22:44:16.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.814+0000 7f90dd791640 1 --2- 172.21.15.64:0/310537476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d815cbf0 0x7f90d80d29d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f90d80cf370 tx=0x7f90d402b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b242098f5216d5f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:16.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.815+0000 7f90cffff640 1 -- 172.21.15.64:0/310537476 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4031870 con 0x7f90d815cbf0 2023-10-14T22:44:16.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.815+0000 7f90cffff640 1 -- 172.21.15.64:0/310537476 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d40319d0 con 0x7f90d815cbf0 2023-10-14T22:44:16.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.815+0000 7f90cffff640 1 -- 172.21.15.64:0/310537476 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d4031d60 con 0x7f90d815cbf0 2023-10-14T22:44:16.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.815+0000 7f90df9f5640 1 -- 172.21.15.64:0/310537476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d815cbf0 msgr2=0x7f90d80d29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.815+0000 7f90df9f5640 1 --2- 172.21.15.64:0/310537476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d815cbf0 0x7f90d80d29d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f90d80cf370 tx=0x7f90d402b910 comp rx=0 tx=0).stop 2023-10-14T22:44:16.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.816+0000 7f90df9f5640 1 -- 172.21.15.64:0/310537476 shutdown_connections 2023-10-14T22:44:16.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.816+0000 7f90df9f5640 1 --2- 172.21.15.64:0/310537476 >> v2:172.21.15.64:3300/0 conn(0x7f90d80b8400 0x7f90d80d11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.816+0000 7f90df9f5640 1 --2- 172.21.15.64:0/310537476 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d815cbf0 0x7f90d80d29d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.816+0000 7f90df9f5640 1 -- 172.21.15.64:0/310537476 >> 172.21.15.64:0/310537476 conn(0x7f90d8071900 msgr2=0x7f90d8071d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:16.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.816+0000 7f90df9f5640 1 -- 172.21.15.64:0/310537476 shutdown_connections 2023-10-14T22:44:16.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.817+0000 7f90df9f5640 1 -- 172.21.15.64:0/310537476 wait complete. 2023-10-14T22:44:16.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.818+0000 7f90df9f5640 1 Processor -- start 2023-10-14T22:44:16.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.819+0000 7f90df9f5640 1 -- start start 2023-10-14T22:44:16.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.820+0000 7f90df9f5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d80b4410 0x7f90d81f3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.820+0000 7f90df9f5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d80b8400 0x7f90d80b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.820+0000 7f90df9f5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90d815cbf0 0x7f90d80b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.820+0000 7f90df9f5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80c8910 con 0x7f90d815cbf0 2023-10-14T22:44:16.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.820+0000 7f90df9f5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80c6c90 con 0x7f90d80b8400 2023-10-14T22:44:16.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.820+0000 7f90df9f5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d80c8630 con 0x7f90d80b4410 2023-10-14T22:44:16.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.821+0000 7f90dcf90640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d80b8400 0x7f90d80b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.821+0000 7f90dcf90640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d80b8400 0x7f90d80b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36308/0 (socket says 172.21.15.64:36308) 2023-10-14T22:44:16.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.821+0000 7f90dcf90640 1 -- 172.21.15.64:0/3830559388 learned_addr learned my addr 172.21.15.64:0/3830559388 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:16.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.821+0000 7f90dd791640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d80b4410 0x7f90d81f3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90ddf92640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90d815cbf0 0x7f90d80b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90dcf90640 1 -- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d80b4410 msgr2=0x7f90d81f3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90dcf90640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d80b4410 0x7f90d81f3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90dcf90640 1 -- 172.21.15.64:0/3830559388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90d815cbf0 msgr2=0x7f90d80b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:16.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90dcf90640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90d815cbf0 0x7f90d80b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:16.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90dcf90640 1 -- 172.21.15.64:0/3830559388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d40094d0 con 0x7f90d80b8400 2023-10-14T22:44:16.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90dd791640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d80b4410 0x7f90d81f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T22:44:16.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90ddf92640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90d815cbf0 0x7f90d80b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:16.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.822+0000 7f90dcf90640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d80b8400 0x7f90d80b5f90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f90c800d800 tx=0x7f90c800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:16.828 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.823+0000 7f90cdffb640 1 -- 172.21.15.64:0/3830559388 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8016be0 con 0x7f90d80b8400 2023-10-14T22:44:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.823+0000 7f90cdffb640 1 -- 172.21.15.64:0/3830559388 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c801a070 con 0x7f90d80b8400 2023-10-14T22:44:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.823+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d80c6640 con 0x7f90d80b8400 2023-10-14T22:44:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.823+0000 7f90cdffb640 1 -- 172.21.15.64:0/3830559388 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c800b6c0 con 0x7f90d80b8400 2023-10-14T22:44:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.823+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d81f37c0 con 0x7f90d80b8400 2023-10-14T22:44:16.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.825+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d81f39e0 con 0x7f90d80b8400 2023-10-14T22:44:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.826+0000 7f90cdffb640 1 -- 172.21.15.64:0/3830559388 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f90c800b820 con 0x7f90d80b8400 2023-10-14T22:44:16.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.827+0000 7f90cdffb640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90bc06aec0 0x7f90bc06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.827+0000 7f90cdffb640 1 -- 172.21.15.64:0/3830559388 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f90c801c070 con 0x7f90d80b8400 2023-10-14T22:44:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.828+0000 7f90dd791640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90bc06aec0 0x7f90bc06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:16.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.829+0000 7f90dd791640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90bc06aec0 0x7f90bc06d380 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f90d4036000 tx=0x7f90d403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:16.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:16.834+0000 7f90cdffb640 1 -- 172.21.15.64:0/3830559388 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f90c805cb20 con 0x7f90d80b8400 2023-10-14T22:44:17.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.107+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"} v 0) v1 -- 0x7f90d80c6440 con 0x7f90d80b8400 2023-10-14T22:44:17.111 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.108+0000 7f90cdffb640 1 -- 172.21.15.64:0/3830559388 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_metadata", "var": "pg_num"}]=0 v43) v1 ==== 109+0+11 (secure 0 0 0) 0x7f90c8060140 con 0x7f90d80b8400 2023-10-14T22:44:17.111 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 32 2023-10-14T22:44:17.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90bc06aec0 msgr2=0x7f90bc06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:17.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90bc06aec0 0x7f90bc06d380 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f90d4036000 tx=0x7f90d403c040 comp rx=0 tx=0).stop 2023-10-14T22:44:17.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d80b8400 msgr2=0x7f90d80b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:17.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d80b8400 0x7f90d80b5f90 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f90c800d800 tx=0x7f90c800dcc0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 shutdown_connections 2023-10-14T22:44:17.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f90bc06aec0 0x7f90bc06d380 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f90d815cbf0 0x7f90d80b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f90d80b8400 0x7f90d80b5f90 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 --2- 172.21.15.64:0/3830559388 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f90d80b4410 0x7f90d81f3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.111+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 >> 172.21.15.64:0/3830559388 conn(0x7f90d8071900 msgr2=0x7f90d8071ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:17.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.112+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 shutdown_connections 2023-10-14T22:44:17.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.112+0000 7f90df9f5640 1 -- 172.21.15.64:0/3830559388 wait complete. 2023-10-14T22:44:17.140 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get testcephfs1_data pg_num 2023-10-14T22:44:17.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.393+0000 7f50269d0640 1 Processor -- start 2023-10-14T22:44:17.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.393+0000 7f50269d0640 1 -- start start 2023-10-14T22:44:17.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.396+0000 7f50269d0640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5020160ee0 0x7f50201654e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:17.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.396+0000 7f50269d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200cb3b0 0x7f50200cd070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:17.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.396+0000 7f50269d0640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50200cc8b0 con 0x7f50200c9060 2023-10-14T22:44:17.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.396+0000 7f50269d0640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5020165a20 con 0x7f5020160ee0 2023-10-14T22:44:17.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.396+0000 7f50269d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50200c9cc0 con 0x7f50200cb3b0 2023-10-14T22:44:17.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.396+0000 7f501ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5020160ee0 0x7f50201654e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:17.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.396+0000 7f501ffff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5020160ee0 0x7f50201654e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36324/0 (socket says 172.21.15.64:36324) 2023-10-14T22:44:17.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.397+0000 7f501ffff640 1 -- 172.21.15.64:0/1381123693 learned_addr learned my addr 172.21.15.64:0/1381123693 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:17.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.397+0000 7f501ffff640 1 -- 172.21.15.64:0/1381123693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200cb3b0 msgr2=0x7f50200cd070 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-14T22:44:17.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.398+0000 7f501ffff640 1 --2- 172.21.15.64:0/1381123693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200cb3b0 0x7f50200cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.398+0000 7f501ffff640 1 -- 172.21.15.64:0/1381123693 >> v1:172.21.15.64:6789/0 conn(0x7f50200c9060 legacy=0x7f50200caca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:17.401 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.398+0000 7f501ffff640 1 -- 172.21.15.64:0/1381123693 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50200c9700 con 0x7f5020160ee0 2023-10-14T22:44:17.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.399+0000 7f501ffff640 1 --2- 172.21.15.64:0/1381123693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5020160ee0 0x7f50201654e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5010009870 tx=0x7f501002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59c4dbcfaf645cce server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:17.402 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.400+0000 7f501effd640 1 -- 172.21.15.64:0/1381123693 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010031640 con 0x7f5020160ee0 2023-10-14T22:44:17.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.400+0000 7f501effd640 1 -- 172.21.15.64:0/1381123693 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50100317a0 con 0x7f5020160ee0 2023-10-14T22:44:17.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.400+0000 7f501effd640 1 -- 172.21.15.64:0/1381123693 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010031b30 con 0x7f5020160ee0 2023-10-14T22:44:17.403 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.401+0000 7f50269d0640 1 -- 172.21.15.64:0/1381123693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5020160ee0 msgr2=0x7f50201654e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:17.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.401+0000 7f50269d0640 1 --2- 172.21.15.64:0/1381123693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5020160ee0 0x7f50201654e0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f5010009870 tx=0x7f501002b8f0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.402+0000 7f50269d0640 1 -- 172.21.15.64:0/1381123693 shutdown_connections 2023-10-14T22:44:17.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.402+0000 7f50269d0640 1 --2- 172.21.15.64:0/1381123693 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200cb3b0 0x7f50200cd070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.404 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.402+0000 7f50269d0640 1 --2- 172.21.15.64:0/1381123693 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5020160ee0 0x7f50201654e0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.402+0000 7f50269d0640 1 -- 172.21.15.64:0/1381123693 >> 172.21.15.64:0/1381123693 conn(0x7f50200b0030 msgr2=0x7f50200b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:17.405 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.402+0000 7f50269d0640 1 -- 172.21.15.64:0/1381123693 shutdown_connections 2023-10-14T22:44:17.406 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.402+0000 7f50269d0640 1 -- 172.21.15.64:0/1381123693 wait complete. 2023-10-14T22:44:17.407 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.405+0000 7f50269d0640 1 Processor -- start 2023-10-14T22:44:17.408 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.405+0000 7f50269d0640 1 -- start start 2023-10-14T22:44:17.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.408+0000 7f50269d0640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200c9060 0x7f5020151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:17.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.408+0000 7f50269d0640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200cb3b0 0x7f50200aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:17.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.408+0000 7f50269d0640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5020160ee0 0x7f502015a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:17.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.408+0000 7f50269d0640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5020152080 con 0x7f5020160ee0 2023-10-14T22:44:17.412 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.408+0000 7f50269d0640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f502015a650 con 0x7f50200cb3b0 2023-10-14T22:44:17.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.408+0000 7f50269d0640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f502015a090 con 0x7f50200c9060 2023-10-14T22:44:17.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f501ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200c9060 0x7f5020151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:17.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f501ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200c9060 0x7f5020151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:56672/0 (socket says 172.21.15.64:56672) 2023-10-14T22:44:17.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f501ffff640 1 -- 172.21.15.64:0/1136552541 learned_addr learned my addr 172.21.15.64:0/1136552541 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:17.413 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f5024f6d640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5020160ee0 0x7f502015a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:17.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f501f7fe640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200cb3b0 0x7f50200aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:17.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f501ffff640 1 -- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200cb3b0 msgr2=0x7f50200aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:17.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f501ffff640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200cb3b0 0x7f50200aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.414 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.409+0000 7f501ffff640 1 -- 172.21.15.64:0/1136552541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5020160ee0 msgr2=0x7f502015a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:17.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.411+0000 7f501ffff640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5020160ee0 0x7f502015a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.415 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.411+0000 7f501ffff640 1 -- 172.21.15.64:0/1136552541 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50100094d0 con 0x7f50200c9060 2023-10-14T22:44:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.411+0000 7f501ffff640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200c9060 0x7f5020151b40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5010009870 tx=0x7f50100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.412+0000 7f501cff9640 1 -- 172.21.15.64:0/1136552541 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f501003ac60 con 0x7f50200c9060 2023-10-14T22:44:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.412+0000 7f501cff9640 1 -- 172.21.15.64:0/1136552541 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f501003adc0 con 0x7f50200c9060 2023-10-14T22:44:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.412+0000 7f501cff9640 1 -- 172.21.15.64:0/1136552541 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5010044630 con 0x7f50200c9060 2023-10-14T22:44:17.416 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.412+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f502015a370 con 0x7f50200c9060 2023-10-14T22:44:17.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.412+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50200ae900 con 0x7f50200c9060 2023-10-14T22:44:17.417 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.414+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5000005250 con 0x7f50200c9060 2023-10-14T22:44:17.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.417+0000 7f501cff9640 1 -- 172.21.15.64:0/1136552541 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f501002f050 con 0x7f50200c9060 2023-10-14T22:44:17.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.418+0000 7f501cff9640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f500c06ae70 0x7f500c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:17.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.418+0000 7f501cff9640 1 -- 172.21.15.64:0/1136552541 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f50100ab780 con 0x7f50200c9060 2023-10-14T22:44:17.421 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.419+0000 7f501f7fe640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f500c06ae70 0x7f500c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:17.423 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.420+0000 7f501f7fe640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f500c06ae70 0x7f500c06d330 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5014006fd0 tx=0x7f5014008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:17.427 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.424+0000 7f501cff9640 1 -- 172.21.15.64:0/1136552541 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5010076620 con 0x7f50200c9060 2023-10-14T22:44:17.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.727+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"} v 0) v1 -- 0x7f5000005a80 con 0x7f50200c9060 2023-10-14T22:44:17.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.727+0000 7f501cff9640 1 -- 172.21.15.64:0/1136552541 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testcephfs1_data", "var": "pg_num"}]=0 v43) v1 ==== 105+0+11 (secure 0 0 0) 0x7f50100800b0 con 0x7f50200c9060 2023-10-14T22:44:17.730 INFO:teuthology.orchestra.run.smithi064.stdout:pg_num: 64 2023-10-14T22:44:17.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.730+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f500c06ae70 msgr2=0x7f500c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:17.733 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.730+0000 7f50269d0640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f500c06ae70 0x7f500c06d330 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f5014006fd0 tx=0x7f5014008040 comp rx=0 tx=0).stop 2023-10-14T22:44:17.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.730+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200c9060 msgr2=0x7f5020151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:17.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.730+0000 7f50269d0640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200c9060 0x7f5020151b40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5010009870 tx=0x7f50100046c0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 shutdown_connections 2023-10-14T22:44:17.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f500c06ae70 0x7f500c06d330 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5020160ee0 0x7f502015a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f50200cb3b0 0x7f50200aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 --2- 172.21.15.64:0/1136552541 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f50200c9060 0x7f5020151b40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:17.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 >> 172.21.15.64:0/1136552541 conn(0x7f50200b0030 msgr2=0x7f502015fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:17.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 shutdown_connections 2023-10-14T22:44:17.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.731+0000 7f50269d0640 1 -- 172.21.15.64:0/1136552541 wait complete. 2023-10-14T22:44:17.757 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T22:44:17.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.995+0000 7f6e638af640 1 Processor -- start 2023-10-14T22:44:17.998 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.995+0000 7f6e638af640 1 -- start start 2023-10-14T22:44:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.997+0000 7f6e638af640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f6e5c0c20e0 0x7f6e5c0c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:17.999 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.997+0000 7f6e638af640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c071c10 con 0x7f6e5c071800 2023-10-14T22:44:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.997+0000 7f6e638af640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e5c071e40 con 0x7f6e5c0ca340 2023-10-14T22:44:18.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.997+0000 7f6e638af640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ca7d0 con 0x7f6e5c0c20e0 2023-10-14T22:44:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.997+0000 7f6e60e4a640 1 --1- >> v1:172.21.15.177:6789/0 conn(0x7f6e5c0ca340 0x7f6e5c0710f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.177:6789/0 says I am v1:172.21.15.64:38084/0 (socket says 172.21.15.64:38084) 2023-10-14T22:44:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.997+0000 7f6e60e4a640 1 -- 172.21.15.64:0/130240615 learned_addr learned my addr 172.21.15.64:0/130240615 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.998+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884580659 0 0) 0x7f6e5c071e40 con 0x7f6e5c0ca340 2023-10-14T22:44:18.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.998+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e48003520 con 0x7f6e5c0ca340 2023-10-14T22:44:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4101378717 0 0) 0x7f6e48003520 con 0x7f6e5c0ca340 2023-10-14T22:44:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 >> v2:172.21.15.177:3300/0 conn(0x7f6e5c0c20e0 msgr2=0x7f6e5c0c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 --2- 172.21.15.64:0/130240615 >> v2:172.21.15.177:3300/0 conn(0x7f6e5c0c20e0 0x7f6e5c0c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 >> v1:172.21.15.64:6789/0 conn(0x7f6e5c071800 legacy=0x7f6e5c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:18.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 --> v1:172.21.15.177:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c1603b0 con 0x7f6e5c0ca340 2023-10-14T22:44:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 <== mon.1 v1:172.21.15.177:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f6e4c001670 con 0x7f6e5c0ca340 2023-10-14T22:44:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 >> v1:172.21.15.177:6789/0 conn(0x7f6e5c0ca340 legacy=0x7f6e5c0710f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480039e0 0x7f6e48003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e48004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480052d0 0x7f6e4800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0ca7d0 con 0x7f6e480052d0 2023-10-14T22:44:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4800c210 con 0x7f6e480047c0 2023-10-14T22:44:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:17.999+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4800c3d0 con 0x7f6e480039e0 2023-10-14T22:44:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.000+0000 7f6e60e4a640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e48004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.000+0000 7f6e6164b640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480039e0 0x7f6e48003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.001+0000 7f6e60e4a640 1 -- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480039e0 msgr2=0x7f6e48003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.001+0000 7f6e60e4a640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e480039e0 0x7f6e48003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.001+0000 7f6e60e4a640 1 -- 172.21.15.64:0/130240615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480052d0 msgr2=0x7f6e4800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.001+0000 7f6e60e4a640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e480052d0 0x7f6e4800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.001+0000 7f6e60e4a640 1 -- 172.21.15.64:0/130240615 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c1603b0 con 0x7f6e480047c0 2023-10-14T22:44:18.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.002+0000 7f6e60e4a640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e48004c40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00c1b0 tx=0x7f6e480057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd9707d356acf16c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.002+0000 7f6e61e4c640 1 -- 172.21.15.64:0/130240615 reap_dead start 2023-10-14T22:44:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.002+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c005ad0 con 0x7f6e480047c0 2023-10-14T22:44:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.002+0000 7f6e53fff640 1 -- 172.21.15.64:0/130240615 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c005c50 con 0x7f6e480047c0 2023-10-14T22:44:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.003+0000 7f6e638af640 1 -- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 msgr2=0x7f6e48004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.003+0000 7f6e638af640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e48004c40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00c1b0 tx=0x7f6e480057f0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.003+0000 7f6e638af640 1 -- 172.21.15.64:0/130240615 shutdown_connections 2023-10-14T22:44:18.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.003+0000 7f6e638af640 1 --2- 172.21.15.64:0/130240615 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e48004c40 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.003+0000 7f6e638af640 1 -- 172.21.15.64:0/130240615 >> 172.21.15.64:0/130240615 conn(0x7f6e5c06c1c0 msgr2=0x7f6e5c06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:18.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.004+0000 7f6e638af640 1 -- 172.21.15.64:0/130240615 shutdown_connections 2023-10-14T22:44:18.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.004+0000 7f6e638af640 1 -- 172.21.15.64:0/130240615 wait complete. 2023-10-14T22:44:18.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.007+0000 7f6e638af640 1 Processor -- start 2023-10-14T22:44:18.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.007+0000 7f6e638af640 1 -- start start 2023-10-14T22:44:18.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.008+0000 7f6e638af640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e5c15c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.008+0000 7f6e638af640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c14ef00 0x7f6e5c14f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.011 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.008+0000 7f6e638af640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e5c0b1230 0x7f6e5c0b16e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.008+0000 7f6e638af640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b0e10 con 0x7f6e5c14ef00 2023-10-14T22:44:18.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.008+0000 7f6e638af640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b0190 con 0x7f6e480047c0 2023-10-14T22:44:18.012 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.008+0000 7f6e638af640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5c0b0470 con 0x7f6e5c0b1230 2023-10-14T22:44:18.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c14ef00 0x7f6e5c14f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c14ef00 0x7f6e5c14f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48374/0 (socket says 172.21.15.64:48374) 2023-10-14T22:44:18.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 -- 172.21.15.64:0/127788974 learned_addr learned my addr 172.21.15.64:0/127788974 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:18.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e6164b640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e5c15c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e61e4c640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e5c0b1230 0x7f6e5c0b16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 -- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e5c0b1230 msgr2=0x7f6e5c0b16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e5c0b1230 0x7f6e5c0b16e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 -- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 msgr2=0x7f6e5c15c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e5c15c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e60e4a640 1 -- 172.21.15.64:0/127788974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e5c0b0750 con 0x7f6e5c14ef00 2023-10-14T22:44:18.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.009+0000 7f6e61e4c640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e5c0b1230 0x7f6e5c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:18.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.010+0000 7f6e60e4a640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c14ef00 0x7f6e5c14f380 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00c210 tx=0x7f6e4c000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:18.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.010+0000 7f6e51ffb640 1 -- 172.21.15.64:0/127788974 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c004e30 con 0x7f6e5c14ef00 2023-10-14T22:44:18.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.010+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5c0b0a30 con 0x7f6e5c14ef00 2023-10-14T22:44:18.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.011+0000 7f6e51ffb640 1 -- 172.21.15.64:0/127788974 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4c03a070 con 0x7f6e5c14ef00 2023-10-14T22:44:18.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.011+0000 7f6e51ffb640 1 -- 172.21.15.64:0/127788974 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4c007270 con 0x7f6e5c14ef00 2023-10-14T22:44:18.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.011+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5c15c840 con 0x7f6e5c14ef00 2023-10-14T22:44:18.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.012+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e5c0b0f50 con 0x7f6e5c14ef00 2023-10-14T22:44:18.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.013+0000 7f6e51ffb640 1 -- 172.21.15.64:0/127788974 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6e4c032070 con 0x7f6e5c14ef00 2023-10-14T22:44:18.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.014+0000 7f6e51ffb640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e4006ae70 0x7f6e4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.015+0000 7f6e51ffb640 1 -- 172.21.15.64:0/127788974 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f6e4c0aaee0 con 0x7f6e5c14ef00 2023-10-14T22:44:18.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.015+0000 7f6e6164b640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e4006ae70 0x7f6e4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.016+0000 7f6e6164b640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e4006ae70 0x7f6e4006d330 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6e58006fd0 tx=0x7f6e58009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:18.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.018+0000 7f6e51ffb640 1 -- 172.21.15.64:0/127788974 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6e5c0b0f50 con 0x7f6e5c14ef00 2023-10-14T22:44:18.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.378+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6e5c15c840 con 0x7f6e5c14ef00 2023-10-14T22:44:18.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.379+0000 7f6e51ffb640 1 -- 172.21.15.64:0/127788974 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f6e5c15c840 con 0x7f6e5c14ef00 2023-10-14T22:44:18.382 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:18.382 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2123710189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2123710189},{"type":"v1","addr":"172.21.15.177:6837","nonce":2123710189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1971405270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1971405270},{"type":"v1","addr":"172.21.15.177:6836","nonce":1971405270}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/47775465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":47775465},{"type":"v1","addr":"172.21.15.64:6833","nonce":47775465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:30:33.786154+0000","modified":"2023-10-14T12:30:36.843227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5457":{"gid":5457,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3900287009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3900287009},{"type":"v1","addr":"172.21.15.64:6835","nonce":3900287009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T22:44:18.382 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2023-10-14T22:44:18.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.381+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e4006ae70 msgr2=0x7f6e4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.381+0000 7f6e638af640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e4006ae70 0x7f6e4006d330 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6e58006fd0 tx=0x7f6e58009060 comp rx=0 tx=0).stop 2023-10-14T22:44:18.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.381+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c14ef00 msgr2=0x7f6e5c14f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.381+0000 7f6e638af640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c14ef00 0x7f6e5c14f380 secure :-1 s=READY pgs=2227 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c00c210 tx=0x7f6e4c000fe0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 shutdown_connections 2023-10-14T22:44:18.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6e4006ae70 0x7f6e4006d330 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6e5c0b1230 0x7f6e5c0b16e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6e5c14ef00 0x7f6e5c14f380 unknown :-1 s=CLOSED pgs=2227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 --2- 172.21.15.64:0/127788974 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6e480047c0 0x7f6e5c15c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 >> 172.21.15.64:0/127788974 conn(0x7f6e5c06c1c0 msgr2=0x7f6e5c158c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:18.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 shutdown_connections 2023-10-14T22:44:18.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.382+0000 7f6e638af640 1 -- 172.21.15.64:0/127788974 wait complete. 2023-10-14T22:44:18.404 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T22:44:18.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.673+0000 7f7ed938a640 1 Processor -- start 2023-10-14T22:44:18.676 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.674+0000 7f7ed938a640 1 -- start start 2023-10-14T22:44:18.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed938a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed415ad00 0x7f7ed40701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.677 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed938a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7ed415f040 0x7f7ed415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed938a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ed40707f0 con 0x7f7ed40b0010 2023-10-14T22:44:18.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed938a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ed4070ad0 con 0x7f7ed415f040 2023-10-14T22:44:18.678 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed938a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed415b1d0 con 0x7f7ed415ad00 2023-10-14T22:44:18.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed37fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7ed415f040 0x7f7ed415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.679 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed37fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f7ed415f040 0x7f7ed415b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48380/0 (socket says 172.21.15.64:48380) 2023-10-14T22:44:18.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed37fe640 1 -- 172.21.15.64:0/3094257419 learned_addr learned my addr 172.21.15.64:0/3094257419 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:18.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.675+0000 7f7ed27fc640 1 --2- 172.21.15.64:0/3094257419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed415ad00 0x7f7ed40701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.676+0000 7f7ed37fe640 1 -- 172.21.15.64:0/3094257419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed415ad00 msgr2=0x7f7ed40701a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:18.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.676+0000 7f7ed37fe640 1 --2- 172.21.15.64:0/3094257419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed415ad00 0x7f7ed40701a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.680 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.676+0000 7f7ed37fe640 1 -- 172.21.15.64:0/3094257419 >> v1:172.21.15.177:6789/0 conn(0x7f7ed40b0010 legacy=0x7f7ed40b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.676+0000 7f7ed37fe640 1 -- 172.21.15.64:0/3094257419 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed415b4b0 con 0x7f7ed415f040 2023-10-14T22:44:18.681 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.677+0000 7f7ed37fe640 1 --2- 172.21.15.64:0/3094257419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415f040 0x7f7ed415b9d0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009e50 tx=0x7f7ecc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374afc175aada14f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:18.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.677+0000 7f7ed1ffb640 1 -- 172.21.15.64:0/3094257419 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc02cb00 con 0x7f7ed415f040 2023-10-14T22:44:18.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.677+0000 7f7ed1ffb640 1 -- 172.21.15.64:0/3094257419 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ecc02cc60 con 0x7f7ed415f040 2023-10-14T22:44:18.682 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.677+0000 7f7ed1ffb640 1 -- 172.21.15.64:0/3094257419 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ecc0343f0 con 0x7f7ed415f040 2023-10-14T22:44:18.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.678+0000 7f7ed938a640 1 -- 172.21.15.64:0/3094257419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415f040 msgr2=0x7f7ed415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.678+0000 7f7ed938a640 1 --2- 172.21.15.64:0/3094257419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415f040 0x7f7ed415b9d0 secure :-1 s=READY pgs=2228 cs=0 l=1 rev1=1 crypto rx=0x7f7ecc009e50 tx=0x7f7ecc02bf60 comp rx=0 tx=0).stop 2023-10-14T22:44:18.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.678+0000 7f7ed938a640 1 -- 172.21.15.64:0/3094257419 shutdown_connections 2023-10-14T22:44:18.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.678+0000 7f7ed938a640 1 --2- 172.21.15.64:0/3094257419 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415f040 0x7f7ed415b9d0 unknown :-1 s=CLOSED pgs=2228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.683 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.678+0000 7f7ed938a640 1 --2- 172.21.15.64:0/3094257419 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed415ad00 0x7f7ed40701a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.678+0000 7f7ed938a640 1 -- 172.21.15.64:0/3094257419 >> 172.21.15.64:0/3094257419 conn(0x7f7ed406c1c0 msgr2=0x7f7ed406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:18.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.679+0000 7f7ed938a640 1 -- 172.21.15.64:0/3094257419 shutdown_connections 2023-10-14T22:44:18.684 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.679+0000 7f7ed938a640 1 -- 172.21.15.64:0/3094257419 wait complete. 2023-10-14T22:44:18.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.681+0000 7f7ed938a640 1 Processor -- start 2023-10-14T22:44:18.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.681+0000 7f7ed938a640 1 -- start start 2023-10-14T22:44:18.685 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed938a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed40b0010 0x7f7ed40cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed938a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415ad00 0x7f7ed40b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed938a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ed415f040 0x7f7ed40c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed938a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed4152520 con 0x7f7ed415ad00 2023-10-14T22:44:18.686 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed938a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40c5e70 con 0x7f7ed415f040 2023-10-14T22:44:18.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed938a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed40c5ba0 con 0x7f7ed40b0010 2023-10-14T22:44:18.687 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415ad00 0x7f7ed40b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.683+0000 7f7ed27fc640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415ad00 0x7f7ed40b3bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48396/0 (socket says 172.21.15.64:48396) 2023-10-14T22:44:18.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed27fc640 1 -- 172.21.15.64:0/2180652908 learned_addr learned my addr 172.21.15.64:0/2180652908 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:18.688 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed2ffd640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed40b0010 0x7f7ed40cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed37fe640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ed415f040 0x7f7ed40c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed27fc640 1 -- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed40b0010 msgr2=0x7f7ed40cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed27fc640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed40b0010 0x7f7ed40cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed27fc640 1 -- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ed415f040 msgr2=0x7f7ed40c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:18.689 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed27fc640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ed415f040 0x7f7ed40c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:18.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.684+0000 7f7ed27fc640 1 -- 172.21.15.64:0/2180652908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ecc009b30 con 0x7f7ed415ad00 2023-10-14T22:44:18.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.685+0000 7f7ed27fc640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415ad00 0x7f7ed40b3bc0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800d7d0 tx=0x7f7ec800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:18.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.685+0000 7f7ebb7fe640 1 -- 172.21.15.64:0/2180652908 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800b6c0 con 0x7f7ed415ad00 2023-10-14T22:44:18.690 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.685+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ed40c7570 con 0x7f7ed415ad00 2023-10-14T22:44:18.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.685+0000 7f7ebb7fe640 1 -- 172.21.15.64:0/2180652908 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ec800b840 con 0x7f7ed415ad00 2023-10-14T22:44:18.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.685+0000 7f7ebb7fe640 1 -- 172.21.15.64:0/2180652908 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ec800bbf0 con 0x7f7ed415ad00 2023-10-14T22:44:18.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.685+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ed40c7b30 con 0x7f7ed415ad00 2023-10-14T22:44:18.691 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.687+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb4005250 con 0x7f7ed415ad00 2023-10-14T22:44:18.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.689+0000 7f7ebb7fe640 1 -- 172.21.15.64:0/2180652908 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f7ec800bd50 con 0x7f7ed415ad00 2023-10-14T22:44:18.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.690+0000 7f7ebb7fe640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ec006ae70 0x7f7ec006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:18.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.691+0000 7f7ebb7fe640 1 -- 172.21.15.64:0/2180652908 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f7ec8089b50 con 0x7f7ed415ad00 2023-10-14T22:44:18.694 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.691+0000 7f7ed2ffd640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ec006ae70 0x7f7ec006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:18.696 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.693+0000 7f7ed2ffd640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ec006ae70 0x7f7ec006d330 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4000f60 tx=0x7f7ec4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:18.698 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.696+0000 7f7ebb7fe640 1 -- 172.21.15.64:0/2180652908 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7ec8054b30 con 0x7f7ed415ad00 2023-10-14T22:44:18.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:18.988+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7eb4005500 con 0x7f7ed415ad00 2023-10-14T22:44:19.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.006+0000 7f7ebb7fe640 1 -- 172.21.15.64:0/2180652908 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f7ec8058150 con 0x7f7ed415ad00 2023-10-14T22:44:19.010 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:19.010 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":43,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:31:32.842217+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:30:31.794557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:30:32.797876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T22:44:19.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ec006ae70 msgr2=0x7f7ec006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ec006ae70 0x7f7ec006d330 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7ec4000f60 tx=0x7f7ec4009040 comp rx=0 tx=0).stop 2023-10-14T22:44:19.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415ad00 msgr2=0x7f7ed40b3bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415ad00 0x7f7ed40b3bc0 secure :-1 s=READY pgs=2229 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800d7d0 tx=0x7f7ec800dc90 comp rx=0 tx=0).stop 2023-10-14T22:44:19.014 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 shutdown_connections 2023-10-14T22:44:19.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f7ec006ae70 0x7f7ec006d330 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f7ed415f040 0x7f7ed40c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f7ed415ad00 0x7f7ed40b3bc0 unknown :-1 s=CLOSED pgs=2229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 --2- 172.21.15.64:0/2180652908 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f7ed40b0010 0x7f7ed40cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.011+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 >> 172.21.15.64:0/2180652908 conn(0x7f7ed406c1c0 msgr2=0x7f7ed4158870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:19.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.012+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 shutdown_connections 2023-10-14T22:44:19.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.012+0000 7f7ed938a640 1 -- 172.21.15.64:0/2180652908 wait complete. 2023-10-14T22:44:19.042 INFO:tasks.cephfs.filesystem:Destroying file system testcephfs1 and related pools 2023-10-14T22:44:19.042 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T22:44:19.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.294+0000 7f67f5ee5640 1 Processor -- start 2023-10-14T22:44:19.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.294+0000 7f67f5ee5640 1 -- start start 2023-10-14T22:44:19.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.295+0000 7f67f5ee5640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f67f00b0010 0x7f67f00701a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.295+0000 7f67f5ee5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f015ad00 0x7f67f015f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.295+0000 7f67f5ee5640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67f015f580 con 0x7f67f00b03f0 2023-10-14T22:44:19.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.295+0000 7f67f5ee5640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67f00707f0 con 0x7f67f00b0010 2023-10-14T22:44:19.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.295+0000 7f67f5ee5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f0070ad0 con 0x7f67f015ad00 2023-10-14T22:44:19.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.296+0000 7f67effff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f67f00b03f0 0x7f67f015b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:39048/0 (socket says 172.21.15.64:39048) 2023-10-14T22:44:19.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.296+0000 7f67effff640 1 -- 172.21.15.64:0/2810370881 learned_addr learned my addr 172.21.15.64:0/2810370881 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:19.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.296+0000 7f67ef7fe640 1 --2- 172.21.15.64:0/2810370881 >> v2:172.21.15.177:3300/0 conn(0x7f67f00b0010 0x7f67f00701a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:19.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.296+0000 7f67ee7fc640 1 -- 172.21.15.64:0/2810370881 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2269058503 0 0) 0x7f67e8001490 con 0x7f67f00b03f0 2023-10-14T22:44:19.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.296+0000 7f67ee7fc640 1 -- 172.21.15.64:0/2810370881 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67d8003520 con 0x7f67f00b03f0 2023-10-14T22:44:19.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.297+0000 7f67ef7fe640 1 -- 172.21.15.64:0/2810370881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f015ad00 msgr2=0x7f67f015f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:19.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.297+0000 7f67ef7fe640 1 --2- 172.21.15.64:0/2810370881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f015ad00 0x7f67f015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.297+0000 7f67ef7fe640 1 -- 172.21.15.64:0/2810370881 >> v1:172.21.15.64:6789/0 conn(0x7f67f00b03f0 legacy=0x7f67f015b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.297+0000 7f67ef7fe640 1 -- 172.21.15.64:0/2810370881 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f015b1d0 con 0x7f67f00b0010 2023-10-14T22:44:19.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.298+0000 7f67ef7fe640 1 --2- 172.21.15.64:0/2810370881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b0010 0x7f67f00701a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f67e00097a0 tx=0x7f67e002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4444d7a5f641949c server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:19.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.298+0000 7f67ee7fc640 1 -- 172.21.15.64:0/2810370881 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e002d040 con 0x7f67f00b0010 2023-10-14T22:44:19.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.298+0000 7f67ee7fc640 1 -- 172.21.15.64:0/2810370881 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e0031810 con 0x7f67f00b0010 2023-10-14T22:44:19.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.298+0000 7f67ee7fc640 1 -- 172.21.15.64:0/2810370881 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e0031ba0 con 0x7f67f00b0010 2023-10-14T22:44:19.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.299+0000 7f67f5ee5640 1 -- 172.21.15.64:0/2810370881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b0010 msgr2=0x7f67f00701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.299+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/2810370881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b0010 0x7f67f00701a0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f67e00097a0 tx=0x7f67e002b8b0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.299+0000 7f67f5ee5640 1 -- 172.21.15.64:0/2810370881 shutdown_connections 2023-10-14T22:44:19.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.299+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/2810370881 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f015ad00 0x7f67f015f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.299+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/2810370881 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b0010 0x7f67f00701a0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.299+0000 7f67f5ee5640 1 -- 172.21.15.64:0/2810370881 >> 172.21.15.64:0/2810370881 conn(0x7f67f006c1c0 msgr2=0x7f67f006c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:19.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.300+0000 7f67f5ee5640 1 -- 172.21.15.64:0/2810370881 shutdown_connections 2023-10-14T22:44:19.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.300+0000 7f67f5ee5640 1 -- 172.21.15.64:0/2810370881 wait complete. 2023-10-14T22:44:19.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.302+0000 7f67f5ee5640 1 Processor -- start 2023-10-14T22:44:19.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.302+0000 7f67f5ee5640 1 -- start start 2023-10-14T22:44:19.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67f5ee5640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f00b0010 0x7f67f0148b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67f5ee5640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b03f0 0x7f67f0157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67f5ee5640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67f015ad00 0x7f67f00c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67f5ee5640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00c2550 con 0x7f67f015ad00 2023-10-14T22:44:19.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67f5ee5640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00c2830 con 0x7f67f00b03f0 2023-10-14T22:44:19.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67f5ee5640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67f00c2b10 con 0x7f67f00b0010 2023-10-14T22:44:19.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67effff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67f015ad00 0x7f67f00c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:19.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67effff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67f015ad00 0x7f67f00c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48400/0 (socket says 172.21.15.64:48400) 2023-10-14T22:44:19.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67effff640 1 -- 172.21.15.64:0/1533058170 learned_addr learned my addr 172.21.15.64:0/1533058170 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:19.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.304+0000 7f67ef7fe640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f00b0010 0x7f67f0148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:19.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.305+0000 7f67effff640 1 -- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f00b0010 msgr2=0x7f67f0148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.305+0000 7f67effff640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f00b0010 0x7f67f0148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.305+0000 7f67effff640 1 -- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b03f0 msgr2=0x7f67f0157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.305+0000 7f67effff640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b03f0 0x7f67f0157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.305+0000 7f67effff640 1 -- 172.21.15.64:0/1533058170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67e0009400 con 0x7f67f015ad00 2023-10-14T22:44:19.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.305+0000 7f67effff640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67f015ad00 0x7f67f00c6bd0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f67e800cb40 tx=0x7f67e800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:19.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.305+0000 7f67d7fff640 1 -- 172.21.15.64:0/1533058170 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e800aca0 con 0x7f67f015ad00 2023-10-14T22:44:19.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.306+0000 7f67d7fff640 1 -- 172.21.15.64:0/1533058170 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67e800ae00 con 0x7f67f015ad00 2023-10-14T22:44:19.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.306+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67f00c2df0 con 0x7f67f015ad00 2023-10-14T22:44:19.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.306+0000 7f67d7fff640 1 -- 172.21.15.64:0/1533058170 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67e8012600 con 0x7f67f015ad00 2023-10-14T22:44:19.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.306+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67f01490b0 con 0x7f67f015ad00 2023-10-14T22:44:19.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.307+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67f00c3310 con 0x7f67f015ad00 2023-10-14T22:44:19.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.308+0000 7f67d7fff640 1 -- 172.21.15.64:0/1533058170 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f67e8007070 con 0x7f67f015ad00 2023-10-14T22:44:19.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.309+0000 7f67d7fff640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f67dc06aea0 0x7f67dc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.309+0000 7f67d7fff640 1 -- 172.21.15.64:0/1533058170 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f67e80894a0 con 0x7f67f015ad00 2023-10-14T22:44:19.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.310+0000 7f67ef7fe640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f67dc06aea0 0x7f67dc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:19.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.311+0000 7f67ef7fe640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f67dc06aea0 0x7f67dc06d360 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f67e0036000 tx=0x7f67e003c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:19.320 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.317+0000 7f67d7fff640 1 -- 172.21.15.64:0/1533058170 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f67f00c3310 con 0x7f67f015ad00 2023-10-14T22:44:19.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.716+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f67f015f580 con 0x7f67f015ad00 2023-10-14T22:44:19.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.717+0000 7f67d7fff640 1 -- 172.21.15.64:0/1533058170 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4918 (secure 0 0 0) 0x7f67f015f580 con 0x7f67f015ad00 2023-10-14T22:44:19.719 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:19.720 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2123710189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2123710189},{"type":"v1","addr":"172.21.15.177:6837","nonce":2123710189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1971405270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1971405270},{"type":"v1","addr":"172.21.15.177:6836","nonce":1971405270}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/47775465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":47775465},{"type":"v1","addr":"172.21.15.64:6833","nonce":47775465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:30:33.786154+0000","modified":"2023-10-14T12:30:36.843227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5457":{"gid":5457,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3900287009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3900287009},{"type":"v1","addr":"172.21.15.64:6835","nonce":3900287009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T22:44:19.720 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2023-10-14T22:44:19.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f67dc06aea0 msgr2=0x7f67dc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f67dc06aea0 0x7f67dc06d360 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f67e0036000 tx=0x7f67e003c040 comp rx=0 tx=0).stop 2023-10-14T22:44:19.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67f015ad00 msgr2=0x7f67f00c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.723 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67f015ad00 0x7f67f00c6bd0 secure :-1 s=READY pgs=2231 cs=0 l=1 rev1=1 crypto rx=0x7f67e800cb40 tx=0x7f67e800a060 comp rx=0 tx=0).stop 2023-10-14T22:44:19.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 shutdown_connections 2023-10-14T22:44:19.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f67dc06aea0 0x7f67dc06d360 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f67f015ad00 0x7f67f00c6bd0 unknown :-1 s=CLOSED pgs=2231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f67f00b03f0 0x7f67f0157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 --2- 172.21.15.64:0/1533058170 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f67f00b0010 0x7f67f0148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 >> 172.21.15.64:0/1533058170 conn(0x7f67f006c1c0 msgr2=0x7f67f00ae740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:19.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.720+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 shutdown_connections 2023-10-14T22:44:19.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.721+0000 7f67f5ee5640 1 -- 172.21.15.64:0/1533058170 wait complete. 2023-10-14T22:44:19.743 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T22:44:19.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.984+0000 7effc1190640 1 Processor -- start 2023-10-14T22:44:19.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.985+0000 7effc1190640 1 -- start start 2023-10-14T22:44:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.987+0000 7effc1190640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7effbc0c17a0 0x7effbc0700f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.987+0000 7effc1190640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7effbc071cd0 0x7effbc165780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.987+0000 7effc1190640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc165cc0 con 0x7effbc0c1b80 2023-10-14T22:44:19.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.987+0000 7effc1190640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc070630 con 0x7effbc071cd0 2023-10-14T22:44:19.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.987+0000 7effc1190640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0cbdf0 con 0x7effbc0c17a0 2023-10-14T22:44:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.988+0000 7effbad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7effbc0c17a0 0x7effbc0700f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.988+0000 7effbad9d640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7effbc0c17a0 0x7effbc0700f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36392/0 (socket says 172.21.15.64:36392) 2023-10-14T22:44:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.988+0000 7effbad9d640 1 -- 172.21.15.64:0/2030685877 learned_addr learned my addr 172.21.15.64:0/2030685877 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.989+0000 7effba59c640 1 --2- 172.21.15.64:0/2030685877 >> v2:172.21.15.64:3300/0 conn(0x7effbc071cd0 0x7effbc165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.989+0000 7effb9d9b640 1 -- 172.21.15.64:0/2030685877 <== mon.1 v1:172.21.15.177:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1517519331 0 0) 0x7effb4001490 con 0x7effbc0c1b80 2023-10-14T22:44:19.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.989+0000 7effb9d9b640 1 -- 172.21.15.64:0/2030685877 --> v1:172.21.15.177:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7effa4003520 con 0x7effbc0c1b80 2023-10-14T22:44:19.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.989+0000 7effbad9d640 1 -- 172.21.15.64:0/2030685877 >> v2:172.21.15.64:3300/0 conn(0x7effbc071cd0 msgr2=0x7effbc165780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:19.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.990+0000 7effbad9d640 1 --2- 172.21.15.64:0/2030685877 >> v2:172.21.15.64:3300/0 conn(0x7effbc071cd0 0x7effbc165780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:19.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.990+0000 7effbad9d640 1 -- 172.21.15.64:0/2030685877 >> v1:172.21.15.177:6789/0 conn(0x7effbc0c1b80 legacy=0x7effbc0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:19.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.990+0000 7effb9d9b640 1 -- 172.21.15.64:0/2030685877 <== mon.1 v1:172.21.15.177:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2114447533 0 0) 0x7effa4003520 con 0x7effbc0c1b80 2023-10-14T22:44:19.996 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.990+0000 7effbad9d640 1 -- 172.21.15.64:0/2030685877 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0cb1e0 con 0x7effbc0c17a0 2023-10-14T22:44:19.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.990+0000 7effba59c640 1 --2- 172.21.15.64:0/2030685877 >> v2:172.21.15.64:3300/0 conn(0x7effbc071cd0 0x7effbc165780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T22:44:19.997 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:19.995+0000 7effbad9d640 1 --2- 172.21.15.64:0/2030685877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc0c17a0 0x7effbc0700f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7effbc0b0cd0 tx=0x7effac02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=209b5d286d950a4e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:20.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.003+0000 7effb9d9b640 1 -- 172.21.15.64:0/2030685877 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4001b80 con 0x7effbc0c17a0 2023-10-14T22:44:20.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.003+0000 7effb9d9b640 1 -- 172.21.15.64:0/2030685877 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac0315f0 con 0x7effbc0c17a0 2023-10-14T22:44:20.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.003+0000 7effb9d9b640 1 -- 172.21.15.64:0/2030685877 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac031980 con 0x7effbc0c17a0 2023-10-14T22:44:20.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.004+0000 7effc1190640 1 -- 172.21.15.64:0/2030685877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc0c17a0 msgr2=0x7effbc0700f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.004+0000 7effc1190640 1 --2- 172.21.15.64:0/2030685877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc0c17a0 0x7effbc0700f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7effbc0b0cd0 tx=0x7effac02b910 comp rx=0 tx=0).stop 2023-10-14T22:44:20.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.007+0000 7effc1190640 1 -- 172.21.15.64:0/2030685877 shutdown_connections 2023-10-14T22:44:20.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.007+0000 7effc1190640 1 --2- 172.21.15.64:0/2030685877 >> v2:172.21.15.64:3300/0 conn(0x7effbc071cd0 0x7effbc165780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.007+0000 7effc1190640 1 --2- 172.21.15.64:0/2030685877 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc0c17a0 0x7effbc0700f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.007+0000 7effc1190640 1 -- 172.21.15.64:0/2030685877 >> 172.21.15.64:0/2030685877 conn(0x7effbc06c1c0 msgr2=0x7effbc06c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:20.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.007+0000 7effc1190640 1 -- 172.21.15.64:0/2030685877 shutdown_connections 2023-10-14T22:44:20.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.007+0000 7effc1190640 1 -- 172.21.15.64:0/2030685877 wait complete. 2023-10-14T22:44:20.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.010+0000 7effc1190640 1 Processor -- start 2023-10-14T22:44:20.013 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.010+0000 7effc1190640 1 -- start start 2023-10-14T22:44:20.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effc1190640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc071cd0 0x7effbc0b35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effc1190640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effbc0c17a0 0x7effbc0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effc1190640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effbc0c1b80 0x7effbc0c1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.015 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effc1190640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c8700 con 0x7effbc0c1b80 2023-10-14T22:44:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effc1190640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c2a60 con 0x7effbc071cd0 2023-10-14T22:44:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effc1190640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0c2d40 con 0x7effbc0c17a0 2023-10-14T22:44:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effbb59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effbc0c1b80 0x7effbc0c1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effbb59e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effbc0c1b80 0x7effbc0c1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48426/0 (socket says 172.21.15.64:48426) 2023-10-14T22:44:20.016 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effbb59e640 1 -- 172.21.15.64:0/3316991734 learned_addr learned my addr 172.21.15.64:0/3316991734 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:20.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.012+0000 7effba59c640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effbc0c17a0 0x7effbc0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.017 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.013+0000 7effbad9d640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc071cd0 0x7effbc0b35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.013+0000 7effbb59e640 1 -- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effbc0c17a0 msgr2=0x7effbc0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.013+0000 7effbb59e640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effbc0c17a0 0x7effbc0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.013+0000 7effbb59e640 1 -- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc071cd0 msgr2=0x7effbc0b35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.018 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.013+0000 7effbb59e640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc071cd0 0x7effbc0b35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.013+0000 7effbb59e640 1 -- 172.21.15.64:0/3316991734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb0009400 con 0x7effbc0c1b80 2023-10-14T22:44:20.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.014+0000 7effbb59e640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effbc0c1b80 0x7effbc0c1fc0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7effb400c890 tx=0x7effb400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:20.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.014+0000 7effa37fe640 1 -- 172.21.15.64:0/3316991734 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400aa50 con 0x7effbc0c1b80 2023-10-14T22:44:20.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.014+0000 7effa37fe640 1 -- 172.21.15.64:0/3316991734 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb400abd0 con 0x7effbc0c1b80 2023-10-14T22:44:20.019 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.014+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effac0094d0 con 0x7effbc0c1b80 2023-10-14T22:44:20.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.014+0000 7effa37fe640 1 -- 172.21.15.64:0/3316991734 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4012420 con 0x7effbc0c1b80 2023-10-14T22:44:20.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.014+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc0c8c60 con 0x7effbc0c1b80 2023-10-14T22:44:20.020 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.016+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc0c8e80 con 0x7effbc0c1b80 2023-10-14T22:44:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.018+0000 7effa37fe640 1 -- 172.21.15.64:0/3316991734 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7effb4012580 con 0x7effbc0c1b80 2023-10-14T22:44:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.019+0000 7effa37fe640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7effa806af40 0x7effa806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.021 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.019+0000 7effa37fe640 1 -- 172.21.15.64:0/3316991734 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7effb4089be0 con 0x7effbc0c1b80 2023-10-14T22:44:20.024 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.021+0000 7effbad9d640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7effa806af40 0x7effa806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.024+0000 7effbad9d640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7effa806af40 0x7effa806d400 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7effac036000 tx=0x7effac03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:20.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.025+0000 7effa37fe640 1 -- 172.21.15.64:0/3316991734 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7effb4054b00 con 0x7effbc0c1b80 2023-10-14T22:44:20.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.432+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effbc165cc0 con 0x7effbc0c1b80 2023-10-14T22:44:20.436 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.434+0000 7effa37fe640 1 -- 172.21.15.64:0/3316991734 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4918 (secure 0 0 0) 0x7effbc165cc0 con 0x7effbc0c1b80 2023-10-14T22:44:20.436 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:20.437 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2123710189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2123710189},{"type":"v1","addr":"172.21.15.177:6837","nonce":2123710189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1971405270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1971405270},{"type":"v1","addr":"172.21.15.177:6836","nonce":1971405270}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/47775465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":47775465},{"type":"v1","addr":"172.21.15.64:6833","nonce":47775465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-14T12:30:33.786154+0000","modified":"2023-10-14T12:30:36.843227+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5457},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5457":{"gid":5457,"name":"c","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.64:6835/3900287009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":3900287009},{"type":"v1","addr":"172.21.15.64:6835","nonce":3900287009}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"testcephfs1","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-10-14T22:44:20.437 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 18 2023-10-14T22:44:20.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.439+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7effa806af40 msgr2=0x7effa806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.439+0000 7effc1190640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7effa806af40 0x7effa806d400 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7effac036000 tx=0x7effac03d040 comp rx=0 tx=0).stop 2023-10-14T22:44:20.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.439+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effbc0c1b80 msgr2=0x7effbc0c1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.439+0000 7effc1190640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effbc0c1b80 0x7effbc0c1fc0 secure :-1 s=READY pgs=2232 cs=0 l=1 rev1=1 crypto rx=0x7effb400c890 tx=0x7effb400cd50 comp rx=0 tx=0).stop 2023-10-14T22:44:20.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.440+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 shutdown_connections 2023-10-14T22:44:20.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.440+0000 7effc1190640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7effa806af40 0x7effa806d400 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.440+0000 7effc1190640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7effbc0c1b80 0x7effbc0c1fc0 unknown :-1 s=CLOSED pgs=2232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.440+0000 7effc1190640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7effbc0c17a0 0x7effbc0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.440+0000 7effc1190640 1 --2- 172.21.15.64:0/3316991734 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7effbc071cd0 0x7effbc0b35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.440+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 >> 172.21.15.64:0/3316991734 conn(0x7effbc06c1c0 msgr2=0x7effbc0ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:20.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.441+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 shutdown_connections 2023-10-14T22:44:20.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.441+0000 7effc1190640 1 -- 172.21.15.64:0/3316991734 wait complete. 2023-10-14T22:44:20.469 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T22:44:20.784 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.782+0000 7f8d8393c640 1 Processor -- start 2023-10-14T22:44:20.785 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.782+0000 7f8d8393c640 1 -- start start 2023-10-14T22:44:20.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.783+0000 7f8d8393c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8d7c0cd190 0x7f8d7c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.783+0000 7f8d8393c640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c06dde0 con 0x7f8d7c0cb8e0 2023-10-14T22:44:20.786 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.783+0000 7f8d8393c640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7c06e730 con 0x7f8d7c0cb2a0 2023-10-14T22:44:20.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.783+0000 7f8d8393c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7c06ccc0 con 0x7f8d7c0cd190 2023-10-14T22:44:20.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.784+0000 7f8d80ed7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8d7c0cd190 0x7f8d7c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.787 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.784+0000 7f8d80ed7640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f8d7c0cd190 0x7f8d7c069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48428/0 (socket says 172.21.15.64:48428) 2023-10-14T22:44:20.788 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.784+0000 7f8d80ed7640 1 -- 172.21.15.64:0/4227635168 learned_addr learned my addr 172.21.15.64:0/4227635168 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:20.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.785+0000 7f8d80ed7640 1 -- 172.21.15.64:0/4227635168 >> v1:172.21.15.177:6789/0 conn(0x7f8d7c0cb2a0 legacy=0x7f8d7c06d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:20.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.786+0000 7f8d80ed7640 1 -- 172.21.15.64:0/4227635168 >> v1:172.21.15.64:6789/0 conn(0x7f8d7c0cb8e0 legacy=0x7f8d7c0c9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:20.789 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.786+0000 7f8d80ed7640 1 -- 172.21.15.64:0/4227635168 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7c06ea10 con 0x7f8d7c0cd190 2023-10-14T22:44:20.790 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.787+0000 7f8d80ed7640 1 --2- 172.21.15.64:0/4227635168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c069de0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009870 tx=0x7f8d6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d6ed7d19ab664f server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:20.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.789+0000 7f8d73fff640 1 -- 172.21.15.64:0/4227635168 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c031870 con 0x7f8d7c0cd190 2023-10-14T22:44:20.791 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.789+0000 7f8d73fff640 1 -- 172.21.15.64:0/4227635168 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c0319d0 con 0x7f8d7c0cd190 2023-10-14T22:44:20.792 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.789+0000 7f8d73fff640 1 -- 172.21.15.64:0/4227635168 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c031d60 con 0x7f8d7c0cd190 2023-10-14T22:44:20.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.791+0000 7f8d8393c640 1 -- 172.21.15.64:0/4227635168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cd190 msgr2=0x7f8d7c069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.793 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.791+0000 7f8d8393c640 1 --2- 172.21.15.64:0/4227635168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c069de0 secure :-1 s=READY pgs=2234 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c009870 tx=0x7f8d6c02b910 comp rx=0 tx=0).stop 2023-10-14T22:44:20.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.791+0000 7f8d8393c640 1 -- 172.21.15.64:0/4227635168 shutdown_connections 2023-10-14T22:44:20.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.791+0000 7f8d8393c640 1 --2- 172.21.15.64:0/4227635168 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c069de0 unknown :-1 s=CLOSED pgs=2234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.791+0000 7f8d8393c640 1 -- 172.21.15.64:0/4227635168 >> 172.21.15.64:0/4227635168 conn(0x7f8d7c0cf5c0 msgr2=0x7f8d7c0cf9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:20.795 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.793+0000 7f8d8393c640 1 -- 172.21.15.64:0/4227635168 shutdown_connections 2023-10-14T22:44:20.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.795+0000 7f8d8393c640 1 -- 172.21.15.64:0/4227635168 wait complete. 2023-10-14T22:44:20.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.796+0000 7f8d8393c640 1 Processor -- start 2023-10-14T22:44:20.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.800+0000 7f8d8393c640 1 -- start start 2023-10-14T22:44:20.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.801+0000 7f8d8393c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0cb2a0 0x7f8d7c1f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.801+0000 7f8d8393c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cb8e0 0x7f8d7c0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.801+0000 7f8d8393c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c0b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.801+0000 7f8d8393c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0c5e10 con 0x7f8d7c0cb8e0 2023-10-14T22:44:20.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.801+0000 7f8d8393c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c0b1fa0 con 0x7f8d7c0cd190 2023-10-14T22:44:20.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.801+0000 7f8d8393c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7c1f6500 con 0x7f8d7c0cb2a0 2023-10-14T22:44:20.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.802+0000 7f8d81ed9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c0b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.802+0000 7f8d81ed9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c0b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36396/0 (socket says 172.21.15.64:36396) 2023-10-14T22:44:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.802+0000 7f8d81ed9640 1 -- 172.21.15.64:0/2517773317 learned_addr learned my addr 172.21.15.64:0/2517773317 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d80ed7640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cb8e0 0x7f8d7c0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d81ed9640 1 -- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0cb2a0 msgr2=0x7f8d7c1f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d816d8640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0cb2a0 0x7f8d7c1f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d81ed9640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0cb2a0 0x7f8d7c1f2f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d81ed9640 1 -- 172.21.15.64:0/2517773317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cb8e0 msgr2=0x7f8d7c0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:20.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d81ed9640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cb8e0 0x7f8d7c0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:20.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d81ed9640 1 -- 172.21.15.64:0/2517773317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c0094d0 con 0x7f8d7c0cd190 2023-10-14T22:44:20.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.803+0000 7f8d80ed7640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cb8e0 0x7f8d7c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T22:44:20.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.805+0000 7f8d81ed9640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c0b4230 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400b970 tx=0x7f8d7400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:20.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.805+0000 7f8d71ffb640 1 -- 172.21.15.64:0/2517773317 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400cb40 con 0x7f8d7c0cd190 2023-10-14T22:44:20.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.805+0000 7f8d71ffb640 1 -- 172.21.15.64:0/2517773317 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7400cca0 con 0x7f8d7c0cd190 2023-10-14T22:44:20.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.805+0000 7f8d71ffb640 1 -- 172.21.15.64:0/2517773317 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d74014680 con 0x7f8d7c0cd190 2023-10-14T22:44:20.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.805+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c1f67e0 con 0x7f8d7c0cd190 2023-10-14T22:44:20.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.806+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d7c1f2720 con 0x7f8d7c0cd190 2023-10-14T22:44:20.810 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.807+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7c067180 con 0x7f8d7c0cd190 2023-10-14T22:44:20.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.809+0000 7f8d71ffb640 1 -- 172.21.15.64:0/2517773317 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8d7401d3b0 con 0x7f8d7c0cd190 2023-10-14T22:44:20.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.811+0000 7f8d71ffb640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8d6006aec0 0x7f8d6006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:20.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.811+0000 7f8d71ffb640 1 -- 172.21.15.64:0/2517773317 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f8d74089670 con 0x7f8d7c0cd190 2023-10-14T22:44:20.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.812+0000 7f8d816d8640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8d6006aec0 0x7f8d6006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:20.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.814+0000 7f8d816d8640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8d6006aec0 0x7f8d6006d380 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001520 tx=0x7f8d78009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:20.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:20.817+0000 7f8d71ffb640 1 -- 172.21.15.64:0/2517773317 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f8d74054590 con 0x7f8d7c0cd190 2023-10-14T22:44:21.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.147+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d7c0ccc90 con 0x7f8d7c0cd190 2023-10-14T22:44:21.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.150+0000 7f8d71ffb640 1 -- 172.21.15.64:0/2517773317 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16775 (secure 0 0 0) 0x7f8d74057bb0 con 0x7f8d7c0cd190 2023-10-14T22:44:21.153 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:21.153 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":43,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T12:31:32.842217+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"testcephfs1_metadata","create_time":"2023-10-14T12:30:31.794557+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"testcephfs1_data","create_time":"2023-10-14T12:30:32.797876+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"testcephfs1"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.39","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T22:44:21.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8d6006aec0 msgr2=0x7f8d6006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:21.157 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8d6006aec0 0x7f8d6006d380 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8d78001520 tx=0x7f8d78009040 comp rx=0 tx=0).stop 2023-10-14T22:44:21.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0cd190 msgr2=0x7f8d7c0b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:21.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c0b4230 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400b970 tx=0x7f8d7400be30 comp rx=0 tx=0).stop 2023-10-14T22:44:21.158 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 shutdown_connections 2023-10-14T22:44:21.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f8d6006aec0 0x7f8d6006d380 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f8d7c0cd190 0x7f8d7c0b4230 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f8d7c0cb8e0 0x7f8d7c0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 --2- 172.21.15.64:0/2517773317 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f8d7c0cb2a0 0x7f8d7c1f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.159 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.155+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 >> 172.21.15.64:0/2517773317 conn(0x7f8d7c0cf5c0 msgr2=0x7f8d7c0cea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:21.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.158+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 shutdown_connections 2023-10-14T22:44:21.160 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.158+0000 7f8d8393c640 1 -- 172.21.15.64:0/2517773317 wait complete. 2023-10-14T22:44:21.182 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail testcephfs1 2023-10-14T22:44:21.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.458+0000 7f6b65040640 1 Processor -- start 2023-10-14T22:44:21.460 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.458+0000 7f6b65040640 1 -- start start 2023-10-14T22:44:21.462 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.460+0000 7f6b65040640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6b600cd120 0x7f6b6006ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:21.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.460+0000 7f6b5ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6b600cd120 0x7f6b6006ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:21.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.460+0000 7f6b65040640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b6015feb0 0x7f6b600c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:21.463 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.461+0000 7f6b65040640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b60070fc0 con 0x7f6b600add50 2023-10-14T22:44:21.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.461+0000 7f6b65040640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b60071280 con 0x7f6b600cd120 2023-10-14T22:44:21.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.461+0000 7f6b5ffff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f6b600cd120 0x7f6b6006ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48434/0 (socket says 172.21.15.64:48434) 2023-10-14T22:44:21.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.461+0000 7f6b65040640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b60071560 con 0x7f6b6015feb0 2023-10-14T22:44:21.464 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.461+0000 7f6b5ffff640 1 -- 172.21.15.64:0/2868759727 learned_addr learned my addr 172.21.15.64:0/2868759727 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:21.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.462+0000 7f6b5ffff640 1 -- 172.21.15.64:0/2868759727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b6015feb0 msgr2=0x7f6b600c9e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:21.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.462+0000 7f6b6483f640 1 --2- 172.21.15.64:0/2868759727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b6015feb0 0x7f6b600c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:21.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.462+0000 7f6b5ffff640 1 --2- 172.21.15.64:0/2868759727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b6015feb0 0x7f6b600c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.465 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.462+0000 7f6b5ffff640 1 -- 172.21.15.64:0/2868759727 >> v1:172.21.15.64:6789/0 conn(0x7f6b600add50 legacy=0x7f6b6015f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:21.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.462+0000 7f6b5ffff640 1 -- 172.21.15.64:0/2868759727 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60071840 con 0x7f6b600cd120 2023-10-14T22:44:21.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.463+0000 7f6b5ffff640 1 --2- 172.21.15.64:0/2868759727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b600cd120 0x7f6b6006ea40 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009870 tx=0x7f6b5002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d140b8a99b3784a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:21.466 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.464+0000 7f6b5f7fe640 1 -- 172.21.15.64:0/2868759727 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500317c0 con 0x7f6b600cd120 2023-10-14T22:44:21.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.464+0000 7f6b5f7fe640 1 -- 172.21.15.64:0/2868759727 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b50031920 con 0x7f6b600cd120 2023-10-14T22:44:21.467 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.464+0000 7f6b5f7fe640 1 -- 172.21.15.64:0/2868759727 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b500317c0 con 0x7f6b600cd120 2023-10-14T22:44:21.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.465+0000 7f6b65040640 1 -- 172.21.15.64:0/2868759727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b600cd120 msgr2=0x7f6b6006ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:21.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.465+0000 7f6b65040640 1 --2- 172.21.15.64:0/2868759727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b600cd120 0x7f6b6006ea40 secure :-1 s=READY pgs=2235 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009870 tx=0x7f6b5002b860 comp rx=0 tx=0).stop 2023-10-14T22:44:21.468 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.465+0000 7f6b65040640 1 -- 172.21.15.64:0/2868759727 shutdown_connections 2023-10-14T22:44:21.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.465+0000 7f6b65040640 1 --2- 172.21.15.64:0/2868759727 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b6015feb0 0x7f6b600c9e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.465+0000 7f6b65040640 1 --2- 172.21.15.64:0/2868759727 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b600cd120 0x7f6b6006ea40 unknown :-1 s=CLOSED pgs=2235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.465+0000 7f6b65040640 1 -- 172.21.15.64:0/2868759727 >> 172.21.15.64:0/2868759727 conn(0x7f6b600cb430 msgr2=0x7f6b600cb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:21.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.466+0000 7f6b65040640 1 -- 172.21.15.64:0/2868759727 shutdown_connections 2023-10-14T22:44:21.469 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.466+0000 7f6b65040640 1 -- 172.21.15.64:0/2868759727 wait complete. 2023-10-14T22:44:21.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.468+0000 7f6b65040640 1 Processor -- start 2023-10-14T22:44:21.471 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.469+0000 7f6b65040640 1 -- start start 2023-10-14T22:44:21.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b65040640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b600add50 0x7f6b600c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:21.473 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b65040640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b600cd120 0x7f6b60154330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:21.474 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b65040640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b6015feb0 0x7f6b600c6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:21.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b600cd120 0x7f6b60154330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:21.475 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b5ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b600add50 0x7f6b600c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:21.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b57fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b600cd120 0x7f6b60154330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36398/0 (socket says 172.21.15.64:36398) 2023-10-14T22:44:21.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b5ffff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b600add50 0x7f6b600c83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:56744/0 (socket says 172.21.15.64:56744) 2023-10-14T22:44:21.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b5ffff640 1 -- 172.21.15.64:0/1043442401 learned_addr learned my addr 172.21.15.64:0/1043442401 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:21.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600c7ec0 con 0x7f6b6015feb0 2023-10-14T22:44:21.476 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600c6190 con 0x7f6b600cd120 2023-10-14T22:44:21.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.471+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b600c8910 con 0x7f6b600add50 2023-10-14T22:44:21.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.472+0000 7f6b57fff640 1 -- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b600add50 msgr2=0x7f6b600c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:21.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.472+0000 7f6b57fff640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b600add50 0x7f6b600c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.472+0000 7f6b57fff640 1 -- 172.21.15.64:0/1043442401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b6015feb0 msgr2=0x7f6b600c6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:21.477 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.472+0000 7f6b57fff640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b6015feb0 0x7f6b600c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.472+0000 7f6b57fff640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b500094d0 con 0x7f6b600cd120 2023-10-14T22:44:21.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.473+0000 7f6b57fff640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b600cd120 0x7f6b60154330 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800b3e0 tx=0x7f6b4800b8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:21.478 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.473+0000 7f6b5d7fa640 1 -- 172.21.15.64:0/1043442401 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48011830 con 0x7f6b600cd120 2023-10-14T22:44:21.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.473+0000 7f6b5d7fa640 1 -- 172.21.15.64:0/1043442401 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b48011990 con 0x7f6b600cd120 2023-10-14T22:44:21.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.473+0000 7f6b5d7fa640 1 -- 172.21.15.64:0/1043442401 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b48011d40 con 0x7f6b600cd120 2023-10-14T22:44:21.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.473+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b600c5eb0 con 0x7f6b600cd120 2023-10-14T22:44:21.479 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.474+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b600b2b40 con 0x7f6b600cd120 2023-10-14T22:44:21.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.477+0000 7f6b5d7fa640 1 -- 172.21.15.64:0/1043442401 <== mon.1 v2:172.21.15.177:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f6b4801a400 con 0x7f6b600cd120 2023-10-14T22:44:21.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.478+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b44005250 con 0x7f6b600cd120 2023-10-14T22:44:21.481 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.479+0000 7f6b5d7fa640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b4006af40 0x7f6b4006d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:21.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.479+0000 7f6b5d7fa640 1 -- 172.21.15.64:0/1043442401 <== mon.1 v2:172.21.15.177:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6078+0+0 (secure 0 0 0) 0x7f6b48089380 con 0x7f6b600cd120 2023-10-14T22:44:21.482 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.479+0000 7f6b5ffff640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b4006af40 0x7f6b4006d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:21.484 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.481+0000 7f6b5ffff640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b4006af40 0x7f6b4006d400 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009280 tx=0x7f6b5003d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:21.488 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.485+0000 7f6b5d7fa640 1 -- 172.21.15.64:0/1043442401 <== mon.1 v2:172.21.15.177:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f6b48015080 con 0x7f6b600cd120 2023-10-14T22:44:21.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.866+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "testcephfs1"} v 0) v1 -- 0x7f6b44005500 con 0x7f6b600cd120 2023-10-14T22:44:21.912 INFO:tasks.ceph.mon.a.smithi064.stderr:2023-10-14T22:44:21.909+0000 7fd0af0b1640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-14T22:44:21.918 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.915+0000 7f6b5d7fa640 1 -- 172.21.15.64:0/1043442401 <== mon.1 v2:172.21.15.177:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "testcephfs1"}]=0 testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7f6b48054330 con 0x7f6b600cd120 2023-10-14T22:44:21.921 INFO:teuthology.orchestra.run.smithi064.stderr:testcephfs1 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-14T22:44:21.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b4006af40 msgr2=0x7f6b4006d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:21.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b4006af40 0x7f6b4006d400 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f6b50009280 tx=0x7f6b5003d040 comp rx=0 tx=0).stop 2023-10-14T22:44:21.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b600cd120 msgr2=0x7f6b60154330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:21.922 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b600cd120 0x7f6b60154330 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800b3e0 tx=0x7f6b4800b8a0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 shutdown_connections 2023-10-14T22:44:21.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f6b4006af40 0x7f6b4006d400 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f6b6015feb0 0x7f6b600c6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f6b600cd120 0x7f6b60154330 secure :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f6b4800b3e0 tx=0x7f6b4800b8a0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 --2- 172.21.15.64:0/1043442401 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f6b600add50 0x7f6b600c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:21.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.919+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 >> 172.21.15.64:0/1043442401 conn(0x7f6b600cb430 msgr2=0x7f6b6006e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:21.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.921+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 shutdown_connections 2023-10-14T22:44:21.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:21.921+0000 7f6b65040640 1 -- 172.21.15.64:0/1043442401 wait complete. 2023-10-14T22:44:21.946 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm testcephfs1 --yes-i-really-mean-it 2023-10-14T22:44:22.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.128+0000 7fb192f28640 1 Processor -- start 2023-10-14T22:44:22.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.128+0000 7fb192f28640 1 -- start start 2023-10-14T22:44:22.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.129+0000 7fb192f28640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb18c15c940 0x7fb18c0d0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:22.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.129+0000 7fb192f28640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb18c0b6fe0 0x7fb18c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:22.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.129+0000 7fb192f28640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18c0ce810 con 0x7fb18c0d0d80 2023-10-14T22:44:22.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.129+0000 7fb192f28640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c0d1740 con 0x7fb18c0b6fe0 2023-10-14T22:44:22.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.129+0000 7fb192f28640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18c0b5b40 con 0x7fb18c15c940 2023-10-14T22:44:22.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb192727640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb18c0b6fe0 0x7fb18c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:22.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb192727640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb18c0b6fe0 0x7fb18c0d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48460/0 (socket says 172.21.15.64:48460) 2023-10-14T22:44:22.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb192727640 1 -- 172.21.15.64:0/787845076 learned_addr learned my addr 172.21.15.64:0/787845076 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:22.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb191f26640 1 --2- 172.21.15.64:0/787845076 >> v2:172.21.15.177:3300/0 conn(0x7fb18c15c940 0x7fb18c0d0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:22.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb192727640 1 -- 172.21.15.64:0/787845076 >> v2:172.21.15.177:3300/0 conn(0x7fb18c15c940 msgr2=0x7fb18c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:22.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb192727640 1 --2- 172.21.15.64:0/787845076 >> v2:172.21.15.177:3300/0 conn(0x7fb18c15c940 0x7fb18c0d0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb192727640 1 -- 172.21.15.64:0/787845076 >> v1:172.21.15.177:6789/0 conn(0x7fb18c0d0d80 legacy=0x7fb18c160520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:22.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.130+0000 7fb192727640 1 -- 172.21.15.64:0/787845076 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18c0ce250 con 0x7fb18c0b6fe0 2023-10-14T22:44:22.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.131+0000 7fb192727640 1 --2- 172.21.15.64:0/787845076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c0b6fe0 0x7fb18c0d1200 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0671a0 tx=0x7fb18402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58a9101e245be94 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:22.136 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb190f24640 1 -- 172.21.15.64:0/787845076 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18402c9f0 con 0x7fb18c0b6fe0 2023-10-14T22:44:22.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb190f24640 1 -- 172.21.15.64:0/787845076 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18402cb50 con 0x7fb18c0b6fe0 2023-10-14T22:44:22.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb190f24640 1 -- 172.21.15.64:0/787845076 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1840343f0 con 0x7fb18c0b6fe0 2023-10-14T22:44:22.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 -- 172.21.15.64:0/787845076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c0b6fe0 msgr2=0x7fb18c0d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:22.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 --2- 172.21.15.64:0/787845076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c0b6fe0 0x7fb18c0d1200 secure :-1 s=READY pgs=2236 cs=0 l=1 rev1=1 crypto rx=0x7fb18c0671a0 tx=0x7fb18402be50 comp rx=0 tx=0).stop 2023-10-14T22:44:22.137 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 -- 172.21.15.64:0/787845076 shutdown_connections 2023-10-14T22:44:22.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 --2- 172.21.15.64:0/787845076 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c0b6fe0 0x7fb18c0d1200 unknown :-1 s=CLOSED pgs=2236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 --2- 172.21.15.64:0/787845076 >> v2:172.21.15.177:3300/0 conn(0x7fb18c15c940 0x7fb18c0d0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 -- 172.21.15.64:0/787845076 >> 172.21.15.64:0/787845076 conn(0x7fb18c09bb30 msgr2=0x7fb18c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:22.138 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 -- 172.21.15.64:0/787845076 shutdown_connections 2023-10-14T22:44:22.139 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.132+0000 7fb192f28640 1 -- 172.21.15.64:0/787845076 wait complete. 2023-10-14T22:44:22.140 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.134+0000 7fb192f28640 1 Processor -- start 2023-10-14T22:44:22.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.134+0000 7fb192f28640 1 -- start start 2023-10-14T22:44:22.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.135+0000 7fb192f28640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0b6fe0 0x7fb18c154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:22.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.135+0000 7fb192f28640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb18c0d0d80 0x7fb18c158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:22.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.135+0000 7fb192f28640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c15c940 0x7fb18c148a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:22.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.135+0000 7fb192f28640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c8180 con 0x7fb18c15c940 2023-10-14T22:44:22.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.135+0000 7fb192f28640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c1594d0 con 0x7fb18c0b6fe0 2023-10-14T22:44:22.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.135+0000 7fb192f28640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb18c0c7570 con 0x7fb18c0d0d80 2023-10-14T22:44:22.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c15c940 0x7fb18c148a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:22.142 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c15c940 0x7fb18c148a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48472/0 (socket says 172.21.15.64:48472) 2023-10-14T22:44:22.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 -- 172.21.15.64:0/2483931215 learned_addr learned my addr 172.21.15.64:0/2483931215 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:22.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 -- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb18c0d0d80 msgr2=0x7fb18c158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:22.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb18c0d0d80 0x7fb18c158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 -- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0b6fe0 msgr2=0x7fb18c154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:22.143 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0b6fe0 0x7fb18c154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 -- 172.21.15.64:0/2483931215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb184009b30 con 0x7fb18c15c940 2023-10-14T22:44:22.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.136+0000 7fb192727640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c15c940 0x7fb18c148a20 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fb184036040 tx=0x7fb184004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:22.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.137+0000 7fb1827fc640 1 -- 172.21.15.64:0/2483931215 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb184009510 con 0x7fb18c15c940 2023-10-14T22:44:22.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.137+0000 7fb1827fc640 1 -- 172.21.15.64:0/2483931215 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb18403e450 con 0x7fb18c15c940 2023-10-14T22:44:22.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.137+0000 7fb1827fc640 1 -- 172.21.15.64:0/2483931215 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb18403e800 con 0x7fb18c15c940 2023-10-14T22:44:22.144 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.137+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb18c0c7850 con 0x7fb18c15c940 2023-10-14T22:44:22.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.137+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18c0c7e10 con 0x7fb18c15c940 2023-10-14T22:44:22.145 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.138+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb18c04e9b0 con 0x7fb18c15c940 2023-10-14T22:44:22.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.139+0000 7fb1827fc640 1 -- 172.21.15.64:0/2483931215 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb18403e960 con 0x7fb18c15c940 2023-10-14T22:44:22.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.140+0000 7fb1827fc640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb17006aea0 0x7fb17006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:22.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.140+0000 7fb1827fc640 1 -- 172.21.15.64:0/2483931215 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6164+0+0 (secure 0 0 0) 0x7fb1840ac650 con 0x7fb18c15c940 2023-10-14T22:44:22.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.141+0000 7fb191f26640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb17006aea0 0x7fb17006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:22.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.142+0000 7fb191f26640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb17006aea0 0x7fb17006d360 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb188006fd0 tx=0x7fb188008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:22.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.148+0000 7fb1827fc640 1 -- 172.21.15.64:0/2483931215 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb184077490 con 0x7fb18c15c940 2023-10-14T22:44:22.235 INFO:tasks.ceph.mds.c.smithi064.stdout:starting mds.c at 2023-10-14T22:44:22.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.389+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb18c0c82c0 con 0x7fb18c15c940 2023-10-14T22:44:22.963 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.960+0000 7fb1827fc640 1 -- 172.21.15.64:0/2483931215 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "testcephfs1", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb18407aab0 con 0x7fb18c15c940 2023-10-14T22:44:22.966 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.963+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb17006aea0 msgr2=0x7fb17006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:22.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.963+0000 7fb192f28640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb17006aea0 0x7fb17006d360 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7fb188006fd0 tx=0x7fb188008040 comp rx=0 tx=0).stop 2023-10-14T22:44:22.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.963+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c15c940 msgr2=0x7fb18c148a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:22.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.963+0000 7fb192f28640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c15c940 0x7fb18c148a20 secure :-1 s=READY pgs=2237 cs=0 l=1 rev1=1 crypto rx=0x7fb184036040 tx=0x7fb184004a40 comp rx=0 tx=0).stop 2023-10-14T22:44:22.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 shutdown_connections 2023-10-14T22:44:22.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb17006aea0 0x7fb17006d360 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb18c15c940 0x7fb18c148a20 unknown :-1 s=CLOSED pgs=2237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb18c0d0d80 0x7fb18c158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 --2- 172.21.15.64:0/2483931215 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb18c0b6fe0 0x7fb18c154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:22.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 >> 172.21.15.64:0/2483931215 conn(0x7fb18c09bb30 msgr2=0x7fb18c0b73c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:22.968 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 shutdown_connections 2023-10-14T22:44:22.969 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:22.964+0000 7fb192f28640 1 -- 172.21.15.64:0/2483931215 wait complete. 2023-10-14T22:44:22.985 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_metadata testcephfs1_metadata --yes-i-really-really-mean-it 2023-10-14T22:44:23.210 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.208+0000 7fb9a6c1a640 1 Processor -- start 2023-10-14T22:44:23.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.208+0000 7fb9a6c1a640 1 -- start start 2023-10-14T22:44:23.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.210+0000 7fb9a6c1a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a015cae0 0x7fb9a00ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:23.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.210+0000 7fb9a6c1a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9a00d2760 0x7fb9a00d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:23.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.210+0000 7fb9a6c1a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a00d30e0 con 0x7fb9a00cf180 2023-10-14T22:44:23.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.210+0000 7fb9a6c1a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a00cfed0 con 0x7fb9a00d2760 2023-10-14T22:44:23.213 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.210+0000 7fb9a6c1a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00cd660 con 0x7fb9a015cae0 2023-10-14T22:44:23.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.210+0000 7fb9a5417640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9a00d2760 0x7fb9a00d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:23.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.210+0000 7fb9a5c18640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a015cae0 0x7fb9a00ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:23.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.211+0000 7fb9a5417640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb9a00d2760 0x7fb9a00d2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36450/0 (socket says 172.21.15.64:36450) 2023-10-14T22:44:23.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.211+0000 7fb9a5417640 1 -- 172.21.15.64:0/1568774506 learned_addr learned my addr 172.21.15.64:0/1568774506 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:23.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.211+0000 7fb9a5c18640 1 -- 172.21.15.64:0/1568774506 >> v2:172.21.15.177:3300/0 conn(0x7fb9a00d2760 msgr2=0x7fb9a00d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:23.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.211+0000 7fb9a5c18640 1 --2- 172.21.15.64:0/1568774506 >> v2:172.21.15.177:3300/0 conn(0x7fb9a00d2760 0x7fb9a00d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.211+0000 7fb9a5c18640 1 -- 172.21.15.64:0/1568774506 >> v1:172.21.15.177:6789/0 conn(0x7fb9a00cf180 legacy=0x7fb9a00cf610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:23.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.211+0000 7fb9a5c18640 1 -- 172.21.15.64:0/1568774506 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a00cd940 con 0x7fb9a015cae0 2023-10-14T22:44:23.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.211+0000 7fb9a5417640 1 --2- 172.21.15.64:0/1568774506 >> v2:172.21.15.177:3300/0 conn(0x7fb9a00d2760 0x7fb9a00d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-14T22:44:23.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.213+0000 7fb9a5c18640 1 --2- 172.21.15.64:0/1568774506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a015cae0 0x7fb9a00ce140 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009790 tx=0x7fb99c02b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=465519b2e0c113d6 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:23.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.213+0000 7fb9a4c16640 1 -- 172.21.15.64:0/1568774506 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c031800 con 0x7fb9a015cae0 2023-10-14T22:44:23.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a4c16640 1 -- 172.21.15.64:0/1568774506 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c031960 con 0x7fb9a015cae0 2023-10-14T22:44:23.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a4c16640 1 -- 172.21.15.64:0/1568774506 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb99c031cf0 con 0x7fb9a015cae0 2023-10-14T22:44:23.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/1568774506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a015cae0 msgr2=0x7fb9a00ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:23.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/1568774506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a015cae0 0x7fb9a00ce140 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb99c009790 tx=0x7fb99c02b8a0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/1568774506 shutdown_connections 2023-10-14T22:44:23.218 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/1568774506 >> v2:172.21.15.177:3300/0 conn(0x7fb9a00d2760 0x7fb9a00d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/1568774506 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a015cae0 0x7fb9a00ce140 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/1568774506 >> 172.21.15.64:0/1568774506 conn(0x7fb9a009bb50 msgr2=0x7fb9a0089f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:23.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/1568774506 shutdown_connections 2023-10-14T22:44:23.219 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.214+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/1568774506 wait complete. 2023-10-14T22:44:23.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.216+0000 7fb9a6c1a640 1 Processor -- start 2023-10-14T22:44:23.221 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.216+0000 7fb9a6c1a640 1 -- start start 2023-10-14T22:44:23.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.217+0000 7fb9a6c1a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a00cf180 0x7fb9a00b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:23.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.217+0000 7fb9a6c1a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a00d2760 0x7fb9a01f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:23.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.217+0000 7fb9a6c1a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9a015cae0 0x7fb9a00c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:23.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.217+0000 7fb9a6c1a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00b8040 con 0x7fb9a015cae0 2023-10-14T22:44:23.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.217+0000 7fb9a6c1a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00b5b80 con 0x7fb9a00cf180 2023-10-14T22:44:23.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.217+0000 7fb9a6c1a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a00b7430 con 0x7fb9a00d2760 2023-10-14T22:44:23.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9a015cae0 0x7fb9a00c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:23.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9a015cae0 0x7fb9a00c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48496/0 (socket says 172.21.15.64:48496) 2023-10-14T22:44:23.223 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 -- 172.21.15.64:0/2699464666 learned_addr learned my addr 172.21.15.64:0/2699464666 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:23.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a5c18640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a00cf180 0x7fb9a00b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:23.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a5417640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a00d2760 0x7fb9a01f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:23.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 -- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a00d2760 msgr2=0x7fb9a01f25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:23.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a00d2760 0x7fb9a01f25f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 -- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a00cf180 msgr2=0x7fb9a00b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:23.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a00cf180 0x7fb9a00b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 -- 172.21.15.64:0/2699464666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9900094d0 con 0x7fb9a015cae0 2023-10-14T22:44:23.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.218+0000 7fb9a6419640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9a015cae0 0x7fb9a00c5040 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c7a0 tx=0x7fb99800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:23.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.219+0000 7fb9967fc640 1 -- 172.21.15.64:0/2699464666 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998003b70 con 0x7fb9a015cae0 2023-10-14T22:44:23.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.219+0000 7fb9967fc640 1 -- 172.21.15.64:0/2699464666 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb998003cf0 con 0x7fb9a015cae0 2023-10-14T22:44:23.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.219+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99c0093a0 con 0x7fb9a015cae0 2023-10-14T22:44:23.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.219+0000 7fb9967fc640 1 -- 172.21.15.64:0/2699464666 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb998003ea0 con 0x7fb9a015cae0 2023-10-14T22:44:23.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.219+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a00b79f0 con 0x7fb9a015cae0 2023-10-14T22:44:23.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.220+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a00b81f0 con 0x7fb9a015cae0 2023-10-14T22:44:23.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.221+0000 7fb9967fc640 1 -- 172.21.15.64:0/2699464666 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb99800aa90 con 0x7fb9a015cae0 2023-10-14T22:44:23.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.222+0000 7fb9967fc640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb98406aec0 0x7fb98406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:23.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.222+0000 7fb9967fc640 1 -- 172.21.15.64:0/2699464666 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 6164+0+0 (secure 0 0 0) 0x7fb998089620 con 0x7fb9a015cae0 2023-10-14T22:44:23.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.223+0000 7fb9a5c18640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb98406aec0 0x7fb98406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:23.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.224+0000 7fb9a5c18640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb98406aec0 0x7fb98406d380 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb99c036000 tx=0x7fb99c03c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:23.232 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.230+0000 7fb9967fc640 1 -- 172.21.15.64:0/2699464666 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fb9a00b81f0 con 0x7fb9a015cae0 2023-10-14T22:44:23.429 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.426+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb9a004e9b0 con 0x7fb9a015cae0 2023-10-14T22:44:23.967 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.964+0000 7fb9967fc640 1 -- 172.21.15.64:0/2699464666 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_metadata", "pool2": "testcephfs1_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_metadata' removed v45) v1 ==== 196+0+0 (secure 0 0 0) 0x7fb9980544e0 con 0x7fb9a015cae0 2023-10-14T22:44:23.967 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'testcephfs1_metadata' removed 2023-10-14T22:44:23.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb98406aec0 msgr2=0x7fb98406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:23.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb98406aec0 0x7fb98406d380 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fb99c036000 tx=0x7fb99c03c040 comp rx=0 tx=0).stop 2023-10-14T22:44:23.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9a015cae0 msgr2=0x7fb9a00c5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:23.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9a015cae0 0x7fb9a00c5040 secure :-1 s=READY pgs=2241 cs=0 l=1 rev1=1 crypto rx=0x7fb99800c7a0 tx=0x7fb99800cc60 comp rx=0 tx=0).stop 2023-10-14T22:44:23.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 shutdown_connections 2023-10-14T22:44:23.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb98406aec0 0x7fb98406d380 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb9a015cae0 0x7fb9a00c5040 unknown :-1 s=CLOSED pgs=2241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb9a00d2760 0x7fb9a01f25f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 --2- 172.21.15.64:0/2699464666 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb9a00cf180 0x7fb9a00b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:23.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 >> 172.21.15.64:0/2699464666 conn(0x7fb9a009bb50 msgr2=0x7fb9a00b1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:23.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 shutdown_connections 2023-10-14T22:44:23.972 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:23.967+0000 7fb9a6c1a640 1 -- 172.21.15.64:0/2699464666 wait complete. 2023-10-14T22:44:23.995 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm testcephfs1_data testcephfs1_data --yes-i-really-really-mean-it 2023-10-14T22:44:24.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.219+0000 7f868c525640 1 Processor -- start 2023-10-14T22:44:24.222 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.220+0000 7f868c525640 1 -- start start 2023-10-14T22:44:24.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.221+0000 7f868c525640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f868415cbb0 0x7f86840d06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:24.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.221+0000 7f868c525640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f86840cf230 0x7f86840d0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:24.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.221+0000 7f868c525640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86840d1410 0x7f86840cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:24.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.221+0000 7f868c525640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840d18a0 con 0x7f86840cf230 2023-10-14T22:44:24.224 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.221+0000 7f868c525640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86840cf7a0 con 0x7f86840d1410 2023-10-14T22:44:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.221+0000 7f868c525640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840cfa80 con 0x7f868415cbb0 2023-10-14T22:44:24.225 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f868415cbb0 0x7f86840d06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868aac2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f86840d1410 0x7f86840cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f868415cbb0 0x7f86840d06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:56798/0 (socket says 172.21.15.64:56798) 2023-10-14T22:44:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 -- 172.21.15.64:0/4271664531 learned_addr learned my addr 172.21.15.64:0/4271664531 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f8689ac0640 1 --2- 172.21.15.64:0/4271664531 >> v2:172.21.15.64:3300/0 conn(0x7f86840cf230 0x7f86840d0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:24.226 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 -- 172.21.15.64:0/4271664531 >> v2:172.21.15.177:3300/0 conn(0x7f86840d1410 msgr2=0x7f86840cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 --2- 172.21.15.64:0/4271664531 >> v2:172.21.15.177:3300/0 conn(0x7f86840d1410 0x7f86840cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 -- 172.21.15.64:0/4271664531 >> v2:172.21.15.64:3300/0 conn(0x7f86840cf230 msgr2=0x7f86840d0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 --2- 172.21.15.64:0/4271664531 >> v2:172.21.15.64:3300/0 conn(0x7f86840cf230 0x7f86840d0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.227 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.222+0000 7f868a2c1640 1 -- 172.21.15.64:0/4271664531 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840cfd60 con 0x7f868415cbb0 2023-10-14T22:44:24.228 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.223+0000 7f868a2c1640 1 --2- 172.21.15.64:0/4271664531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f868415cbb0 0x7f86840d06a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f868408c0c0 tx=0x7f868002b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d57747353dee616b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.224+0000 7f86892bf640 1 -- 172.21.15.64:0/4271664531 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680031870 con 0x7f868415cbb0 2023-10-14T22:44:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.224+0000 7f86892bf640 1 -- 172.21.15.64:0/4271664531 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86800319d0 con 0x7f868415cbb0 2023-10-14T22:44:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.224+0000 7f86892bf640 1 -- 172.21.15.64:0/4271664531 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680031d60 con 0x7f868415cbb0 2023-10-14T22:44:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 -- 172.21.15.64:0/4271664531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f868415cbb0 msgr2=0x7f86840d06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:24.229 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 --2- 172.21.15.64:0/4271664531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f868415cbb0 0x7f86840d06a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f868408c0c0 tx=0x7f868002b910 comp rx=0 tx=0).stop 2023-10-14T22:44:24.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 -- 172.21.15.64:0/4271664531 shutdown_connections 2023-10-14T22:44:24.230 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 --2- 172.21.15.64:0/4271664531 >> v2:172.21.15.177:3300/0 conn(0x7f86840d1410 0x7f86840cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 --2- 172.21.15.64:0/4271664531 >> v2:172.21.15.64:3300/0 conn(0x7f86840cf230 0x7f86840d0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 --2- 172.21.15.64:0/4271664531 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f868415cbb0 0x7f86840d06a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 -- 172.21.15.64:0/4271664531 >> 172.21.15.64:0/4271664531 conn(0x7f868409bc60 msgr2=0x7f86840d2910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:24.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 -- 172.21.15.64:0/4271664531 shutdown_connections 2023-10-14T22:44:24.231 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.225+0000 7f868c525640 1 -- 172.21.15.64:0/4271664531 wait complete. 2023-10-14T22:44:24.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.227+0000 7f868c525640 1 Processor -- start 2023-10-14T22:44:24.233 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.227+0000 7f868c525640 1 -- start start 2023-10-14T22:44:24.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868c525640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86840cf230 0x7f86841597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:24.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868c525640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86840d1410 0x7f868406c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:24.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868c525640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868415cbb0 0x7f868406c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:24.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868c525640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8684159ce0 con 0x7f86840cf230 2023-10-14T22:44:24.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868c525640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86840b5e80 con 0x7f868415cbb0 2023-10-14T22:44:24.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868c525640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86840b5270 con 0x7f86840d1410 2023-10-14T22:44:24.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868a2c1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86840cf230 0x7f86841597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:24.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868a2c1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86840cf230 0x7f86841597a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48510/0 (socket says 172.21.15.64:48510) 2023-10-14T22:44:24.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868a2c1640 1 -- 172.21.15.64:0/4270345406 learned_addr learned my addr 172.21.15.64:0/4270345406 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:24.235 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f8689ac0640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86840d1410 0x7f868406c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:24.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.229+0000 7f868aac2640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868415cbb0 0x7f868406c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:24.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.230+0000 7f868a2c1640 1 -- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86840d1410 msgr2=0x7f868406c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:24.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.230+0000 7f868a2c1640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86840d1410 0x7f868406c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.230+0000 7f868a2c1640 1 -- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868415cbb0 msgr2=0x7f868406c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:24.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.230+0000 7f868a2c1640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868415cbb0 0x7f868406c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.230+0000 7f868a2c1640 1 -- 172.21.15.64:0/4270345406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86800094d0 con 0x7f86840cf230 2023-10-14T22:44:24.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.230+0000 7f868a2c1640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86840cf230 0x7f86841597a0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f868002b950 tx=0x7f86800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:24.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.231+0000 7f867affd640 1 -- 172.21.15.64:0/4270345406 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868003abe0 con 0x7f86840cf230 2023-10-14T22:44:24.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.231+0000 7f867affd640 1 -- 172.21.15.64:0/4270345406 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868003ad40 con 0x7f86840cf230 2023-10-14T22:44:24.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.231+0000 7f867affd640 1 -- 172.21.15.64:0/4270345406 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680044610 con 0x7f86840cf230 2023-10-14T22:44:24.237 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.231+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86840b5550 con 0x7f86840cf230 2023-10-14T22:44:24.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.231+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86840b5b10 con 0x7f86840cf230 2023-10-14T22:44:24.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.233+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86840c99c0 con 0x7f86840cf230 2023-10-14T22:44:24.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.234+0000 7f867affd640 1 -- 172.21.15.64:0/4270345406 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f8680044770 con 0x7f86840cf230 2023-10-14T22:44:24.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.236+0000 7f867affd640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:24.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.236+0000 7f867affd640 1 -- 172.21.15.64:0/4270345406 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5716+0+0 (secure 0 0 0) 0x7f868002d040 con 0x7f86840cf230 2023-10-14T22:44:24.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.236+0000 7f8689ac0640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:24.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.237+0000 7f8689ac0640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f866806ae70 0x7f866806d330 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8674006fd0 tx=0x7f8674013040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:24.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.244+0000 7f867affd640 1 -- 172.21.15.64:0/4270345406 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f86840c99c0 con 0x7f86840cf230 2023-10-14T22:44:24.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.615+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f86840c99c0 con 0x7f86840cf230 2023-10-14T22:44:24.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.967+0000 7f867affd640 1 -- 172.21.15.64:0/4270345406 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "testcephfs1_data", "pool2": "testcephfs1_data", "yes_i_really_really_mean_it": true}]=0 pool 'testcephfs1_data' removed v46) v1 ==== 184+0+0 (secure 0 0 0) 0x7f86840c99c0 con 0x7f86840cf230 2023-10-14T22:44:24.970 INFO:teuthology.orchestra.run.smithi064.stderr:pool 'testcephfs1_data' removed 2023-10-14T22:44:24.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.970+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f866806ae70 msgr2=0x7f866806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:24.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.970+0000 7f868c525640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f866806ae70 0x7f866806d330 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8674006fd0 tx=0x7f8674013040 comp rx=0 tx=0).stop 2023-10-14T22:44:24.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.970+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86840cf230 msgr2=0x7f86841597a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:24.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.970+0000 7f868c525640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86840cf230 0x7f86841597a0 secure :-1 s=READY pgs=2242 cs=0 l=1 rev1=1 crypto rx=0x7f868002b950 tx=0x7f86800046c0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 shutdown_connections 2023-10-14T22:44:24.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f866806ae70 0x7f866806d330 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f868415cbb0 0x7f868406c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f86840d1410 0x7f868406c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 --2- 172.21.15.64:0/4270345406 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f86840cf230 0x7f86841597a0 unknown :-1 s=CLOSED pgs=2242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:24.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 >> 172.21.15.64:0/4270345406 conn(0x7f868409bc60 msgr2=0x7f868415efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:24.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 shutdown_connections 2023-10-14T22:44:24.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:24.971+0000 7f868c525640 1 -- 172.21.15.64:0/4270345406 wait complete. 2023-10-14T22:44:25.015 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-14T22:44:25.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.289+0000 7f2568426640 1 Processor -- start 2023-10-14T22:44:25.292 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.289+0000 7f2568426640 1 -- start start 2023-10-14T22:44:25.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.291+0000 7f2568426640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f2560066d30 0x7f25600cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:25.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.291+0000 7f2568426640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2560158c40 0x7f25600cbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:25.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.291+0000 7f2568426640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560069de0 0x7f256006a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:25.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.291+0000 7f2568426640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256015d480 con 0x7f2560066d30 2023-10-14T22:44:25.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.292+0000 7f2568426640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f256015c620 con 0x7f2560158c40 2023-10-14T22:44:25.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.292+0000 7f2568426640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f256015c870 con 0x7f2560069de0 2023-10-14T22:44:25.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.292+0000 7f25659c1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2560158c40 0x7f25600cbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:25.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.292+0000 7f25659c1640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f2560158c40 0x7f25600cbe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36500/0 (socket says 172.21.15.64:36500) 2023-10-14T22:44:25.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.292+0000 7f25659c1640 1 -- 172.21.15.64:0/2552408930 learned_addr learned my addr 172.21.15.64:0/2552408930 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:25.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.292+0000 7f25669c3640 1 --2- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560069de0 0x7f256006a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:25.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.293+0000 7f25659c1640 1 -- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560069de0 msgr2=0x7f256006a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:25.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.293+0000 7f25659c1640 1 --2- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560069de0 0x7f256006a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.293+0000 7f25659c1640 1 -- 172.21.15.64:0/2552408930 >> v2:172.21.15.64:3300/0 conn(0x7f2560066d30 msgr2=0x7f25600cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:25.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.293+0000 7f25659c1640 1 --2- 172.21.15.64:0/2552408930 >> v2:172.21.15.64:3300/0 conn(0x7f2560066d30 0x7f25600cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.293+0000 7f25659c1640 1 -- 172.21.15.64:0/2552408930 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256015cb50 con 0x7f2560158c40 2023-10-14T22:44:25.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.295+0000 7f25659c1640 1 --2- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560158c40 0x7f25600cbe20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f25600ce5b0 tx=0x7f255c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae8054651c4ad461 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:25.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.295+0000 7f25651c0640 1 -- 172.21.15.64:0/2552408930 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c02ca80 con 0x7f2560158c40 2023-10-14T22:44:25.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.295+0000 7f25651c0640 1 -- 172.21.15.64:0/2552408930 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c02cbe0 con 0x7f2560158c40 2023-10-14T22:44:25.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.295+0000 7f25651c0640 1 -- 172.21.15.64:0/2552408930 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c0343f0 con 0x7f2560158c40 2023-10-14T22:44:25.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.296+0000 7f2568426640 1 -- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560158c40 msgr2=0x7f25600cbe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:25.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.296+0000 7f2568426640 1 --2- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560158c40 0x7f25600cbe20 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f25600ce5b0 tx=0x7f255c02bee0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.296+0000 7f2568426640 1 -- 172.21.15.64:0/2552408930 shutdown_connections 2023-10-14T22:44:25.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.296+0000 7f2568426640 1 --2- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560158c40 0x7f25600cbe20 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.296+0000 7f2568426640 1 --2- 172.21.15.64:0/2552408930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560069de0 0x7f256006a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.296+0000 7f2568426640 1 --2- 172.21.15.64:0/2552408930 >> v2:172.21.15.64:3300/0 conn(0x7f2560066d30 0x7f25600cb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.296+0000 7f2568426640 1 -- 172.21.15.64:0/2552408930 >> 172.21.15.64:0/2552408930 conn(0x7f25600b09e0 msgr2=0x7f25600b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:25.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.297+0000 7f2568426640 1 -- 172.21.15.64:0/2552408930 shutdown_connections 2023-10-14T22:44:25.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.297+0000 7f2568426640 1 -- 172.21.15.64:0/2552408930 wait complete. 2023-10-14T22:44:25.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.299+0000 7f2568426640 1 Processor -- start 2023-10-14T22:44:25.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.300+0000 7f2568426640 1 -- start start 2023-10-14T22:44:25.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.302+0000 7f2568426640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560066d30 0x7f256014f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:25.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.302+0000 7f2568426640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560069de0 0x7f25600b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:25.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.302+0000 7f2568426640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2560158c40 0x7f25600b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:25.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.302+0000 7f2568426640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f256014f6e0 con 0x7f2560158c40 2023-10-14T22:44:25.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.302+0000 7f2568426640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2560150ce0 con 0x7f2560069de0 2023-10-14T22:44:25.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.302+0000 7f2568426640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2560150fc0 con 0x7f2560066d30 2023-10-14T22:44:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.303+0000 7f25661c2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560066d30 0x7f256014f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:25.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.303+0000 7f25669c3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2560158c40 0x7f25600b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.303+0000 7f25659c1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560069de0 0x7f25600b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.303+0000 7f25659c1640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560069de0 0x7f25600b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:36502/0 (socket says 172.21.15.64:36502) 2023-10-14T22:44:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.303+0000 7f25659c1640 1 -- 172.21.15.64:0/1796251660 learned_addr learned my addr 172.21.15.64:0/1796251660 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.303+0000 7f25669c3640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2560158c40 0x7f25600b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:48538/0 (socket says 172.21.15.64:48538) 2023-10-14T22:44:25.307 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.304+0000 7f25661c2640 1 -- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560069de0 msgr2=0x7f25600b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.304+0000 7f25661c2640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560069de0 0x7f25600b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.304+0000 7f25661c2640 1 -- 172.21.15.64:0/1796251660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2560158c40 msgr2=0x7f25600b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.304+0000 7f25661c2640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2560158c40 0x7f25600b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.304+0000 7f25661c2640 1 -- 172.21.15.64:0/1796251660 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f255c009b30 con 0x7f2560066d30 2023-10-14T22:44:25.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.305+0000 7f25661c2640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560066d30 0x7f256014f1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f255000b410 tx=0x7f255000b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:25.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.306+0000 7f2556ffd640 1 -- 172.21.15.64:0/1796251660 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550011830 con 0x7f2560066d30 2023-10-14T22:44:25.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.306+0000 7f2556ffd640 1 -- 172.21.15.64:0/1796251660 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25500119b0 con 0x7f2560066d30 2023-10-14T22:44:25.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.307+0000 7f2556ffd640 1 -- 172.21.15.64:0/1796251660 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550011d60 con 0x7f2560066d30 2023-10-14T22:44:25.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.307+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25601512a0 con 0x7f2560066d30 2023-10-14T22:44:25.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.307+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2560151860 con 0x7f2560066d30 2023-10-14T22:44:25.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.310+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25600667f0 con 0x7f2560066d30 2023-10-14T22:44:25.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.311+0000 7f2556ffd640 1 -- 172.21.15.64:0/1796251660 <== mon.2 v2:172.21.15.177:3301/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f255001a400 con 0x7f2560066d30 2023-10-14T22:44:25.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.313+0000 7f2556ffd640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f254406aef0 0x7f254406d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:25.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.313+0000 7f2556ffd640 1 -- 172.21.15.64:0/1796251660 <== mon.2 v2:172.21.15.177:3301/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f25500892e0 con 0x7f2560066d30 2023-10-14T22:44:25.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.314+0000 7f25659c1640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f254406aef0 0x7f254406d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:25.319 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.316+0000 7f25659c1640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f254406aef0 0x7f254406d3b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f25600af8e0 tx=0x7f255c030000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:25.322 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.320+0000 7f2556ffd640 1 -- 172.21.15.64:0/1796251660 <== mon.2 v2:172.21.15.177:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2550054650 con 0x7f2560066d30 2023-10-14T22:44:25.692 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.689+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f2560151100 con 0x7f2560066d30 2023-10-14T22:44:25.709 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.707+0000 7f2556ffd640 1 -- 172.21.15.64:0/1796251660 <== mon.2 v2:172.21.15.177:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2560151100 con 0x7f2560066d30 2023-10-14T22:44:25.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.713+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f254406aef0 msgr2=0x7f254406d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:25.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.713+0000 7f2568426640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f254406aef0 0x7f254406d3b0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f25600af8e0 tx=0x7f255c030000 comp rx=0 tx=0).stop 2023-10-14T22:44:25.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560066d30 msgr2=0x7f256014f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:25.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560066d30 0x7f256014f1a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f255000b410 tx=0x7f255000b8d0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.717 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 shutdown_connections 2023-10-14T22:44:25.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f254406aef0 0x7f254406d3b0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2560158c40 0x7f25600b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2560069de0 0x7f25600b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 --2- 172.21.15.64:0/1796251660 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2560066d30 0x7f256014f1a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:25.718 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 >> 172.21.15.64:0/1796251660 conn(0x7f25600b09e0 msgr2=0x7f256006ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 shutdown_connections 2023-10-14T22:44:25.719 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:25.714+0000 7f2568426640 1 -- 172.21.15.64:0/1796251660 wait complete. 2023-10-14T22:44:25.749 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-10-14T22:44:26.065 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.063+0000 7f5b6d28a640 1 Processor -- start 2023-10-14T22:44:26.066 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.063+0000 7f5b6d28a640 1 -- start start 2023-10-14T22:44:26.068 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.066+0000 7f5b6d28a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b68158b40 0x7f5b680ce300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:26.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.066+0000 7f5b6d28a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680ce840 0x7f5b6815c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:26.069 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.067+0000 7f5b67fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b68158b40 0x7f5b680ce300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:26.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.067+0000 7f5b67fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f5b68158b40 0x7f5b680ce300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3300/0 says I am v2:172.21.15.64:44740/0 (socket says 172.21.15.64:44740) 2023-10-14T22:44:26.070 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.067+0000 7f5b67fff640 1 -- 172.21.15.64:0/516072926 learned_addr learned my addr 172.21.15.64:0/516072926 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:26.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.068+0000 7f5b677fe640 1 --2- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680ce840 0x7f5b6815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:26.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.068+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b680ceca0 con 0x7f5b680cadf0 2023-10-14T22:44:26.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.068+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b680c8fc0 con 0x7f5b68158b40 2023-10-14T22:44:26.071 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.068+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b680cc0d0 con 0x7f5b680ce840 2023-10-14T22:44:26.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.069+0000 7f5b67fff640 1 -- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680ce840 msgr2=0x7f5b6815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:26.072 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.069+0000 7f5b67fff640 1 --2- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680ce840 0x7f5b6815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:26.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.070+0000 7f5b67fff640 1 -- 172.21.15.64:0/516072926 >> v1:172.21.15.177:6789/0 conn(0x7f5b680cadf0 legacy=0x7f5b6806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:26.073 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.071+0000 7f5b67fff640 1 -- 172.21.15.64:0/516072926 --> v2:172.21.15.177:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6815d3d0 con 0x7f5b68158b40 2023-10-14T22:44:26.076 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.074+0000 7f5b67fff640 1 --2- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 0x7f5b680ce300 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5b580083f0 tx=0x7f5b5800abe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e39f9f547ac384e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:26.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.075+0000 7f5b66ffd640 1 -- 172.21.15.64:0/516072926 <== mon.1 v2:172.21.15.177:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b58008df0 con 0x7f5b68158b40 2023-10-14T22:44:26.077 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.075+0000 7f5b66ffd640 1 -- 172.21.15.64:0/516072926 <== mon.1 v2:172.21.15.177:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5802e050 con 0x7f5b68158b40 2023-10-14T22:44:26.078 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.075+0000 7f5b66ffd640 1 -- 172.21.15.64:0/516072926 <== mon.1 v2:172.21.15.177:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5800a2f0 con 0x7f5b68158b40 2023-10-14T22:44:26.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.076+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 msgr2=0x7f5b680ce300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:26.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.076+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 0x7f5b680ce300 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5b580083f0 tx=0x7f5b5800abe0 comp rx=0 tx=0).stop 2023-10-14T22:44:26.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.076+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 shutdown_connections 2023-10-14T22:44:26.079 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.076+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680ce840 0x7f5b6815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:26.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.077+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/516072926 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 0x7f5b680ce300 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:26.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.077+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 >> 172.21.15.64:0/516072926 conn(0x7f5b68069ff0 msgr2=0x7f5b6806a400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:26.080 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.077+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 shutdown_connections 2023-10-14T22:44:26.081 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.077+0000 7f5b6d28a640 1 -- 172.21.15.64:0/516072926 wait complete. 2023-10-14T22:44:26.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.080+0000 7f5b6d28a640 1 Processor -- start 2023-10-14T22:44:26.084 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.081+0000 7f5b6d28a640 1 -- start start 2023-10-14T22:44:26.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.082+0000 7f5b6d28a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680cadf0 0x7f5b68149d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:26.085 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.082+0000 7f5b6d28a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b680ce840 0x7f5b680c4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:26.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.082+0000 7f5b6d28a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 0x7f5b680c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:26.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.082+0000 7f5b6d28a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6814a240 con 0x7f5b680ce840 2023-10-14T22:44:26.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.082+0000 7f5b6d28a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6815b6e0 con 0x7f5b68158b40 2023-10-14T22:44:26.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.082+0000 7f5b6d28a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b6815a640 con 0x7f5b680cadf0 2023-10-14T22:44:26.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.084+0000 7f5b6ca89640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 0x7f5b680c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:26.087 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.084+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680cadf0 0x7f5b68149d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:26.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.084+0000 7f5b67fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680cadf0 0x7f5b68149d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:58714/0 (socket says 172.21.15.64:58714) 2023-10-14T22:44:26.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.084+0000 7f5b67fff640 1 -- 172.21.15.64:0/2083725544 learned_addr learned my addr 172.21.15.64:0/2083725544 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:26.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.085+0000 7f5b677fe640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b680ce840 0x7f5b680c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:26.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.086+0000 7f5b677fe640 1 -- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680cadf0 msgr2=0x7f5b68149d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:26.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.086+0000 7f5b677fe640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680cadf0 0x7f5b68149d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:26.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.086+0000 7f5b677fe640 1 -- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 msgr2=0x7f5b680c45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:26.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.086+0000 7f5b677fe640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 0x7f5b680c45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:26.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.086+0000 7f5b677fe640 1 -- 172.21.15.64:0/2083725544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b58008050 con 0x7f5b680ce840 2023-10-14T22:44:26.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.087+0000 7f5b677fe640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b680ce840 0x7f5b680c4070 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00ea00 tx=0x7f5b5c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:26.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.088+0000 7f5b64ff9640 1 -- 172.21.15.64:0/2083725544 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00de00 con 0x7f5b680ce840 2023-10-14T22:44:26.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.088+0000 7f5b64ff9640 1 -- 172.21.15.64:0/2083725544 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b5c010440 con 0x7f5b680ce840 2023-10-14T22:44:26.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.088+0000 7f5b64ff9640 1 -- 172.21.15.64:0/2083725544 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b5c00de00 con 0x7f5b680ce840 2023-10-14T22:44:26.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.088+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b6815a920 con 0x7f5b680ce840 2023-10-14T22:44:26.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.092+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b6815aee0 con 0x7f5b680ce840 2023-10-14T22:44:26.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.094+0000 7f5b64ff9640 1 -- 172.21.15.64:0/2083725544 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f5b5c0105b0 con 0x7f5b680ce840 2023-10-14T22:44:26.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.094+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b6804e9b0 con 0x7f5b680ce840 2023-10-14T22:44:26.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.095+0000 7f5b64ff9640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5b5406aed0 0x7f5b5406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:26.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.096+0000 7f5b67fff640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5b5406aed0 0x7f5b5406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:26.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.098+0000 7f5b64ff9640 1 -- 172.21.15.64:0/2083725544 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5b5c0580c0 con 0x7f5b680ce840 2023-10-14T22:44:26.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.101+0000 7f5b67fff640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5b5406aed0 0x7f5b5406d390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ac20 tx=0x7f5b5800a000 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:26.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.107+0000 7f5b64ff9640 1 -- 172.21.15.64:0/2083725544 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f5b5c053d00 con 0x7f5b680ce840 2023-10-14T22:44:26.629 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:26.626+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7f5b680cd500 con 0x7f5b680ce840 2023-10-14T22:44:27.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.000+0000 7f5b64ff9640 1 -- 172.21.15.64:0/2083725544 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v18575) v1 ==== 144+0+0 (secure 0 0 0) 0x7f5b5c057320 con 0x7f5b680ce840 2023-10-14T22:44:27.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.003+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5b5406aed0 msgr2=0x7f5b5406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:27.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.003+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5b5406aed0 0x7f5b5406d390 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5b5800ac20 tx=0x7f5b5800a000 comp rx=0 tx=0).stop 2023-10-14T22:44:27.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.003+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b680ce840 msgr2=0x7f5b680c4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:27.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.003+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b680ce840 0x7f5b680c4070 secure :-1 s=READY pgs=2243 cs=0 l=1 rev1=1 crypto rx=0x7f5b5c00ea00 tx=0x7f5b5c00eec0 comp rx=0 tx=0).stop 2023-10-14T22:44:27.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.005+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 shutdown_connections 2023-10-14T22:44:27.008 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.005+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f5b5406aed0 0x7f5b5406d390 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:27.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.005+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f5b68158b40 0x7f5b680c45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:27.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.005+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f5b680ce840 0x7f5b680c4070 unknown :-1 s=CLOSED pgs=2243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:27.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.005+0000 7f5b6d28a640 1 --2- 172.21.15.64:0/2083725544 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f5b680cadf0 0x7f5b68149d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:27.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.005+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 >> 172.21.15.64:0/2083725544 conn(0x7f5b68069ff0 msgr2=0x7f5b680cd720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:27.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.006+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 shutdown_connections 2023-10-14T22:44:27.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:27.006+0000 7f5b6d28a640 1 -- 172.21.15.64:0/2083725544 wait complete. 2023-10-14T22:44:27.046 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2023-10-14T22:44:27.046 INFO:tasks.cephfs_test_runner: 2023-10-14T22:44:27.047 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T22:44:27.047 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-14T22:44:27.047 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T22:44:27.047 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T22:44:27.048 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-14T22:44:27.048 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-14T22:44:27.048 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-14T22:44:27.048 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-14T22:44:27.049 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-14T22:44:27.049 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-10-14T22:44:27.049 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-10-14T22:44:27.049 INFO:tasks.cephfs_test_runner: 2023-10-14T22:44:27.050 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T22:44:27.050 INFO:tasks.cephfs_test_runner:Ran 1 test in 36879.708s 2023-10-14T22:44:27.050 INFO:tasks.cephfs_test_runner: 2023-10-14T22:44:27.051 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2023-10-14T22:44:27.051 INFO:tasks.cephfs_test_runner: 2023-10-14T22:44:27.051 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-14T22:44:27.051 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-14T22:44:27.052 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-14T22:44:27.052 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-14T22:44:27.052 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2023-10-14T22:44:27.052 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2023-10-14T22:44:27.053 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/xfstests_dev.py", line 387, in run_generic_tests 2023-10-14T22:44:27.053 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2023-10-14T22:44:27.053 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs/xfstests_dev.py", line 379, in run_testdir 2023-10-14T22:44:27.054 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2023-10-14T22:44:27.054 INFO:tasks.cephfs_test_runner:AssertionError: 16 != 0 2023-10-14T22:44:27.054 INFO:tasks.cephfs_test_runner: 2023-10-14T22:44:27.055 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-14T22:44:27.141 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=28e5153f17a7409a9e8a7da87558a6ce Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_8cdab074dcca9a68965bc5a50e9c30b691949723/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4ba8a190d7130cb1f1e7ceedfc0d129df5dd29b0/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-10-14T22:44:27.142 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-14T22:44:27.151 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-10-14T22:44:27.161 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-10-14T22:44:27.161 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T22:44:27.162 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:27.264 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054305,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249416k,nr_inodes=812354,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T22:44:27.265 DEBUG:teuthology.orchestra.run.smithi064:> set -ex 2023-10-14T22:44:27.265 DEBUG:teuthology.orchestra.run.smithi064:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:27.374 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054305,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249416k,nr_inodes=812354,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-10-14T22:44:27.374 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T22:44:27.375 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:27.468 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T22:44:27.469 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2023-10-14T22:44:27.469 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/proc/self/mounts of=/dev/stdout 2023-10-14T22:44:27.570 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054259,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249376k,nr_inodes=812344,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498760k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-10-14T22:44:27.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:27.571 DEBUG:teuthology.orchestra.run.smithi177:> ip netns list 2023-10-14T22:44:28.017 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-14T22:44:28.017 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-14T22:44:28.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:28.021 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-14T22:44:28.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:28.177 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-14T22:44:28.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:28.325 DEBUG:teuthology.orchestra.run.smithi177:> sudo ip link delete ceph-brx 2023-10-14T22:44:28.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:28.514 DEBUG:teuthology.orchestra.run.smithi064:> ip netns list 2023-10-14T22:44:28.885 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-14T22:44:28.886 INFO:teuthology.orchestra.run.smithi064.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-14T22:44:28.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:28.887 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-14T22:44:28.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:28.979 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-14T22:44:29.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-14T22:44:29.069 DEBUG:teuthology.orchestra.run.smithi064:> sudo ip link delete ceph-brx 2023-10-14T22:44:29.180 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-14T22:44:29.190 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-14T22:44:29.190 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T22:44:29.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.376+0000 7ff88cb35640 1 Processor -- start 2023-10-14T22:44:29.379 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.377+0000 7ff88cb35640 1 -- start start 2023-10-14T22:44:29.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.378+0000 7ff88cb35640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff88815a8d0 0x7ff8880cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.378+0000 7ff88cb35640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff8880ca660 0x7ff8880cb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.378+0000 7ff88cb35640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff88815acb0 con 0x7ff88806ff40 2023-10-14T22:44:29.381 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.378+0000 7ff88cb35640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880c1c60 con 0x7ff88815a8d0 2023-10-14T22:44:29.382 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.378+0000 7ff88cb35640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff88815e350 con 0x7ff8880ca660 2023-10-14T22:44:29.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff8877fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff88815a8d0 0x7ff8880cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.383 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff8877fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7ff88815a8d0 0x7ff8880cab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40446/0 (socket says 172.21.15.64:40446) 2023-10-14T22:44:29.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff8877fe640 1 -- 172.21.15.64:0/4267171334 learned_addr learned my addr 172.21.15.64:0/4267171334 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:29.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff87ffff640 1 --2- 172.21.15.64:0/4267171334 >> v2:172.21.15.177:3300/0 conn(0x7ff8880ca660 0x7ff8880cb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff8877fe640 1 -- 172.21.15.64:0/4267171334 >> v2:172.21.15.177:3300/0 conn(0x7ff8880ca660 msgr2=0x7ff8880cb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:29.384 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff8877fe640 1 --2- 172.21.15.64:0/4267171334 >> v2:172.21.15.177:3300/0 conn(0x7ff8880ca660 0x7ff8880cb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff8877fe640 1 -- 172.21.15.64:0/4267171334 >> v1:172.21.15.177:6789/0 conn(0x7ff88806ff40 legacy=0x7ff88806bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:29.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.379+0000 7ff8877fe640 1 -- 172.21.15.64:0/4267171334 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88815e630 con 0x7ff88815a8d0 2023-10-14T22:44:29.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.380+0000 7ff8877fe640 1 --2- 172.21.15.64:0/4267171334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff8880cab40 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7ff8880b0aa0 tx=0x7ff87802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dc66e818602ade server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:29.385 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff886ffd640 1 -- 172.21.15.64:0/4267171334 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878004230 con 0x7ff88815a8d0 2023-10-14T22:44:29.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff886ffd640 1 -- 172.21.15.64:0/4267171334 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff878004390 con 0x7ff88815a8d0 2023-10-14T22:44:29.386 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff886ffd640 1 -- 172.21.15.64:0/4267171334 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878003810 con 0x7ff88815a8d0 2023-10-14T22:44:29.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff88cb35640 1 -- 172.21.15.64:0/4267171334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 msgr2=0x7ff8880cab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff88cb35640 1 --2- 172.21.15.64:0/4267171334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff8880cab40 secure :-1 s=READY pgs=2244 cs=0 l=1 rev1=1 crypto rx=0x7ff8880b0aa0 tx=0x7ff87802b8f0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.389 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff88cb35640 1 -- 172.21.15.64:0/4267171334 shutdown_connections 2023-10-14T22:44:29.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff88cb35640 1 --2- 172.21.15.64:0/4267171334 >> v2:172.21.15.177:3300/0 conn(0x7ff8880ca660 0x7ff8880cb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff88cb35640 1 --2- 172.21.15.64:0/4267171334 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff8880cab40 unknown :-1 s=CLOSED pgs=2244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.381+0000 7ff88cb35640 1 -- 172.21.15.64:0/4267171334 >> 172.21.15.64:0/4267171334 conn(0x7ff88806a470 msgr2=0x7ff8880afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:29.390 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.382+0000 7ff88cb35640 1 -- 172.21.15.64:0/4267171334 shutdown_connections 2023-10-14T22:44:29.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.382+0000 7ff88cb35640 1 -- 172.21.15.64:0/4267171334 wait complete. 2023-10-14T22:44:29.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.384+0000 7ff88cb35640 1 Processor -- start 2023-10-14T22:44:29.391 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.384+0000 7ff88cb35640 1 -- start start 2023-10-14T22:44:29.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff88cb35640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff88806ff40 0x7ff88815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff88cb35640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8880ca660 0x7ff8880cd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff88cb35640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff88815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.392 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff88cb35640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88815bfa0 con 0x7ff88815a8d0 2023-10-14T22:44:29.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff88cb35640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff88815d1c0 con 0x7ff8880ca660 2023-10-14T22:44:29.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff88cb35640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff88815af80 con 0x7ff88806ff40 2023-10-14T22:44:29.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff887fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff88815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.393 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff887fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff88815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40448/0 (socket says 172.21.15.64:40448) 2023-10-14T22:44:29.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff887fff640 1 -- 172.21.15.64:0/1970193720 learned_addr learned my addr 172.21.15.64:0/1970193720 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:29.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff8877fe640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff88806ff40 0x7ff88815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff87ffff640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8880ca660 0x7ff8880cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.394 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff887fff640 1 -- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff88806ff40 msgr2=0x7ff88815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff887fff640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff88806ff40 0x7ff88815ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff887fff640 1 -- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8880ca660 msgr2=0x7ff8880cd200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.395 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.385+0000 7ff887fff640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8880ca660 0x7ff8880cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.386+0000 7ff887fff640 1 -- 172.21.15.64:0/1970193720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff878009460 con 0x7ff88815a8d0 2023-10-14T22:44:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.386+0000 7ff887fff640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff88815c770 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c780 tx=0x7ff88000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.386+0000 7ff884ff9640 1 -- 172.21.15.64:0/1970193720 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880003d80 con 0x7ff88815a8d0 2023-10-14T22:44:29.396 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.386+0000 7ff884ff9640 1 -- 172.21.15.64:0/1970193720 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000ce30 con 0x7ff88815a8d0 2023-10-14T22:44:29.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.386+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff88815b260 con 0x7ff88815a8d0 2023-10-14T22:44:29.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.386+0000 7ff884ff9640 1 -- 172.21.15.64:0/1970193720 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880005290 con 0x7ff88815a8d0 2023-10-14T22:44:29.397 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.386+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff888153a50 con 0x7ff88815a8d0 2023-10-14T22:44:29.398 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.388+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff88815b780 con 0x7ff88815a8d0 2023-10-14T22:44:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.388+0000 7ff884ff9640 1 -- 172.21.15.64:0/1970193720 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff8800053f0 con 0x7ff88815a8d0 2023-10-14T22:44:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.390+0000 7ff884ff9640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff86806ae70 0x7ff86806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.399 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.390+0000 7ff884ff9640 1 -- 172.21.15.64:0/1970193720 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff880088c20 con 0x7ff88815a8d0 2023-10-14T22:44:29.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.390+0000 7ff8877fe640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff86806ae70 0x7ff86806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.391+0000 7ff8877fe640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff86806ae70 0x7ff86806d330 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff878035000 tx=0x7ff878008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:29.400 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.394+0000 7ff884ff9640 1 -- 172.21.15.64:0/1970193720 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff88815b780 con 0x7ff88815a8d0 2023-10-14T22:44:29.581 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.578+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff88815ebf0 con 0x7ff86806ae70 2023-10-14T22:44:29.618 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.615+0000 7ff884ff9640 1 -- 172.21.15.64:0/1970193720 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48842 (secure 0 0 0) 0x7ff878004500 con 0x7ff86806ae70 2023-10-14T22:44:29.619 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:29.620 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T22:44:29.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff86806ae70 msgr2=0x7ff86806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.621 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff86806ae70 0x7ff86806d330 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7ff878035000 tx=0x7ff878008030 comp rx=0 tx=0).stop 2023-10-14T22:44:29.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 msgr2=0x7ff88815c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff88815c770 secure :-1 s=READY pgs=2245 cs=0 l=1 rev1=1 crypto rx=0x7ff88000c780 tx=0x7ff88000cc40 comp rx=0 tx=0).stop 2023-10-14T22:44:29.622 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 shutdown_connections 2023-10-14T22:44:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff86806ae70 0x7ff86806d330 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff88815a8d0 0x7ff88815c770 unknown :-1 s=CLOSED pgs=2245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff8880ca660 0x7ff8880cd200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.623 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 --2- 172.21.15.64:0/1970193720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff88806ff40 0x7ff88815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.618+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 >> 172.21.15.64:0/1970193720 conn(0x7ff88806a470 msgr2=0x7ff888158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.619+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 shutdown_connections 2023-10-14T22:44:29.624 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.619+0000 7ff88cb35640 1 -- 172.21.15.64:0/1970193720 wait complete. 2023-10-14T22:44:29.641 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":18507,"stamp":"2023-10-14T22:44:28.839678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":53731792,"kb_used_data":41536624,"kb_used_omap":2929,"kb_used_meta":12192142,"kb_avail":701242928,"statfs":{"total":773094113280,"available":718072758272,"internally_reserved":0,"allocated":42533502976,"data_stored":42444734282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2999830,"internal_metadata":12484753898},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40107094326,"num_objects":-33643,"num_object_clones":0,"num_object_copies":-67286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33643,"num_whiteouts":0,"num_read":-1805263,"num_read_kb":-127868209,"num_write":-7442291,"num_write_kb":-159909719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2311,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.838797"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T22:44:21.932940+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T22:44:21.932940+0000","last_peered":"2023-10-14T22:44:21.932940+0000","last_clean":"2023-10-14T22:44:21.932940+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T22:44:21.932940+0000","last_undegraded":"2023-10-14T22:44:21.932940+0000","last_fullsized":"2023-10-14T22:44:21.932940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129549534,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6873832,"kb_used_data":5345436,"kb_used_omap":333,"kb_used_meta":1528050,"kb_avail":87498008,"statfs":{"total":96636764160,"available":89597960192,"internally_reserved":0,"allocated":5473726464,"data_stored":5461503232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341850,"internal_metadata":1564723366},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.036,"15min":1.0189999999999999},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.949999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.2519999999999998,"5min":1.2,"15min":1.1479999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":25.702999999999999,"5min":25.702999999999999,"15min":25.702999999999999},"last":0.71099999999999997}]},{"osd":1,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":4.1310000000000002,"5min":1.821,"15min":1.4890000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.35799999999999998},"max":{"1min":36.848999999999997,"5min":36.848999999999997,"15min":43.484999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":2.782,"5min":1.48,"15min":1.4259999999999999},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":30.545000000000002,"5min":30.545000000000002,"15min":47.561},"last":1.3049999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":1.498,"15min":1.288},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":8.7270000000000003,"5min":8.7270000000000003,"15min":8.7270000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":3.427,"5min":1.611,"15min":1.3640000000000001},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":28.446000000000002,"5min":28.446000000000002,"15min":28.446000000000002},"last":0.96699999999999997}]},{"osd":3,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":1.4930000000000001,"15min":1.349},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.432},"max":{"1min":12.698,"5min":12.773999999999999,"15min":12.773999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":19.802,"5min":19.802,"15min":19.802},"last":1.034}]},{"osd":4,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.94199999999999995,"15min":0.98299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.3530000000000002,"5min":3.3530000000000002,"15min":5.2649999999999997},"last":1.256},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.087,"15min":1.056},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.373},"max":{"1min":9.7859999999999996,"5min":9.7859999999999996,"15min":9.7859999999999996},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.1240000000000001,"15min":1.028},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":16.484999999999999,"5min":16.484999999999999,"15min":16.484999999999999},"last":1.137},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.0720000000000001,"15min":1.0900000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.36499999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":1.359}]},{"osd":6,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.399,"5min":3.399,"15min":5.1500000000000004},"last":1.484},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.1779999999999999,"15min":1.133},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":9.7390000000000008,"5min":9.7390000000000008,"15min":9.7390000000000008},"last":1.6080000000000001}]}]},{"osd":6,"up_from":14,"seq":60129549534,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6116040,"kb_used_data":4841660,"kb_used_omap":259,"kb_used_meta":1274108,"kb_avail":88255800,"statfs":{"total":96636764160,"available":90373939200,"internally_reserved":0,"allocated":4957859840,"data_stored":4947355685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265300,"internal_metadata":1304687532},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.601,"15min":1.272},"min":{"1min":0.56699999999999995,"5min":0.312,"15min":0.312},"max":{"1min":19.954000000000001,"5min":26.696999999999999,"15min":26.696999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.5489999999999999,"15min":1.246},"min":{"1min":0.435,"5min":0.371,"15min":0.34200000000000003},"max":{"1min":12.029999999999999,"5min":26.645,"15min":26.645},"last":1.0249999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9910000000000001,"5min":1.617,"15min":1.764},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":11.016,"5min":22.859000000000002,"15min":102.004},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.7709999999999999,"5min":1.4630000000000001,"15min":1.7130000000000001},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.35299999999999998},"max":{"1min":9.5570000000000004,"5min":19.837,"15min":106.91800000000001},"last":1.496}]},{"osd":2,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":3.4119999999999999,"5min":1.8740000000000001,"15min":1.5209999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":40.963999999999999,"5min":40.963999999999999,"15min":40.963999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":5.3300000000000001,"5min":2.3109999999999999,"15min":1.6639999999999999},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":44.948,"5min":44.948,"15min":44.948},"last":1.1870000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":5.6790000000000003,"5min":2.391,"15min":1.639},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"max":{"1min":45.972999999999999,"5min":45.972999999999999,"15min":45.972999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.4159999999999999,"15min":1.3009999999999999},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.42799999999999999},"max":{"1min":9.0879999999999992,"5min":18.366,"15min":18.366},"last":1.5389999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.1399999999999999,"15min":1.0669999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":13.894,"5min":13.894,"15min":13.894},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.2,"15min":1.0860000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":11.987,"5min":11.987,"15min":11.987},"last":1.444}]},{"osd":5,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":2.1400000000000001,"15min":1.4219999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":68.251000000000005,"5min":68.251000000000005,"15min":68.251000000000005},"last":1.77},{"interface":"front","average":{"1min":5.0800000000000001,"5min":1.8740000000000001,"15min":1.3799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":67.287999999999997,"5min":67.287999999999997,"15min":67.287999999999997},"last":1.861}]},{"osd":7,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":4.2069999999999999,"5min":1.758,"15min":1.3300000000000001},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":45.869999999999997,"5min":45.869999999999997,"15min":45.869999999999997},"last":1.925},{"interface":"front","average":{"1min":2.3090000000000002,"5min":1.411,"15min":1.2410000000000001},"min":{"1min":0.57699999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":11.73,"5min":11.73,"15min":11.73},"last":1.6699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129549529,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8438912,"kb_used_data":6638964,"kb_used_omap":373,"kb_used_meta":1799562,"kb_avail":85932928,"statfs":{"total":96636764160,"available":87995318272,"internally_reserved":0,"allocated":6798299136,"data_stored":6783428904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":382088,"internal_metadata":1842752376},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.347,"15min":1.1200000000000001},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.30599999999999999},"max":{"1min":18.402000000000001,"5min":24.623999999999999,"15min":24.623999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.484,"15min":1.2190000000000001},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.33800000000000002},"max":{"1min":14.494,"5min":21.686,"15min":21.686},"last":1.1639999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":1.736,"15min":1.7410000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":26.164000000000001,"5min":26.164000000000001,"15min":89.793999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.875,"5min":1.4990000000000001,"15min":1.673},"min":{"1min":0.60799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.6150000000000002,"5min":25.41,"15min":88.759},"last":0.76200000000000001}]},{"osd":2,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.244,"15min":1.2849999999999999},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40899999999999997},"max":{"1min":10.307,"5min":10.307,"15min":18.366},"last":3.3149999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.1599999999999999,"15min":1.194},"min":{"1min":0.57599999999999996,"5min":0.442,"15min":0.35499999999999998},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":17.277000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":1.857,"15min":1.5960000000000001},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":25.887,"5min":25.887,"15min":25.887},"last":0.81799999999999995},{"interface":"front","average":{"1min":2.589,"5min":1.6240000000000001,"15min":1.532},"min":{"1min":0.58699999999999997,"5min":0.51300000000000001,"15min":0.48599999999999999},"max":{"1min":10.269,"5min":10.269,"15min":16.033999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.1259999999999999,"15min":1.0329999999999999},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":18.32,"5min":18.32,"15min":18.32},"last":0.52900000000000003},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.387,"15min":1.1299999999999999},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.35599999999999998},"max":{"1min":35.996000000000002,"5min":35.996000000000002,"15min":35.996000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.1459999999999999,"15min":1.101},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.40799999999999997},"max":{"1min":18.574999999999999,"5min":18.574999999999999,"15min":18.574999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":6.2430000000000003},"last":0.83899999999999997}]},{"osd":7,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.2130000000000001,"15min":1.131},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.443},"max":{"1min":12.337,"5min":12.337,"15min":12.337},"last":0.73599999999999999},{"interface":"front","average":{"1min":3.5750000000000002,"5min":1.4910000000000001,"15min":1.264},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.504},"max":{"1min":42.744999999999997,"5min":42.744999999999997,"15min":42.744999999999997},"last":0.72199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129549535,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6125676,"kb_used_data":4683424,"kb_used_omap":895,"kb_used_meta":1441344,"kb_avail":88246164,"statfs":{"total":96636764160,"available":90364071936,"internally_reserved":0,"allocated":4795826176,"data_stored":4786091761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":917343,"internal_metadata":1475936417},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.52,"15min":1.1379999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.314},"max":{"1min":9.1950000000000003,"5min":29.893000000000001,"15min":29.893000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.74,"5min":1.615,"15min":1.29},"min":{"1min":0.379,"5min":0.371,"15min":0.316},"max":{"1min":9.3900000000000006,"5min":26.690999999999999,"15min":26.690999999999999},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":4.226,"5min":2.1899999999999999,"15min":1.9279999999999999},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":63.497,"5min":63.497,"15min":137.398},"last":0.46999999999999997},{"interface":"front","average":{"1min":3.6070000000000002,"5min":1.929,"15min":1.8029999999999999},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.33600000000000002},"max":{"1min":42.393000000000001,"5min":42.393000000000001,"15min":142.18299999999999},"last":1.028}]},{"osd":2,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.468,"5min":1.6930000000000001,"15min":1.3879999999999999},"min":{"1min":0.60799999999999998,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":16.384,"5min":21.434000000000001,"15min":21.434000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":2.4119999999999999,"5min":1.8420000000000001,"15min":1.4430000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":13.545,"5min":24.052,"15min":24.052},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.7549999999999999,"5min":1.8759999999999999,"15min":2.1339999999999999},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":19.736999999999998,"5min":22.067,"15min":163.07900000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.1699999999999999,"5min":1.6799999999999999,"15min":2.0529999999999999},"min":{"1min":0.56200000000000006,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.422000000000001,"5min":21.585000000000001,"15min":161.60400000000001},"last":2.2930000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":1.222,"15min":1.044},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":11.791,"5min":11.791,"15min":11.791},"last":0.873},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.4950000000000001,"15min":1.224},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":9.4770000000000003,"5min":13.093,"15min":13.093},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.212,"15min":1.129},"min":{"1min":0.443,"5min":0.443,"15min":0.39200000000000002},"max":{"1min":16.257999999999999,"5min":16.257999999999999,"15min":16.257999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":2.1930000000000001,"5min":1.4059999999999999,"15min":1.175},"min":{"1min":0.60699999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.500999999999999,"5min":13.500999999999999,"15min":13.500999999999999},"last":1.105}]},{"osd":7,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.3049999999999999,"15min":1.222},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":9.4339999999999993,"5min":9.4339999999999993,"15min":9.4339999999999993},"last":0.65200000000000002},{"interface":"front","average":{"1min":2.9489999999999998,"5min":1.585,"15min":1.286},"min":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":27.295000000000002,"5min":27.295000000000002,"15min":27.295000000000002},"last":0.89400000000000002}]}]},{"osd":3,"up_from":14,"seq":60129549499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7040136,"kb_used_data":5789308,"kb_used_omap":507,"kb_used_meta":1250308,"kb_avail":87331704,"statfs":{"total":96636764160,"available":89427664896,"internally_reserved":0,"allocated":5928251392,"data_stored":5916113165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":519900,"internal_metadata":1280315684},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.5279999999999996,"5min":2.073,"15min":1.694},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":31.922999999999998,"5min":31.922999999999998,"15min":31.922999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":4.5609999999999999,"5min":2.1699999999999999,"15min":1.823},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":37.823999999999998,"5min":37.823999999999998,"15min":37.823999999999998},"last":0.999}]},{"osd":1,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4180000000000001,"5min":15.904999999999999,"15min":7.1029999999999998},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":17.184999999999999,"5min":1547.634,"15min":1547.634},"last":0.70599999999999996},{"interface":"front","average":{"1min":4.133,"5min":16.254000000000001,"15min":7.258},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":31.963999999999999,"5min":1552.8879999999999,"15min":1552.8879999999999},"last":1.556}]},{"osd":2,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.2489999999999997,"5min":1.97,"15min":1.857},"min":{"1min":0.60699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":28.045000000000002,"5min":28.045000000000002,"15min":28.045000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":3.415,"5min":1.99,"15min":1.8300000000000001},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":18.495999999999999,"5min":18.495999999999999,"15min":18.495999999999999},"last":1.028}]},{"osd":4,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":1.762,"15min":1.661},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.134999999999998,"5min":36.134999999999998,"15min":36.134999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":3.4009999999999998,"5min":2.012,"15min":1.7549999999999999},"min":{"1min":0.77500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":18.535,"5min":18.535,"15min":18.535},"last":1.4339999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.3029999999999999,"5min":1.893,"15min":1.724},"min":{"1min":0.57599999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":36.192,"5min":36.192,"15min":36.192},"last":1.208},{"interface":"front","average":{"1min":3.677,"5min":2.1800000000000002,"15min":1.8640000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":31.771000000000001,"5min":31.771000000000001,"15min":31.771000000000001},"last":1.6200000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":1.9510000000000001,"15min":1.8029999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":21.146999999999998,"5min":21.146999999999998,"15min":21.146999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":3.5089999999999999,"5min":2.1019999999999999,"15min":1.8979999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":34.142000000000003,"5min":34.142000000000003,"15min":34.142000000000003},"last":1.177}]},{"osd":7,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.1930000000000001,"15min":1.901},"min":{"1min":0.70699999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":32.061999999999998,"5min":32.061999999999998,"15min":32.061999999999998},"last":1.3},{"interface":"front","average":{"1min":3.375,"5min":1.79,"15min":1.772},"min":{"1min":0.66000000000000003,"5min":0.59599999999999997,"15min":0.56299999999999994},"max":{"1min":17.132000000000001,"5min":17.132000000000001,"15min":17.132000000000001},"last":1.3919999999999999}]}]},{"osd":2,"up_from":14,"seq":60129549505,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7329028,"kb_used_data":5599608,"kb_used_omap":91,"kb_used_meta":1729316,"kb_avail":87042812,"statfs":{"total":96636764160,"available":89131839488,"internally_reserved":0,"allocated":5733998592,"data_stored":5722195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93223,"internal_metadata":1770820569},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.46,"15min":1.542},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":12.6,"5min":12.6,"15min":12.82},"last":0.94599999999999995},{"interface":"front","average":{"1min":2.754,"5min":1.754,"15min":1.7090000000000001},"min":{"1min":0.51500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":20.664000000000001,"5min":20.664000000000001,"15min":20.664000000000001},"last":0.77900000000000003}]},{"osd":1,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.8530000000000002,"5min":2.0859999999999999,"15min":2.4409999999999998},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.33400000000000002},"max":{"1min":37.893000000000001,"5min":37.893000000000001,"15min":126.84099999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":3.2890000000000001,"5min":2.028,"15min":2.5049999999999999},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":25.445,"5min":25.445,"15min":129.59100000000001},"last":1.208}]},{"osd":3,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.744,"15min":1.708},"min":{"1min":0.46200000000000002,"5min":0.36599999999999999,"15min":0.32200000000000001},"max":{"1min":5.0659999999999998,"5min":5.1379999999999999,"15min":6.7460000000000004},"last":0.88100000000000001},{"interface":"front","average":{"1min":2.4319999999999999,"5min":1.9079999999999999,"15min":1.7310000000000001},"min":{"1min":0.65100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":1.2669999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.863,"5min":1.7609999999999999,"15min":1.6899999999999999},"min":{"1min":0.63,"5min":0.501,"15min":0.46000000000000002},"max":{"1min":20.613,"5min":20.613,"15min":20.613},"last":1.071},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.659,"15min":1.528},"min":{"1min":0.51800000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"max":{"1min":5.1950000000000003,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.1100000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":1.6339999999999999,"15min":1.6499999999999999},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.47599999999999998},"max":{"1min":12.507,"5min":12.507,"15min":12.507},"last":1.8149999999999999},{"interface":"front","average":{"1min":2.3719999999999999,"5min":1.7070000000000001,"15min":1.71},"min":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.48899999999999999},"max":{"1min":11.375,"5min":11.375,"15min":11.375},"last":1.4430000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":1.792,"15min":1.643},"min":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":14.448,"5min":14.448,"15min":14.448},"last":1.5900000000000001},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.6990000000000001,"15min":1.679},"min":{"1min":0.67000000000000004,"5min":0.57199999999999995,"15min":0.53700000000000003},"max":{"1min":12.631,"5min":12.631,"15min":12.631},"last":1.893}]},{"osd":7,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.569,"5min":2.0110000000000001,"15min":1.8700000000000001},"min":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.54800000000000004},"max":{"1min":30.634,"5min":30.634,"15min":30.634},"last":1.383},{"interface":"front","average":{"1min":3.2869999999999999,"5min":2.0649999999999999,"15min":1.819},"min":{"1min":0.90800000000000003,"5min":0.53800000000000003,"15min":0.50800000000000001},"max":{"1min":27.34,"5min":27.34,"15min":27.34},"last":1.667}]}]},{"osd":1,"up_from":14,"seq":60129549517,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5787200,"kb_used_data":4249332,"kb_used_omap":431,"kb_used_meta":1537424,"kb_avail":88584640,"statfs":{"total":96636764160,"available":90710671360,"internally_reserved":0,"allocated":4351315968,"data_stored":4342532980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":442347,"internal_metadata":1574322197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.3399999999999999,"5min":1.923,"15min":1.5149999999999999},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":34.283999999999999,"5min":34.283999999999999,"15min":34.283999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":4.1870000000000003,"5min":1.97,"15min":1.639},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":35.313000000000002,"5min":35.313000000000002,"15min":35.313000000000002},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":2.1480000000000001,"15min":1.956},"min":{"1min":0.53000000000000003,"5min":0.32900000000000001,"15min":0.28000000000000003},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":54.386000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":6.2590000000000003,"5min":2.4740000000000002,"15min":2.1560000000000001},"min":{"1min":0.497,"5min":0.38500000000000001,"15min":0.32500000000000001},"max":{"1min":34.396000000000001,"5min":34.396000000000001,"15min":52.030000000000001},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.8869999999999996,"5min":2.419,"15min":1.9570000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.41499999999999998},"max":{"1min":34.362000000000002,"5min":34.362000000000002,"15min":34.362000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":5.2469999999999999,"5min":2.4390000000000001,"15min":1.913},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40200000000000002},"max":{"1min":35.412999999999997,"5min":35.412999999999997,"15min":35.412999999999997},"last":0.90700000000000003}]},{"osd":4,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.3260000000000001,"5min":1.9419999999999999,"15min":1.6970000000000001},"min":{"1min":0.61099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":34.481999999999999,"5min":34.481999999999999,"15min":34.481999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":7.891,"5min":2.7109999999999999,"15min":2.0760000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":63.896999999999998,"5min":63.896999999999998,"15min":63.896999999999998},"last":1.0189999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.2830000000000004,"5min":2.4329999999999998,"15min":2.218},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":35.222000000000001,"5min":35.222000000000001,"15min":85.819999999999993},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.9650000000000001,"15min":1.9870000000000001},"min":{"1min":0.57099999999999995,"5min":0.46300000000000002,"15min":0.441},"max":{"1min":17.254000000000001,"5min":17.254000000000001,"15min":81.944000000000003},"last":2.1259999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.8450000000000002,"5min":1.9299999999999999,"15min":1.863},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"max":{"1min":36.453000000000003,"5min":36.453000000000003,"15min":36.453000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":4.6429999999999998,"5min":2.3119999999999998,"15min":1.96},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.497},"max":{"1min":35.542000000000002,"5min":35.542000000000002,"15min":35.926000000000002},"last":1.127}]},{"osd":7,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":2.3029999999999999,"15min":1.8759999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":35.277999999999999,"5min":35.277999999999999,"15min":35.277999999999999},"last":2.1539999999999999},{"interface":"front","average":{"1min":3.4350000000000001,"5min":2.089,"15min":1.7869999999999999},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":34.590000000000003,"5min":34.590000000000003,"15min":34.590000000000003},"last":1.262}]}]},{"osd":0,"up_from":14,"seq":60129549513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6020968,"kb_used_data":4388892,"kb_used_omap":36,"kb_used_meta":1632027,"kb_avail":88350872,"statfs":{"total":96636764160,"available":90471292928,"internally_reserved":0,"allocated":4494225408,"data_stored":4485513320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37779,"internal_metadata":1671195757},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.7490000000000001,"5min":6.8129999999999997,"15min":3.8660000000000001},"min":{"1min":0.316,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":23.366,"5min":437.22399999999999,"15min":437.22399999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":2.6309999999999998,"5min":6.7460000000000004,"15min":3.8820000000000001},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.27500000000000002},"max":{"1min":16.048999999999999,"5min":439.05700000000002,"15min":439.05700000000002},"last":1.0349999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.7599999999999998,"5min":1.861,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.314},"max":{"1min":18.789000000000001,"5min":18.789000000000001,"15min":18.789000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":2.891,"5min":1.766,"15min":1.7470000000000001},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.32300000000000001},"max":{"1min":16.006,"5min":16.006,"15min":19.305},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.948,"5min":1.7689999999999999,"15min":2.0550000000000002},"min":{"1min":0.53500000000000003,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":17.547000000000001,"5min":17.547000000000001,"15min":88.554000000000002},"last":1.3400000000000001},{"interface":"front","average":{"1min":3.617,"5min":2.0680000000000001,"15min":2.198},"min":{"1min":0.432,"5min":0.432,"15min":0.35299999999999998},"max":{"1min":23.32,"5min":23.32,"15min":83.847999999999999},"last":1.4810000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.137,"5min":1.752,"15min":1.6180000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":31.427,"5min":31.427,"15min":31.427},"last":1.3959999999999999},{"interface":"front","average":{"1min":3.7789999999999999,"5min":1.956,"15min":1.718},"min":{"1min":0.67100000000000004,"5min":0.46700000000000003,"15min":0.433},"max":{"1min":31.443999999999999,"5min":31.443999999999999,"15min":31.443999999999999},"last":1.286}]},{"osd":5,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6040000000000001,"5min":2.2589999999999999,"15min":1.8300000000000001},"min":{"1min":0.54200000000000004,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":51.655999999999999,"5min":51.655999999999999,"15min":51.655999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":3.6419999999999999,"5min":1.9319999999999999,"15min":1.7030000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":31.558,"5min":31.558,"15min":31.558},"last":1.2649999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.093,"5min":2.3069999999999999,"15min":1.915},"min":{"1min":0.64200000000000002,"5min":0.53000000000000003,"15min":0.46999999999999997},"max":{"1min":51.612000000000002,"5min":51.612000000000002,"15min":51.612000000000002},"last":1.004},{"interface":"front","average":{"1min":3.891,"5min":1.9730000000000001,"15min":1.8009999999999999},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":23.242000000000001,"5min":23.242000000000001,"15min":23.242000000000001},"last":1.4350000000000001}]},{"osd":7,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.8939999999999999,"15min":1.778},"min":{"1min":0.77600000000000002,"5min":0.62,"15min":0.45500000000000002},"max":{"1min":31.504000000000001,"5min":31.504000000000001,"15min":31.504000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":2.7360000000000002,"5min":1.887,"15min":1.7869999999999999},"min":{"1min":0.75900000000000001,"5min":0.59799999999999998,"15min":0.51600000000000001},"max":{"1min":12.771000000000001,"5min":12.771000000000001,"15min":12.771000000000001},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T22:44:29.644 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T22:44:29.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.838+0000 7f0dc2246640 1 Processor -- start 2023-10-14T22:44:29.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.838+0000 7f0dc2246640 1 -- start start 2023-10-14T22:44:29.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.839+0000 7f0dc2246640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0dbc15ca30 0x7f0dbc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dc2246640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f0dbc15ce10 0x7f0dbc069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dc2246640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dbc06b1d0 con 0x7f0dbc0ccb80 2023-10-14T22:44:29.843 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dc2246640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc06a320 con 0x7f0dbc15ca30 2023-10-14T22:44:29.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dc2246640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dbc06a5c0 con 0x7f0dbc15ce10 2023-10-14T22:44:29.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dbb7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f0dbc15ca30 0x7f0dbc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dbbfff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f0dbc0ccb80 0x7f0dbc160780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54320/0 (socket says 172.21.15.64:54320) 2023-10-14T22:44:29.844 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dbbfff640 1 -- 172.21.15.64:0/1538733109 learned_addr learned my addr 172.21.15.64:0/1538733109 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:29.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.840+0000 7f0dbaffd640 1 --2- 172.21.15.64:0/1538733109 >> v2:172.21.15.177:3300/0 conn(0x7f0dbc15ce10 0x7f0dbc069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.841+0000 7f0dbb7fe640 1 -- 172.21.15.64:0/1538733109 >> v2:172.21.15.177:3300/0 conn(0x7f0dbc15ce10 msgr2=0x7f0dbc069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:29.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.841+0000 7f0dbb7fe640 1 --2- 172.21.15.64:0/1538733109 >> v2:172.21.15.177:3300/0 conn(0x7f0dbc15ce10 0x7f0dbc069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.841+0000 7f0dbb7fe640 1 -- 172.21.15.64:0/1538733109 >> v1:172.21.15.64:6789/0 conn(0x7f0dbc0ccb80 legacy=0x7f0dbc160780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.841+0000 7f0dba7fc640 1 -- 172.21.15.64:0/1538733109 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1515786029 0 0) 0x7f0dbc06b1d0 con 0x7f0dbc0ccb80 2023-10-14T22:44:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.841+0000 7f0dbb7fe640 1 -- 172.21.15.64:0/1538733109 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc06a8a0 con 0x7f0dbc15ca30 2023-10-14T22:44:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.842+0000 7f0dbb7fe640 1 --2- 172.21.15.64:0/1538733109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ca30 0x7f0dbc06d3d0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0720b0 tx=0x7f0dac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1939be07d6f33aa server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.842+0000 7f0dba7fc640 1 -- 172.21.15.64:0/1538733109 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031830 con 0x7f0dbc15ca30 2023-10-14T22:44:29.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.842+0000 7f0dba7fc640 1 -- 172.21.15.64:0/1538733109 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac031990 con 0x7f0dbc15ca30 2023-10-14T22:44:29.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.842+0000 7f0dba7fc640 1 -- 172.21.15.64:0/1538733109 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac031d20 con 0x7f0dbc15ca30 2023-10-14T22:44:29.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 -- 172.21.15.64:0/1538733109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ca30 msgr2=0x7f0dbc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1538733109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ca30 0x7f0dbc06d3d0 secure :-1 s=READY pgs=2247 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc0720b0 tx=0x7f0dac02b8d0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 -- 172.21.15.64:0/1538733109 shutdown_connections 2023-10-14T22:44:29.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1538733109 >> v2:172.21.15.177:3300/0 conn(0x7f0dbc15ce10 0x7f0dbc069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1538733109 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ca30 0x7f0dbc06d3d0 unknown :-1 s=CLOSED pgs=2247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 -- 172.21.15.64:0/1538733109 >> 172.21.15.64:0/1538733109 conn(0x7f0dbc0b0890 msgr2=0x7f0dbc0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:29.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 -- 172.21.15.64:0/1538733109 shutdown_connections 2023-10-14T22:44:29.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.843+0000 7f0dc2246640 1 -- 172.21.15.64:0/1538733109 wait complete. 2023-10-14T22:44:29.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.846+0000 7f0dc2246640 1 Processor -- start 2023-10-14T22:44:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.846+0000 7f0dc2246640 1 -- start start 2023-10-14T22:44:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.847+0000 7f0dc2246640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dbc0ccb80 0x7f0dbc0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.847+0000 7f0dc2246640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dbc15ca30 0x7f0dbc15f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.847+0000 7f0dc2246640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ce10 0x7f0dbc1e68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.847+0000 7f0dc2246640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b2470 con 0x7f0dbc15ce10 2023-10-14T22:44:29.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.847+0000 7f0dc2246640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b2750 con 0x7f0dbc15ca30 2023-10-14T22:44:29.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.847+0000 7f0dc2246640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dbc0b2a30 con 0x7f0dbc0ccb80 2023-10-14T22:44:29.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ce10 0x7f0dbc1e68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ce10 0x7f0dbc1e68a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40466/0 (socket says 172.21.15.64:40466) 2023-10-14T22:44:29.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 -- 172.21.15.64:0/1761116072 learned_addr learned my addr 172.21.15.64:0/1761116072 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:29.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbaffd640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dbc15ca30 0x7f0dbc15f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbb7fe640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dbc0ccb80 0x7f0dbc0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 -- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dbc0ccb80 msgr2=0x7f0dbc0b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dbc0ccb80 0x7f0dbc0b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.857 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 -- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dbc15ca30 msgr2=0x7f0dbc15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:29.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dbc15ca30 0x7f0dbc15f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:29.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 -- 172.21.15.64:0/1761116072 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac009400 con 0x7f0dbc15ce10 2023-10-14T22:44:29.858 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbb7fe640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dbc0ccb80 0x7f0dbc0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:29.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.848+0000 7f0dbbfff640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ce10 0x7f0dbc1e68a0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c780 tx=0x7f0db400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:29.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.849+0000 7f0da3fff640 1 -- 172.21.15.64:0/1761116072 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400ce90 con 0x7f0dbc15ce10 2023-10-14T22:44:29.859 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.849+0000 7f0da3fff640 1 -- 172.21.15.64:0/1761116072 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db400a640 con 0x7f0dbc15ce10 2023-10-14T22:44:29.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.849+0000 7f0da3fff640 1 -- 172.21.15.64:0/1761116072 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0db400a9d0 con 0x7f0dbc15ce10 2023-10-14T22:44:29.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.849+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dbc0b2d10 con 0x7f0dbc15ce10 2023-10-14T22:44:29.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.849+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dbc160110 con 0x7f0dbc15ce10 2023-10-14T22:44:29.860 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.850+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dbc0b3a50 con 0x7f0dbc15ce10 2023-10-14T22:44:29.861 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.851+0000 7f0da3fff640 1 -- 172.21.15.64:0/1761116072 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0db400ab30 con 0x7f0dbc15ce10 2023-10-14T22:44:29.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.852+0000 7f0da3fff640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0da806ae70 0x7f0da806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:29.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.852+0000 7f0da3fff640 1 -- 172.21.15.64:0/1761116072 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0db40888e0 con 0x7f0dbc15ce10 2023-10-14T22:44:29.862 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.852+0000 7f0dbb7fe640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0da806ae70 0x7f0da806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:29.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.854+0000 7f0dbb7fe640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0da806ae70 0x7f0da806d330 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0dac036000 tx=0x7f0dac008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:29.863 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:29.856+0000 7f0da3fff640 1 -- 172.21.15.64:0/1761116072 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f0db4053be0 con 0x7f0dbc15ce10 2023-10-14T22:44:30.045 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.043+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0dbc06ae60 con 0x7f0da806ae70 2023-10-14T22:44:30.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.050+0000 7f0da3fff640 1 -- 172.21.15.64:0/1761116072 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48842 (secure 0 0 0) 0x7f0dac045400 con 0x7f0da806ae70 2023-10-14T22:44:30.053 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:30.053 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T22:44:30.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0da806ae70 msgr2=0x7f0da806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0da806ae70 0x7f0da806d330 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f0dac036000 tx=0x7f0dac008030 comp rx=0 tx=0).stop 2023-10-14T22:44:30.055 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ce10 msgr2=0x7f0dbc1e68a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ce10 0x7f0dbc1e68a0 secure :-1 s=READY pgs=2248 cs=0 l=1 rev1=1 crypto rx=0x7f0db400c780 tx=0x7f0db400cc40 comp rx=0 tx=0).stop 2023-10-14T22:44:30.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 shutdown_connections 2023-10-14T22:44:30.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f0da806ae70 0x7f0da806d330 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.056 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f0dbc15ce10 0x7f0dbc1e68a0 unknown :-1 s=CLOSED pgs=2248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f0dbc15ca30 0x7f0dbc15f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 --2- 172.21.15.64:0/1761116072 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f0dbc0ccb80 0x7f0dbc0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.057 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 >> 172.21.15.64:0/1761116072 conn(0x7f0dbc0b0890 msgr2=0x7f0dbc0af820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:30.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 shutdown_connections 2023-10-14T22:44:30.058 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.052+0000 7f0dc2246640 1 -- 172.21.15.64:0/1761116072 wait complete. 2023-10-14T22:44:30.073 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":18507,"stamp":"2023-10-14T22:44:28.839678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":53731792,"kb_used_data":41536624,"kb_used_omap":2929,"kb_used_meta":12192142,"kb_avail":701242928,"statfs":{"total":773094113280,"available":718072758272,"internally_reserved":0,"allocated":42533502976,"data_stored":42444734282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2999830,"internal_metadata":12484753898},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40107094326,"num_objects":-33643,"num_object_clones":0,"num_object_copies":-67286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33643,"num_whiteouts":0,"num_read":-1805263,"num_read_kb":-127868209,"num_write":-7442291,"num_write_kb":-159909719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2311,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.838797"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T22:44:21.932940+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T22:44:21.932940+0000","last_peered":"2023-10-14T22:44:21.932940+0000","last_clean":"2023-10-14T22:44:21.932940+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T22:44:21.932940+0000","last_undegraded":"2023-10-14T22:44:21.932940+0000","last_fullsized":"2023-10-14T22:44:21.932940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129549534,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6873832,"kb_used_data":5345436,"kb_used_omap":333,"kb_used_meta":1528050,"kb_avail":87498008,"statfs":{"total":96636764160,"available":89597960192,"internally_reserved":0,"allocated":5473726464,"data_stored":5461503232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341850,"internal_metadata":1564723366},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.036,"15min":1.0189999999999999},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.949999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.2519999999999998,"5min":1.2,"15min":1.1479999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":25.702999999999999,"5min":25.702999999999999,"15min":25.702999999999999},"last":0.71099999999999997}]},{"osd":1,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":4.1310000000000002,"5min":1.821,"15min":1.4890000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.35799999999999998},"max":{"1min":36.848999999999997,"5min":36.848999999999997,"15min":43.484999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":2.782,"5min":1.48,"15min":1.4259999999999999},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":30.545000000000002,"5min":30.545000000000002,"15min":47.561},"last":1.3049999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":1.498,"15min":1.288},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":8.7270000000000003,"5min":8.7270000000000003,"15min":8.7270000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":3.427,"5min":1.611,"15min":1.3640000000000001},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":28.446000000000002,"5min":28.446000000000002,"15min":28.446000000000002},"last":0.96699999999999997}]},{"osd":3,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":1.4930000000000001,"15min":1.349},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.432},"max":{"1min":12.698,"5min":12.773999999999999,"15min":12.773999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":19.802,"5min":19.802,"15min":19.802},"last":1.034}]},{"osd":4,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.94199999999999995,"15min":0.98299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.3530000000000002,"5min":3.3530000000000002,"15min":5.2649999999999997},"last":1.256},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.087,"15min":1.056},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.373},"max":{"1min":9.7859999999999996,"5min":9.7859999999999996,"15min":9.7859999999999996},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.1240000000000001,"15min":1.028},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":16.484999999999999,"5min":16.484999999999999,"15min":16.484999999999999},"last":1.137},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.0720000000000001,"15min":1.0900000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.36499999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":1.359}]},{"osd":6,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.399,"5min":3.399,"15min":5.1500000000000004},"last":1.484},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.1779999999999999,"15min":1.133},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":9.7390000000000008,"5min":9.7390000000000008,"15min":9.7390000000000008},"last":1.6080000000000001}]}]},{"osd":6,"up_from":14,"seq":60129549534,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6116040,"kb_used_data":4841660,"kb_used_omap":259,"kb_used_meta":1274108,"kb_avail":88255800,"statfs":{"total":96636764160,"available":90373939200,"internally_reserved":0,"allocated":4957859840,"data_stored":4947355685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265300,"internal_metadata":1304687532},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.601,"15min":1.272},"min":{"1min":0.56699999999999995,"5min":0.312,"15min":0.312},"max":{"1min":19.954000000000001,"5min":26.696999999999999,"15min":26.696999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.5489999999999999,"15min":1.246},"min":{"1min":0.435,"5min":0.371,"15min":0.34200000000000003},"max":{"1min":12.029999999999999,"5min":26.645,"15min":26.645},"last":1.0249999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9910000000000001,"5min":1.617,"15min":1.764},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":11.016,"5min":22.859000000000002,"15min":102.004},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.7709999999999999,"5min":1.4630000000000001,"15min":1.7130000000000001},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.35299999999999998},"max":{"1min":9.5570000000000004,"5min":19.837,"15min":106.91800000000001},"last":1.496}]},{"osd":2,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":3.4119999999999999,"5min":1.8740000000000001,"15min":1.5209999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":40.963999999999999,"5min":40.963999999999999,"15min":40.963999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":5.3300000000000001,"5min":2.3109999999999999,"15min":1.6639999999999999},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":44.948,"5min":44.948,"15min":44.948},"last":1.1870000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":5.6790000000000003,"5min":2.391,"15min":1.639},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"max":{"1min":45.972999999999999,"5min":45.972999999999999,"15min":45.972999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.4159999999999999,"15min":1.3009999999999999},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.42799999999999999},"max":{"1min":9.0879999999999992,"5min":18.366,"15min":18.366},"last":1.5389999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.1399999999999999,"15min":1.0669999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":13.894,"5min":13.894,"15min":13.894},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.2,"15min":1.0860000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":11.987,"5min":11.987,"15min":11.987},"last":1.444}]},{"osd":5,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":2.1400000000000001,"15min":1.4219999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":68.251000000000005,"5min":68.251000000000005,"15min":68.251000000000005},"last":1.77},{"interface":"front","average":{"1min":5.0800000000000001,"5min":1.8740000000000001,"15min":1.3799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":67.287999999999997,"5min":67.287999999999997,"15min":67.287999999999997},"last":1.861}]},{"osd":7,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":4.2069999999999999,"5min":1.758,"15min":1.3300000000000001},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":45.869999999999997,"5min":45.869999999999997,"15min":45.869999999999997},"last":1.925},{"interface":"front","average":{"1min":2.3090000000000002,"5min":1.411,"15min":1.2410000000000001},"min":{"1min":0.57699999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":11.73,"5min":11.73,"15min":11.73},"last":1.6699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129549529,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8438912,"kb_used_data":6638964,"kb_used_omap":373,"kb_used_meta":1799562,"kb_avail":85932928,"statfs":{"total":96636764160,"available":87995318272,"internally_reserved":0,"allocated":6798299136,"data_stored":6783428904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":382088,"internal_metadata":1842752376},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.347,"15min":1.1200000000000001},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.30599999999999999},"max":{"1min":18.402000000000001,"5min":24.623999999999999,"15min":24.623999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.484,"15min":1.2190000000000001},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.33800000000000002},"max":{"1min":14.494,"5min":21.686,"15min":21.686},"last":1.1639999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":1.736,"15min":1.7410000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":26.164000000000001,"5min":26.164000000000001,"15min":89.793999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.875,"5min":1.4990000000000001,"15min":1.673},"min":{"1min":0.60799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.6150000000000002,"5min":25.41,"15min":88.759},"last":0.76200000000000001}]},{"osd":2,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.244,"15min":1.2849999999999999},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40899999999999997},"max":{"1min":10.307,"5min":10.307,"15min":18.366},"last":3.3149999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.1599999999999999,"15min":1.194},"min":{"1min":0.57599999999999996,"5min":0.442,"15min":0.35499999999999998},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":17.277000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":1.857,"15min":1.5960000000000001},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":25.887,"5min":25.887,"15min":25.887},"last":0.81799999999999995},{"interface":"front","average":{"1min":2.589,"5min":1.6240000000000001,"15min":1.532},"min":{"1min":0.58699999999999997,"5min":0.51300000000000001,"15min":0.48599999999999999},"max":{"1min":10.269,"5min":10.269,"15min":16.033999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.1259999999999999,"15min":1.0329999999999999},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":18.32,"5min":18.32,"15min":18.32},"last":0.52900000000000003},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.387,"15min":1.1299999999999999},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.35599999999999998},"max":{"1min":35.996000000000002,"5min":35.996000000000002,"15min":35.996000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.1459999999999999,"15min":1.101},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.40799999999999997},"max":{"1min":18.574999999999999,"5min":18.574999999999999,"15min":18.574999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":6.2430000000000003},"last":0.83899999999999997}]},{"osd":7,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.2130000000000001,"15min":1.131},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.443},"max":{"1min":12.337,"5min":12.337,"15min":12.337},"last":0.73599999999999999},{"interface":"front","average":{"1min":3.5750000000000002,"5min":1.4910000000000001,"15min":1.264},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.504},"max":{"1min":42.744999999999997,"5min":42.744999999999997,"15min":42.744999999999997},"last":0.72199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129549535,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6125676,"kb_used_data":4683424,"kb_used_omap":895,"kb_used_meta":1441344,"kb_avail":88246164,"statfs":{"total":96636764160,"available":90364071936,"internally_reserved":0,"allocated":4795826176,"data_stored":4786091761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":917343,"internal_metadata":1475936417},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.52,"15min":1.1379999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.314},"max":{"1min":9.1950000000000003,"5min":29.893000000000001,"15min":29.893000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.74,"5min":1.615,"15min":1.29},"min":{"1min":0.379,"5min":0.371,"15min":0.316},"max":{"1min":9.3900000000000006,"5min":26.690999999999999,"15min":26.690999999999999},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":4.226,"5min":2.1899999999999999,"15min":1.9279999999999999},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":63.497,"5min":63.497,"15min":137.398},"last":0.46999999999999997},{"interface":"front","average":{"1min":3.6070000000000002,"5min":1.929,"15min":1.8029999999999999},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.33600000000000002},"max":{"1min":42.393000000000001,"5min":42.393000000000001,"15min":142.18299999999999},"last":1.028}]},{"osd":2,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.468,"5min":1.6930000000000001,"15min":1.3879999999999999},"min":{"1min":0.60799999999999998,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":16.384,"5min":21.434000000000001,"15min":21.434000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":2.4119999999999999,"5min":1.8420000000000001,"15min":1.4430000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":13.545,"5min":24.052,"15min":24.052},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.7549999999999999,"5min":1.8759999999999999,"15min":2.1339999999999999},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":19.736999999999998,"5min":22.067,"15min":163.07900000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.1699999999999999,"5min":1.6799999999999999,"15min":2.0529999999999999},"min":{"1min":0.56200000000000006,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.422000000000001,"5min":21.585000000000001,"15min":161.60400000000001},"last":2.2930000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":1.222,"15min":1.044},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":11.791,"5min":11.791,"15min":11.791},"last":0.873},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.4950000000000001,"15min":1.224},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":9.4770000000000003,"5min":13.093,"15min":13.093},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.212,"15min":1.129},"min":{"1min":0.443,"5min":0.443,"15min":0.39200000000000002},"max":{"1min":16.257999999999999,"5min":16.257999999999999,"15min":16.257999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":2.1930000000000001,"5min":1.4059999999999999,"15min":1.175},"min":{"1min":0.60699999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.500999999999999,"5min":13.500999999999999,"15min":13.500999999999999},"last":1.105}]},{"osd":7,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.3049999999999999,"15min":1.222},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":9.4339999999999993,"5min":9.4339999999999993,"15min":9.4339999999999993},"last":0.65200000000000002},{"interface":"front","average":{"1min":2.9489999999999998,"5min":1.585,"15min":1.286},"min":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":27.295000000000002,"5min":27.295000000000002,"15min":27.295000000000002},"last":0.89400000000000002}]}]},{"osd":3,"up_from":14,"seq":60129549499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7040136,"kb_used_data":5789308,"kb_used_omap":507,"kb_used_meta":1250308,"kb_avail":87331704,"statfs":{"total":96636764160,"available":89427664896,"internally_reserved":0,"allocated":5928251392,"data_stored":5916113165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":519900,"internal_metadata":1280315684},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.5279999999999996,"5min":2.073,"15min":1.694},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":31.922999999999998,"5min":31.922999999999998,"15min":31.922999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":4.5609999999999999,"5min":2.1699999999999999,"15min":1.823},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":37.823999999999998,"5min":37.823999999999998,"15min":37.823999999999998},"last":0.999}]},{"osd":1,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4180000000000001,"5min":15.904999999999999,"15min":7.1029999999999998},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":17.184999999999999,"5min":1547.634,"15min":1547.634},"last":0.70599999999999996},{"interface":"front","average":{"1min":4.133,"5min":16.254000000000001,"15min":7.258},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":31.963999999999999,"5min":1552.8879999999999,"15min":1552.8879999999999},"last":1.556}]},{"osd":2,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.2489999999999997,"5min":1.97,"15min":1.857},"min":{"1min":0.60699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":28.045000000000002,"5min":28.045000000000002,"15min":28.045000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":3.415,"5min":1.99,"15min":1.8300000000000001},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":18.495999999999999,"5min":18.495999999999999,"15min":18.495999999999999},"last":1.028}]},{"osd":4,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":1.762,"15min":1.661},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.134999999999998,"5min":36.134999999999998,"15min":36.134999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":3.4009999999999998,"5min":2.012,"15min":1.7549999999999999},"min":{"1min":0.77500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":18.535,"5min":18.535,"15min":18.535},"last":1.4339999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.3029999999999999,"5min":1.893,"15min":1.724},"min":{"1min":0.57599999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":36.192,"5min":36.192,"15min":36.192},"last":1.208},{"interface":"front","average":{"1min":3.677,"5min":2.1800000000000002,"15min":1.8640000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":31.771000000000001,"5min":31.771000000000001,"15min":31.771000000000001},"last":1.6200000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":1.9510000000000001,"15min":1.8029999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":21.146999999999998,"5min":21.146999999999998,"15min":21.146999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":3.5089999999999999,"5min":2.1019999999999999,"15min":1.8979999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":34.142000000000003,"5min":34.142000000000003,"15min":34.142000000000003},"last":1.177}]},{"osd":7,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.1930000000000001,"15min":1.901},"min":{"1min":0.70699999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":32.061999999999998,"5min":32.061999999999998,"15min":32.061999999999998},"last":1.3},{"interface":"front","average":{"1min":3.375,"5min":1.79,"15min":1.772},"min":{"1min":0.66000000000000003,"5min":0.59599999999999997,"15min":0.56299999999999994},"max":{"1min":17.132000000000001,"5min":17.132000000000001,"15min":17.132000000000001},"last":1.3919999999999999}]}]},{"osd":2,"up_from":14,"seq":60129549505,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7329028,"kb_used_data":5599608,"kb_used_omap":91,"kb_used_meta":1729316,"kb_avail":87042812,"statfs":{"total":96636764160,"available":89131839488,"internally_reserved":0,"allocated":5733998592,"data_stored":5722195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93223,"internal_metadata":1770820569},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.46,"15min":1.542},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":12.6,"5min":12.6,"15min":12.82},"last":0.94599999999999995},{"interface":"front","average":{"1min":2.754,"5min":1.754,"15min":1.7090000000000001},"min":{"1min":0.51500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":20.664000000000001,"5min":20.664000000000001,"15min":20.664000000000001},"last":0.77900000000000003}]},{"osd":1,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.8530000000000002,"5min":2.0859999999999999,"15min":2.4409999999999998},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.33400000000000002},"max":{"1min":37.893000000000001,"5min":37.893000000000001,"15min":126.84099999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":3.2890000000000001,"5min":2.028,"15min":2.5049999999999999},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":25.445,"5min":25.445,"15min":129.59100000000001},"last":1.208}]},{"osd":3,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.744,"15min":1.708},"min":{"1min":0.46200000000000002,"5min":0.36599999999999999,"15min":0.32200000000000001},"max":{"1min":5.0659999999999998,"5min":5.1379999999999999,"15min":6.7460000000000004},"last":0.88100000000000001},{"interface":"front","average":{"1min":2.4319999999999999,"5min":1.9079999999999999,"15min":1.7310000000000001},"min":{"1min":0.65100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":1.2669999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.863,"5min":1.7609999999999999,"15min":1.6899999999999999},"min":{"1min":0.63,"5min":0.501,"15min":0.46000000000000002},"max":{"1min":20.613,"5min":20.613,"15min":20.613},"last":1.071},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.659,"15min":1.528},"min":{"1min":0.51800000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"max":{"1min":5.1950000000000003,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.1100000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":1.6339999999999999,"15min":1.6499999999999999},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.47599999999999998},"max":{"1min":12.507,"5min":12.507,"15min":12.507},"last":1.8149999999999999},{"interface":"front","average":{"1min":2.3719999999999999,"5min":1.7070000000000001,"15min":1.71},"min":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.48899999999999999},"max":{"1min":11.375,"5min":11.375,"15min":11.375},"last":1.4430000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":1.792,"15min":1.643},"min":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":14.448,"5min":14.448,"15min":14.448},"last":1.5900000000000001},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.6990000000000001,"15min":1.679},"min":{"1min":0.67000000000000004,"5min":0.57199999999999995,"15min":0.53700000000000003},"max":{"1min":12.631,"5min":12.631,"15min":12.631},"last":1.893}]},{"osd":7,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.569,"5min":2.0110000000000001,"15min":1.8700000000000001},"min":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.54800000000000004},"max":{"1min":30.634,"5min":30.634,"15min":30.634},"last":1.383},{"interface":"front","average":{"1min":3.2869999999999999,"5min":2.0649999999999999,"15min":1.819},"min":{"1min":0.90800000000000003,"5min":0.53800000000000003,"15min":0.50800000000000001},"max":{"1min":27.34,"5min":27.34,"15min":27.34},"last":1.667}]}]},{"osd":1,"up_from":14,"seq":60129549517,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5787200,"kb_used_data":4249332,"kb_used_omap":431,"kb_used_meta":1537424,"kb_avail":88584640,"statfs":{"total":96636764160,"available":90710671360,"internally_reserved":0,"allocated":4351315968,"data_stored":4342532980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":442347,"internal_metadata":1574322197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.3399999999999999,"5min":1.923,"15min":1.5149999999999999},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":34.283999999999999,"5min":34.283999999999999,"15min":34.283999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":4.1870000000000003,"5min":1.97,"15min":1.639},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":35.313000000000002,"5min":35.313000000000002,"15min":35.313000000000002},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":2.1480000000000001,"15min":1.956},"min":{"1min":0.53000000000000003,"5min":0.32900000000000001,"15min":0.28000000000000003},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":54.386000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":6.2590000000000003,"5min":2.4740000000000002,"15min":2.1560000000000001},"min":{"1min":0.497,"5min":0.38500000000000001,"15min":0.32500000000000001},"max":{"1min":34.396000000000001,"5min":34.396000000000001,"15min":52.030000000000001},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.8869999999999996,"5min":2.419,"15min":1.9570000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.41499999999999998},"max":{"1min":34.362000000000002,"5min":34.362000000000002,"15min":34.362000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":5.2469999999999999,"5min":2.4390000000000001,"15min":1.913},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40200000000000002},"max":{"1min":35.412999999999997,"5min":35.412999999999997,"15min":35.412999999999997},"last":0.90700000000000003}]},{"osd":4,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.3260000000000001,"5min":1.9419999999999999,"15min":1.6970000000000001},"min":{"1min":0.61099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":34.481999999999999,"5min":34.481999999999999,"15min":34.481999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":7.891,"5min":2.7109999999999999,"15min":2.0760000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":63.896999999999998,"5min":63.896999999999998,"15min":63.896999999999998},"last":1.0189999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.2830000000000004,"5min":2.4329999999999998,"15min":2.218},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":35.222000000000001,"5min":35.222000000000001,"15min":85.819999999999993},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.9650000000000001,"15min":1.9870000000000001},"min":{"1min":0.57099999999999995,"5min":0.46300000000000002,"15min":0.441},"max":{"1min":17.254000000000001,"5min":17.254000000000001,"15min":81.944000000000003},"last":2.1259999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.8450000000000002,"5min":1.9299999999999999,"15min":1.863},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"max":{"1min":36.453000000000003,"5min":36.453000000000003,"15min":36.453000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":4.6429999999999998,"5min":2.3119999999999998,"15min":1.96},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.497},"max":{"1min":35.542000000000002,"5min":35.542000000000002,"15min":35.926000000000002},"last":1.127}]},{"osd":7,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":2.3029999999999999,"15min":1.8759999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":35.277999999999999,"5min":35.277999999999999,"15min":35.277999999999999},"last":2.1539999999999999},{"interface":"front","average":{"1min":3.4350000000000001,"5min":2.089,"15min":1.7869999999999999},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":34.590000000000003,"5min":34.590000000000003,"15min":34.590000000000003},"last":1.262}]}]},{"osd":0,"up_from":14,"seq":60129549513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6020968,"kb_used_data":4388892,"kb_used_omap":36,"kb_used_meta":1632027,"kb_avail":88350872,"statfs":{"total":96636764160,"available":90471292928,"internally_reserved":0,"allocated":4494225408,"data_stored":4485513320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37779,"internal_metadata":1671195757},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.7490000000000001,"5min":6.8129999999999997,"15min":3.8660000000000001},"min":{"1min":0.316,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":23.366,"5min":437.22399999999999,"15min":437.22399999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":2.6309999999999998,"5min":6.7460000000000004,"15min":3.8820000000000001},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.27500000000000002},"max":{"1min":16.048999999999999,"5min":439.05700000000002,"15min":439.05700000000002},"last":1.0349999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.7599999999999998,"5min":1.861,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.314},"max":{"1min":18.789000000000001,"5min":18.789000000000001,"15min":18.789000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":2.891,"5min":1.766,"15min":1.7470000000000001},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.32300000000000001},"max":{"1min":16.006,"5min":16.006,"15min":19.305},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.948,"5min":1.7689999999999999,"15min":2.0550000000000002},"min":{"1min":0.53500000000000003,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":17.547000000000001,"5min":17.547000000000001,"15min":88.554000000000002},"last":1.3400000000000001},{"interface":"front","average":{"1min":3.617,"5min":2.0680000000000001,"15min":2.198},"min":{"1min":0.432,"5min":0.432,"15min":0.35299999999999998},"max":{"1min":23.32,"5min":23.32,"15min":83.847999999999999},"last":1.4810000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.137,"5min":1.752,"15min":1.6180000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":31.427,"5min":31.427,"15min":31.427},"last":1.3959999999999999},{"interface":"front","average":{"1min":3.7789999999999999,"5min":1.956,"15min":1.718},"min":{"1min":0.67100000000000004,"5min":0.46700000000000003,"15min":0.433},"max":{"1min":31.443999999999999,"5min":31.443999999999999,"15min":31.443999999999999},"last":1.286}]},{"osd":5,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6040000000000001,"5min":2.2589999999999999,"15min":1.8300000000000001},"min":{"1min":0.54200000000000004,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":51.655999999999999,"5min":51.655999999999999,"15min":51.655999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":3.6419999999999999,"5min":1.9319999999999999,"15min":1.7030000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":31.558,"5min":31.558,"15min":31.558},"last":1.2649999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.093,"5min":2.3069999999999999,"15min":1.915},"min":{"1min":0.64200000000000002,"5min":0.53000000000000003,"15min":0.46999999999999997},"max":{"1min":51.612000000000002,"5min":51.612000000000002,"15min":51.612000000000002},"last":1.004},{"interface":"front","average":{"1min":3.891,"5min":1.9730000000000001,"15min":1.8009999999999999},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":23.242000000000001,"5min":23.242000000000001,"15min":23.242000000000001},"last":1.4350000000000001}]},{"osd":7,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.8939999999999999,"15min":1.778},"min":{"1min":0.77600000000000002,"5min":0.62,"15min":0.45500000000000002},"max":{"1min":31.504000000000001,"5min":31.504000000000001,"15min":31.504000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":2.7360000000000002,"5min":1.887,"15min":1.7869999999999999},"min":{"1min":0.75900000000000001,"5min":0.59799999999999998,"15min":0.51600000000000001},"max":{"1min":12.771000000000001,"5min":12.771000000000001,"15min":12.771000000000001},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T22:44:30.075 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-14T22:44:30.075 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T22:44:30.282 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.280+0000 7f095611a640 1 Processor -- start 2023-10-14T22:44:30.283 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.280+0000 7f095611a640 1 -- start start 2023-10-14T22:44:30.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f095611a640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f09500d0e20 0x7f09500d3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f095611a640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f095006aff0 0x7f095006b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f095611a640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09500cd3e0 con 0x7f095015cb50 2023-10-14T22:44:30.285 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f095611a640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095006b940 con 0x7f09500d0e20 2023-10-14T22:44:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f095611a640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f095015cf30 con 0x7f095006aff0 2023-10-14T22:44:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f0954917640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f09500d0e20 0x7f09500d3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.286 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f0954917640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f09500d0e20 0x7f09500d3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40480/0 (socket says 172.21.15.64:40480) 2023-10-14T22:44:30.289 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.282+0000 7f0954917640 1 -- 172.21.15.64:0/184255813 learned_addr learned my addr 172.21.15.64:0/184255813 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:30.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.283+0000 7f0955919640 1 --2- 172.21.15.64:0/184255813 >> v2:172.21.15.177:3300/0 conn(0x7f095006aff0 0x7f095006b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.283+0000 7f0954917640 1 -- 172.21.15.64:0/184255813 >> v2:172.21.15.177:3300/0 conn(0x7f095006aff0 msgr2=0x7f095006b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:30.293 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.283+0000 7f0954917640 1 --2- 172.21.15.64:0/184255813 >> v2:172.21.15.177:3300/0 conn(0x7f095006aff0 0x7f095006b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.283+0000 7f0954917640 1 -- 172.21.15.64:0/184255813 >> v1:172.21.15.177:6789/0 conn(0x7f095015cb50 legacy=0x7f09500ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:30.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.283+0000 7f0954917640 1 -- 172.21.15.64:0/184255813 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500d1280 con 0x7f09500d0e20 2023-10-14T22:44:30.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.284+0000 7f0954917640 1 --2- 172.21.15.64:0/184255813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09500d0e20 0x7f09500d3310 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f095008cad0 tx=0x7f094402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edf1e8fb12298fc3 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:30.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f094ffff640 1 -- 172.21.15.64:0/184255813 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944031870 con 0x7f09500d0e20 2023-10-14T22:44:30.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f094ffff640 1 -- 172.21.15.64:0/184255813 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09440319d0 con 0x7f09500d0e20 2023-10-14T22:44:30.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f094ffff640 1 -- 172.21.15.64:0/184255813 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944031d60 con 0x7f09500d0e20 2023-10-14T22:44:30.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 -- 172.21.15.64:0/184255813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09500d0e20 msgr2=0x7f09500d3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.295 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 --2- 172.21.15.64:0/184255813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09500d0e20 0x7f09500d3310 secure :-1 s=READY pgs=2249 cs=0 l=1 rev1=1 crypto rx=0x7f095008cad0 tx=0x7f094402b910 comp rx=0 tx=0).stop 2023-10-14T22:44:30.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 -- 172.21.15.64:0/184255813 shutdown_connections 2023-10-14T22:44:30.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 --2- 172.21.15.64:0/184255813 >> v2:172.21.15.177:3300/0 conn(0x7f095006aff0 0x7f095006b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 --2- 172.21.15.64:0/184255813 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f09500d0e20 0x7f09500d3310 unknown :-1 s=CLOSED pgs=2249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 -- 172.21.15.64:0/184255813 >> 172.21.15.64:0/184255813 conn(0x7f0950089f70 msgr2=0x7f09500d2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 -- 172.21.15.64:0/184255813 shutdown_connections 2023-10-14T22:44:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.285+0000 7f095611a640 1 -- 172.21.15.64:0/184255813 wait complete. 2023-10-14T22:44:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.287+0000 7f095611a640 1 Processor -- start 2023-10-14T22:44:30.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.287+0000 7f095611a640 1 -- start start 2023-10-14T22:44:30.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.288+0000 7f095611a640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095006aff0 0x7f095014ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.288+0000 7f095611a640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09500d0e20 0x7f095015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.288+0000 7f095611a640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f095015cb50 0x7f09500cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.288+0000 7f095611a640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f095014f250 con 0x7f095006aff0 2023-10-14T22:44:30.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.288+0000 7f095611a640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0950159230 con 0x7f095015cb50 2023-10-14T22:44:30.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.288+0000 7f095611a640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f095015d230 con 0x7f09500d0e20 2023-10-14T22:44:30.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.288+0000 7f0955118640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095006aff0 0x7f095014ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095006aff0 0x7f095014ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40482/0 (socket says 172.21.15.64:40482) 2023-10-14T22:44:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 -- 172.21.15.64:0/3085852720 learned_addr learned my addr 172.21.15.64:0/3085852720 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955919640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f095015cb50 0x7f09500cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 -- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09500d0e20 msgr2=0x7f095015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0954917640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09500d0e20 0x7f095015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09500d0e20 0x7f095015dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 -- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f095015cb50 msgr2=0x7f09500cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f095015cb50 0x7f09500cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 -- 172.21.15.64:0/3085852720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440094d0 con 0x7f095006aff0 2023-10-14T22:44:30.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.289+0000 7f0955118640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095006aff0 0x7f095014ed10 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f094000c7c0 tx=0x7f094000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:30.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.290+0000 7f094dffb640 1 -- 172.21.15.64:0/3085852720 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094000aa50 con 0x7f095006aff0 2023-10-14T22:44:30.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.290+0000 7f094dffb640 1 -- 172.21.15.64:0/3085852720 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094000abb0 con 0x7f095006aff0 2023-10-14T22:44:30.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.290+0000 7f094dffb640 1 -- 172.21.15.64:0/3085852720 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0940012420 con 0x7f095006aff0 2023-10-14T22:44:30.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.290+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f095015d510 con 0x7f095006aff0 2023-10-14T22:44:30.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.290+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f095015dad0 con 0x7f095006aff0 2023-10-14T22:44:30.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.291+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095004e9b0 con 0x7f095006aff0 2023-10-14T22:44:30.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.292+0000 7f094dffb640 1 -- 172.21.15.64:0/3085852720 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f0940012580 con 0x7f095006aff0 2023-10-14T22:44:30.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.293+0000 7f094dffb640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f093c06ae70 0x7f093c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.293+0000 7f094dffb640 1 -- 172.21.15.64:0/3085852720 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0940089680 con 0x7f095006aff0 2023-10-14T22:44:30.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.294+0000 7f0954917640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f093c06ae70 0x7f093c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.295+0000 7f0954917640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f093c06ae70 0x7f093c06d330 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0944036000 tx=0x7f094403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:30.306 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.297+0000 7f094dffb640 1 -- 172.21.15.64:0/3085852720 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f09400548f0 con 0x7f095006aff0 2023-10-14T22:44:30.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.486+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f095015d3a0 con 0x7f093c06ae70 2023-10-14T22:44:30.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.493+0000 7f094dffb640 1 -- 172.21.15.64:0/3085852720 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48842 (secure 0 0 0) 0x7f095015d3a0 con 0x7f093c06ae70 2023-10-14T22:44:30.498 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:30.499 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T22:44:30.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f093c06ae70 msgr2=0x7f093c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f093c06ae70 0x7f093c06d330 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f0944036000 tx=0x7f094403c040 comp rx=0 tx=0).stop 2023-10-14T22:44:30.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095006aff0 msgr2=0x7f095014ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095006aff0 0x7f095014ed10 secure :-1 s=READY pgs=2250 cs=0 l=1 rev1=1 crypto rx=0x7f094000c7c0 tx=0x7f094000cc80 comp rx=0 tx=0).stop 2023-10-14T22:44:30.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 shutdown_connections 2023-10-14T22:44:30.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f093c06ae70 0x7f093c06d330 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f095015cb50 0x7f09500cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.501 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f09500d0e20 0x7f095015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 --2- 172.21.15.64:0/3085852720 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f095006aff0 0x7f095014ed10 unknown :-1 s=CLOSED pgs=2250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 >> 172.21.15.64:0/3085852720 conn(0x7f0950089f70 msgr2=0x7f09500b03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:30.502 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 shutdown_connections 2023-10-14T22:44:30.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.496+0000 7f095611a640 1 -- 172.21.15.64:0/3085852720 wait complete. 2023-10-14T22:44:30.517 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":18507,"stamp":"2023-10-14T22:44:28.839678+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":53731792,"kb_used_data":41536624,"kb_used_omap":2929,"kb_used_meta":12192142,"kb_avail":701242928,"statfs":{"total":773094113280,"available":718072758272,"internally_reserved":0,"allocated":42533502976,"data_stored":42444734282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2999830,"internal_metadata":12484753898},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,2,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-40107094326,"num_objects":-33643,"num_object_clones":0,"num_object_copies":-67286,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-33643,"num_whiteouts":0,"num_read":-1805263,"num_read_kb":-127868209,"num_write":-7442291,"num_write_kb":-159909719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-2311,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.838797"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":492,"reported_epoch":44,"state":"active+clean","last_fresh":"2023-10-14T22:44:21.932940+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T22:44:21.932940+0000","last_peered":"2023-10-14T22:44:21.932940+0000","last_clean":"2023-10-14T22:44:21.932940+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T22:44:21.932940+0000","last_undegraded":"2023-10-14T22:44:21.932940+0000","last_fullsized":"2023-10-14T22:44:21.932940+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129549534,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6873832,"kb_used_data":5345436,"kb_used_omap":333,"kb_used_meta":1528050,"kb_avail":87498008,"statfs":{"total":96636764160,"available":89597960192,"internally_reserved":0,"allocated":5473726464,"data_stored":5461503232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341850,"internal_metadata":1564723366},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.036,"15min":1.0189999999999999},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.949999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":2.2519999999999998,"5min":1.2,"15min":1.1479999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":25.702999999999999,"5min":25.702999999999999,"15min":25.702999999999999},"last":0.71099999999999997}]},{"osd":1,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":4.1310000000000002,"5min":1.821,"15min":1.4890000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.35799999999999998},"max":{"1min":36.848999999999997,"5min":36.848999999999997,"15min":43.484999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":2.782,"5min":1.48,"15min":1.4259999999999999},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":30.545000000000002,"5min":30.545000000000002,"15min":47.561},"last":1.3049999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":1.498,"15min":1.288},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":8.7270000000000003,"5min":8.7270000000000003,"15min":8.7270000000000003},"last":0.93200000000000005},{"interface":"front","average":{"1min":3.427,"5min":1.611,"15min":1.3640000000000001},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":28.446000000000002,"5min":28.446000000000002,"15min":28.446000000000002},"last":0.96699999999999997}]},{"osd":3,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":1.4930000000000001,"15min":1.349},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.432},"max":{"1min":12.698,"5min":12.773999999999999,"15min":12.773999999999999},"last":1.2090000000000001},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":19.802,"5min":19.802,"15min":19.802},"last":1.034}]},{"osd":4,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.94199999999999995,"15min":0.98299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.3530000000000002,"5min":3.3530000000000002,"15min":5.2649999999999997},"last":1.256},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.087,"15min":1.056},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.373},"max":{"1min":9.7859999999999996,"5min":9.7859999999999996,"15min":9.7859999999999996},"last":1.4119999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.1240000000000001,"15min":1.028},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":16.484999999999999,"5min":16.484999999999999,"15min":16.484999999999999},"last":1.137},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.0720000000000001,"15min":1.0900000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.36499999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":1.359}]},{"osd":6,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.399,"5min":3.399,"15min":5.1500000000000004},"last":1.484},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.1779999999999999,"15min":1.133},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":9.7390000000000008,"5min":9.7390000000000008,"15min":9.7390000000000008},"last":1.6080000000000001}]}]},{"osd":6,"up_from":14,"seq":60129549534,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6116040,"kb_used_data":4841660,"kb_used_omap":259,"kb_used_meta":1274108,"kb_avail":88255800,"statfs":{"total":96636764160,"available":90373939200,"internally_reserved":0,"allocated":4957859840,"data_stored":4947355685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265300,"internal_metadata":1304687532},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.601,"15min":1.272},"min":{"1min":0.56699999999999995,"5min":0.312,"15min":0.312},"max":{"1min":19.954000000000001,"5min":26.696999999999999,"15min":26.696999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.5489999999999999,"15min":1.246},"min":{"1min":0.435,"5min":0.371,"15min":0.34200000000000003},"max":{"1min":12.029999999999999,"5min":26.645,"15min":26.645},"last":1.0249999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9910000000000001,"5min":1.617,"15min":1.764},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":11.016,"5min":22.859000000000002,"15min":102.004},"last":0.84099999999999997},{"interface":"front","average":{"1min":1.7709999999999999,"5min":1.4630000000000001,"15min":1.7130000000000001},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.35299999999999998},"max":{"1min":9.5570000000000004,"5min":19.837,"15min":106.91800000000001},"last":1.496}]},{"osd":2,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":3.4119999999999999,"5min":1.8740000000000001,"15min":1.5209999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":40.963999999999999,"5min":40.963999999999999,"15min":40.963999999999999},"last":1.3859999999999999},{"interface":"front","average":{"1min":5.3300000000000001,"5min":2.3109999999999999,"15min":1.6639999999999999},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":44.948,"5min":44.948,"15min":44.948},"last":1.1870000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":5.6790000000000003,"5min":2.391,"15min":1.639},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"max":{"1min":45.972999999999999,"5min":45.972999999999999,"15min":45.972999999999999},"last":1.5940000000000001},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.4159999999999999,"15min":1.3009999999999999},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.42799999999999999},"max":{"1min":9.0879999999999992,"5min":18.366,"15min":18.366},"last":1.5389999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.1399999999999999,"15min":1.0669999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":13.894,"5min":13.894,"15min":13.894},"last":1.9710000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.2,"15min":1.0860000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":11.987,"5min":11.987,"15min":11.987},"last":1.444}]},{"osd":5,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":2.1400000000000001,"15min":1.4219999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":68.251000000000005,"5min":68.251000000000005,"15min":68.251000000000005},"last":1.77},{"interface":"front","average":{"1min":5.0800000000000001,"5min":1.8740000000000001,"15min":1.3799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":67.287999999999997,"5min":67.287999999999997,"15min":67.287999999999997},"last":1.861}]},{"osd":7,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":4.2069999999999999,"5min":1.758,"15min":1.3300000000000001},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":45.869999999999997,"5min":45.869999999999997,"15min":45.869999999999997},"last":1.925},{"interface":"front","average":{"1min":2.3090000000000002,"5min":1.411,"15min":1.2410000000000001},"min":{"1min":0.57699999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":11.73,"5min":11.73,"15min":11.73},"last":1.6699999999999999}]}]},{"osd":5,"up_from":14,"seq":60129549529,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8438912,"kb_used_data":6638964,"kb_used_omap":373,"kb_used_meta":1799562,"kb_avail":85932928,"statfs":{"total":96636764160,"available":87995318272,"internally_reserved":0,"allocated":6798299136,"data_stored":6783428904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":382088,"internal_metadata":1842752376},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.347,"15min":1.1200000000000001},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.30599999999999999},"max":{"1min":18.402000000000001,"5min":24.623999999999999,"15min":24.623999999999999},"last":0.46300000000000002},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.484,"15min":1.2190000000000001},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.33800000000000002},"max":{"1min":14.494,"5min":21.686,"15min":21.686},"last":1.1639999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":1.736,"15min":1.7410000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":26.164000000000001,"5min":26.164000000000001,"15min":89.793999999999997},"last":0.65300000000000002},{"interface":"front","average":{"1min":1.875,"5min":1.4990000000000001,"15min":1.673},"min":{"1min":0.60799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.6150000000000002,"5min":25.41,"15min":88.759},"last":0.76200000000000001}]},{"osd":2,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.244,"15min":1.2849999999999999},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40899999999999997},"max":{"1min":10.307,"5min":10.307,"15min":18.366},"last":3.3149999999999999},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.1599999999999999,"15min":1.194},"min":{"1min":0.57599999999999996,"5min":0.442,"15min":0.35499999999999998},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":17.277000000000001},"last":0.95699999999999996}]},{"osd":3,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":1.857,"15min":1.5960000000000001},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":25.887,"5min":25.887,"15min":25.887},"last":0.81799999999999995},{"interface":"front","average":{"1min":2.589,"5min":1.6240000000000001,"15min":1.532},"min":{"1min":0.58699999999999997,"5min":0.51300000000000001,"15min":0.48599999999999999},"max":{"1min":10.269,"5min":10.269,"15min":16.033999999999999},"last":0.79800000000000004}]},{"osd":4,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.1259999999999999,"15min":1.0329999999999999},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":18.32,"5min":18.32,"15min":18.32},"last":0.52900000000000003},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.387,"15min":1.1299999999999999},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.35599999999999998},"max":{"1min":35.996000000000002,"5min":35.996000000000002,"15min":35.996000000000002},"last":0.69499999999999995}]},{"osd":6,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.1459999999999999,"15min":1.101},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.40799999999999997},"max":{"1min":18.574999999999999,"5min":18.574999999999999,"15min":18.574999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":6.2430000000000003},"last":0.83899999999999997}]},{"osd":7,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.2130000000000001,"15min":1.131},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.443},"max":{"1min":12.337,"5min":12.337,"15min":12.337},"last":0.73599999999999999},{"interface":"front","average":{"1min":3.5750000000000002,"5min":1.4910000000000001,"15min":1.264},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.504},"max":{"1min":42.744999999999997,"5min":42.744999999999997,"15min":42.744999999999997},"last":0.72199999999999998}]}]},{"osd":4,"up_from":14,"seq":60129549535,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6125676,"kb_used_data":4683424,"kb_used_omap":895,"kb_used_meta":1441344,"kb_avail":88246164,"statfs":{"total":96636764160,"available":90364071936,"internally_reserved":0,"allocated":4795826176,"data_stored":4786091761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":917343,"internal_metadata":1475936417},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.52,"15min":1.1379999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.314},"max":{"1min":9.1950000000000003,"5min":29.893000000000001,"15min":29.893000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.74,"5min":1.615,"15min":1.29},"min":{"1min":0.379,"5min":0.371,"15min":0.316},"max":{"1min":9.3900000000000006,"5min":26.690999999999999,"15min":26.690999999999999},"last":0.39200000000000002}]},{"osd":1,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":4.226,"5min":2.1899999999999999,"15min":1.9279999999999999},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":63.497,"5min":63.497,"15min":137.398},"last":0.46999999999999997},{"interface":"front","average":{"1min":3.6070000000000002,"5min":1.929,"15min":1.8029999999999999},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.33600000000000002},"max":{"1min":42.393000000000001,"5min":42.393000000000001,"15min":142.18299999999999},"last":1.028}]},{"osd":2,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.468,"5min":1.6930000000000001,"15min":1.3879999999999999},"min":{"1min":0.60799999999999998,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":16.384,"5min":21.434000000000001,"15min":21.434000000000001},"last":0.85199999999999998},{"interface":"front","average":{"1min":2.4119999999999999,"5min":1.8420000000000001,"15min":1.4430000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":13.545,"5min":24.052,"15min":24.052},"last":0.91300000000000003}]},{"osd":3,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.7549999999999999,"5min":1.8759999999999999,"15min":2.1339999999999999},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":19.736999999999998,"5min":22.067,"15min":163.07900000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":2.1699999999999999,"5min":1.6799999999999999,"15min":2.0529999999999999},"min":{"1min":0.56200000000000006,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.422000000000001,"5min":21.585000000000001,"15min":161.60400000000001},"last":2.2930000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":1.222,"15min":1.044},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":11.791,"5min":11.791,"15min":11.791},"last":0.873},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.4950000000000001,"15min":1.224},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":9.4770000000000003,"5min":13.093,"15min":13.093},"last":0.76200000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.212,"15min":1.129},"min":{"1min":0.443,"5min":0.443,"15min":0.39200000000000002},"max":{"1min":16.257999999999999,"5min":16.257999999999999,"15min":16.257999999999999},"last":1.0029999999999999},{"interface":"front","average":{"1min":2.1930000000000001,"5min":1.4059999999999999,"15min":1.175},"min":{"1min":0.60699999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.500999999999999,"5min":13.500999999999999,"15min":13.500999999999999},"last":1.105}]},{"osd":7,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.3049999999999999,"15min":1.222},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":9.4339999999999993,"5min":9.4339999999999993,"15min":9.4339999999999993},"last":0.65200000000000002},{"interface":"front","average":{"1min":2.9489999999999998,"5min":1.585,"15min":1.286},"min":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":27.295000000000002,"5min":27.295000000000002,"15min":27.295000000000002},"last":0.89400000000000002}]}]},{"osd":3,"up_from":14,"seq":60129549499,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7040136,"kb_used_data":5789308,"kb_used_omap":507,"kb_used_meta":1250308,"kb_avail":87331704,"statfs":{"total":96636764160,"available":89427664896,"internally_reserved":0,"allocated":5928251392,"data_stored":5916113165,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":519900,"internal_metadata":1280315684},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.5279999999999996,"5min":2.073,"15min":1.694},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":31.922999999999998,"5min":31.922999999999998,"15min":31.922999999999998},"last":0.81200000000000006},{"interface":"front","average":{"1min":4.5609999999999999,"5min":2.1699999999999999,"15min":1.823},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":37.823999999999998,"5min":37.823999999999998,"15min":37.823999999999998},"last":0.999}]},{"osd":1,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4180000000000001,"5min":15.904999999999999,"15min":7.1029999999999998},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":17.184999999999999,"5min":1547.634,"15min":1547.634},"last":0.70599999999999996},{"interface":"front","average":{"1min":4.133,"5min":16.254000000000001,"15min":7.258},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":31.963999999999999,"5min":1552.8879999999999,"15min":1552.8879999999999},"last":1.556}]},{"osd":2,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.2489999999999997,"5min":1.97,"15min":1.857},"min":{"1min":0.60699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":28.045000000000002,"5min":28.045000000000002,"15min":28.045000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":3.415,"5min":1.99,"15min":1.8300000000000001},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":18.495999999999999,"5min":18.495999999999999,"15min":18.495999999999999},"last":1.028}]},{"osd":4,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":1.762,"15min":1.661},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.134999999999998,"5min":36.134999999999998,"15min":36.134999999999998},"last":1.0840000000000001},{"interface":"front","average":{"1min":3.4009999999999998,"5min":2.012,"15min":1.7549999999999999},"min":{"1min":0.77500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":18.535,"5min":18.535,"15min":18.535},"last":1.4339999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.3029999999999999,"5min":1.893,"15min":1.724},"min":{"1min":0.57599999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":36.192,"5min":36.192,"15min":36.192},"last":1.208},{"interface":"front","average":{"1min":3.677,"5min":2.1800000000000002,"15min":1.8640000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":31.771000000000001,"5min":31.771000000000001,"15min":31.771000000000001},"last":1.6200000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":1.9510000000000001,"15min":1.8029999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":21.146999999999998,"5min":21.146999999999998,"15min":21.146999999999998},"last":0.94499999999999995},{"interface":"front","average":{"1min":3.5089999999999999,"5min":2.1019999999999999,"15min":1.8979999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":34.142000000000003,"5min":34.142000000000003,"15min":34.142000000000003},"last":1.177}]},{"osd":7,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.1930000000000001,"15min":1.901},"min":{"1min":0.70699999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":32.061999999999998,"5min":32.061999999999998,"15min":32.061999999999998},"last":1.3},{"interface":"front","average":{"1min":3.375,"5min":1.79,"15min":1.772},"min":{"1min":0.66000000000000003,"5min":0.59599999999999997,"15min":0.56299999999999994},"max":{"1min":17.132000000000001,"5min":17.132000000000001,"15min":17.132000000000001},"last":1.3919999999999999}]}]},{"osd":2,"up_from":14,"seq":60129549505,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7329028,"kb_used_data":5599608,"kb_used_omap":91,"kb_used_meta":1729316,"kb_avail":87042812,"statfs":{"total":96636764160,"available":89131839488,"internally_reserved":0,"allocated":5733998592,"data_stored":5722195235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93223,"internal_metadata":1770820569},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.46,"15min":1.542},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":12.6,"5min":12.6,"15min":12.82},"last":0.94599999999999995},{"interface":"front","average":{"1min":2.754,"5min":1.754,"15min":1.7090000000000001},"min":{"1min":0.51500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":20.664000000000001,"5min":20.664000000000001,"15min":20.664000000000001},"last":0.77900000000000003}]},{"osd":1,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.8530000000000002,"5min":2.0859999999999999,"15min":2.4409999999999998},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.33400000000000002},"max":{"1min":37.893000000000001,"5min":37.893000000000001,"15min":126.84099999999999},"last":1.1519999999999999},{"interface":"front","average":{"1min":3.2890000000000001,"5min":2.028,"15min":2.5049999999999999},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":25.445,"5min":25.445,"15min":129.59100000000001},"last":1.208}]},{"osd":3,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.744,"15min":1.708},"min":{"1min":0.46200000000000002,"5min":0.36599999999999999,"15min":0.32200000000000001},"max":{"1min":5.0659999999999998,"5min":5.1379999999999999,"15min":6.7460000000000004},"last":0.88100000000000001},{"interface":"front","average":{"1min":2.4319999999999999,"5min":1.9079999999999999,"15min":1.7310000000000001},"min":{"1min":0.65100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":1.2669999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.863,"5min":1.7609999999999999,"15min":1.6899999999999999},"min":{"1min":0.63,"5min":0.501,"15min":0.46000000000000002},"max":{"1min":20.613,"5min":20.613,"15min":20.613},"last":1.071},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.659,"15min":1.528},"min":{"1min":0.51800000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"max":{"1min":5.1950000000000003,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.1100000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":1.6339999999999999,"15min":1.6499999999999999},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.47599999999999998},"max":{"1min":12.507,"5min":12.507,"15min":12.507},"last":1.8149999999999999},{"interface":"front","average":{"1min":2.3719999999999999,"5min":1.7070000000000001,"15min":1.71},"min":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.48899999999999999},"max":{"1min":11.375,"5min":11.375,"15min":11.375},"last":1.4430000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":1.792,"15min":1.643},"min":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":14.448,"5min":14.448,"15min":14.448},"last":1.5900000000000001},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.6990000000000001,"15min":1.679},"min":{"1min":0.67000000000000004,"5min":0.57199999999999995,"15min":0.53700000000000003},"max":{"1min":12.631,"5min":12.631,"15min":12.631},"last":1.893}]},{"osd":7,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.569,"5min":2.0110000000000001,"15min":1.8700000000000001},"min":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.54800000000000004},"max":{"1min":30.634,"5min":30.634,"15min":30.634},"last":1.383},{"interface":"front","average":{"1min":3.2869999999999999,"5min":2.0649999999999999,"15min":1.819},"min":{"1min":0.90800000000000003,"5min":0.53800000000000003,"15min":0.50800000000000001},"max":{"1min":27.34,"5min":27.34,"15min":27.34},"last":1.667}]}]},{"osd":1,"up_from":14,"seq":60129549517,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5787200,"kb_used_data":4249332,"kb_used_omap":431,"kb_used_meta":1537424,"kb_avail":88584640,"statfs":{"total":96636764160,"available":90710671360,"internally_reserved":0,"allocated":4351315968,"data_stored":4342532980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":442347,"internal_metadata":1574322197},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.3399999999999999,"5min":1.923,"15min":1.5149999999999999},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":34.283999999999999,"5min":34.283999999999999,"15min":34.283999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":4.1870000000000003,"5min":1.97,"15min":1.639},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":35.313000000000002,"5min":35.313000000000002,"15min":35.313000000000002},"last":0.46500000000000002}]},{"osd":2,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":2.1480000000000001,"15min":1.956},"min":{"1min":0.53000000000000003,"5min":0.32900000000000001,"15min":0.28000000000000003},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":54.386000000000003},"last":0.53400000000000003},{"interface":"front","average":{"1min":6.2590000000000003,"5min":2.4740000000000002,"15min":2.1560000000000001},"min":{"1min":0.497,"5min":0.38500000000000001,"15min":0.32500000000000001},"max":{"1min":34.396000000000001,"5min":34.396000000000001,"15min":52.030000000000001},"last":0.88400000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.8869999999999996,"5min":2.419,"15min":1.9570000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.41499999999999998},"max":{"1min":34.362000000000002,"5min":34.362000000000002,"15min":34.362000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":5.2469999999999999,"5min":2.4390000000000001,"15min":1.913},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40200000000000002},"max":{"1min":35.412999999999997,"5min":35.412999999999997,"15min":35.412999999999997},"last":0.90700000000000003}]},{"osd":4,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.3260000000000001,"5min":1.9419999999999999,"15min":1.6970000000000001},"min":{"1min":0.61099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":34.481999999999999,"5min":34.481999999999999,"15min":34.481999999999999},"last":0.97499999999999998},{"interface":"front","average":{"1min":7.891,"5min":2.7109999999999999,"15min":2.0760000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":63.896999999999998,"5min":63.896999999999998,"15min":63.896999999999998},"last":1.0189999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.2830000000000004,"5min":2.4329999999999998,"15min":2.218},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":35.222000000000001,"5min":35.222000000000001,"15min":85.819999999999993},"last":1.3660000000000001},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.9650000000000001,"15min":1.9870000000000001},"min":{"1min":0.57099999999999995,"5min":0.46300000000000002,"15min":0.441},"max":{"1min":17.254000000000001,"5min":17.254000000000001,"15min":81.944000000000003},"last":2.1259999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.8450000000000002,"5min":1.9299999999999999,"15min":1.863},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"max":{"1min":36.453000000000003,"5min":36.453000000000003,"15min":36.453000000000003},"last":0.78100000000000003},{"interface":"front","average":{"1min":4.6429999999999998,"5min":2.3119999999999998,"15min":1.96},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.497},"max":{"1min":35.542000000000002,"5min":35.542000000000002,"15min":35.926000000000002},"last":1.127}]},{"osd":7,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":2.3029999999999999,"15min":1.8759999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":35.277999999999999,"5min":35.277999999999999,"15min":35.277999999999999},"last":2.1539999999999999},{"interface":"front","average":{"1min":3.4350000000000001,"5min":2.089,"15min":1.7869999999999999},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":34.590000000000003,"5min":34.590000000000003,"15min":34.590000000000003},"last":1.262}]}]},{"osd":0,"up_from":14,"seq":60129549513,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":6020968,"kb_used_data":4388892,"kb_used_omap":36,"kb_used_meta":1632027,"kb_avail":88350872,"statfs":{"total":96636764160,"available":90471292928,"internally_reserved":0,"allocated":4494225408,"data_stored":4485513320,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37779,"internal_metadata":1671195757},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.7490000000000001,"5min":6.8129999999999997,"15min":3.8660000000000001},"min":{"1min":0.316,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":23.366,"5min":437.22399999999999,"15min":437.22399999999999},"last":0.96099999999999997},{"interface":"front","average":{"1min":2.6309999999999998,"5min":6.7460000000000004,"15min":3.8820000000000001},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.27500000000000002},"max":{"1min":16.048999999999999,"5min":439.05700000000002,"15min":439.05700000000002},"last":1.0349999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.7599999999999998,"5min":1.861,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.314},"max":{"1min":18.789000000000001,"5min":18.789000000000001,"15min":18.789000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":2.891,"5min":1.766,"15min":1.7470000000000001},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.32300000000000001},"max":{"1min":16.006,"5min":16.006,"15min":19.305},"last":0.78200000000000003}]},{"osd":3,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.948,"5min":1.7689999999999999,"15min":2.0550000000000002},"min":{"1min":0.53500000000000003,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":17.547000000000001,"5min":17.547000000000001,"15min":88.554000000000002},"last":1.3400000000000001},{"interface":"front","average":{"1min":3.617,"5min":2.0680000000000001,"15min":2.198},"min":{"1min":0.432,"5min":0.432,"15min":0.35299999999999998},"max":{"1min":23.32,"5min":23.32,"15min":83.847999999999999},"last":1.4810000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.137,"5min":1.752,"15min":1.6180000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":31.427,"5min":31.427,"15min":31.427},"last":1.3959999999999999},{"interface":"front","average":{"1min":3.7789999999999999,"5min":1.956,"15min":1.718},"min":{"1min":0.67100000000000004,"5min":0.46700000000000003,"15min":0.433},"max":{"1min":31.443999999999999,"5min":31.443999999999999,"15min":31.443999999999999},"last":1.286}]},{"osd":5,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6040000000000001,"5min":2.2589999999999999,"15min":1.8300000000000001},"min":{"1min":0.54200000000000004,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":51.655999999999999,"5min":51.655999999999999,"15min":51.655999999999999},"last":1.5229999999999999},{"interface":"front","average":{"1min":3.6419999999999999,"5min":1.9319999999999999,"15min":1.7030000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":31.558,"5min":31.558,"15min":31.558},"last":1.2649999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.093,"5min":2.3069999999999999,"15min":1.915},"min":{"1min":0.64200000000000002,"5min":0.53000000000000003,"15min":0.46999999999999997},"max":{"1min":51.612000000000002,"5min":51.612000000000002,"15min":51.612000000000002},"last":1.004},{"interface":"front","average":{"1min":3.891,"5min":1.9730000000000001,"15min":1.8009999999999999},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":23.242000000000001,"5min":23.242000000000001,"15min":23.242000000000001},"last":1.4350000000000001}]},{"osd":7,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.8939999999999999,"15min":1.778},"min":{"1min":0.77600000000000002,"5min":0.62,"15min":0.45500000000000002},"max":{"1min":31.504000000000001,"5min":31.504000000000001,"15min":31.504000000000001},"last":1.3089999999999999},{"interface":"front","average":{"1min":2.7360000000000002,"5min":1.887,"15min":1.7869999999999999},"min":{"1min":0.75900000000000001,"5min":0.59799999999999998,"15min":0.51600000000000001},"max":{"1min":12.771000000000001,"5min":12.771000000000001,"15min":12.771000000000001},"last":1.5600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T22:44:30.519 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-14T22:44:30.724 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.722+0000 7f7381d27640 1 Processor -- start 2023-10-14T22:44:30.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.722+0000 7f7381d27640 1 -- start start 2023-10-14T22:44:30.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381d27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381d27640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f737c15def0 0x7f737c06bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381d27640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f737c154110 con 0x7f737c0cd980 2023-10-14T22:44:30.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381d27640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f737c15d1f0 con 0x7f737c15def0 2023-10-14T22:44:30.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381d27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c15a4c0 con 0x7f737c0cdd60 2023-10-14T22:44:30.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381526640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f737c15def0 0x7f737c06bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381526640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f737c15def0 0x7f737c06bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40488/0 (socket says 172.21.15.64:40488) 2023-10-14T22:44:30.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f7381526640 1 -- 172.21.15.64:0/4088258631 learned_addr learned my addr 172.21.15.64:0/4088258631 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:30.729 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.724+0000 7f737bfff640 1 --2- 172.21.15.64:0/4088258631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.725+0000 7f7381526640 1 -- 172.21.15.64:0/4088258631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 msgr2=0x7f737c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:30.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.725+0000 7f7381526640 1 --2- 172.21.15.64:0/4088258631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.730 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.725+0000 7f7381526640 1 -- 172.21.15.64:0/4088258631 >> v1:172.21.15.177:6789/0 conn(0x7f737c0cd980 legacy=0x7f737c159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.725+0000 7f7381526640 1 -- 172.21.15.64:0/4088258631 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c15a7a0 con 0x7f737c15def0 2023-10-14T22:44:30.731 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.725+0000 7f737bfff640 1 --2- 172.21.15.64:0/4088258631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:30.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.726+0000 7f7381526640 1 --2- 172.21.15.64:0/4088258631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c15def0 0x7f737c06bf30 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f7374009e50 tx=0x7f737402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af25109e9843a3e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:30.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.726+0000 7f737b7fe640 1 -- 172.21.15.64:0/4088258631 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737402cb00 con 0x7f737c15def0 2023-10-14T22:44:30.734 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.726+0000 7f737b7fe640 1 -- 172.21.15.64:0/4088258631 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737402cc60 con 0x7f737c15def0 2023-10-14T22:44:30.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.726+0000 7f737b7fe640 1 -- 172.21.15.64:0/4088258631 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73740343f0 con 0x7f737c15def0 2023-10-14T22:44:30.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 -- 172.21.15.64:0/4088258631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c15def0 msgr2=0x7f737c06bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 --2- 172.21.15.64:0/4088258631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c15def0 0x7f737c06bf30 secure :-1 s=READY pgs=2251 cs=0 l=1 rev1=1 crypto rx=0x7f7374009e50 tx=0x7f737402bf60 comp rx=0 tx=0).stop 2023-10-14T22:44:30.735 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 -- 172.21.15.64:0/4088258631 shutdown_connections 2023-10-14T22:44:30.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 --2- 172.21.15.64:0/4088258631 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c15def0 0x7f737c06bf30 unknown :-1 s=CLOSED pgs=2251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 --2- 172.21.15.64:0/4088258631 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 -- 172.21.15.64:0/4088258631 >> 172.21.15.64:0/4088258631 conn(0x7f737c06a470 msgr2=0x7f737c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:30.736 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 -- 172.21.15.64:0/4088258631 shutdown_connections 2023-10-14T22:44:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.727+0000 7f7381d27640 1 -- 172.21.15.64:0/4088258631 wait complete. 2023-10-14T22:44:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.728+0000 7f7381d27640 1 Processor -- start 2023-10-14T22:44:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.729+0000 7f7381d27640 1 -- start start 2023-10-14T22:44:30.737 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.729+0000 7f7381d27640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c0cd980 0x7f737c0c3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7381d27640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7381d27640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737c14ba00 0x7f737c1ef850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.738 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7381d27640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c1543d0 con 0x7f737c0cd980 2023-10-14T22:44:30.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7381d27640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737c14f330 con 0x7f737c14ba00 2023-10-14T22:44:30.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7381d27640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f737c1efd90 con 0x7f737c0cdd60 2023-10-14T22:44:30.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c0cd980 0x7f737c0c3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.739 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c0cd980 0x7f737c0c3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40502/0 (socket says 172.21.15.64:40502) 2023-10-14T22:44:30.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 -- 172.21.15.64:0/3778069335 learned_addr learned my addr 172.21.15.64:0/3778069335 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:30.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 -- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 msgr2=0x7f737c14edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.740 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 -- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737c14ba00 msgr2=0x7f737c1ef850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737c14ba00 0x7f737c1ef850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 -- 172.21.15.64:0/3778069335 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7374009b30 con 0x7f737c0cd980 2023-10-14T22:44:30.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.730+0000 7f7380d25640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c0cd980 0x7f737c0c3f90 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f737000c480 tx=0x7f737000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:30.741 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.731+0000 7f73797fa640 1 -- 172.21.15.64:0/3778069335 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73700052d0 con 0x7f737c0cd980 2023-10-14T22:44:30.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.731+0000 7f73797fa640 1 -- 172.21.15.64:0/3778069335 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7370005450 con 0x7f737c0cd980 2023-10-14T22:44:30.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.731+0000 7f73797fa640 1 -- 172.21.15.64:0/3778069335 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7370003880 con 0x7f737c0cd980 2023-10-14T22:44:30.742 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.731+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737c0c1e80 con 0x7f737c0cd980 2023-10-14T22:44:30.743 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.731+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737c0c2720 con 0x7f737c0cd980 2023-10-14T22:44:30.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.732+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f737c04e9b0 con 0x7f737c0cd980 2023-10-14T22:44:30.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.733+0000 7f73797fa640 1 -- 172.21.15.64:0/3778069335 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f73700039e0 con 0x7f737c0cd980 2023-10-14T22:44:30.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.734+0000 7f73797fa640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f736006ae70 0x7f736006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:30.744 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.734+0000 7f73797fa640 1 -- 172.21.15.64:0/3778069335 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7370088f90 con 0x7f737c0cd980 2023-10-14T22:44:30.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.734+0000 7f737bfff640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f736006ae70 0x7f736006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:30.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.736+0000 7f737bfff640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f736006ae70 0x7f736006d330 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7368006fd0 tx=0x7f7368008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:30.745 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.738+0000 7f73797fa640 1 -- 172.21.15.64:0/3778069335 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f73700bbca0 con 0x7f737c0cd980 2023-10-14T22:44:30.934 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.932+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f737c153dd0 con 0x7f737c0cd980 2023-10-14T22:44:30.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.934+0000 7f73797fa640 1 -- 172.21.15.64:0/3778069335 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+13179 (secure 0 0 0) 0x7f7370054290 con 0x7f737c0cd980 2023-10-14T22:44:30.937 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:30.937 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":46,"fsid":"0b341ded-8bb8-4993-857a-677cfc30784b","created":"2023-10-14T12:28:26.766055+0000","modified":"2023-10-14T22:44:24.964868+0000","last_up_change":"2023-10-14T12:28:38.498621+0000","last_in_change":"2023-10-14T12:28:30.348896+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-14T12:28:39.804498+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c82488e5-1d5c-4614-b20e-f82d06bdf4c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6812","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6816","nonce":1338117486}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6818","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6819","nonce":1338117486}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6828","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6830","nonce":1338117486}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6822","nonce":1338117486},{"type":"v1","addr":"172.21.15.64:6825","nonce":1338117486}]},"public_addr":"172.21.15.64:6816/1338117486","cluster_addr":"172.21.15.64:6819/1338117486","heartbeat_back_addr":"172.21.15.64:6830/1338117486","heartbeat_front_addr":"172.21.15.64:6825/1338117486","state":["exists","up"]},{"osd":1,"uuid":"cb294d40-4734-4fb9-90b3-983fd221c324","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6802","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6804","nonce":1017343200}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6806","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6808","nonce":1017343200}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6815","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6817","nonce":1017343200}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6810","nonce":1017343200},{"type":"v1","addr":"172.21.15.64:6813","nonce":1017343200}]},"public_addr":"172.21.15.64:6804/1017343200","cluster_addr":"172.21.15.64:6808/1017343200","heartbeat_back_addr":"172.21.15.64:6817/1017343200","heartbeat_front_addr":"172.21.15.64:6813/1017343200","state":["exists","up"]},{"osd":2,"uuid":"7e7f88be-3314-42fb-9d1a-09b7cf83793e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6820","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6821","nonce":496287232}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6823","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6824","nonce":496287232}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6829","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6831","nonce":496287232}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6826","nonce":496287232},{"type":"v1","addr":"172.21.15.64:6827","nonce":496287232}]},"public_addr":"172.21.15.64:6821/496287232","cluster_addr":"172.21.15.64:6824/496287232","heartbeat_back_addr":"172.21.15.64:6831/496287232","heartbeat_front_addr":"172.21.15.64:6827/496287232","state":["exists","up"]},{"osd":3,"uuid":"cd253ad3-e5c6-44cf-9b91-a95d93c09c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6800","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6801","nonce":635710568}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6803","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6805","nonce":635710568}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6811","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6814","nonce":635710568}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6807","nonce":635710568},{"type":"v1","addr":"172.21.15.64:6809","nonce":635710568}]},"public_addr":"172.21.15.64:6801/635710568","cluster_addr":"172.21.15.64:6805/635710568","heartbeat_back_addr":"172.21.15.64:6814/635710568","heartbeat_front_addr":"172.21.15.64:6809/635710568","state":["exists","up"]},{"osd":4,"uuid":"4a24093b-276c-484e-a5ba-06592392a672","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6801","nonce":2887223078}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6803","nonce":2887223078}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6807","nonce":2887223078}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":2887223078},{"type":"v1","addr":"172.21.15.177:6805","nonce":2887223078}]},"public_addr":"172.21.15.177:6801/2887223078","cluster_addr":"172.21.15.177:6803/2887223078","heartbeat_back_addr":"172.21.15.177:6807/2887223078","heartbeat_front_addr":"172.21.15.177:6805/2887223078","state":["exists","up"]},{"osd":5,"uuid":"ede92de1-99ba-4932-95d0-35a00f93a8bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6809","nonce":2099766660}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6811","nonce":2099766660}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6815","nonce":2099766660}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2099766660},{"type":"v1","addr":"172.21.15.177:6813","nonce":2099766660}]},"public_addr":"172.21.15.177:6809/2099766660","cluster_addr":"172.21.15.177:6811/2099766660","heartbeat_back_addr":"172.21.15.177:6815/2099766660","heartbeat_front_addr":"172.21.15.177:6813/2099766660","state":["exists","up"]},{"osd":6,"uuid":"96e6bf56-293a-40dd-b7cb-c5565c083485","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6817","nonce":3504567380}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6819","nonce":3504567380}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6823","nonce":3504567380}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":3504567380},{"type":"v1","addr":"172.21.15.177:6821","nonce":3504567380}]},"public_addr":"172.21.15.177:6817/3504567380","cluster_addr":"172.21.15.177:6819/3504567380","heartbeat_back_addr":"172.21.15.177:6823/3504567380","heartbeat_front_addr":"172.21.15.177:6821/3504567380","state":["exists","up"]},{"osd":7,"uuid":"5a5a8c51-fbfc-4d8b-a462-f7127b648d79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6825","nonce":1113952152}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6826","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6827","nonce":1113952152}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6830","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6831","nonce":1113952152}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6828","nonce":1113952152},{"type":"v1","addr":"172.21.15.177:6829","nonce":1113952152}]},"public_addr":"172.21.15.177:6825/1113952152","cluster_addr":"172.21.15.177:6827/1113952152","heartbeat_back_addr":"172.21.15.177:6831/1113952152","heartbeat_front_addr":"172.21.15.177:6829/1113952152","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.995576+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.746055+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.945189+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.752059+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.623085+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.709501+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.642190+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-10-14T12:28:35.705082+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.64:6835/3900287009":"2023-10-15T22:44:21.868658+0000","172.21.15.64:6834/3900287009":"2023-10-15T22:44:21.868658+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-14T22:44:30.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.936+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f736006ae70 msgr2=0x7f736006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.936+0000 7f7381d27640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f736006ae70 0x7f736006d330 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7368006fd0 tx=0x7f7368008040 comp rx=0 tx=0).stop 2023-10-14T22:44:30.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.936+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c0cd980 msgr2=0x7f737c0c3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:30.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.936+0000 7f7381d27640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c0cd980 0x7f737c0c3f90 secure :-1 s=READY pgs=2252 cs=0 l=1 rev1=1 crypto rx=0x7f737000c480 tx=0x7f737000c940 comp rx=0 tx=0).stop 2023-10-14T22:44:30.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 shutdown_connections 2023-10-14T22:44:30.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f736006ae70 0x7f736006d330 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f737c14ba00 0x7f737c1ef850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f737c0cdd60 0x7f737c14edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 --2- 172.21.15.64:0/3778069335 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f737c0cd980 0x7f737c0c3f90 unknown :-1 s=CLOSED pgs=2252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:30.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 >> 172.21.15.64:0/3778069335 conn(0x7f737c06a470 msgr2=0x7f737c0cb020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:30.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 shutdown_connections 2023-10-14T22:44:30.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:30.937+0000 7f7381d27640 1 -- 172.21.15.64:0/3778069335 wait complete. 2023-10-14T22:44:31.960 INFO:tasks.ceph:Scrubbing osd.0 2023-10-14T22:44:31.960 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:32.171 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.169+0000 7fea2a264640 1 Processor -- start 2023-10-14T22:44:32.172 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.169+0000 7fea2a264640 1 -- start start 2023-10-14T22:44:32.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea2a264640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fea24157340 0x7fea2415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea2a264640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fea240cd8a0 0x7fea24159d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.174 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea2a264640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2415e250 con 0x7fea240cd410 2023-10-14T22:44:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea2a264640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea240ce390 con 0x7fea24157340 2023-10-14T22:44:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea2a264640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea240cddd0 con 0x7fea240cd8a0 2023-10-14T22:44:32.175 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea23fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fea24157340 0x7fea2415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea23fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fea24157340 0x7fea2415dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40518/0 (socket says 172.21.15.64:40518) 2023-10-14T22:44:32.176 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.171+0000 7fea23fff640 1 -- 172.21.15.64:0/3334914914 learned_addr learned my addr 172.21.15.64:0/3334914914 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:32.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.172+0000 7fea28801640 1 --2- 172.21.15.64:0/3334914914 >> v2:172.21.15.177:3300/0 conn(0x7fea240cd8a0 0x7fea24159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.172+0000 7fea23fff640 1 -- 172.21.15.64:0/3334914914 >> v2:172.21.15.177:3300/0 conn(0x7fea240cd8a0 msgr2=0x7fea24159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:32.178 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.172+0000 7fea23fff640 1 --2- 172.21.15.64:0/3334914914 >> v2:172.21.15.177:3300/0 conn(0x7fea240cd8a0 0x7fea24159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.172+0000 7fea22ffd640 1 -- 172.21.15.64:0/3334914914 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902774610 0 0) 0x7fea2415e250 con 0x7fea240cd410 2023-10-14T22:44:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.172+0000 7fea23fff640 1 -- 172.21.15.64:0/3334914914 >> v1:172.21.15.64:6789/0 conn(0x7fea240cd410 legacy=0x7fea240cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.172+0000 7fea23fff640 1 -- 172.21.15.64:0/3334914914 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240ce0b0 con 0x7fea24157340 2023-10-14T22:44:32.179 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.173+0000 7fea23fff640 1 --2- 172.21.15.64:0/3334914914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea24157340 0x7fea2415dd10 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fea240cbdc0 tx=0x7fea1402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b411b9451ef0a2d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.173+0000 7fea22ffd640 1 -- 172.21.15.64:0/3334914914 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14031870 con 0x7fea24157340 2023-10-14T22:44:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea22ffd640 1 -- 172.21.15.64:0/3334914914 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea140319d0 con 0x7fea24157340 2023-10-14T22:44:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea22ffd640 1 -- 172.21.15.64:0/3334914914 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14031d60 con 0x7fea24157340 2023-10-14T22:44:32.180 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea2a264640 1 -- 172.21.15.64:0/3334914914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea24157340 msgr2=0x7fea2415dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea2a264640 1 --2- 172.21.15.64:0/3334914914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea24157340 0x7fea2415dd10 secure :-1 s=READY pgs=2254 cs=0 l=1 rev1=1 crypto rx=0x7fea240cbdc0 tx=0x7fea1402b910 comp rx=0 tx=0).stop 2023-10-14T22:44:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea2a264640 1 -- 172.21.15.64:0/3334914914 shutdown_connections 2023-10-14T22:44:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea2a264640 1 --2- 172.21.15.64:0/3334914914 >> v2:172.21.15.177:3300/0 conn(0x7fea240cd8a0 0x7fea24159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.181 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea2a264640 1 --2- 172.21.15.64:0/3334914914 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea24157340 0x7fea2415dd10 unknown :-1 s=CLOSED pgs=2254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.174+0000 7fea2a264640 1 -- 172.21.15.64:0/3334914914 >> 172.21.15.64:0/3334914914 conn(0x7fea2406c190 msgr2=0x7fea2406c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:32.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.175+0000 7fea2a264640 1 -- 172.21.15.64:0/3334914914 shutdown_connections 2023-10-14T22:44:32.182 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.175+0000 7fea2a264640 1 -- 172.21.15.64:0/3334914914 wait complete. 2023-10-14T22:44:32.184 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.176+0000 7fea2a264640 1 Processor -- start 2023-10-14T22:44:32.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.176+0000 7fea2a264640 1 -- start start 2023-10-14T22:44:32.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.177+0000 7fea2a264640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea240cd410 0x7fea2414a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.177+0000 7fea2a264640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea240cd8a0 0x7fea240abf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.185 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.177+0000 7fea2a264640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea24157340 0x7fea240ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.177+0000 7fea2a264640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea240a9030 con 0x7fea240cd410 2023-10-14T22:44:32.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.177+0000 7fea2a264640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2414aee0 con 0x7fea24157340 2023-10-14T22:44:32.186 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.177+0000 7fea2a264640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea240a97c0 con 0x7fea240cd8a0 2023-10-14T22:44:32.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea240cd410 0x7fea2414a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea240cd410 0x7fea2414a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40526/0 (socket says 172.21.15.64:40526) 2023-10-14T22:44:32.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 -- 172.21.15.64:0/2603063930 learned_addr learned my addr 172.21.15.64:0/2603063930 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:32.187 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea28801640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea24157340 0x7fea240ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 -- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea240cd8a0 msgr2=0x7fea240abf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fea240cd8a0 0x7fea240abf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.188 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 -- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea24157340 msgr2=0x7fea240ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fea24157340 0x7fea240ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.178+0000 7fea23fff640 1 -- 172.21.15.64:0/2603063930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea140094d0 con 0x7fea240cd410 2023-10-14T22:44:32.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.179+0000 7fea23fff640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea240cd410 0x7fea2414a9a0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fea1402b950 tx=0x7fea140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.189 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.179+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea1403ad30 con 0x7fea240cd410 2023-10-14T22:44:32.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.179+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea1403ae90 con 0x7fea240cd410 2023-10-14T22:44:32.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.179+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea14044630 con 0x7fea240cd410 2023-10-14T22:44:32.190 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.179+0000 7fea2a264640 1 -- 172.21.15.64:0/2603063930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea240a9aa0 con 0x7fea240cd410 2023-10-14T22:44:32.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.179+0000 7fea2a264640 1 -- 172.21.15.64:0/2603063930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea240aa060 con 0x7fea240cd410 2023-10-14T22:44:32.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.180+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea2415d7f0 con 0x7fea240cd410 2023-10-14T22:44:32.191 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.182+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fea14044790 con 0x7fea240cd410 2023-10-14T22:44:32.192 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.183+0000 7fea20ff9640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fea1006ae70 0x7fea1006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.183+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fea1402d040 con 0x7fea240cd410 2023-10-14T22:44:32.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.183+0000 7fea20ff9640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fea10071170 0x7fea100735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.193 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.183+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 --> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea10073c80 con 0x7fea10071170 2023-10-14T22:44:32.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.183+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea140b02c0 con 0x7fea240cd410 2023-10-14T22:44:32.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.184+0000 7fea28801640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fea10071170 0x7fea100735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.184+0000 7fea237fe640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fea1006ae70 0x7fea1006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.194 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.184+0000 7fea28801640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fea10071170 0x7fea100735b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.185+0000 7fea237fe640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fea1006ae70 0x7fea1006d330 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fea241f5db0 tx=0x7fea18007950 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.195 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.185+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== osd.0 v2:172.21.15.64:6812/1338117486 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fea10073c80 con 0x7fea10071170 2023-10-14T22:44:32.211 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.209+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 --> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fea2415d510 con 0x7fea10071170 2023-10-14T22:44:32.212 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.209+0000 7fea20ff9640 1 -- 172.21.15.64:0/2603063930 <== osd.0 v2:172.21.15.64:6812/1338117486 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fea1c014380 con 0x7fea10071170 2023-10-14T22:44:32.212 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:32.213 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:32.213 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:32.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fea10071170 msgr2=0x7fea100735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:6812/1338117486,v1:172.21.15.64:6816/1338117486] conn(0x7fea10071170 0x7fea100735b0 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.214 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fea1006ae70 msgr2=0x7fea1006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fea1006ae70 0x7fea1006d330 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7fea241f5db0 tx=0x7fea18007950 comp rx=0 tx=0).stop 2023-10-14T22:44:32.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea240cd410 msgr2=0x7fea2414a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.215 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 --2- 172.21.15.64:0/2603063930 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fea240cd410 0x7fea2414a9a0 secure :-1 s=READY pgs=2255 cs=0 l=1 rev1=1 crypto rx=0x7fea1402b950 tx=0x7fea140046c0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea28801640 1 -- 172.21.15.64:0/2603063930 reap_dead start 2023-10-14T22:44:32.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 shutdown_connections 2023-10-14T22:44:32.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 >> 172.21.15.64:0/2603063930 conn(0x7fea2406c190 msgr2=0x7fea2406c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:32.216 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 shutdown_connections 2023-10-14T22:44:32.217 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.210+0000 7fea0a7fc640 1 -- 172.21.15.64:0/2603063930 wait complete. 2023-10-14T22:44:32.232 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-14T22:44:32.431 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.429+0000 7f1e374d7640 1 Processor -- start 2023-10-14T22:44:32.432 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.429+0000 7f1e374d7640 1 -- start start 2023-10-14T22:44:32.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.430+0000 7f1e374d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 0x7f1e30160680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.433 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.430+0000 7f1e374d7640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f1e300b83b0 0x7f1e300cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.430+0000 7f1e374d7640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e30161520 con 0x7f1e300cdbc0 2023-10-14T22:44:32.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.430+0000 7f1e374d7640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e300ce050 con 0x7f1e300b83b0 2023-10-14T22:44:32.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.430+0000 7f1e374d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30160f60 con 0x7f1e3015c9f0 2023-10-14T22:44:32.434 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.431+0000 7f1e35a74640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f1e300cdbc0 0x7f1e300b4430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54340/0 (socket says 172.21.15.64:54340) 2023-10-14T22:44:32.435 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.431+0000 7f1e35a74640 1 -- 172.21.15.64:0/372563641 learned_addr learned my addr 172.21.15.64:0/372563641 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:32.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.431+0000 7f1e35273640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 0x7f1e30160680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.437 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.431+0000 7f1e34a72640 1 --2- 172.21.15.64:0/372563641 >> v2:172.21.15.177:3300/0 conn(0x7f1e300b83b0 0x7f1e300cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.431+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1471162649 0 0) 0x7f1e30161520 con 0x7f1e300cdbc0 2023-10-14T22:44:32.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.431+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e1c003520 con 0x7f1e300cdbc0 2023-10-14T22:44:32.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2042660809 0 0) 0x7f1e1c003520 con 0x7f1e300cdbc0 2023-10-14T22:44:32.438 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 msgr2=0x7f1e30160680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:32.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 0x7f1e30160680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 >> v2:172.21.15.177:3300/0 conn(0x7f1e300b83b0 msgr2=0x7f1e300cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:32.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 --2- 172.21.15.64:0/372563641 >> v2:172.21.15.177:3300/0 conn(0x7f1e300b83b0 0x7f1e300cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.439 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e30161240 con 0x7f1e300cdbc0 2023-10-14T22:44:32.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f1e280019f0 con 0x7f1e300cdbc0 2023-10-14T22:44:32.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 >> v1:172.21.15.64:6789/0 conn(0x7f1e300cdbc0 legacy=0x7f1e300b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 0x7f1e1c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.440 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c003ef0 0x7f1e1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e1c004d00 0x7f1e1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300ce050 con 0x7f1e1c004d00 2023-10-14T22:44:32.441 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30160f60 con 0x7f1e1c003ef0 2023-10-14T22:44:32.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c00b980 con 0x7f1e3015c9f0 2023-10-14T22:44:32.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.432+0000 7f1e35a74640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e1c004d00 0x7f1e1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e34a72640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c003ef0 0x7f1e1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.442 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e35273640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 0x7f1e1c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e35a74640 1 -- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 msgr2=0x7f1e1c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:32.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e35a74640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e3015c9f0 0x7f1e1c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e35a74640 1 -- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c003ef0 msgr2=0x7f1e1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:32.443 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e35a74640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c003ef0 0x7f1e1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e35a74640 1 -- 172.21.15.64:0/372563641 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c003520 con 0x7f1e1c004d00 2023-10-14T22:44:32.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.433+0000 7f1e34a72640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c003ef0 0x7f1e1c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T22:44:32.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.434+0000 7f1e35a74640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e1c004d00 0x7f1e1c005180 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800a830 tx=0x7f1e1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7b50af35f034a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.444 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.435+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28034630 con 0x7f1e1c004d00 2023-10-14T22:44:32.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.435+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2802f070 con 0x7f1e1c004d00 2023-10-14T22:44:32.445 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.435+0000 7f1e27fff640 1 -- 172.21.15.64:0/372563641 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e28034a30 con 0x7f1e1c004d00 2023-10-14T22:44:32.447 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.436+0000 7f1e374d7640 1 -- 172.21.15.64:0/372563641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e1c004d00 msgr2=0x7f1e1c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.436+0000 7f1e374d7640 1 --2- 172.21.15.64:0/372563641 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e1c004d00 0x7f1e1c005180 secure :-1 s=READY pgs=2257 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800a830 tx=0x7f1e1c0057f0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.436+0000 7f1e35a74640 1 -- 172.21.15.64:0/372563641 reap_dead start 2023-10-14T22:44:32.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.436+0000 7f1e374d7640 1 -- 172.21.15.64:0/372563641 shutdown_connections 2023-10-14T22:44:32.448 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.436+0000 7f1e374d7640 1 -- 172.21.15.64:0/372563641 >> 172.21.15.64:0/372563641 conn(0x7f1e30071510 msgr2=0x7f1e30071920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:32.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.436+0000 7f1e374d7640 1 -- 172.21.15.64:0/372563641 shutdown_connections 2023-10-14T22:44:32.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.436+0000 7f1e374d7640 1 -- 172.21.15.64:0/372563641 wait complete. 2023-10-14T22:44:32.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.439+0000 7f1e374d7640 1 Processor -- start 2023-10-14T22:44:32.449 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.439+0000 7f1e374d7640 1 -- start start 2023-10-14T22:44:32.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.440+0000 7f1e374d7640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c004d00 0x7f1e30151750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.440+0000 7f1e374d7640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e301503e0 0x7f1e300b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.450 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.440+0000 7f1e374d7640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e300b70e0 0x7f1e300c9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.440+0000 7f1e374d7640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300caae0 con 0x7f1e301503e0 2023-10-14T22:44:32.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.440+0000 7f1e374d7640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e300b7560 con 0x7f1e1c004d00 2023-10-14T22:44:32.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.440+0000 7f1e374d7640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e3015dbf0 con 0x7f1e300b70e0 2023-10-14T22:44:32.451 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e301503e0 0x7f1e300b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e301503e0 0x7f1e300b6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40552/0 (socket says 172.21.15.64:40552) 2023-10-14T22:44:32.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 -- 172.21.15.64:0/2615491384 learned_addr learned my addr 172.21.15.64:0/2615491384 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:32.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e35273640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c004d00 0x7f1e30151750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.452 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 -- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e300b70e0 msgr2=0x7f1e300c9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e35a74640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e300b70e0 0x7f1e300c9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e300b70e0 0x7f1e300c9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 -- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c004d00 msgr2=0x7f1e30151750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.453 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c004d00 0x7f1e30151750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 -- 172.21.15.64:0/2615491384 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e3015d2c0 con 0x7f1e301503e0 2023-10-14T22:44:32.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.441+0000 7f1e34a72640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e301503e0 0x7f1e300b6ba0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f1e200115e0 tx=0x7f1e20011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.454 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.442+0000 7f1e25ffb640 1 -- 172.21.15.64:0/2615491384 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000f8f0 con 0x7f1e301503e0 2023-10-14T22:44:32.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.442+0000 7f1e25ffb640 1 -- 172.21.15.64:0/2615491384 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2000fa50 con 0x7f1e301503e0 2023-10-14T22:44:32.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.442+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e3015d5a0 con 0x7f1e301503e0 2023-10-14T22:44:32.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.442+0000 7f1e25ffb640 1 -- 172.21.15.64:0/2615491384 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000fdc0 con 0x7f1e301503e0 2023-10-14T22:44:32.455 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.442+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e30150840 con 0x7f1e301503e0 2023-10-14T22:44:32.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.443+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e30150a60 con 0x7f1e301503e0 2023-10-14T22:44:32.456 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.444+0000 7f1e25ffb640 1 -- 172.21.15.64:0/2615491384 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f1e20015460 con 0x7f1e301503e0 2023-10-14T22:44:32.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.445+0000 7f1e25ffb640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1e1406aea0 0x7f1e1406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.446+0000 7f1e25ffb640 1 -- 172.21.15.64:0/2615491384 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1e20089d20 con 0x7f1e301503e0 2023-10-14T22:44:32.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.446+0000 7f1e35273640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1e1406aea0 0x7f1e1406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.457 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.447+0000 7f1e35273640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1e1406aea0 0x7f1e1406d360 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009950 tx=0x7f1e2c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.458 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.454+0000 7f1e25ffb640 1 -- 172.21.15.64:0/2615491384 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f1e30150a60 con 0x7f1e301503e0 2023-10-14T22:44:32.649 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.647+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e300d0e50 con 0x7f1e1406aea0 2023-10-14T22:44:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.648+0000 7f1e25ffb640 1 -- 172.21.15.64:0/2615491384 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1e2c0095c0 con 0x7f1e1406aea0 2023-10-14T22:44:32.650 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 0 to deep-scrub 2023-10-14T22:44:32.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1e1406aea0 msgr2=0x7f1e1406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1e1406aea0 0x7f1e1406d360 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c009950 tx=0x7f1e2c008040 comp rx=0 tx=0).stop 2023-10-14T22:44:32.653 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e301503e0 msgr2=0x7f1e300b6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e301503e0 0x7f1e300b6ba0 secure :-1 s=READY pgs=2258 cs=0 l=1 rev1=1 crypto rx=0x7f1e200115e0 tx=0x7f1e20011aa0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 shutdown_connections 2023-10-14T22:44:32.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f1e1406aea0 0x7f1e1406d360 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.654 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f1e300b70e0 0x7f1e300c9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.655 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f1e301503e0 0x7f1e300b6ba0 unknown :-1 s=CLOSED pgs=2258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.655 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 --2- 172.21.15.64:0/2615491384 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f1e1c004d00 0x7f1e30151750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.655 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 >> 172.21.15.64:0/2615491384 conn(0x7f1e30071510 msgr2=0x7f1e300c64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:32.655 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 shutdown_connections 2023-10-14T22:44:32.656 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.650+0000 7f1e374d7640 1 -- 172.21.15.64:0/2615491384 wait complete. 2023-10-14T22:44:32.670 INFO:tasks.ceph:Scrubbing osd.1 2023-10-14T22:44:32.670 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:32.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.862+0000 7fc176fc4640 1 Processor -- start 2023-10-14T22:44:32.865 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.862+0000 7fc176fc4640 1 -- start start 2023-10-14T22:44:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc176fc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 0x7fc1700cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc176fc4640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc17006b570 0x7fc17006ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.868 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc176fc4640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc17006bf40 con 0x7fc1700d0cd0 2023-10-14T22:44:32.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc176fc4640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1700cfc20 con 0x7fc17006b570 2023-10-14T22:44:32.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc176fc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700cd4a0 con 0x7fc1700b1a30 2023-10-14T22:44:32.869 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc1767c3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc17006b570 0x7fc17006ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc1767c3640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc17006b570 0x7fc17006ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40568/0 (socket says 172.21.15.64:40568) 2023-10-14T22:44:32.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.864+0000 7fc1767c3640 1 -- 172.21.15.64:0/2625449293 learned_addr learned my addr 172.21.15.64:0/2625449293 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:32.870 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.865+0000 7fc175fc2640 1 --2- 172.21.15.64:0/2625449293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 0x7fc1700cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.865+0000 7fc1767c3640 1 -- 172.21.15.64:0/2625449293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 msgr2=0x7fc1700cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:32.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.865+0000 7fc1767c3640 1 --2- 172.21.15.64:0/2625449293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 0x7fc1700cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.865+0000 7fc1767c3640 1 -- 172.21.15.64:0/2625449293 >> v1:172.21.15.177:6789/0 conn(0x7fc1700d0cd0 legacy=0x7fc1700d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:32.871 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.865+0000 7fc1767c3640 1 -- 172.21.15.64:0/2625449293 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1700cd780 con 0x7fc17006b570 2023-10-14T22:44:32.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.866+0000 7fc1767c3640 1 --2- 172.21.15.64:0/2625449293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc17006b570 0x7fc17006ba00 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fc168009e50 tx=0x7fc16802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46d6b9afdb17ca7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.866+0000 7fc174fc0640 1 -- 172.21.15.64:0/2625449293 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16802ca70 con 0x7fc17006b570 2023-10-14T22:44:32.873 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.866+0000 7fc174fc0640 1 -- 172.21.15.64:0/2625449293 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16802cbd0 con 0x7fc17006b570 2023-10-14T22:44:32.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.866+0000 7fc174fc0640 1 -- 172.21.15.64:0/2625449293 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1680343f0 con 0x7fc17006b570 2023-10-14T22:44:32.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 -- 172.21.15.64:0/2625449293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc17006b570 msgr2=0x7fc17006ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.874 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 --2- 172.21.15.64:0/2625449293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc17006b570 0x7fc17006ba00 secure :-1 s=READY pgs=2259 cs=0 l=1 rev1=1 crypto rx=0x7fc168009e50 tx=0x7fc16802bed0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 -- 172.21.15.64:0/2625449293 shutdown_connections 2023-10-14T22:44:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 --2- 172.21.15.64:0/2625449293 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc17006b570 0x7fc17006ba00 unknown :-1 s=CLOSED pgs=2259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 --2- 172.21.15.64:0/2625449293 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 0x7fc1700cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.875 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 -- 172.21.15.64:0/2625449293 >> 172.21.15.64:0/2625449293 conn(0x7fc17008c140 msgr2=0x7fc17009ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:32.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 -- 172.21.15.64:0/2625449293 shutdown_connections 2023-10-14T22:44:32.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.867+0000 7fc176fc4640 1 -- 172.21.15.64:0/2625449293 wait complete. 2023-10-14T22:44:32.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.870+0000 7fc176fc4640 1 Processor -- start 2023-10-14T22:44:32.876 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.870+0000 7fc176fc4640 1 -- start start 2023-10-14T22:44:32.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.871+0000 7fc176fc4640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc17006b570 0x7fc1700b6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.871+0000 7fc176fc4640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 0x7fc1700c85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.871+0000 7fc176fc4640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1700d0cd0 0x7fc1700b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.879 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.871+0000 7fc176fc4640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b5830 con 0x7fc1700d0cd0 2023-10-14T22:44:32.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.871+0000 7fc176fc4640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b5a60 con 0x7fc17006b570 2023-10-14T22:44:32.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.871+0000 7fc176fc4640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1700b5d40 con 0x7fc1700b1a30 2023-10-14T22:44:32.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1700d0cd0 0x7fc1700b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.880 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1700d0cd0 0x7fc1700b52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40574/0 (socket says 172.21.15.64:40574) 2023-10-14T22:44:32.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 -- 172.21.15.64:0/2932416160 learned_addr learned my addr 172.21.15.64:0/2932416160 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:32.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc175fc2640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc17006b570 0x7fc1700b6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.881 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1757c1640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 0x7fc1700c85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 -- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 msgr2=0x7fc1700c85f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc1700b1a30 0x7fc1700c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 -- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc17006b570 msgr2=0x7fc1700b6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.882 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc17006b570 0x7fc1700b6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.872+0000 7fc1767c3640 1 -- 172.21.15.64:0/2932416160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc168009b30 con 0x7fc1700d0cd0 2023-10-14T22:44:32.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.873+0000 7fc1767c3640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1700d0cd0 0x7fc1700b52f0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fc168036040 tx=0x7fc168004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.873+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc168009510 con 0x7fc1700d0cd0 2023-10-14T22:44:32.883 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.873+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc16803e450 con 0x7fc1700d0cd0 2023-10-14T22:44:32.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.873+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc16803e7e0 con 0x7fc1700d0cd0 2023-10-14T22:44:32.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.874+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1700b6020 con 0x7fc1700d0cd0 2023-10-14T22:44:32.884 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.874+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1700b65e0 con 0x7fc1700d0cd0 2023-10-14T22:44:32.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.875+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc1700cfec0 con 0x7fc1700d0cd0 2023-10-14T22:44:32.885 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.876+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc16803e940 con 0x7fc1700d0cd0 2023-10-14T22:44:32.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.877+0000 7fc1667fc640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc15406aec0 0x7fc15406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.877+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc1680ac080 con 0x7fc1700d0cd0 2023-10-14T22:44:32.887 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.877+0000 7fc1667fc640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fc1540711c0 0x7fc154073600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:32.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.877+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 --> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc154073cd0 con 0x7fc1540711c0 2023-10-14T22:44:32.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.877+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1680ae790 con 0x7fc1700d0cd0 2023-10-14T22:44:32.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.878+0000 7fc175fc2640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc15406aec0 0x7fc15406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.888 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.878+0000 7fc1757c1640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fc1540711c0 0x7fc154073600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:32.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.878+0000 7fc1757c1640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fc1540711c0 0x7fc154073600 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.879+0000 7fc175fc2640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc15406aec0 0x7fc15406d380 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006fd0 tx=0x7fc16c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:32.889 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.879+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== osd.1 v2:172.21.15.64:6802/1017343200 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fc154073cd0 con 0x7fc1540711c0 2023-10-14T22:44:32.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.893+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 --> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc1700cda60 con 0x7fc1540711c0 2023-10-14T22:44:32.897 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.894+0000 7fc1667fc640 1 -- 172.21.15.64:0/2932416160 <== osd.1 v2:172.21.15.64:6802/1017343200 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fc16000b960 con 0x7fc1540711c0 2023-10-14T22:44:32.898 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:32.898 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:32.898 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:32.899 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.894+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fc1540711c0 msgr2=0x7fc154073600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.894+0000 7fc176fc4640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:6802/1017343200,v1:172.21.15.64:6804/1017343200] conn(0x7fc1540711c0 0x7fc154073600 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc15406aec0 msgr2=0x7fc15406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc15406aec0 0x7fc15406d380 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fc16c006fd0 tx=0x7fc16c008040 comp rx=0 tx=0).stop 2023-10-14T22:44:32.900 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1700d0cd0 msgr2=0x7fc1700b52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 --2- 172.21.15.64:0/2932416160 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc1700d0cd0 0x7fc1700b52f0 secure :-1 s=READY pgs=2260 cs=0 l=1 rev1=1 crypto rx=0x7fc168036040 tx=0x7fc168004a40 comp rx=0 tx=0).stop 2023-10-14T22:44:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc1767c3640 1 -- 172.21.15.64:0/2932416160 reap_dead start 2023-10-14T22:44:32.901 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 shutdown_connections 2023-10-14T22:44:32.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 >> 172.21.15.64:0/2932416160 conn(0x7fc17008c140 msgr2=0x7fc1700cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:32.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 shutdown_connections 2023-10-14T22:44:32.902 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:32.895+0000 7fc176fc4640 1 -- 172.21.15.64:0/2932416160 wait complete. 2023-10-14T22:44:32.914 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-14T22:44:33.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.104+0000 7ff6aef9e640 1 Processor -- start 2023-10-14T22:44:33.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.104+0000 7ff6aef9e640 1 -- start start 2023-10-14T22:44:33.108 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.106+0000 7ff6aef9e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cfe70 0x7ff6a80cda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.106+0000 7ff6aef9e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80d3760 con 0x7ff6a815cc90 2023-10-14T22:44:33.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.106+0000 7ff6aef9e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80cf9e0 con 0x7ff6a80d14d0 2023-10-14T22:44:33.109 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.106+0000 7ff6aef9e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a815d070 con 0x7ff6a80cfe70 2023-10-14T22:44:33.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.106+0000 7ff6adf9c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ff6a815cc90 0x7ff6a80d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54356/0 (socket says 172.21.15.64:54356) 2023-10-14T22:44:33.110 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.106+0000 7ff6adf9c640 1 -- 172.21.15.64:0/702416438 learned_addr learned my addr 172.21.15.64:0/702416438 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:33.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6ae79d640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cfe70 0x7ff6a80cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.113 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1904230183 0 0) 0x7ff6a80d3760 con 0x7ff6a815cc90 2023-10-14T22:44:33.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694003520 con 0x7ff6a815cc90 2023-10-14T22:44:33.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1423591347 0 0) 0x7ff694003520 con 0x7ff6a815cc90 2023-10-14T22:44:33.114 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cfe70 msgr2=0x7ff6a80cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cfe70 0x7ff6a80cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 >> v1:172.21.15.177:6789/0 conn(0x7ff6a80d14d0 legacy=0x7ff6a80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.115 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a80b1870 con 0x7ff6a815cc90 2023-10-14T22:44:33.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7ff6a4001670 con 0x7ff6a815cc90 2023-10-14T22:44:33.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 >> v1:172.21.15.64:6789/0 conn(0x7ff6a815cc90 legacy=0x7ff6a80d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6940039a0 0x7ff694003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.116 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6940047c0 0x7ff694004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff69400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a815d070 con 0x7ff6940051d0 2023-10-14T22:44:33.117 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69400c0d0 con 0x7ff6940047c0 2023-10-14T22:44:33.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff69400c290 con 0x7ff6940039a0 2023-10-14T22:44:33.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.107+0000 7ff6ae79d640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cfe70 0x7ff6a80cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T22:44:33.118 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ae79d640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff69400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6adf9c640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6940039a0 0x7ff694003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ad79b640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6940047c0 0x7ff694004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ae79d640 1 -- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6940039a0 msgr2=0x7ff694003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.119 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ae79d640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6940039a0 0x7ff694003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ae79d640 1 -- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6940047c0 msgr2=0x7ff694004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ae79d640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6940047c0 0x7ff694004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.120 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ae79d640 1 -- 172.21.15.64:0/702416438 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694003520 con 0x7ff6940051d0 2023-10-14T22:44:33.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.108+0000 7ff6ad79b640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6940047c0 0x7ff694004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:33.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.109+0000 7ff6ae79d640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff69400b980 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009f00 tx=0x7ff6940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=538e1080d9842498 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.109+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a002cc70 con 0x7ff6940051d0 2023-10-14T22:44:33.121 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.109+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a002cdd0 con 0x7ff6940051d0 2023-10-14T22:44:33.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.109+0000 7ff6acf9a640 1 -- 172.21.15.64:0/702416438 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0003bb0 con 0x7ff6940051d0 2023-10-14T22:44:33.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.110+0000 7ff6aef9e640 1 -- 172.21.15.64:0/702416438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 msgr2=0x7ff69400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.122 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.110+0000 7ff6aef9e640 1 --2- 172.21.15.64:0/702416438 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff69400b980 secure :-1 s=READY pgs=2262 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009f00 tx=0x7ff6940057f0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.110+0000 7ff6ae79d640 1 -- 172.21.15.64:0/702416438 reap_dead start 2023-10-14T22:44:33.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.110+0000 7ff6aef9e640 1 -- 172.21.15.64:0/702416438 shutdown_connections 2023-10-14T22:44:33.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.110+0000 7ff6aef9e640 1 -- 172.21.15.64:0/702416438 >> 172.21.15.64:0/702416438 conn(0x7ff6a80d27e0 msgr2=0x7ff6a80d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:33.123 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.110+0000 7ff6aef9e640 1 -- 172.21.15.64:0/702416438 shutdown_connections 2023-10-14T22:44:33.124 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.110+0000 7ff6aef9e640 1 -- 172.21.15.64:0/702416438 wait complete. 2023-10-14T22:44:33.126 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.112+0000 7ff6aef9e640 1 Processor -- start 2023-10-14T22:44:33.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.112+0000 7ff6aef9e640 1 -- start start 2023-10-14T22:44:33.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6aef9e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff6a80c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.127 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6aef9e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a81e6c70 0x7ff6a8150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6aef9e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cb080 0x7ff6a815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6aef9e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8150880 con 0x7ff6940051d0 2023-10-14T22:44:33.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6aef9e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a81e73c0 con 0x7ff6a81e6c70 2023-10-14T22:44:33.128 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6aef9e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a814f580 con 0x7ff6a80cb080 2023-10-14T22:44:33.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff6a80c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff6a80c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40596/0 (socket says 172.21.15.64:40596) 2023-10-14T22:44:33.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 -- 172.21.15.64:0/3041793867 learned_addr learned my addr 172.21.15.64:0/3041793867 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:33.129 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 -- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cb080 msgr2=0x7ff6a815b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cb080 0x7ff6a815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 -- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a81e6c70 msgr2=0x7ff6a8150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.130 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6ad79b640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a81e6c70 0x7ff6a8150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a81e6c70 0x7ff6a8150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6adf9c640 1 -- 172.21.15.64:0/3041793867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a814f860 con 0x7ff6940051d0 2023-10-14T22:44:33.131 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.113+0000 7ff6ad79b640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a81e6c70 0x7ff6a8150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:33.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.114+0000 7ff6adf9c640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff6a80c8e40 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400e750 tx=0x7ff6a400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.114+0000 7ff69e7fc640 1 -- 172.21.15.64:0/3041793867 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400ee60 con 0x7ff6940051d0 2023-10-14T22:44:33.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.114+0000 7ff69e7fc640 1 -- 172.21.15.64:0/3041793867 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a400c8d0 con 0x7ff6940051d0 2023-10-14T22:44:33.132 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.114+0000 7ff69e7fc640 1 -- 172.21.15.64:0/3041793867 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a400cc80 con 0x7ff6940051d0 2023-10-14T22:44:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.114+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a814fb40 con 0x7ff6940051d0 2023-10-14T22:44:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.114+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a80cb500 con 0x7ff6940051d0 2023-10-14T22:44:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.115+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80d3460 con 0x7ff6940051d0 2023-10-14T22:44:33.133 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.117+0000 7ff69e7fc640 1 -- 172.21.15.64:0/3041793867 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff6a401d460 con 0x7ff6940051d0 2023-10-14T22:44:33.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.118+0000 7ff69e7fc640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff68c06aea0 0x7ff68c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.118+0000 7ff69e7fc640 1 -- 172.21.15.64:0/3041793867 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff6a40894e0 con 0x7ff6940051d0 2023-10-14T22:44:33.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.119+0000 7ff6ad79b640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff68c06aea0 0x7ff68c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.134 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.120+0000 7ff6ad79b640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff68c06aea0 0x7ff68c06d360 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff6a806d070 tx=0x7ff698009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.135 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.122+0000 7ff69e7fc640 1 -- 172.21.15.64:0/3041793867 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff6a80d3460 con 0x7ff6940051d0 2023-10-14T22:44:33.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.308+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6a80b1de0 con 0x7ff68c06aea0 2023-10-14T22:44:33.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.309+0000 7ff69e7fc640 1 -- 172.21.15.64:0/3041793867 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff69800d040 con 0x7ff68c06aea0 2023-10-14T22:44:33.312 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 1 to deep-scrub 2023-10-14T22:44:33.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff68c06aea0 msgr2=0x7ff68c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff68c06aea0 0x7ff68c06d360 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff6a806d070 tx=0x7ff698009040 comp rx=0 tx=0).stop 2023-10-14T22:44:33.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 msgr2=0x7ff6a80c8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff6a80c8e40 secure :-1 s=READY pgs=2263 cs=0 l=1 rev1=1 crypto rx=0x7ff6a400e750 tx=0x7ff6a400ec10 comp rx=0 tx=0).stop 2023-10-14T22:44:33.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 shutdown_connections 2023-10-14T22:44:33.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff68c06aea0 0x7ff68c06d360 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff6a80cb080 0x7ff6a815b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff6a81e6c70 0x7ff6a8150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 --2- 172.21.15.64:0/3041793867 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff6940051d0 0x7ff6a80c8e40 unknown :-1 s=CLOSED pgs=2263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 >> 172.21.15.64:0/3041793867 conn(0x7ff6a80d27e0 msgr2=0x7ff6a80afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:33.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 shutdown_connections 2023-10-14T22:44:33.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.312+0000 7ff6aef9e640 1 -- 172.21.15.64:0/3041793867 wait complete. 2023-10-14T22:44:33.332 INFO:tasks.ceph:Scrubbing osd.2 2023-10-14T22:44:33.332 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:33.543 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.541+0000 7fdbfe210640 1 Processor -- start 2023-10-14T22:44:33.544 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.541+0000 7fdbfe210640 1 -- start start 2023-10-14T22:44:33.546 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.542+0000 7fdbfe210640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fdbf8157380 0x7fdbf815dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbfe210640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdbf80cade0 0x7fdbf80cb200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbfe210640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbf80cdb20 con 0x7fdbf80b4080 2023-10-14T22:44:33.547 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbfe210640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf80ce320 con 0x7fdbf8157380 2023-10-14T22:44:33.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbfe210640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbf815d810 con 0x7fdbf80cade0 2023-10-14T22:44:33.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbeffff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fdbf80b4080 0x7fdbf80cd410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54364/0 (socket says 172.21.15.64:54364) 2023-10-14T22:44:33.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbeffff640 1 -- 172.21.15.64:0/3531423239 learned_addr learned my addr 172.21.15.64:0/3531423239 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:33.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbf77fe640 1 --2- 172.21.15.64:0/3531423239 >> v2:172.21.15.64:3300/0 conn(0x7fdbf8157380 0x7fdbf815dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.543+0000 7fdbf7fff640 1 --2- 172.21.15.64:0/3531423239 >> v2:172.21.15.177:3300/0 conn(0x7fdbf80cade0 0x7fdbf80cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.544+0000 7fdbf77fe640 1 -- 172.21.15.64:0/3531423239 >> v2:172.21.15.177:3300/0 conn(0x7fdbf80cade0 msgr2=0x7fdbf80cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.544+0000 7fdbf77fe640 1 --2- 172.21.15.64:0/3531423239 >> v2:172.21.15.177:3300/0 conn(0x7fdbf80cade0 0x7fdbf80cb200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.544+0000 7fdbf77fe640 1 -- 172.21.15.64:0/3531423239 >> v1:172.21.15.64:6789/0 conn(0x7fdbf80b4080 legacy=0x7fdbf80cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.544+0000 7fdbf77fe640 1 -- 172.21.15.64:0/3531423239 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8157760 con 0x7fdbf8157380 2023-10-14T22:44:33.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.545+0000 7fdbf77fe640 1 --2- 172.21.15.64:0/3531423239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf815dca0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80c5520 tx=0x7fdbe802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90dc18e0808680e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.545+0000 7fdbf6ffd640 1 -- 172.21.15.64:0/3531423239 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe802e070 con 0x7fdbf8157380 2023-10-14T22:44:33.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.545+0000 7fdbf6ffd640 1 -- 172.21.15.64:0/3531423239 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe80315a0 con 0x7fdbf8157380 2023-10-14T22:44:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.545+0000 7fdbf6ffd640 1 -- 172.21.15.64:0/3531423239 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe8031930 con 0x7fdbf8157380 2023-10-14T22:44:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 -- 172.21.15.64:0/3531423239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 msgr2=0x7fdbf815dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 --2- 172.21.15.64:0/3531423239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf815dca0 secure :-1 s=READY pgs=2265 cs=0 l=1 rev1=1 crypto rx=0x7fdbf80c5520 tx=0x7fdbe802b840 comp rx=0 tx=0).stop 2023-10-14T22:44:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 -- 172.21.15.64:0/3531423239 shutdown_connections 2023-10-14T22:44:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 --2- 172.21.15.64:0/3531423239 >> v2:172.21.15.177:3300/0 conn(0x7fdbf80cade0 0x7fdbf80cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 --2- 172.21.15.64:0/3531423239 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf815dca0 unknown :-1 s=CLOSED pgs=2265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 -- 172.21.15.64:0/3531423239 >> 172.21.15.64:0/3531423239 conn(0x7fdbf806c190 msgr2=0x7fdbf806c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:33.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 -- 172.21.15.64:0/3531423239 shutdown_connections 2023-10-14T22:44:33.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.546+0000 7fdbfe210640 1 -- 172.21.15.64:0/3531423239 wait complete. 2023-10-14T22:44:33.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.549+0000 7fdbfe210640 1 Processor -- start 2023-10-14T22:44:33.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.549+0000 7fdbfe210640 1 -- start start 2023-10-14T22:44:33.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.550+0000 7fdbfe210640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbf80b4080 0x7fdbf8159460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.550+0000 7fdbfe210640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbf80cade0 0x7fdbf81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.559 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.550+0000 7fdbfe210640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf81f22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.550+0000 7fdbfe210640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80c3a70 con 0x7fdbf8157380 2023-10-14T22:44:33.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.550+0000 7fdbfe210640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80c3d10 con 0x7fdbf80b4080 2023-10-14T22:44:33.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.550+0000 7fdbfe210640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf80c3ff0 con 0x7fdbf80cade0 2023-10-14T22:44:33.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf81f22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf81f22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40604/0 (socket says 172.21.15.64:40604) 2023-10-14T22:44:33.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 -- 172.21.15.64:0/4294890603 learned_addr learned my addr 172.21.15.64:0/4294890603 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:33.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf77fe640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbf80b4080 0x7fdbf8159460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbeffff640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbf80cade0 0x7fdbf81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 -- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbf80cade0 msgr2=0x7fdbf81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbf80cade0 0x7fdbf81555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 -- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbf80b4080 msgr2=0x7fdbf8159460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdbf80b4080 0x7fdbf8159460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 -- 172.21.15.64:0/4294890603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe8009400 con 0x7fdbf8157380 2023-10-14T22:44:33.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbeffff640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdbf80cade0 0x7fdbf81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:33.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.551+0000 7fdbf7fff640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf81f22c0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000cd70 tx=0x7fdbf000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.552+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0003b90 con 0x7fdbf8157380 2023-10-14T22:44:33.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.552+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbf0003cf0 con 0x7fdbf8157380 2023-10-14T22:44:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.552+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbf0004240 con 0x7fdbf8157380 2023-10-14T22:44:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.552+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbf80c42d0 con 0x7fdbf8157380 2023-10-14T22:44:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.552+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbf81f2800 con 0x7fdbf8157380 2023-10-14T22:44:33.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.553+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdbf81f2a20 con 0x7fdbf8157380 2023-10-14T22:44:33.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.554+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdbf00043a0 con 0x7fdbf8157380 2023-10-14T22:44:33.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.555+0000 7fdbf4ff9640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdbd806ae70 0x7fdbd806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.555+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdbf0012070 con 0x7fdbf8157380 2023-10-14T22:44:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.555+0000 7fdbf4ff9640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7fdbd8071170 0x7fdbd80735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.555+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 --> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdbd8073c80 con 0x7fdbd8071170 2023-10-14T22:44:33.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.555+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdbf008d020 con 0x7fdbf8157380 2023-10-14T22:44:33.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.556+0000 7fdbf77fe640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdbd806ae70 0x7fdbd806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.556+0000 7fdbeffff640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7fdbd8071170 0x7fdbd80735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.556+0000 7fdbeffff640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7fdbd8071170 0x7fdbd80735b0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.557+0000 7fdbf77fe640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdbd806ae70 0x7fdbd806d330 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8036000 tx=0x7fdbe803d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.557+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== osd.2 v2:172.21.15.64:6820/496287232 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fdbd8073c80 con 0x7fdbd8071170 2023-10-14T22:44:33.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.584+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 --> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdbf80ce040 con 0x7fdbd8071170 2023-10-14T22:44:33.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.584+0000 7fdbf4ff9640 1 -- 172.21.15.64:0/4294890603 <== osd.2 v2:172.21.15.64:6820/496287232 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdbe0001860 con 0x7fdbd8071170 2023-10-14T22:44:33.588 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:33.588 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:33.588 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:33.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7fdbd8071170 msgr2=0x7fdbd80735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:6820/496287232,v1:172.21.15.64:6821/496287232] conn(0x7fdbd8071170 0x7fdbd80735b0 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdbd806ae70 msgr2=0x7fdbd806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fdbd806ae70 0x7fdbd806d330 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fdbe8036000 tx=0x7fdbe803d040 comp rx=0 tx=0).stop 2023-10-14T22:44:33.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 msgr2=0x7fdbf81f22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 --2- 172.21.15.64:0/4294890603 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdbf8157380 0x7fdbf81f22c0 secure :-1 s=READY pgs=2266 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000cd70 tx=0x7fdbf000a660 comp rx=0 tx=0).stop 2023-10-14T22:44:33.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbf7fff640 1 -- 172.21.15.64:0/4294890603 reap_dead start 2023-10-14T22:44:33.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 shutdown_connections 2023-10-14T22:44:33.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 >> 172.21.15.64:0/4294890603 conn(0x7fdbf806c190 msgr2=0x7fdbf815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:33.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 shutdown_connections 2023-10-14T22:44:33.592 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.585+0000 7fdbfe210640 1 -- 172.21.15.64:0/4294890603 wait complete. 2023-10-14T22:44:33.604 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-14T22:44:33.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.791+0000 7f227e5e2640 1 Processor -- start 2023-10-14T22:44:33.794 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.791+0000 7f227e5e2640 1 -- start start 2023-10-14T22:44:33.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.793+0000 7f227e5e2640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f22780ad440 0x7f227806da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.793+0000 7f227e5e2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22780cb120 0x7f22780cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.796 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.793+0000 7f227e5e2640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2278158d60 con 0x7f227806e0e0 2023-10-14T22:44:33.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.793+0000 7f227e5e2640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22780cacd0 con 0x7f22780ad440 2023-10-14T22:44:33.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.793+0000 7f227e5e2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22780cd4d0 con 0x7f22780cb120 2023-10-14T22:44:33.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.793+0000 7f227d5e0640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f227806e0e0 0x7f22780b1210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54368/0 (socket says 172.21.15.64:54368) 2023-10-14T22:44:33.797 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.793+0000 7f227d5e0640 1 -- 172.21.15.64:0/2835924563 learned_addr learned my addr 172.21.15.64:0/2835924563 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:33.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1185943195 0 0) 0x7f2278158d60 con 0x7f227806e0e0 2023-10-14T22:44:33.800 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f227cddf640 1 --2- 172.21.15.64:0/2835924563 >> v2:172.21.15.177:3300/0 conn(0x7f22780ad440 0x7f227806da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2264003520 con 0x7f227806e0e0 2023-10-14T22:44:33.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f227dde1640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22780cb120 0x7f22780cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 272112002 0 0) 0x7f2264003520 con 0x7f227806e0e0 2023-10-14T22:44:33.801 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22780cb120 msgr2=0x7f22780cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22780cb120 0x7f22780cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 >> v2:172.21.15.177:3300/0 conn(0x7f22780ad440 msgr2=0x7f227806da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.802 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 --2- 172.21.15.64:0/2835924563 >> v2:172.21.15.177:3300/0 conn(0x7f22780ad440 0x7f227806da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22780cd770 con 0x7f227806e0e0 2023-10-14T22:44:33.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f22740017f0 con 0x7f227806e0e0 2023-10-14T22:44:33.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.794+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 >> v1:172.21.15.64:6789/0 conn(0x7f227806e0e0 legacy=0x7f22780b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.803 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f226ffff640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2264003970 0x7f2264003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f226ffff640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22780cb120 0x7f22640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f226ffff640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2264004d00 0x7f2264005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780cacd0 con 0x7f2264004d00 2023-10-14T22:44:33.804 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22780cd4d0 con 0x7f2264003970 2023-10-14T22:44:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f226400dbc0 con 0x7f22780cb120 2023-10-14T22:44:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f227dde1640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2264004d00 0x7f2264005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.805 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f227dde1640 1 -- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22780cb120 msgr2=0x7f22640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f227dde1640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f22780cb120 0x7f22640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f227dde1640 1 -- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2264003970 msgr2=0x7f2264003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:33.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f227dde1640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f2264003970 0x7f2264003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.806 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.795+0000 7f227dde1640 1 -- 172.21.15.64:0/2835924563 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2264003520 con 0x7f2264004d00 2023-10-14T22:44:33.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.796+0000 7f227dde1640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2264004d00 0x7f2264005180 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f2270009fc0 tx=0x7f22640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704b5f180774805e server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227002cc60 con 0x7f2264004d00 2023-10-14T22:44:33.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f227000f040 con 0x7f2264004d00 2023-10-14T22:44:33.807 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f226ffff640 1 -- 172.21.15.64:0/2835924563 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270034440 con 0x7f2264004d00 2023-10-14T22:44:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f227e5e2640 1 -- 172.21.15.64:0/2835924563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2264004d00 msgr2=0x7f2264005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f227e5e2640 1 --2- 172.21.15.64:0/2835924563 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2264004d00 0x7f2264005180 secure :-1 s=READY pgs=2268 cs=0 l=1 rev1=1 crypto rx=0x7f2270009fc0 tx=0x7f22640057f0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f227dde1640 1 -- 172.21.15.64:0/2835924563 reap_dead start 2023-10-14T22:44:33.808 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f227e5e2640 1 -- 172.21.15.64:0/2835924563 shutdown_connections 2023-10-14T22:44:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f227e5e2640 1 -- 172.21.15.64:0/2835924563 >> 172.21.15.64:0/2835924563 conn(0x7f2278069fc0 msgr2=0x7f227806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f227e5e2640 1 -- 172.21.15.64:0/2835924563 shutdown_connections 2023-10-14T22:44:33.809 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.797+0000 7f227e5e2640 1 -- 172.21.15.64:0/2835924563 wait complete. 2023-10-14T22:44:33.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.799+0000 7f227e5e2640 1 Processor -- start 2023-10-14T22:44:33.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.799+0000 7f227e5e2640 1 -- start start 2023-10-14T22:44:33.812 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227e5e2640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2264004d00 0x7f22780ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227e5e2640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f227815a7f0 0x7f227815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227e5e2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2278157de0 0x7f2278158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227e5e2640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227815b2b0 con 0x7f2278157de0 2023-10-14T22:44:33.813 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227e5e2640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227815b590 con 0x7f227815a7f0 2023-10-14T22:44:33.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227e5e2640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227815b870 con 0x7f2264004d00 2023-10-14T22:44:33.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227dde1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2278157de0 0x7f2278158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227dde1640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2278157de0 0x7f2278158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40618/0 (socket says 172.21.15.64:40618) 2023-10-14T22:44:33.814 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.800+0000 7f227dde1640 1 -- 172.21.15.64:0/2413777031 learned_addr learned my addr 172.21.15.64:0/2413777031 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:33.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f227dde1640 1 -- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2264004d00 msgr2=0x7f22780ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f227dde1640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2264004d00 0x7f22780ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f227dde1640 1 -- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f227815a7f0 msgr2=0x7f227815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:33.815 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f227dde1640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f227815a7f0 0x7f227815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:33.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f227dde1640 1 -- 172.21.15.64:0/2413777031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227815bb50 con 0x7f2278157de0 2023-10-14T22:44:33.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f227dde1640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2278157de0 0x7f2278158260 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f2270037040 tx=0x7f2270009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f226dffb640 1 -- 172.21.15.64:0/2413777031 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270034b50 con 0x7f2278157de0 2023-10-14T22:44:33.816 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f226dffb640 1 -- 172.21.15.64:0/2413777031 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2270034cb0 con 0x7f2278157de0 2023-10-14T22:44:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.801+0000 7f226dffb640 1 -- 172.21.15.64:0/2413777031 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270003bd0 con 0x7f2278157de0 2023-10-14T22:44:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.802+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227815be30 con 0x7f2278157de0 2023-10-14T22:44:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.802+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22781587a0 con 0x7f2278157de0 2023-10-14T22:44:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.803+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227804e9b0 con 0x7f2278157de0 2023-10-14T22:44:33.817 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.804+0000 7f226dffb640 1 -- 172.21.15.64:0/2413777031 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f2270047460 con 0x7f2278157de0 2023-10-14T22:44:33.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.804+0000 7f226dffb640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f225c06ae70 0x7f225c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:33.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.805+0000 7f226dffb640 1 -- 172.21.15.64:0/2413777031 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f22700ab370 con 0x7f2278157de0 2023-10-14T22:44:33.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.805+0000 7f227d5e0640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f225c06ae70 0x7f225c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:33.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.806+0000 7f227d5e0640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f225c06ae70 0x7f225c06d330 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2274001eb0 tx=0x7f22740015b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:33.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.809+0000 7f226dffb640 1 -- 172.21.15.64:0/2413777031 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f2270076690 con 0x7f2278157de0 2023-10-14T22:44:34.000 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.998+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f22780cdd30 con 0x7f225c06ae70 2023-10-14T22:44:34.001 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:33.998+0000 7f226dffb640 1 -- 172.21.15.64:0/2413777031 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f2274007e30 con 0x7f225c06ae70 2023-10-14T22:44:34.001 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 2 to deep-scrub 2023-10-14T22:44:34.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f225c06ae70 msgr2=0x7f225c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.004 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f225c06ae70 0x7f225c06d330 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f2274001eb0 tx=0x7f22740015b0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2278157de0 msgr2=0x7f2278158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2278157de0 0x7f2278158260 secure :-1 s=READY pgs=2269 cs=0 l=1 rev1=1 crypto rx=0x7f2270037040 tx=0x7f2270009750 comp rx=0 tx=0).stop 2023-10-14T22:44:34.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 shutdown_connections 2023-10-14T22:44:34.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f225c06ae70 0x7f225c06d330 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f2278157de0 0x7f2278158260 unknown :-1 s=CLOSED pgs=2269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f227815a7f0 0x7f227815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 --2- 172.21.15.64:0/2413777031 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f2264004d00 0x7f22780ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 >> 172.21.15.64:0/2413777031 conn(0x7f2278069fc0 msgr2=0x7f22780ce730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:34.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 shutdown_connections 2023-10-14T22:44:34.007 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.001+0000 7f227e5e2640 1 -- 172.21.15.64:0/2413777031 wait complete. 2023-10-14T22:44:34.021 INFO:tasks.ceph:Scrubbing osd.3 2023-10-14T22:44:34.022 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:34.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.236+0000 7f71f49b8640 1 Processor -- start 2023-10-14T22:44:34.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.236+0000 7f71f49b8640 1 -- start start 2023-10-14T22:44:34.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71f49b8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71f006c630 0x7f71f0159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71f49b8640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f00c89d0 con 0x7f71f0071b50 2023-10-14T22:44:34.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71f49b8640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71f0071600 con 0x7f71f0071f30 2023-10-14T22:44:34.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71f49b8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f015a260 con 0x7f71f006c630 2023-10-14T22:44:34.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ef7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f71f0071b50 0x7f71f0070ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54376/0 (socket says 172.21.15.64:54376) 2023-10-14T22:44:34.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ef7fe640 1 -- 172.21.15.64:0/3555888962 learned_addr learned my addr 172.21.15.64:0/3555888962 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:34.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3638510609 0 0) 0x7f71f00c89d0 con 0x7f71f0071b50 2023-10-14T22:44:34.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71effff640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71f006c630 0x7f71f0159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71d8005730 con 0x7f71f0071b50 2023-10-14T22:44:34.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4119674181 0 0) 0x7f71d8005730 con 0x7f71f0071b50 2023-10-14T22:44:34.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71f006c630 msgr2=0x7f71f0159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:34.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71f006c630 0x7f71f0159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 >> v1:172.21.15.177:6789/0 conn(0x7f71f0071f30 legacy=0x7f71f006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f015a540 con 0x7f71f0071b50 2023-10-14T22:44:34.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f71e0001670 con 0x7f71f0071b50 2023-10-14T22:44:34.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 >> v1:172.21.15.64:6789/0 conn(0x7f71f0071b50 legacy=0x7f71f0070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8005bb0 0x7f71d8005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d80069d0 0x7f71d8006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71d8007390 0x7f71d800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f015a260 con 0x7f71d8007390 2023-10-14T22:44:34.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d800e290 con 0x7f71d80069d0 2023-10-14T22:44:34.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d800e450 con 0x7f71d8005bb0 2023-10-14T22:44:34.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71effff640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71f006c630 0x7f71f0159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T22:44:34.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.238+0000 7f71effff640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71d8007390 0x7f71d800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71eeffd640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d80069d0 0x7f71d8006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71ef7fe640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8005bb0 0x7f71d8005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71effff640 1 -- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8005bb0 msgr2=0x7f71d8005fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:34.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71effff640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8005bb0 0x7f71d8005fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71effff640 1 -- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d80069d0 msgr2=0x7f71d8006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:34.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71effff640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d80069d0 0x7f71d8006e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71effff640 1 -- 172.21.15.64:0/3555888962 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d8005730 con 0x7f71d8007390 2023-10-14T22:44:34.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.239+0000 7f71eeffd640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71d80069d0 0x7f71d8006e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-14T22:44:34.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.240+0000 7f71effff640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71d8007390 0x7f71d800db90 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f71f00b4450 tx=0x7f71d8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a6d16f676753f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.240+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e802cc80 con 0x7f71d8007390 2023-10-14T22:44:34.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.240+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e802cde0 con 0x7f71d8007390 2023-10-14T22:44:34.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.240+0000 7f71ee7fc640 1 -- 172.21.15.64:0/3555888962 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8003bb0 con 0x7f71d8007390 2023-10-14T22:44:34.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.241+0000 7f71f49b8640 1 -- 172.21.15.64:0/3555888962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71d8007390 msgr2=0x7f71d800db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.241+0000 7f71f49b8640 1 --2- 172.21.15.64:0/3555888962 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71d8007390 0x7f71d800db90 secure :-1 s=READY pgs=2271 cs=0 l=1 rev1=1 crypto rx=0x7f71f00b4450 tx=0x7f71d8007a00 comp rx=0 tx=0).stop 2023-10-14T22:44:34.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.241+0000 7f71effff640 1 -- 172.21.15.64:0/3555888962 reap_dead start 2023-10-14T22:44:34.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.241+0000 7f71f49b8640 1 -- 172.21.15.64:0/3555888962 shutdown_connections 2023-10-14T22:44:34.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.241+0000 7f71f49b8640 1 -- 172.21.15.64:0/3555888962 >> 172.21.15.64:0/3555888962 conn(0x7f71f006a470 msgr2=0x7f71f00afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:34.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.241+0000 7f71f49b8640 1 -- 172.21.15.64:0/3555888962 shutdown_connections 2023-10-14T22:44:34.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.241+0000 7f71f49b8640 1 -- 172.21.15.64:0/3555888962 wait complete. 2023-10-14T22:44:34.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.243+0000 7f71f49b8640 1 Processor -- start 2023-10-14T22:44:34.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.243+0000 7f71f49b8640 1 -- start start 2023-10-14T22:44:34.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71f49b8640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8007390 0x7f71f00cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.259 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71f49b8640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71f01476a0 0x7f71f00c7840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71f49b8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71f00c7d80 0x7f71f00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71f49b8640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00c8200 con 0x7f71f00c7d80 2023-10-14T22:44:34.260 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71f49b8640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71f0153ba0 con 0x7f71f01476a0 2023-10-14T22:44:34.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71f49b8640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71f00b1e30 con 0x7f71d8007390 2023-10-14T22:44:34.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71f00c7d80 0x7f71f00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.261 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71f00c7d80 0x7f71f00caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40632/0 (socket says 172.21.15.64:40632) 2023-10-14T22:44:34.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 -- 172.21.15.64:0/2048875600 learned_addr learned my addr 172.21.15.64:0/2048875600 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:34.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71ef7fe640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8007390 0x7f71f00cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71eeffd640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71f01476a0 0x7f71f00c7840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.262 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 -- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8007390 msgr2=0x7f71f00cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f71d8007390 0x7f71f00cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 -- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71f01476a0 msgr2=0x7f71f00c7840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.263 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f71f01476a0 0x7f71f00c7840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.244+0000 7f71effff640 1 -- 172.21.15.64:0/2048875600 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71f00b1220 con 0x7f71f00c7d80 2023-10-14T22:44:34.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.245+0000 7f71effff640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71f00c7d80 0x7f71f00caa40 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f71e802bd30 tx=0x7f71e8004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.245+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e803c070 con 0x7f71f00c7d80 2023-10-14T22:44:34.264 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.245+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71e8003e50 con 0x7f71f00c7d80 2023-10-14T22:44:34.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.245+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71e8004730 con 0x7f71f00c7d80 2023-10-14T22:44:34.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.245+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71f00b1500 con 0x7f71f00c7d80 2023-10-14T22:44:34.265 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.245+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71f00b1ac0 con 0x7f71f00c7d80 2023-10-14T22:44:34.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.246+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f71f015ab00 con 0x7f71f00c7d80 2023-10-14T22:44:34.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.248+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f71e8037460 con 0x7f71f00c7d80 2023-10-14T22:44:34.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.248+0000 7f71d7fff640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f71dc06ae70 0x7f71dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.266 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.249+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f71e80aab40 con 0x7f71f00c7d80 2023-10-14T22:44:34.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.249+0000 7f71d7fff640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7f71dc071170 0x7f71dc0735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.249+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 --> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f71dc073c80 con 0x7f71dc071170 2023-10-14T22:44:34.267 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.249+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71e80af240 con 0x7f71f00c7d80 2023-10-14T22:44:34.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.249+0000 7f71ef7fe640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f71dc06ae70 0x7f71dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.249+0000 7f71eeffd640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7f71dc071170 0x7f71dc0735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.250+0000 7f71eeffd640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7f71dc071170 0x7f71dc0735b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.268 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.250+0000 7f71ef7fe640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f71dc06ae70 0x7f71dc06d330 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005a30 tx=0x7f71e0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.251+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== osd.3 v2:172.21.15.64:6800/635710568 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7f71dc073c80 con 0x7f71dc071170 2023-10-14T22:44:34.269 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 --> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f71f015a820 con 0x7f71dc071170 2023-10-14T22:44:34.270 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71d7fff640 1 -- 172.21.15.64:0/2048875600 <== osd.3 v2:172.21.15.64:6800/635710568 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f71e400d040 con 0x7f71dc071170 2023-10-14T22:44:34.270 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:34.270 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:34.271 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:34.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7f71dc071170 msgr2=0x7f71dc0735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:6800/635710568,v1:172.21.15.64:6801/635710568] conn(0x7f71dc071170 0x7f71dc0735b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.272 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f71dc06ae70 msgr2=0x7f71dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f71dc06ae70 0x7f71dc06d330 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f71e0005a30 tx=0x7f71e0009040 comp rx=0 tx=0).stop 2023-10-14T22:44:34.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71f00c7d80 msgr2=0x7f71f00caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.273 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 --2- 172.21.15.64:0/2048875600 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f71f00c7d80 0x7f71f00caa40 secure :-1 s=READY pgs=2272 cs=0 l=1 rev1=1 crypto rx=0x7f71e802bd30 tx=0x7f71e8004ab0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71effff640 1 -- 172.21.15.64:0/2048875600 reap_dead start 2023-10-14T22:44:34.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 shutdown_connections 2023-10-14T22:44:34.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 >> 172.21.15.64:0/2048875600 conn(0x7f71f006a470 msgr2=0x7f71f00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:34.274 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 shutdown_connections 2023-10-14T22:44:34.275 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.266+0000 7f71f49b8640 1 -- 172.21.15.64:0/2048875600 wait complete. 2023-10-14T22:44:34.286 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-14T22:44:34.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.504+0000 7f7100f0c640 1 Processor -- start 2023-10-14T22:44:34.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.505+0000 7f7100f0c640 1 -- start start 2023-10-14T22:44:34.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f7100f0c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc06d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f7100f0c640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f70fc06dc20 0x7f70fc0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f7100f0c640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f70fc0ceb40 0x7f70fc0b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f7100f0c640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc0ceff0 con 0x7f70fc06dc20 2023-10-14T22:44:34.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f7100f0c640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70fc15e2b0 con 0x7f70fc0ceb40 2023-10-14T22:44:34.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f7100f0c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc15f0d0 con 0x7f70fc0b2dd0 2023-10-14T22:44:34.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f70f3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f70fc06dc20 0x7f70fc0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f70f3fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f70fc06dc20 0x7f70fc0ce600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40648/0 (socket says 172.21.15.64:40648) 2023-10-14T22:44:34.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.506+0000 7f70f3fff640 1 -- 172.21.15.64:0/836785611 learned_addr learned my addr 172.21.15.64:0/836785611 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:34.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.507+0000 7f70fbfff640 1 --2- 172.21.15.64:0/836785611 >> v2:172.21.15.177:3300/0 conn(0x7f70fc0ceb40 0x7f70fc0b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.507+0000 7f70fb7fe640 1 --2- 172.21.15.64:0/836785611 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc06d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.507+0000 7f70f3fff640 1 -- 172.21.15.64:0/836785611 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 msgr2=0x7f70fc06d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:34.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.507+0000 7f70f3fff640 1 --2- 172.21.15.64:0/836785611 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc06d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.507+0000 7f70f3fff640 1 -- 172.21.15.64:0/836785611 >> v2:172.21.15.177:3300/0 conn(0x7f70fc0ceb40 msgr2=0x7f70fc0b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:34.514 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.507+0000 7f70f3fff640 1 --2- 172.21.15.64:0/836785611 >> v2:172.21.15.177:3300/0 conn(0x7f70fc0ceb40 0x7f70fc0b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.507+0000 7f70f3fff640 1 -- 172.21.15.64:0/836785611 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc15ab50 con 0x7f70fc06dc20 2023-10-14T22:44:34.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.508+0000 7f70f3fff640 1 --2- 172.21.15.64:0/836785611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc0ce600 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f70fc06fdb0 tx=0x7f70e402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79df7b7916ca613b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.508+0000 7f70faffd640 1 -- 172.21.15.64:0/836785611 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4031870 con 0x7f70fc06dc20 2023-10-14T22:44:34.515 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.508+0000 7f70faffd640 1 -- 172.21.15.64:0/836785611 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70e40319d0 con 0x7f70fc06dc20 2023-10-14T22:44:34.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.508+0000 7f70faffd640 1 -- 172.21.15.64:0/836785611 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e4031d60 con 0x7f70fc06dc20 2023-10-14T22:44:34.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 -- 172.21.15.64:0/836785611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 msgr2=0x7f70fc0ce600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 --2- 172.21.15.64:0/836785611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc0ce600 secure :-1 s=READY pgs=2273 cs=0 l=1 rev1=1 crypto rx=0x7f70fc06fdb0 tx=0x7f70e402b910 comp rx=0 tx=0).stop 2023-10-14T22:44:34.516 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 -- 172.21.15.64:0/836785611 shutdown_connections 2023-10-14T22:44:34.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 --2- 172.21.15.64:0/836785611 >> v2:172.21.15.177:3300/0 conn(0x7f70fc0ceb40 0x7f70fc0b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 --2- 172.21.15.64:0/836785611 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc0ce600 unknown :-1 s=CLOSED pgs=2273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 --2- 172.21.15.64:0/836785611 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc06d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.517 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 -- 172.21.15.64:0/836785611 >> 172.21.15.64:0/836785611 conn(0x7f70fc069fc0 msgr2=0x7f70fc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:34.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 -- 172.21.15.64:0/836785611 shutdown_connections 2023-10-14T22:44:34.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.509+0000 7f7100f0c640 1 -- 172.21.15.64:0/836785611 wait complete. 2023-10-14T22:44:34.518 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.511+0000 7f7100f0c640 1 Processor -- start 2023-10-14T22:44:34.519 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.511+0000 7f7100f0c640 1 -- start start 2023-10-14T22:44:34.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f7100f0c640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc1f0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.521 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f7100f0c640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f7100f0c640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc0ceb40 0x7f70fc0c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f7100f0c640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc15cc50 con 0x7f70fc06dc20 2023-10-14T22:44:34.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f7100f0c640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc15c3b0 con 0x7f70fc0ceb40 2023-10-14T22:44:34.522 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f7100f0c640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70fc15c690 con 0x7f70fc0b2dd0 2023-10-14T22:44:34.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc1f0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f70fb7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc1f0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40650/0 (socket says 172.21.15.64:40650) 2023-10-14T22:44:34.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.512+0000 7f70fb7fe640 1 -- 172.21.15.64:0/1351515037 learned_addr learned my addr 172.21.15.64:0/1351515037 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:34.523 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fbfff640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc0ceb40 0x7f70fc0c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70f3fff640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fb7fe640 1 -- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 msgr2=0x7f70fc0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.524 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fb7fe640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc0c7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fb7fe640 1 -- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc0ceb40 msgr2=0x7f70fc0c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fb7fe640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc0ceb40 0x7f70fc0c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fb7fe640 1 -- 172.21.15.64:0/1351515037 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40094d0 con 0x7f70fc06dc20 2023-10-14T22:44:34.525 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fbfff640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc0ceb40 0x7f70fc0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:34.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70fb7fe640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc1f0c40 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00d800 tx=0x7f70ec00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70f8ff9640 1 -- 172.21.15.64:0/1351515037 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0096a0 con 0x7f70fc06dc20 2023-10-14T22:44:34.526 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70f8ff9640 1 -- 172.21.15.64:0/1351515037 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70ec009800 con 0x7f70fc06dc20 2023-10-14T22:44:34.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70fc15c970 con 0x7f70fc06dc20 2023-10-14T22:44:34.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.513+0000 7f70f8ff9640 1 -- 172.21.15.64:0/1351515037 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70ec009b90 con 0x7f70fc06dc20 2023-10-14T22:44:34.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.514+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70fc09b690 con 0x7f70fc06dc20 2023-10-14T22:44:34.527 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.515+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70fc149220 con 0x7f70fc06dc20 2023-10-14T22:44:34.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.516+0000 7f70f8ff9640 1 -- 172.21.15.64:0/1351515037 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f70ec009cf0 con 0x7f70fc06dc20 2023-10-14T22:44:34.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.517+0000 7f70f8ff9640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f70dc06ae70 0x7f70dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.517+0000 7f70f8ff9640 1 -- 172.21.15.64:0/1351515037 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f70ec0898b0 con 0x7f70fc06dc20 2023-10-14T22:44:34.528 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.518+0000 7f70f3fff640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f70dc06ae70 0x7f70dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.519+0000 7f70f3fff640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f70dc06ae70 0x7f70dc06d330 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f70e4036000 tx=0x7f70e403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.529 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.522+0000 7f70f8ff9640 1 -- 172.21.15.64:0/1351515037 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f70fc149220 con 0x7f70fc06dc20 2023-10-14T22:44:34.721 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.718+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f70fc15e4c0 con 0x7f70dc06ae70 2023-10-14T22:44:34.722 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.719+0000 7f70f8ff9640 1 -- 172.21.15.64:0/1351515037 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f70e4031b40 con 0x7f70dc06ae70 2023-10-14T22:44:34.722 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 3 to deep-scrub 2023-10-14T22:44:34.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f70dc06ae70 msgr2=0x7f70dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f70dc06ae70 0x7f70dc06d330 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f70e4036000 tx=0x7f70e403c040 comp rx=0 tx=0).stop 2023-10-14T22:44:34.725 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 msgr2=0x7f70fc1f0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc1f0c40 secure :-1 s=READY pgs=2274 cs=0 l=1 rev1=1 crypto rx=0x7f70ec00d800 tx=0x7f70ec00dcc0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 shutdown_connections 2023-10-14T22:44:34.726 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f70dc06ae70 0x7f70dc06d330 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f70fc0ceb40 0x7f70fc0c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f70fc0b2dd0 0x7f70fc0c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 --2- 172.21.15.64:0/1351515037 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f70fc06dc20 0x7f70fc1f0c40 unknown :-1 s=CLOSED pgs=2274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.727 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 >> 172.21.15.64:0/1351515037 conn(0x7f70fc069fc0 msgr2=0x7f70fc0c4b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:34.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 shutdown_connections 2023-10-14T22:44:34.728 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.722+0000 7f7100f0c640 1 -- 172.21.15.64:0/1351515037 wait complete. 2023-10-14T22:44:34.745 INFO:tasks.ceph:Scrubbing osd.4 2023-10-14T22:44:34.745 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:34.970 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.969+0000 7fb0c882e640 1 Processor -- start 2023-10-14T22:44:34.971 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.969+0000 7fb0c882e640 1 -- start start 2023-10-14T22:44:34.973 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0c882e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fb0c415ce30 0x7fb0c415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0c882e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fb0c40cbef0 0x7fb0c40cc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0c882e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0c415d810 con 0x7fb0c415ca50 2023-10-14T22:44:34.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0c882e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c415d2c0 con 0x7fb0c415ce30 2023-10-14T22:44:34.974 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0c882e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0c40cc8a0 con 0x7fb0c40cbef0 2023-10-14T22:44:34.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0c37fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fb0c415ca50 0x7fb0c41607d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54380/0 (socket says 172.21.15.64:54380) 2023-10-14T22:44:34.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0c37fe640 1 -- 172.21.15.64:0/2803348210 learned_addr learned my addr 172.21.15.64:0/2803348210 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:34.975 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.971+0000 7fb0bbfff640 1 --2- 172.21.15.64:0/2803348210 >> v2:172.21.15.64:3300/0 conn(0x7fb0c415ce30 0x7fb0c415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.972+0000 7fb0c3fff640 1 --2- 172.21.15.64:0/2803348210 >> v2:172.21.15.177:3300/0 conn(0x7fb0c40cbef0 0x7fb0c40cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.972+0000 7fb0bbfff640 1 -- 172.21.15.64:0/2803348210 >> v2:172.21.15.177:3300/0 conn(0x7fb0c40cbef0 msgr2=0x7fb0c40cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:34.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.972+0000 7fb0bbfff640 1 --2- 172.21.15.64:0/2803348210 >> v2:172.21.15.177:3300/0 conn(0x7fb0c40cbef0 0x7fb0c40cc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.976 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.972+0000 7fb0bbfff640 1 -- 172.21.15.64:0/2803348210 >> v1:172.21.15.64:6789/0 conn(0x7fb0c415ca50 legacy=0x7fb0c41607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.977 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.972+0000 7fb0bbfff640 1 -- 172.21.15.64:0/2803348210 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c4161220 con 0x7fb0c415ce30 2023-10-14T22:44:34.978 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.973+0000 7fb0bbfff640 1 --2- 172.21.15.64:0/2803348210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c415dca0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0097d0 tx=0x7fb0ac02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1543e47ee38d612d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c2ffd640 1 -- 172.21.15.64:0/2803348210 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0316f0 con 0x7fb0c415ce30 2023-10-14T22:44:34.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c2ffd640 1 -- 172.21.15.64:0/2803348210 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac031850 con 0x7fb0c415ce30 2023-10-14T22:44:34.979 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c2ffd640 1 -- 172.21.15.64:0/2803348210 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac031be0 con 0x7fb0c415ce30 2023-10-14T22:44:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 -- 172.21.15.64:0/2803348210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 msgr2=0x7fb0c415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 --2- 172.21.15.64:0/2803348210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c415dca0 secure :-1 s=READY pgs=2276 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0097d0 tx=0x7fb0ac02b790 comp rx=0 tx=0).stop 2023-10-14T22:44:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 -- 172.21.15.64:0/2803348210 shutdown_connections 2023-10-14T22:44:34.980 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 --2- 172.21.15.64:0/2803348210 >> v2:172.21.15.177:3300/0 conn(0x7fb0c40cbef0 0x7fb0c40cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 --2- 172.21.15.64:0/2803348210 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c415dca0 unknown :-1 s=CLOSED pgs=2276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 -- 172.21.15.64:0/2803348210 >> 172.21.15.64:0/2803348210 conn(0x7fb0c40b0fd0 msgr2=0x7fb0c40b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:34.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 -- 172.21.15.64:0/2803348210 shutdown_connections 2023-10-14T22:44:34.981 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.974+0000 7fb0c882e640 1 -- 172.21.15.64:0/2803348210 wait complete. 2023-10-14T22:44:34.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.976+0000 7fb0c882e640 1 Processor -- start 2023-10-14T22:44:34.982 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.976+0000 7fb0c882e640 1 -- start start 2023-10-14T22:44:34.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.977+0000 7fb0c882e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c40cbef0 0x7fb0c40adeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.977+0000 7fb0c882e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c415ca50 0x7fb0c4154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.985 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.977+0000 7fb0c882e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c40c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.977+0000 7fb0c882e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40ab860 con 0x7fb0c415ce30 2023-10-14T22:44:34.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.977+0000 7fb0c882e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40ac100 con 0x7fb0c415ca50 2023-10-14T22:44:34.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.977+0000 7fb0c882e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0c40ca1d0 con 0x7fb0c40cbef0 2023-10-14T22:44:34.986 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c40c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c40c7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40670/0 (socket says 172.21.15.64:40670) 2023-10-14T22:44:34.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 -- 172.21.15.64:0/1905480052 learned_addr learned my addr 172.21.15.64:0/1905480052 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:34.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c37fe640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c40cbef0 0x7fb0c40adeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.987 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0bbfff640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c415ca50 0x7fb0c4154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 -- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c40cbef0 msgr2=0x7fb0c40adeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fb0c40cbef0 0x7fb0c40adeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 -- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c415ca50 msgr2=0x7fb0c4154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:34.988 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fb0c415ca50 0x7fb0c4154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:34.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 -- 172.21.15.64:0/1905480052 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac009400 con 0x7fb0c415ce30 2023-10-14T22:44:34.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.978+0000 7fb0c3fff640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c40c7ba0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc007e40 tx=0x7fb0bc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.989 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.979+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc014620 con 0x7fb0c415ce30 2023-10-14T22:44:34.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.979+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0bc0147a0 con 0x7fb0c415ce30 2023-10-14T22:44:34.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.979+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc014b50 con 0x7fb0c415ce30 2023-10-14T22:44:34.990 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.979+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0c40ae520 con 0x7fb0c415ce30 2023-10-14T22:44:34.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.979+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0c40abd90 con 0x7fb0c415ce30 2023-10-14T22:44:34.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.980+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0c415d4a0 con 0x7fb0c415ce30 2023-10-14T22:44:34.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.981+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fb0bc014cb0 con 0x7fb0c415ce30 2023-10-14T22:44:34.991 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.982+0000 7fb0c0ff9640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0a406ae70 0x7fb0a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.982+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb0bc089dc0 con 0x7fb0c415ce30 2023-10-14T22:44:34.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.982+0000 7fb0c0ff9640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7fb0a4071170 0x7fb0a40735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:34.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.982+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 --> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0a4073c80 con 0x7fb0a4071170 2023-10-14T22:44:34.992 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.982+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0bc08c3a0 con 0x7fb0c415ce30 2023-10-14T22:44:34.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.983+0000 7fb0c37fe640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0a406ae70 0x7fb0a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.993 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.983+0000 7fb0bbfff640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7fb0a4071170 0x7fb0a40735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:34.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.984+0000 7fb0c37fe640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0a406ae70 0x7fb0a406d330 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005880 tx=0x7fb0b4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.984+0000 7fb0bbfff640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7fb0a4071170 0x7fb0a40735b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:34.994 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:34.986+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== osd.4 v2:172.21.15.177:6800/2887223078 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fb0a4073c80 con 0x7fb0a4071170 2023-10-14T22:44:35.002 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.000+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 --> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0c4161500 con 0x7fb0a4071170 2023-10-14T22:44:35.003 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.001+0000 7fb0c0ff9640 1 -- 172.21.15.64:0/1905480052 <== osd.4 v2:172.21.15.177:6800/2887223078 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb0ac0319c0 con 0x7fb0a4071170 2023-10-14T22:44:35.003 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:35.004 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:35.004 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7fb0a4071170 msgr2=0x7fb0a40735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6800/2887223078,v1:172.21.15.177:6801/2887223078] conn(0x7fb0a4071170 0x7fb0a40735b0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.005 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0a406ae70 msgr2=0x7fb0a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fb0a406ae70 0x7fb0a406d330 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4005880 tx=0x7fb0b4009040 comp rx=0 tx=0).stop 2023-10-14T22:44:35.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 msgr2=0x7fb0c40c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.006 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 --2- 172.21.15.64:0/1905480052 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fb0c415ce30 0x7fb0c40c7ba0 secure :-1 s=READY pgs=2277 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc007e40 tx=0x7fb0bc00e4b0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c3fff640 1 -- 172.21.15.64:0/1905480052 reap_dead start 2023-10-14T22:44:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 shutdown_connections 2023-10-14T22:44:35.009 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.002+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 >> 172.21.15.64:0/1905480052 conn(0x7fb0c40b0fd0 msgr2=0x7fb0c40cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.003+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 shutdown_connections 2023-10-14T22:44:35.010 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.003+0000 7fb0c882e640 1 -- 172.21.15.64:0/1905480052 wait complete. 2023-10-14T22:44:35.022 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-14T22:44:35.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.234+0000 7fc7cdbbf640 1 Processor -- start 2023-10-14T22:44:35.236 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.234+0000 7fc7cdbbf640 1 -- start start 2023-10-14T22:44:35.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7cdbbf640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7c80b2dd0 0x7fc7c806d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7cdbbf640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fc7c80ced10 0x7fc7c80ab180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7cdbbf640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c815f0d0 con 0x7fc7c806dc20 2023-10-14T22:44:35.238 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7cdbbf640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c815e2b0 con 0x7fc7c80b2dd0 2023-10-14T22:44:35.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7cdbbf640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7c815ab50 con 0x7fc7c80ced10 2023-10-14T22:44:35.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7ccbbd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7c80b2dd0 0x7fc7c806d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.239 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7ccbbd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc7c80b2dd0 0x7fc7c806d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40674/0 (socket says 172.21.15.64:40674) 2023-10-14T22:44:35.240 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.236+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2799263915 learned_addr learned my addr 172.21.15.64:0/2799263915 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:35.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.237+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2799263915 >> v2:172.21.15.177:3300/0 conn(0x7fc7c80ced10 msgr2=0x7fc7c80ab180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:35.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.237+0000 7fc7cd3be640 1 --2- 172.21.15.64:0/2799263915 >> v2:172.21.15.177:3300/0 conn(0x7fc7c80ced10 0x7fc7c80ab180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.237+0000 7fc7ccbbd640 1 --2- 172.21.15.64:0/2799263915 >> v2:172.21.15.177:3300/0 conn(0x7fc7c80ced10 0x7fc7c80ab180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.237+0000 7fc7bf7fe640 1 -- 172.21.15.64:0/2799263915 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2718683726 0 0) 0x7fc7c815f0d0 con 0x7fc7c806dc20 2023-10-14T22:44:35.242 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.237+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2799263915 >> v1:172.21.15.64:6789/0 conn(0x7fc7c806dc20 legacy=0x7fc7c80ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.237+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2799263915 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c806d3a0 con 0x7fc7c80b2dd0 2023-10-14T22:44:35.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.238+0000 7fc7ccbbd640 1 --2- 172.21.15.64:0/2799263915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c80b2dd0 0x7fc7c806d6e0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fc7c806e490 tx=0x7fc7c402bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba78bed9b093857b server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:35.243 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.238+0000 7fc7bf7fe640 1 -- 172.21.15.64:0/2799263915 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c402cb70 con 0x7fc7c80b2dd0 2023-10-14T22:44:35.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.238+0000 7fc7bf7fe640 1 -- 172.21.15.64:0/2799263915 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c402ccd0 con 0x7fc7c80b2dd0 2023-10-14T22:44:35.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.238+0000 7fc7bf7fe640 1 -- 172.21.15.64:0/2799263915 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c4034610 con 0x7fc7c80b2dd0 2023-10-14T22:44:35.244 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2799263915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c80b2dd0 msgr2=0x7fc7c806d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2799263915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c80b2dd0 0x7fc7c806d6e0 secure :-1 s=READY pgs=2279 cs=0 l=1 rev1=1 crypto rx=0x7fc7c806e490 tx=0x7fc7c402bfd0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2799263915 shutdown_connections 2023-10-14T22:44:35.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2799263915 >> v2:172.21.15.177:3300/0 conn(0x7fc7c80ced10 0x7fc7c80ab180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2799263915 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c80b2dd0 0x7fc7c806d6e0 unknown :-1 s=CLOSED pgs=2279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2799263915 >> 172.21.15.64:0/2799263915 conn(0x7fc7c8069fc0 msgr2=0x7fc7c806a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:35.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2799263915 shutdown_connections 2023-10-14T22:44:35.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.239+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2799263915 wait complete. 2023-10-14T22:44:35.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.241+0000 7fc7cdbbf640 1 Processor -- start 2023-10-14T22:44:35.249 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.241+0000 7fc7cdbbf640 1 -- start start 2023-10-14T22:44:35.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7cdbbf640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c806dc20 0x7fc7c81ef610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7cdbbf640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7c80b2dd0 0x7fc7c80c5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7cdbbf640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7c80ced10 0x7fc7c814b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.250 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7cdbbf640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80c3050 con 0x7fc7c806dc20 2023-10-14T22:44:35.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7cdbbf640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c815b470 con 0x7fc7c80b2dd0 2023-10-14T22:44:35.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7cdbbf640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c80c7e40 con 0x7fc7c80ced10 2023-10-14T22:44:35.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7ccbbd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c806dc20 0x7fc7c81ef610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.251 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7ccbbd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c806dc20 0x7fc7c81ef610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40688/0 (socket says 172.21.15.64:40688) 2023-10-14T22:44:35.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2260769045 learned_addr learned my addr 172.21.15.64:0/2260769045 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:35.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7bffff640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7c80b2dd0 0x7fc7c80c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.252 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7cd3be640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7c80ced10 0x7fc7c814b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7c80ced10 msgr2=0x7fc7c814b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.242+0000 7fc7ccbbd640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7c80ced10 0x7fc7c814b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7c80b2dd0 msgr2=0x7fc7c80c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.253 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7ccbbd640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7c80b2dd0 0x7fc7c80c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7ccbbd640 1 -- 172.21.15.64:0/2260769045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c4009b30 con 0x7fc7c806dc20 2023-10-14T22:44:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7ccbbd640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c806dc20 0x7fc7c81ef610 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000f80 tx=0x7fc7c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7bd7fa640 1 -- 172.21.15.64:0/2260769045 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c403e450 con 0x7fc7c806dc20 2023-10-14T22:44:35.254 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7bd7fa640 1 -- 172.21.15.64:0/2260769045 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7c403e5b0 con 0x7fc7c806dc20 2023-10-14T22:44:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7bd7fa640 1 -- 172.21.15.64:0/2260769045 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7c403e940 con 0x7fc7c806dc20 2023-10-14T22:44:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c80c8120 con 0x7fc7c806dc20 2023-10-14T22:44:35.255 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.243+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c80c86e0 con 0x7fc7c806dc20 2023-10-14T22:44:35.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.244+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c804e9b0 con 0x7fc7c806dc20 2023-10-14T22:44:35.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.245+0000 7fc7bd7fa640 1 -- 172.21.15.64:0/2260769045 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc7c403eaa0 con 0x7fc7c806dc20 2023-10-14T22:44:35.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.246+0000 7fc7bd7fa640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b406ae70 0x7fc7b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.256 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.246+0000 7fc7bd7fa640 1 -- 172.21.15.64:0/2260769045 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc7c402ce40 con 0x7fc7c806dc20 2023-10-14T22:44:35.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.247+0000 7fc7bffff640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b406ae70 0x7fc7b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.257 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.248+0000 7fc7bffff640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b406ae70 0x7fc7b406d330 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80c4ad0 tx=0x7fc7b8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:35.258 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.251+0000 7fc7bd7fa640 1 -- 172.21.15.64:0/2260769045 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc7c40777d0 con 0x7fc7c806dc20 2023-10-14T22:44:35.446 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.444+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7c815e7a0 con 0x7fc7b406ae70 2023-10-14T22:44:35.447 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 4 to deep-scrub 2023-10-14T22:44:35.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.445+0000 7fc7bd7fa640 1 -- 172.21.15.64:0/2260769045 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc7b8001cf0 con 0x7fc7b406ae70 2023-10-14T22:44:35.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.447+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b406ae70 msgr2=0x7fc7b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.447+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b406ae70 0x7fc7b406d330 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc7c80c4ad0 tx=0x7fc7b8009040 comp rx=0 tx=0).stop 2023-10-14T22:44:35.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.447+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c806dc20 msgr2=0x7fc7c81ef610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c806dc20 0x7fc7c81ef610 secure :-1 s=READY pgs=2280 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4000f80 tx=0x7fc7c4004a40 comp rx=0 tx=0).stop 2023-10-14T22:44:35.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 shutdown_connections 2023-10-14T22:44:35.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc7b406ae70 0x7fc7b406d330 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc7c80ced10 0x7fc7c814b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc7c80b2dd0 0x7fc7c80c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 --2- 172.21.15.64:0/2260769045 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc7c806dc20 0x7fc7c81ef610 unknown :-1 s=CLOSED pgs=2280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 >> 172.21.15.64:0/2260769045 conn(0x7fc7c8069fc0 msgr2=0x7fc7c80ad190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:35.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 shutdown_connections 2023-10-14T22:44:35.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.448+0000 7fc7cdbbf640 1 -- 172.21.15.64:0/2260769045 wait complete. 2023-10-14T22:44:35.594 INFO:tasks.ceph:Scrubbing osd.5 2023-10-14T22:44:35.594 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:35.818 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.816+0000 7fbf155e9640 1 Processor -- start 2023-10-14T22:44:35.819 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.817+0000 7fbf155e9640 1 -- start start 2023-10-14T22:44:35.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.818+0000 7fbf155e9640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbf10071f30 0x7fbf10159c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.820 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.818+0000 7fbf155e9640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf100c89d0 con 0x7fbf100cdc00 2023-10-14T22:44:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.818+0000 7fbf155e9640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf10071600 con 0x7fbf10071b50 2023-10-14T22:44:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.818+0000 7fbf155e9640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf1015a260 con 0x7fbf10071f30 2023-10-14T22:44:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.819+0000 7fbf07fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fbf10071f30 0x7fbf10159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.821 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.819+0000 7fbf14de8640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fbf100cdc00 0x7fbf1006bf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:54394/0 (socket says 172.21.15.64:54394) 2023-10-14T22:44:35.822 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.819+0000 7fbf14de8640 1 -- 172.21.15.64:0/1776077966 learned_addr learned my addr 172.21.15.64:0/1776077966 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:35.823 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.819+0000 7fbf07fff640 1 -- 172.21.15.64:0/1776077966 >> v1:172.21.15.177:6789/0 conn(0x7fbf10071b50 legacy=0x7fbf10070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:35.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.819+0000 7fbf07fff640 1 -- 172.21.15.64:0/1776077966 >> v1:172.21.15.64:6789/0 conn(0x7fbf100cdc00 legacy=0x7fbf1006bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.819+0000 7fbf07fff640 1 -- 172.21.15.64:0/1776077966 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1015a540 con 0x7fbf10071f30 2023-10-14T22:44:35.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.819+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/1776077966 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 526134619 0 0) 0x7fbf100c89d0 con 0x7fbf100cdc00 2023-10-14T22:44:35.824 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.820+0000 7fbf07fff640 1 --2- 172.21.15.64:0/1776077966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10071f30 0x7fbf10159c10 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fbef80097a0 tx=0x7fbef802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8fa244938e388cd server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:35.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/1776077966 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8031830 con 0x7fbf10071f30 2023-10-14T22:44:35.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/1776077966 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbef8031990 con 0x7fbf10071f30 2023-10-14T22:44:35.825 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf0f7fe640 1 -- 172.21.15.64:0/1776077966 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbef8031d20 con 0x7fbf10071f30 2023-10-14T22:44:35.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf155e9640 1 -- 172.21.15.64:0/1776077966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10071f30 msgr2=0x7fbf10159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf155e9640 1 --2- 172.21.15.64:0/1776077966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10071f30 0x7fbf10159c10 secure :-1 s=READY pgs=2282 cs=0 l=1 rev1=1 crypto rx=0x7fbef80097a0 tx=0x7fbef802b8d0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf155e9640 1 -- 172.21.15.64:0/1776077966 shutdown_connections 2023-10-14T22:44:35.826 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf155e9640 1 --2- 172.21.15.64:0/1776077966 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf10071f30 0x7fbf10159c10 unknown :-1 s=CLOSED pgs=2282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.821+0000 7fbf155e9640 1 -- 172.21.15.64:0/1776077966 >> 172.21.15.64:0/1776077966 conn(0x7fbf1006a470 msgr2=0x7fbf100afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:35.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.822+0000 7fbf155e9640 1 -- 172.21.15.64:0/1776077966 shutdown_connections 2023-10-14T22:44:35.827 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.822+0000 7fbf155e9640 1 -- 172.21.15.64:0/1776077966 wait complete. 2023-10-14T22:44:35.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.823+0000 7fbf155e9640 1 Processor -- start 2023-10-14T22:44:35.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.823+0000 7fbf155e9640 1 -- start start 2023-10-14T22:44:35.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.824+0000 7fbf155e9640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf10071b50 0x7fbf100c1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.824+0000 7fbf155e9640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10071f30 0x7fbf10148340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.824+0000 7fbf155e9640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cdc00 0x7fbf100ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.824+0000 7fbf155e9640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf100c16b0 con 0x7fbf100cdc00 2023-10-14T22:44:35.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.824+0000 7fbf155e9640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10148c80 con 0x7fbf10071f30 2023-10-14T22:44:35.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.824+0000 7fbf155e9640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf10148f60 con 0x7fbf10071b50 2023-10-14T22:44:35.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cdc00 0x7fbf100ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cdc00 0x7fbf100ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:40700/0 (socket says 172.21.15.64:40700) 2023-10-14T22:44:35.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 -- 172.21.15.64:0/877997485 learned_addr learned my addr 172.21.15.64:0/877997485 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:35.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf0ffff640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf10071b50 0x7fbf100c1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 -- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf10071b50 msgr2=0x7fbf100c1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fbf10071b50 0x7fbf100c1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.833 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 -- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10071f30 msgr2=0x7fbf10148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf07fff640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10071f30 0x7fbf10148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fbf10071f30 0x7fbf10148340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.825+0000 7fbf14de8640 1 -- 172.21.15.64:0/877997485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef8009400 con 0x7fbf100cdc00 2023-10-14T22:44:35.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.826+0000 7fbf14de8640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cdc00 0x7fbf100ae2c0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c780 tx=0x7fbf0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:35.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.826+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800ce90 con 0x7fbf100cdc00 2023-10-14T22:44:35.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.826+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0800a640 con 0x7fbf100cdc00 2023-10-14T22:44:35.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.826+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf10149240 con 0x7fbf100cdc00 2023-10-14T22:44:35.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.826+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800a9d0 con 0x7fbf100cdc00 2023-10-14T22:44:35.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.826+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf10146670 con 0x7fbf100cdc00 2023-10-14T22:44:35.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.827+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbf1015a820 con 0x7fbf100cdc00 2023-10-14T22:44:35.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.829+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fbf0800ab30 con 0x7fbf100cdc00 2023-10-14T22:44:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.830+0000 7fbf0d7fa640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbef006ae70 0x7fbef006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.830+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fbf080889d0 con 0x7fbf100cdc00 2023-10-14T22:44:35.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.830+0000 7fbf0d7fa640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7fbef0071000 0x7fbef0073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:35.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.830+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 --> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbef0073b10 con 0x7fbef0071000 2023-10-14T22:44:35.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.830+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbf0808d2c0 con 0x7fbf100cdc00 2023-10-14T22:44:35.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.831+0000 7fbf0ffff640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbef006ae70 0x7fbef006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.831+0000 7fbf07fff640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7fbef0071000 0x7fbef0073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:35.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.832+0000 7fbf0ffff640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbef006ae70 0x7fbef006d330 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbf00004ea0 tx=0x7fbf00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:35.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.832+0000 7fbf07fff640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7fbef0071000 0x7fbef0073440 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:35.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.834+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== osd.5 v2:172.21.15.177:6808/2099766660 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fbef0073b10 con 0x7fbef0071000 2023-10-14T22:44:35.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.849+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 --> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbf100ca710 con 0x7fbef0071000 2023-10-14T22:44:35.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf0d7fa640 1 -- 172.21.15.64:0/877997485 <== osd.5 v2:172.21.15.177:6808/2099766660 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbef8041040 con 0x7fbef0071000 2023-10-14T22:44:35.852 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:35.852 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:35.852 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:35.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7fbef0071000 msgr2=0x7fbef0073440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf155e9640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6808/2099766660,v1:172.21.15.177:6809/2099766660] conn(0x7fbef0071000 0x7fbef0073440 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:35.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbef006ae70 msgr2=0x7fbef006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf155e9640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fbef006ae70 0x7fbef006d330 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fbf00004ea0 tx=0x7fbf00009040 comp rx=0 tx=0).stop 2023-10-14T22:44:35.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cdc00 msgr2=0x7fbf100ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:35.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf155e9640 1 --2- 172.21.15.64:0/877997485 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fbf100cdc00 0x7fbf100ae2c0 secure :-1 s=READY pgs=2283 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800c780 tx=0x7fbf0800cc40 comp rx=0 tx=0).stop 2023-10-14T22:44:35.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.850+0000 7fbf14de8640 1 -- 172.21.15.64:0/877997485 reap_dead start 2023-10-14T22:44:35.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.851+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 shutdown_connections 2023-10-14T22:44:35.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.851+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 >> 172.21.15.64:0/877997485 conn(0x7fbf1006a470 msgr2=0x7fbf100ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:35.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.851+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 shutdown_connections 2023-10-14T22:44:35.856 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:35.851+0000 7fbf155e9640 1 -- 172.21.15.64:0/877997485 wait complete. 2023-10-14T22:44:35.868 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-14T22:44:36.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.084+0000 7fc8bbfff640 1 Processor -- start 2023-10-14T22:44:36.086 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.084+0000 7fc8bbfff640 1 -- start start 2023-10-14T22:44:36.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8bbfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc8bc0ace10 0x7fc8bc0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc15ec30 0x7fc8bc0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8bbfff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8bc0b1ed0 con 0x7fc8bc0ceb40 2023-10-14T22:44:36.088 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8bbfff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8bc0cefd0 con 0x7fc8bc0ace10 2023-10-14T22:44:36.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8bbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc0ad1f0 con 0x7fc8bc15ec30 2023-10-14T22:44:36.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8baffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc8bc0ace10 0x7fc8bc0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.089 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8baffd640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fc8bc0ace10 0x7fc8bc0b1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36816/0 (socket says 172.21.15.64:36816) 2023-10-14T22:44:36.090 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.086+0000 7fc8baffd640 1 -- 172.21.15.64:0/456691111 learned_addr learned my addr 172.21.15.64:0/456691111 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:36.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.087+0000 7fc8ba7fc640 1 --2- 172.21.15.64:0/456691111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc15ec30 0x7fc8bc0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.091 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.087+0000 7fc8baffd640 1 -- 172.21.15.64:0/456691111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc15ec30 msgr2=0x7fc8bc0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:36.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.087+0000 7fc8baffd640 1 --2- 172.21.15.64:0/456691111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc15ec30 0x7fc8bc0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.087+0000 7fc8baffd640 1 -- 172.21.15.64:0/456691111 >> v1:172.21.15.177:6789/0 conn(0x7fc8bc0ceb40 legacy=0x7fc8bc06d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:36.092 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.087+0000 7fc8baffd640 1 -- 172.21.15.64:0/456691111 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc0b21b0 con 0x7fc8bc0ace10 2023-10-14T22:44:36.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.088+0000 7fc8baffd640 1 --2- 172.21.15.64:0/456691111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc0b1840 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009880 tx=0x7fc8ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=128b5438a85f9681 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.088+0000 7fc8b9ffb640 1 -- 172.21.15.64:0/456691111 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac004230 con 0x7fc8bc0ace10 2023-10-14T22:44:36.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.088+0000 7fc8b9ffb640 1 -- 172.21.15.64:0/456691111 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac004390 con 0x7fc8bc0ace10 2023-10-14T22:44:36.093 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.088+0000 7fc8b9ffb640 1 -- 172.21.15.64:0/456691111 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031830 con 0x7fc8bc0ace10 2023-10-14T22:44:36.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 -- 172.21.15.64:0/456691111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 msgr2=0x7fc8bc0b1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/456691111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc0b1840 secure :-1 s=READY pgs=2284 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac009880 tx=0x7fc8ac02b8d0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 -- 172.21.15.64:0/456691111 shutdown_connections 2023-10-14T22:44:36.094 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/456691111 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc15ec30 0x7fc8bc0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/456691111 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc0b1840 unknown :-1 s=CLOSED pgs=2284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 -- 172.21.15.64:0/456691111 >> 172.21.15.64:0/456691111 conn(0x7fc8bc069fc0 msgr2=0x7fc8bc06a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:36.095 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 -- 172.21.15.64:0/456691111 shutdown_connections 2023-10-14T22:44:36.096 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.089+0000 7fc8bbfff640 1 -- 172.21.15.64:0/456691111 wait complete. 2023-10-14T22:44:36.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.091+0000 7fc8bbfff640 1 Processor -- start 2023-10-14T22:44:36.098 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.091+0000 7fc8bbfff640 1 -- start start 2023-10-14T22:44:36.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc1f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc0ceb40 0x7fc8bc1e5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.099 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8bbfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8bc15ec30 0x7fc8bc1e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8bbfff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1f6430 con 0x7fc8bc0ace10 2023-10-14T22:44:36.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8bbfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e54c0 con 0x7fc8bc15ec30 2023-10-14T22:44:36.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8bbfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8bc1e5030 con 0x7fc8bc0ceb40 2023-10-14T22:44:36.100 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8baffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc1f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8baffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc1f5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36824/0 (socket says 172.21.15.64:36824) 2023-10-14T22:44:36.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.092+0000 7fc8baffd640 1 -- 172.21.15.64:0/1920555063 learned_addr learned my addr 172.21.15.64:0/1920555063 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:36.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8ba7fc640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc0ceb40 0x7fc8bc1e5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.101 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8bb7fe640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8bc15ec30 0x7fc8bc1e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8baffd640 1 -- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc0ceb40 msgr2=0x7fc8bc1e5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8baffd640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc0ceb40 0x7fc8bc1e5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8baffd640 1 -- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8bc15ec30 msgr2=0x7fc8bc1e64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.102 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8baffd640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8bc15ec30 0x7fc8bc1e64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8baffd640 1 -- 172.21.15.64:0/1920555063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ac009460 con 0x7fc8bc0ace10 2023-10-14T22:44:36.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8bb7fe640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8bc15ec30 0x7fc8bc1e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:36.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.093+0000 7fc8baffd640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc1f5ef0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0090b0 tx=0x7fc8ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.103 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.094+0000 7fc8a37fe640 1 -- 172.21.15.64:0/1920555063 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031630 con 0x7fc8bc0ace10 2023-10-14T22:44:36.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.094+0000 7fc8a37fe640 1 -- 172.21.15.64:0/1920555063 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8ac03f070 con 0x7fc8bc0ace10 2023-10-14T22:44:36.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.094+0000 7fc8a37fe640 1 -- 172.21.15.64:0/1920555063 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8ac031990 con 0x7fc8bc0ace10 2023-10-14T22:44:36.104 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.094+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8bc1e4420 con 0x7fc8bc0ace10 2023-10-14T22:44:36.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.094+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8bc1e49e0 con 0x7fc8bc0ace10 2023-10-14T22:44:36.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.095+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8bc04e9b0 con 0x7fc8bc0ace10 2023-10-14T22:44:36.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.096+0000 7fc8a37fe640 1 -- 172.21.15.64:0/1920555063 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fc8ac041030 con 0x7fc8bc0ace10 2023-10-14T22:44:36.105 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.097+0000 7fc8a37fe640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc8a806ae70 0x7fc8a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.097+0000 7fc8a37fe640 1 -- 172.21.15.64:0/1920555063 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fc8ac0ab4b0 con 0x7fc8bc0ace10 2023-10-14T22:44:36.106 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.097+0000 7fc8ba7fc640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc8a806ae70 0x7fc8a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.099+0000 7fc8ba7fc640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc8a806ae70 0x7fc8a806d330 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0006fd0 tx=0x7fc8b0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.107 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.101+0000 7fc8a37fe640 1 -- 172.21.15.64:0/1920555063 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fc8ac076720 con 0x7fc8bc0ace10 2023-10-14T22:44:36.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.296+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8bc0b2770 con 0x7fc8a806ae70 2023-10-14T22:44:36.299 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.298+0000 7fc8a37fe640 1 -- 172.21.15.64:0/1920555063 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc8b000b5e0 con 0x7fc8a806ae70 2023-10-14T22:44:36.299 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 5 to deep-scrub 2023-10-14T22:44:36.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc8a806ae70 msgr2=0x7fc8a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc8a806ae70 0x7fc8a806d330 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fc8b0006fd0 tx=0x7fc8b0008040 comp rx=0 tx=0).stop 2023-10-14T22:44:36.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 msgr2=0x7fc8bc1f5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc1f5ef0 secure :-1 s=READY pgs=2285 cs=0 l=1 rev1=1 crypto rx=0x7fc8ac0090b0 tx=0x7fc8ac0046c0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 shutdown_connections 2023-10-14T22:44:36.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fc8a806ae70 0x7fc8a806d330 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fc8bc15ec30 0x7fc8bc1e64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fc8bc0ceb40 0x7fc8bc1e5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 --2- 172.21.15.64:0/1920555063 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fc8bc0ace10 0x7fc8bc1f5ef0 unknown :-1 s=CLOSED pgs=2285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 >> 172.21.15.64:0/1920555063 conn(0x7fc8bc069fc0 msgr2=0x7fc8bc06a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:36.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.300+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 shutdown_connections 2023-10-14T22:44:36.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.301+0000 7fc8bbfff640 1 -- 172.21.15.64:0/1920555063 wait complete. 2023-10-14T22:44:36.322 INFO:tasks.ceph:Scrubbing osd.6 2023-10-14T22:44:36.322 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:36.548 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.547+0000 7fdac1009640 1 Processor -- start 2023-10-14T22:44:36.549 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.547+0000 7fdac1009640 1 -- start start 2023-10-14T22:44:36.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.548+0000 7fdac1009640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc0b0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.548+0000 7fdac1009640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdabc15e440 0x7fdabc0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.550 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.548+0000 7fdac1009640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdabc0ca190 con 0x7fdabc15ab30 2023-10-14T22:44:36.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.548+0000 7fdac1009640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdabc0c9660 con 0x7fdabc15e440 2023-10-14T22:44:36.551 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.548+0000 7fdac1009640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0b0870 con 0x7fdabc0aff50 2023-10-14T22:44:36.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.549+0000 7fdabad9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc0b0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.549+0000 7fdabb59e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fdabc15e440 0x7fdabc0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.552 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.549+0000 7fdabad9d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc0b0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.177:3301/0 says I am v2:172.21.15.64:48516/0 (socket says 172.21.15.64:48516) 2023-10-14T22:44:36.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.549+0000 7fdabad9d640 1 -- 172.21.15.64:0/3679336723 learned_addr learned my addr 172.21.15.64:0/3679336723 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:36.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.550+0000 7fdabad9d640 1 -- 172.21.15.64:0/3679336723 >> v2:172.21.15.177:3300/0 conn(0x7fdabc15e440 msgr2=0x7fdabc0b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:36.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.550+0000 7fdabad9d640 1 --2- 172.21.15.64:0/3679336723 >> v2:172.21.15.177:3300/0 conn(0x7fdabc15e440 0x7fdabc0b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.553 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.550+0000 7fdabad9d640 1 -- 172.21.15.64:0/3679336723 >> v1:172.21.15.177:6789/0 conn(0x7fdabc15ab30 legacy=0x7fdabc0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.554 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.550+0000 7fdabad9d640 1 -- 172.21.15.64:0/3679336723 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdabc15ee20 con 0x7fdabc0aff50 2023-10-14T22:44:36.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.551+0000 7fdabad9d640 1 --2- 172.21.15.64:0/3679336723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc0b0330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9f7009b86b98193 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.552+0000 7fdaba59c640 1 -- 172.21.15.64:0/3679336723 <== mon.2 v2:172.21.15.177:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac030840 con 0x7fdabc0aff50 2023-10-14T22:44:36.555 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.552+0000 7fdaba59c640 1 -- 172.21.15.64:0/3679336723 <== mon.2 v2:172.21.15.177:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaac0309a0 con 0x7fdabc0aff50 2023-10-14T22:44:36.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.552+0000 7fdaba59c640 1 -- 172.21.15.64:0/3679336723 <== mon.2 v2:172.21.15.177:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac030d30 con 0x7fdabc0aff50 2023-10-14T22:44:36.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 -- 172.21.15.64:0/3679336723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 msgr2=0x7fdabc0b0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 --2- 172.21.15.64:0/3679336723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc0b0330 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009870 tx=0x7fdaac02b980 comp rx=0 tx=0).stop 2023-10-14T22:44:36.556 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 -- 172.21.15.64:0/3679336723 shutdown_connections 2023-10-14T22:44:36.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 --2- 172.21.15.64:0/3679336723 >> v2:172.21.15.177:3300/0 conn(0x7fdabc15e440 0x7fdabc0b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 --2- 172.21.15.64:0/3679336723 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc0b0330 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 -- 172.21.15.64:0/3679336723 >> 172.21.15.64:0/3679336723 conn(0x7fdabc06c190 msgr2=0x7fdabc06c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:36.557 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 -- 172.21.15.64:0/3679336723 shutdown_connections 2023-10-14T22:44:36.558 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.553+0000 7fdac1009640 1 -- 172.21.15.64:0/3679336723 wait complete. 2023-10-14T22:44:36.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.555+0000 7fdac1009640 1 Processor -- start 2023-10-14T22:44:36.560 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.555+0000 7fdac1009640 1 -- start start 2023-10-14T22:44:36.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.556+0000 7fdac1009640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc1f3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdac1009640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdabc15ab30 0x7fdabc155720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdac1009640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdabc15e440 0x7fdabc1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.561 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdac1009640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc1f3a90 con 0x7fdabc15ab30 2023-10-14T22:44:36.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdac1009640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc0ad060 con 0x7fdabc15e440 2023-10-14T22:44:36.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdac1009640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdabc1f0990 con 0x7fdabc0aff50 2023-10-14T22:44:36.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdabc15ab30 0x7fdabc155720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdab3fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdabc15ab30 0x7fdabc155720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36826/0 (socket says 172.21.15.64:36826) 2023-10-14T22:44:36.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdab3fff640 1 -- 172.21.15.64:0/2199047819 learned_addr learned my addr 172.21.15.64:0/2199047819 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:36.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdabad9d640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc1f3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.557+0000 7fdabb59e640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdabc15e440 0x7fdabc1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab3fff640 1 -- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 msgr2=0x7fdabc1f3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab3fff640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc1f3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab3fff640 1 -- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdabc15e440 msgr2=0x7fdabc1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab3fff640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdabc15e440 0x7fdabc1588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab3fff640 1 -- 172.21.15.64:0/2199047819 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac0094d0 con 0x7fdabc15ab30 2023-10-14T22:44:36.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdabad9d640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fdabc0aff50 0x7fdabc1f3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:36.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdabb59e640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fdabc15e440 0x7fdabc1588a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:36.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab3fff640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdabc15ab30 0x7fdabc155720 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c400 tx=0x7fdaa400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40052d0 con 0x7fdabc15ab30 2023-10-14T22:44:36.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaa4005430 con 0x7fdabc15ab30 2023-10-14T22:44:36.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdabc1f3440 con 0x7fdabc15ab30 2023-10-14T22:44:36.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4003830 con 0x7fdabc15ab30 2023-10-14T22:44:36.567 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.558+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdabc1f0c70 con 0x7fdabc15ab30 2023-10-14T22:44:36.568 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.559+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdabc0c9280 con 0x7fdabc15ab30 2023-10-14T22:44:36.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.561+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fdaa4003990 con 0x7fdabc15ab30 2023-10-14T22:44:36.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.562+0000 7fdab37fe640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda9c06aea0 0x7fda9c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.562+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fdaa4088a00 con 0x7fdabc15ab30 2023-10-14T22:44:36.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.562+0000 7fdab37fe640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7fda9c0711a0 0x7fda9c0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.562+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 --> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fda9c073cb0 con 0x7fda9c0711a0 2023-10-14T22:44:36.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.562+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaa408d2a0 con 0x7fdabc15ab30 2023-10-14T22:44:36.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.562+0000 7fdabad9d640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda9c06aea0 0x7fda9c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.562+0000 7fdabb59e640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7fda9c0711a0 0x7fda9c0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.564+0000 7fdabb59e640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7fda9c0711a0 0x7fda9c0735e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.564+0000 7fdabad9d640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda9c06aea0 0x7fda9c06d360 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fdaac036000 tx=0x7fdaac03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.566+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== osd.6 v2:172.21.15.177:6816/3504567380 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fda9c073cb0 con 0x7fda9c0711a0 2023-10-14T22:44:36.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.581+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 --> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdabc15f100 con 0x7fda9c0711a0 2023-10-14T22:44:36.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.582+0000 7fdab37fe640 1 -- 172.21.15.64:0/2199047819 <== osd.6 v2:172.21.15.177:6816/3504567380 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fdab4009e20 con 0x7fda9c0711a0 2023-10-14T22:44:36.584 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:36.585 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:36.585 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:36.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7fda9c0711a0 msgr2=0x7fda9c0735e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6816/3504567380,v1:172.21.15.177:6817/3504567380] conn(0x7fda9c0711a0 0x7fda9c0735e0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda9c06aea0 msgr2=0x7fda9c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fda9c06aea0 0x7fda9c06d360 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fdaac036000 tx=0x7fdaac03b040 comp rx=0 tx=0).stop 2023-10-14T22:44:36.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdabc15ab30 msgr2=0x7fdabc155720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 --2- 172.21.15.64:0/2199047819 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fdabc15ab30 0x7fdabc155720 secure :-1 s=READY pgs=2286 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c400 tx=0x7fdaa400c8c0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdabb59e640 1 -- 172.21.15.64:0/2199047819 reap_dead start 2023-10-14T22:44:36.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 shutdown_connections 2023-10-14T22:44:36.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 >> 172.21.15.64:0/2199047819 conn(0x7fdabc06c190 msgr2=0x7fdabc0700d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:36.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 shutdown_connections 2023-10-14T22:44:36.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.583+0000 7fdac1009640 1 -- 172.21.15.64:0/2199047819 wait complete. 2023-10-14T22:44:36.604 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-14T22:44:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.827+0000 7f4a53fff640 1 Processor -- start 2023-10-14T22:44:36.829 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.827+0000 7f4a53fff640 1 -- start start 2023-10-14T22:44:36.830 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.829+0000 7f4a53fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f4a540ad970 0x7f4a540b1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.829+0000 7f4a53fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 0x7f4a540ce600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.829+0000 7f4a53fff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a540c8a10 con 0x7f4a540ceb40 2023-10-14T22:44:36.831 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.829+0000 7f4a53fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a54159b40 con 0x7f4a540ad970 2023-10-14T22:44:36.832 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.829+0000 7f4a53fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540cefb0 con 0x7f4a540b2e90 2023-10-14T22:44:36.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.829+0000 7f4a537fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7f4a540ceb40 0x7f4a540b17e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43640/0 (socket says 172.21.15.64:43640) 2023-10-14T22:44:36.834 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.829+0000 7f4a537fe640 1 -- 172.21.15.64:0/3008549567 learned_addr learned my addr 172.21.15.64:0/3008549567 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:36.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/3008549567 >> v2:172.21.15.177:3300/0 conn(0x7f4a540ad970 0x7f4a540b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a4bfff640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 0x7f4a540ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 754172577 0 0) 0x7f4a540c8a10 con 0x7f4a540ceb40 2023-10-14T22:44:36.835 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a40005730 con 0x7f4a540ceb40 2023-10-14T22:44:36.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 981436830 0 0) 0x7f4a40005730 con 0x7f4a540ceb40 2023-10-14T22:44:36.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 msgr2=0x7f4a540ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:36.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 0x7f4a540ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.836 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 >> v2:172.21.15.177:3300/0 conn(0x7f4a540ad970 msgr2=0x7f4a540b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:36.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 --2- 172.21.15.64:0/3008549567 >> v2:172.21.15.177:3300/0 conn(0x7f4a540ad970 0x7f4a540b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a5415d1a0 con 0x7f4a540ceb40 2023-10-14T22:44:36.837 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7f4a4c0019f0 con 0x7f4a540ceb40 2023-10-14T22:44:36.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 >> v1:172.21.15.64:6789/0 conn(0x7f4a540ceb40 legacy=0x7f4a540b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a40005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 0x7f4a400069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.838 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a40006f10 0x7f4a40007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a54159b40 con 0x7f4a40005bb0 2023-10-14T22:44:36.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540cefb0 con 0x7f4a40006f10 2023-10-14T22:44:36.839 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.830+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a4000dbc0 con 0x7f4a540b2e90 2023-10-14T22:44:36.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.831+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a40005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.831+0000 7f4a4bfff640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 0x7f4a400069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.831+0000 7f4a52ffd640 1 -- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 msgr2=0x7f4a400069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:36.840 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.831+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540b2e90 0x7f4a400069d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.831+0000 7f4a52ffd640 1 -- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a40006f10 msgr2=0x7f4a40007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:36.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.831+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a40006f10 0x7f4a40007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.831+0000 7f4a52ffd640 1 -- 172.21.15.64:0/3008549567 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a40005730 con 0x7f4a40005bb0 2023-10-14T22:44:36.841 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.832+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a40005fd0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009ab0 tx=0x7f4a40007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928721da0164b8dc server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.832+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44005990 con 0x7f4a40005bb0 2023-10-14T22:44:36.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a44005af0 con 0x7f4a40005bb0 2023-10-14T22:44:36.842 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a527fc640 1 -- 172.21.15.64:0/3008549567 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44005ea0 con 0x7f4a40005bb0 2023-10-14T22:44:36.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a53fff640 1 -- 172.21.15.64:0/3008549567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 msgr2=0x7f4a40005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a53fff640 1 --2- 172.21.15.64:0/3008549567 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a40005fd0 secure :-1 s=READY pgs=2288 cs=0 l=1 rev1=1 crypto rx=0x7f4a44009ab0 tx=0x7f4a40007a00 comp rx=0 tx=0).stop 2023-10-14T22:44:36.845 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a537fe640 1 -- 172.21.15.64:0/3008549567 reap_dead start 2023-10-14T22:44:36.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a53fff640 1 -- 172.21.15.64:0/3008549567 shutdown_connections 2023-10-14T22:44:36.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a53fff640 1 -- 172.21.15.64:0/3008549567 >> 172.21.15.64:0/3008549567 conn(0x7f4a54069fc0 msgr2=0x7f4a5406a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:36.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a53fff640 1 -- 172.21.15.64:0/3008549567 shutdown_connections 2023-10-14T22:44:36.846 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.833+0000 7f4a53fff640 1 -- 172.21.15.64:0/3008549567 wait complete. 2023-10-14T22:44:36.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.835+0000 7f4a53fff640 1 Processor -- start 2023-10-14T22:44:36.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.835+0000 7f4a53fff640 1 -- start start 2023-10-14T22:44:36.847 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.836+0000 7f4a53fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a541f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.836+0000 7f4a53fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a540ac900 0x7f4a541ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.836+0000 7f4a53fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540aafd0 0x7f4a54150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.836+0000 7f4a53fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540ab860 con 0x7f4a40005bb0 2023-10-14T22:44:36.848 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.836+0000 7f4a53fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540abb40 con 0x7f4a540ac900 2023-10-14T22:44:36.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.836+0000 7f4a53fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a540abe20 con 0x7f4a540aafd0 2023-10-14T22:44:36.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.836+0000 7f4a52ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a541f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.849 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a541f22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36840/0 (socket says 172.21.15.64:36840) 2023-10-14T22:44:36.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 -- 172.21.15.64:0/1815694944 learned_addr learned my addr 172.21.15.64:0/1815694944 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:36.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 -- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540aafd0 msgr2=0x7f4a54150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540aafd0 0x7f4a54150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.850 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a4bfff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a540ac900 0x7f4a541ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 -- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a540ac900 msgr2=0x7f4a541ef6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:36.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a540ac900 0x7f4a541ef6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:36.851 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 -- 172.21.15.64:0/1815694944 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a540ac100 con 0x7f4a40005bb0 2023-10-14T22:44:36.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.837+0000 7f4a52ffd640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a541f22b0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f4a44036040 tx=0x7f4a44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.838+0000 7f4a4b7fe640 1 -- 172.21.15.64:0/1815694944 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a44005e70 con 0x7f4a40005bb0 2023-10-14T22:44:36.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.838+0000 7f4a4b7fe640 1 -- 172.21.15.64:0/1815694944 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a44004020 con 0x7f4a40005bb0 2023-10-14T22:44:36.852 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.838+0000 7f4a4b7fe640 1 -- 172.21.15.64:0/1815694944 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a440043d0 con 0x7f4a40005bb0 2023-10-14T22:44:36.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.838+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a540ac3e0 con 0x7f4a40005bb0 2023-10-14T22:44:36.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.838+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a540acd80 con 0x7f4a40005bb0 2023-10-14T22:44:36.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.839+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5404e9b0 con 0x7f4a40005bb0 2023-10-14T22:44:36.853 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.840+0000 7f4a4b7fe640 1 -- 172.21.15.64:0/1815694944 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4a44003610 con 0x7f4a40005bb0 2023-10-14T22:44:36.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.841+0000 7f4a4b7fe640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4a3406aea0 0x7f4a3406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:36.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.841+0000 7f4a4b7fe640 1 -- 172.21.15.64:0/1815694944 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4a440ab570 con 0x7f4a40005bb0 2023-10-14T22:44:36.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.842+0000 7f4a4bfff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4a3406aea0 0x7f4a3406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:36.854 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.843+0000 7f4a4bfff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4a3406aea0 0x7f4a3406d360 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4a541549a0 tx=0x7f4a3c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:36.855 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:36.846+0000 7f4a4b7fe640 1 -- 172.21.15.64:0/1815694944 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4a44076900 con 0x7f4a40005bb0 2023-10-14T22:44:37.046 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.044+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f4a540ab860 con 0x7f4a3406aea0 2023-10-14T22:44:37.047 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.046+0000 7f4a4b7fe640 1 -- 172.21.15.64:0/1815694944 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4a540ab860 con 0x7f4a3406aea0 2023-10-14T22:44:37.047 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 6 to deep-scrub 2023-10-14T22:44:37.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.048+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4a3406aea0 msgr2=0x7f4a3406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.048+0000 7f4a53fff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4a3406aea0 0x7f4a3406d360 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f4a541549a0 tx=0x7f4a3c008040 comp rx=0 tx=0).stop 2023-10-14T22:44:37.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.048+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 msgr2=0x7f4a541f22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.051 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.048+0000 7f4a53fff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a541f22b0 secure :-1 s=READY pgs=2289 cs=0 l=1 rev1=1 crypto rx=0x7f4a44036040 tx=0x7f4a44004730 comp rx=0 tx=0).stop 2023-10-14T22:44:37.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 shutdown_connections 2023-10-14T22:44:37.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4a3406aea0 0x7f4a3406d360 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.052 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4a540aafd0 0x7f4a54150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4a540ac900 0x7f4a541ef6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 --2- 172.21.15.64:0/1815694944 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4a40005bb0 0x7f4a541f22b0 unknown :-1 s=CLOSED pgs=2289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 >> 172.21.15.64:0/1815694944 conn(0x7f4a54069fc0 msgr2=0x7f4a54157620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:37.053 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 shutdown_connections 2023-10-14T22:44:37.054 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.049+0000 7f4a53fff640 1 -- 172.21.15.64:0/1815694944 wait complete. 2023-10-14T22:44:37.069 INFO:tasks.ceph:Scrubbing osd.7 2023-10-14T22:44:37.069 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-14T22:44:37.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.292+0000 7fd905b1d640 1 Processor -- start 2023-10-14T22:44:37.294 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.292+0000 7fd905b1d640 1 -- start start 2023-10-14T22:44:37.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.294+0000 7fd905b1d640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd90015cd10 0x7fd9000714d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.296 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.294+0000 7fd905b1d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 0x7fd9000c45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.294+0000 7fd905b1d640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000c4110 con 0x7fd900071a10 2023-10-14T22:44:37.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.294+0000 7fd905b1d640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000cb220 con 0x7fd90015cd10 2023-10-14T22:44:37.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.294+0000 7fd905b1d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90015d0f0 con 0x7fd90006b500 2023-10-14T22:44:37.297 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.294+0000 7fd8ff7fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7fd90015cd10 0x7fd9000714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8f7fff640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd900071a10 0x7fd90006adf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43652/0 (socket says 172.21.15.64:43652) 2023-10-14T22:44:37.298 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8f7fff640 1 -- 172.21.15.64:0/1893793221 learned_addr learned my addr 172.21.15.64:0/1893793221 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:37.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8ff7fe640 1 -- 172.21.15.64:0/1893793221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 msgr2=0x7fd9000c45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:37.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8fffff640 1 --2- 172.21.15.64:0/1893793221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 0x7fd9000c45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.300 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8ff7fe640 1 --2- 172.21.15.64:0/1893793221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 0x7fd9000c45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8ff7fe640 1 -- 172.21.15.64:0/1893793221 >> v1:172.21.15.64:6789/0 conn(0x7fd900071a10 legacy=0x7fd90006adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8ff7fe640 1 -- 172.21.15.64:0/1893793221 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9000cac60 con 0x7fd90015cd10 2023-10-14T22:44:37.301 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.295+0000 7fd8feffd640 1 -- 172.21.15.64:0/1893793221 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 543971625 0 0) 0x7fd9000c4110 con 0x7fd900071a10 2023-10-14T22:44:37.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.296+0000 7fd8ff7fe640 1 --2- 172.21.15.64:0/1893793221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000714d0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00097a0 tx=0x7fd8f002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfaf3fda36586889 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:37.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd8feffd640 1 -- 172.21.15.64:0/1893793221 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f002d040 con 0x7fd90015cd10 2023-10-14T22:44:37.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd8feffd640 1 -- 172.21.15.64:0/1893793221 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0031810 con 0x7fd90015cd10 2023-10-14T22:44:37.302 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd8feffd640 1 -- 172.21.15.64:0/1893793221 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0031ba0 con 0x7fd90015cd10 2023-10-14T22:44:37.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd905b1d640 1 -- 172.21.15.64:0/1893793221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 msgr2=0x7fd9000714d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd905b1d640 1 --2- 172.21.15.64:0/1893793221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000714d0 secure :-1 s=READY pgs=2291 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00097a0 tx=0x7fd8f002b8b0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.303 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd905b1d640 1 -- 172.21.15.64:0/1893793221 shutdown_connections 2023-10-14T22:44:37.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd905b1d640 1 --2- 172.21.15.64:0/1893793221 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 0x7fd9000c45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd905b1d640 1 --2- 172.21.15.64:0/1893793221 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000714d0 unknown :-1 s=CLOSED pgs=2291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd905b1d640 1 -- 172.21.15.64:0/1893793221 >> 172.21.15.64:0/1893793221 conn(0x7fd9000709b0 msgr2=0x7fd900070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:37.304 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.297+0000 7fd905b1d640 1 -- 172.21.15.64:0/1893793221 shutdown_connections 2023-10-14T22:44:37.305 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.298+0000 7fd905b1d640 1 -- 172.21.15.64:0/1893793221 wait complete. 2023-10-14T22:44:37.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.299+0000 7fd905b1d640 1 Processor -- start 2023-10-14T22:44:37.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.299+0000 7fd905b1d640 1 -- start start 2023-10-14T22:44:37.308 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.300+0000 7fd905b1d640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 0x7fd9001483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.300+0000 7fd905b1d640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd900071a10 0x7fd90014ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.300+0000 7fd905b1d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000c4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.300+0000 7fd905b1d640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900148af0 con 0x7fd90015cd10 2023-10-14T22:44:37.309 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd905b1d640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd90015dd60 con 0x7fd900071a10 2023-10-14T22:44:37.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd905b1d640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd90014b0c0 con 0x7fd90006b500 2023-10-14T22:44:37.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000c4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.310 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000c4d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36850/0 (socket says 172.21.15.64:36850) 2023-10-14T22:44:37.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 -- 172.21.15.64:0/2890513547 learned_addr learned my addr 172.21.15.64:0/2890513547 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:37.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8ff7fe640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 0x7fd9001483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 -- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 msgr2=0x7fd9001483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.311 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8f7fff640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd900071a10 0x7fd90014ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd90006b500 0x7fd9001483d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 -- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd900071a10 msgr2=0x7fd90014ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd900071a10 0x7fd90014ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.312 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8fffff640 1 -- 172.21.15.64:0/2890513547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0009400 con 0x7fd90015cd10 2023-10-14T22:44:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.301+0000 7fd8f7fff640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd900071a10 0x7fd90014ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.302+0000 7fd8fffff640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000c4d60 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800cc60 tx=0x7fd8f800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.302+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f800ce70 con 0x7fd90015cd10 2023-10-14T22:44:37.313 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.302+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f8003990 con 0x7fd90015cd10 2023-10-14T22:44:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.302+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f8003d20 con 0x7fd90015cd10 2023-10-14T22:44:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.302+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd90014b390 con 0x7fd90015cd10 2023-10-14T22:44:37.314 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.303+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd90014b950 con 0x7fd90015cd10 2023-10-14T22:44:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.304+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd9000c3da0 con 0x7fd90015cd10 2023-10-14T22:44:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.305+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd8f8003e80 con 0x7fd90015cd10 2023-10-14T22:44:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.306+0000 7fd8fcff9640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8e006ae70 0x7fd8e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.315 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.306+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd8f80897f0 con 0x7fd90015cd10 2023-10-14T22:44:37.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.306+0000 7fd8fcff9640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7fd8e0071170 0x7fd8e00735b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.306+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 --> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd8e0073c80 con 0x7fd8e0071170 2023-10-14T22:44:37.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.306+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd8f808bdd0 con 0x7fd90015cd10 2023-10-14T22:44:37.316 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.306+0000 7fd8ff7fe640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8e006ae70 0x7fd8e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.317 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.307+0000 7fd8f7fff640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7fd8e0071170 0x7fd8e00735b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.307+0000 7fd8ff7fe640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8e006ae70 0x7fd8e006d330 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0036000 tx=0x7fd8f0008030 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:37.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.308+0000 7fd8f7fff640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7fd8e0071170 0x7fd8e00735b0 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:37.318 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.309+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== osd.7 v2:172.21.15.177:6824/1113952152 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25755 (crc 0 0 0) 0x7fd8e0073c80 con 0x7fd8e0071170 2023-10-14T22:44:37.328 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.327+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 --> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd90006ef10 con 0x7fd8e0071170 2023-10-14T22:44:37.329 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd8fcff9640 1 -- 172.21.15.64:0/2890513547 <== osd.7 v2:172.21.15.177:6824/1113952152 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd90006ef10 con 0x7fd8e0071170 2023-10-14T22:44:37.330 INFO:teuthology.orchestra.run.smithi064.stdout:{ 2023-10-14T22:44:37.330 INFO:teuthology.orchestra.run.smithi064.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-14T22:44:37.330 INFO:teuthology.orchestra.run.smithi064.stdout:} 2023-10-14T22:44:37.331 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7fd8e0071170 msgr2=0x7fd8e00735b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6824/1113952152,v1:172.21.15.177:6825/1113952152] conn(0x7fd8e0071170 0x7fd8e00735b0 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8e006ae70 msgr2=0x7fd8e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.332 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd8e006ae70 0x7fd8e006d330 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0036000 tx=0x7fd8f0008030 comp rx=0 tx=0).stop 2023-10-14T22:44:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 msgr2=0x7fd9000c4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 --2- 172.21.15.64:0/2890513547 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd90015cd10 0x7fd9000c4d60 secure :-1 s=READY pgs=2292 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800cc60 tx=0x7fd8f800a5c0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd8fffff640 1 -- 172.21.15.64:0/2890513547 reap_dead start 2023-10-14T22:44:37.333 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 shutdown_connections 2023-10-14T22:44:37.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.328+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 >> 172.21.15.64:0/2890513547 conn(0x7fd9000709b0 msgr2=0x7fd900069de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:37.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.329+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 shutdown_connections 2023-10-14T22:44:37.334 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.329+0000 7fd905b1d640 1 -- 172.21.15.64:0/2890513547 wait complete. 2023-10-14T22:44:37.349 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-14T22:44:37.562 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.561+0000 7fd7f359e640 1 Processor -- start 2023-10-14T22:44:37.563 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.561+0000 7fd7f359e640 1 -- start start 2023-10-14T22:44:37.564 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 0x7fd7f40cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f359e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7fd7f40cfe70 0x7fd7f40cd830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f359e640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f40d3760 con 0x7fd7f415cc90 2023-10-14T22:44:37.565 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f359e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f40cf9e0 con 0x7fd7f40cfe70 2023-10-14T22:44:37.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f415d070 con 0x7fd7f40d14d0 2023-10-14T22:44:37.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f259c640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7fd7f415cc90 0x7fd7f40d0dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:43654/0 (socket says 172.21.15.64:43654) 2023-10-14T22:44:37.566 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f259c640 1 -- 172.21.15.64:0/4215280090 learned_addr learned my addr 172.21.15.64:0/4215280090 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:37.569 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.563+0000 7fd7f1d9b640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 0x7fd7f40cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3368125299 0 0) 0x7fd7f40d3760 con 0x7fd7f415cc90 2023-10-14T22:44:37.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f2d9d640 1 --2- 172.21.15.64:0/4215280090 >> v2:172.21.15.177:3300/0 conn(0x7fd7f40cfe70 0x7fd7f40cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7e0003520 con 0x7fd7f415cc90 2023-10-14T22:44:37.570 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1353280956 0 0) 0x7fd7e0003520 con 0x7fd7f415cc90 2023-10-14T22:44:37.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 msgr2=0x7fd7f40cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:37.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 0x7fd7f40cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.571 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 >> v2:172.21.15.177:3300/0 conn(0x7fd7f40cfe70 msgr2=0x7fd7f40cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:37.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 --2- 172.21.15.64:0/4215280090 >> v2:172.21.15.177:3300/0 conn(0x7fd7f40cfe70 0x7fd7f40cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f40b1870 con 0x7fd7f415cc90 2023-10-14T22:44:37.572 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7fd7e40019f0 con 0x7fd7f415cc90 2023-10-14T22:44:37.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 >> v1:172.21.15.64:6789/0 conn(0x7fd7f415cc90 legacy=0x7fd7f40d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 0x7fd7e0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.573 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7e0003ef0 0x7fd7e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0004d00 0x7fd7e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f40cf9e0 con 0x7fd7e0003ef0 2023-10-14T22:44:37.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f415d070 con 0x7fd7e0004d00 2023-10-14T22:44:37.574 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.564+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e000ba80 con 0x7fd7f40d14d0 2023-10-14T22:44:37.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f1d9b640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7e0003ef0 0x7fd7e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f259c640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 0x7fd7e0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.575 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f2d9d640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0004d00 0x7fd7e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f1d9b640 1 -- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 msgr2=0x7fd7e0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:37.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f1d9b640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 0x7fd7e0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f1d9b640 1 -- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0004d00 msgr2=0x7fd7e0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:37.576 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f1d9b640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0004d00 0x7fd7e0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f1d9b640 1 -- 172.21.15.64:0/4215280090 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0003520 con 0x7fd7e0003ef0 2023-10-14T22:44:37.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f2d9d640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0004d00 0x7fd7e0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:37.577 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.565+0000 7fd7f259c640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40d14d0 0x7fd7e0003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:37.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.566+0000 7fd7f1d9b640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7e0003ef0 0x7fd7e00047c0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009ac0 tx=0x7fd7e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bd8b48e510a7117 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:37.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.566+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02c660 con 0x7fd7e0003ef0 2023-10-14T22:44:37.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.566+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7dc02c7c0 con 0x7fd7e0003ef0 2023-10-14T22:44:37.578 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.566+0000 7fd7f159a640 1 -- 172.21.15.64:0/4215280090 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7dc02cb50 con 0x7fd7e0003ef0 2023-10-14T22:44:37.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.567+0000 7fd7f359e640 1 -- 172.21.15.64:0/4215280090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7e0003ef0 msgr2=0x7fd7e00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.567+0000 7fd7f359e640 1 --2- 172.21.15.64:0/4215280090 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7e0003ef0 0x7fd7e00047c0 secure :-1 s=READY pgs=2294 cs=0 l=1 rev1=1 crypto rx=0x7fd7dc009ac0 tx=0x7fd7e00057f0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.567+0000 7fd7f2d9d640 1 -- 172.21.15.64:0/4215280090 reap_dead start 2023-10-14T22:44:37.579 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.567+0000 7fd7f359e640 1 -- 172.21.15.64:0/4215280090 shutdown_connections 2023-10-14T22:44:37.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.567+0000 7fd7f359e640 1 -- 172.21.15.64:0/4215280090 >> 172.21.15.64:0/4215280090 conn(0x7fd7f40d27e0 msgr2=0x7fd7f40d2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:37.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.567+0000 7fd7f359e640 1 -- 172.21.15.64:0/4215280090 shutdown_connections 2023-10-14T22:44:37.580 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.567+0000 7fd7f359e640 1 -- 172.21.15.64:0/4215280090 wait complete. 2023-10-14T22:44:37.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.569+0000 7fd7f359e640 1 Processor -- start 2023-10-14T22:44:37.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.569+0000 7fd7f359e640 1 -- start start 2023-10-14T22:44:37.583 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.570+0000 7fd7f359e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0003ef0 0x7fd7f41e5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.570+0000 7fd7f359e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40b7f30 0x7fd7f4146600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.570+0000 7fd7f359e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7f415b8d0 0x7fd7f415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.570+0000 7fd7f359e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f4156050 con 0x7fd7f415b8d0 2023-10-14T22:44:37.584 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.570+0000 7fd7f359e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f415c290 con 0x7fd7e0003ef0 2023-10-14T22:44:37.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.570+0000 7fd7f359e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f41e6e20 con 0x7fd7f40b7f30 2023-10-14T22:44:37.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7f415b8d0 0x7fd7f415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7f415b8d0 0x7fd7f415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36864/0 (socket says 172.21.15.64:36864) 2023-10-14T22:44:37.585 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 -- 172.21.15.64:0/504873654 learned_addr learned my addr 172.21.15.64:0/504873654 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:37.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f1d9b640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40b7f30 0x7fd7f4146600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f259c640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0003ef0 0x7fd7f41e5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.586 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 -- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40b7f30 msgr2=0x7fd7f4146600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40b7f30 0x7fd7f4146600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 -- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0003ef0 msgr2=0x7fd7f41e5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.587 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0003ef0 0x7fd7f41e5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 -- 172.21.15.64:0/504873654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f4146b40 con 0x7fd7f415b8d0 2023-10-14T22:44:37.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f259c640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0003ef0 0x7fd7f41e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:37.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.571+0000 7fd7f2d9d640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7f415b8d0 0x7fd7f415bd50 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fd7f408bcd0 tx=0x7fd7ec00e770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:37.588 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.572+0000 7fd7eaffd640 1 -- 172.21.15.64:0/504873654 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec00c070 con 0x7fd7f415b8d0 2023-10-14T22:44:37.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.572+0000 7fd7eaffd640 1 -- 172.21.15.64:0/504873654 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7ec013610 con 0x7fd7f415b8d0 2023-10-14T22:44:37.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.572+0000 7fd7eaffd640 1 -- 172.21.15.64:0/504873654 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7ec0139c0 con 0x7fd7f415b8d0 2023-10-14T22:44:37.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.572+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f41e6210 con 0x7fd7f415b8d0 2023-10-14T22:44:37.589 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.572+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f41e67d0 con 0x7fd7f415b8d0 2023-10-14T22:44:37.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.573+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f40d3460 con 0x7fd7f415b8d0 2023-10-14T22:44:37.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.574+0000 7fd7eaffd640 1 -- 172.21.15.64:0/504873654 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7fd7ec013b20 con 0x7fd7f415b8d0 2023-10-14T22:44:37.590 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.575+0000 7fd7eaffd640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd7d406ae70 0x7fd7d406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:37.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.575+0000 7fd7eaffd640 1 -- 172.21.15.64:0/504873654 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd7ec088c40 con 0x7fd7f415b8d0 2023-10-14T22:44:37.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.576+0000 7fd7f259c640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd7d406ae70 0x7fd7d406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:37.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.577+0000 7fd7f259c640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd7d406ae70 0x7fd7d406d330 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400e300 tx=0x7fd7e4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:37.591 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.580+0000 7fd7eaffd640 1 -- 172.21.15.64:0/504873654 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7fd7f40d3460 con 0x7fd7f415b8d0 2023-10-14T22:44:37.776 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.774+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fd7f40d05c0 con 0x7fd7d406ae70 2023-10-14T22:44:37.777 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.775+0000 7fd7eaffd640 1 -- 172.21.15.64:0/504873654 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd7e400d040 con 0x7fd7d406ae70 2023-10-14T22:44:37.777 INFO:teuthology.orchestra.run.smithi064.stderr:instructed osd(s) 7 to deep-scrub 2023-10-14T22:44:37.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd7d406ae70 msgr2=0x7fd7d406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.780 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd7d406ae70 0x7fd7d406d330 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fd7e400e300 tx=0x7fd7e4009040 comp rx=0 tx=0).stop 2023-10-14T22:44:37.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7f415b8d0 msgr2=0x7fd7f415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:37.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7f415b8d0 0x7fd7f415bd50 secure :-1 s=READY pgs=2295 cs=0 l=1 rev1=1 crypto rx=0x7fd7f408bcd0 tx=0x7fd7ec00e770 comp rx=0 tx=0).stop 2023-10-14T22:44:37.781 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 shutdown_connections 2023-10-14T22:44:37.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7fd7d406ae70 0x7fd7d406d330 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7fd7f415b8d0 0x7fd7f415bd50 unknown :-1 s=CLOSED pgs=2295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.782 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7fd7f40b7f30 0x7fd7f4146600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 --2- 172.21.15.64:0/504873654 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7fd7e0003ef0 0x7fd7f41e5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:37.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.778+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 >> 172.21.15.64:0/504873654 conn(0x7fd7f40d27e0 msgr2=0x7fd7f40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:37.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.779+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 shutdown_connections 2023-10-14T22:44:37.783 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:37.779+0000 7fd7f359e640 1 -- 172.21.15.64:0/504873654 wait complete. 2023-10-14T22:44:37.798 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T22:44:38.022 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.021+0000 7f04f7fff640 1 Processor -- start 2023-10-14T22:44:38.023 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.021+0000 7f04f7fff640 1 -- start start 2023-10-14T22:44:38.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f7fff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f04f80cd980 0x7f04f80cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:38.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f7fff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f04f806bf30 0x7f04f806c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:38.025 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f7fff640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04f8154110 con 0x7f04f8159c00 2023-10-14T22:44:38.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f7fff640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f806c8e0 con 0x7f04f806bf30 2023-10-14T22:44:38.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f7fff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04f815d1f0 con 0x7f04f80cd980 2023-10-14T22:44:38.026 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f04f806bf30 0x7f04f806c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:38.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f77fe640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f04f806bf30 0x7f04f806c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36880/0 (socket says 172.21.15.64:36880) 2023-10-14T22:44:38.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f77fe640 1 -- 172.21.15.64:0/798394776 learned_addr learned my addr 172.21.15.64:0/798394776 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:38.027 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.023+0000 7f04f6ffd640 1 --2- 172.21.15.64:0/798394776 >> v2:172.21.15.177:3300/0 conn(0x7f04f80cd980 0x7f04f80cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:38.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.024+0000 7f04f77fe640 1 -- 172.21.15.64:0/798394776 >> v2:172.21.15.177:3300/0 conn(0x7f04f80cd980 msgr2=0x7f04f80cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:38.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.024+0000 7f04f77fe640 1 --2- 172.21.15.64:0/798394776 >> v2:172.21.15.177:3300/0 conn(0x7f04f80cd980 0x7f04f80cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.024+0000 7f04f77fe640 1 -- 172.21.15.64:0/798394776 >> v1:172.21.15.177:6789/0 conn(0x7f04f8159c00 legacy=0x7f04f815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:38.028 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.024+0000 7f04f77fe640 1 -- 172.21.15.64:0/798394776 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f815e0c0 con 0x7f04f806bf30 2023-10-14T22:44:38.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.025+0000 7f04f77fe640 1 --2- 172.21.15.64:0/798394776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f806c3a0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f04f806e320 tx=0x7f04f002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0811e49b7d5b3b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:38.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.025+0000 7f04f5ffb640 1 -- 172.21.15.64:0/798394776 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f002ca80 con 0x7f04f806bf30 2023-10-14T22:44:38.032 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.025+0000 7f04f5ffb640 1 -- 172.21.15.64:0/798394776 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f002cbe0 con 0x7f04f806bf30 2023-10-14T22:44:38.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.025+0000 7f04f5ffb640 1 -- 172.21.15.64:0/798394776 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f00343f0 con 0x7f04f806bf30 2023-10-14T22:44:38.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 -- 172.21.15.64:0/798394776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 msgr2=0x7f04f806c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:38.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 --2- 172.21.15.64:0/798394776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f806c3a0 secure :-1 s=READY pgs=2296 cs=0 l=1 rev1=1 crypto rx=0x7f04f806e320 tx=0x7f04f002bee0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.033 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 -- 172.21.15.64:0/798394776 shutdown_connections 2023-10-14T22:44:38.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 --2- 172.21.15.64:0/798394776 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f806c3a0 unknown :-1 s=CLOSED pgs=2296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 --2- 172.21.15.64:0/798394776 >> v2:172.21.15.177:3300/0 conn(0x7f04f80cd980 0x7f04f80cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.034 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 -- 172.21.15.64:0/798394776 >> 172.21.15.64:0/798394776 conn(0x7f04f806a470 msgr2=0x7f04f80afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:38.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 -- 172.21.15.64:0/798394776 shutdown_connections 2023-10-14T22:44:38.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.026+0000 7f04f7fff640 1 -- 172.21.15.64:0/798394776 wait complete. 2023-10-14T22:44:38.035 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.028+0000 7f04f7fff640 1 Processor -- start 2023-10-14T22:44:38.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.028+0000 7f04f7fff640 1 -- start start 2023-10-14T22:44:38.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f80c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:38.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f80cd980 0x7f04f814a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:38.036 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f7fff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f8159c00 0x7f04f80ae560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:38.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f7fff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80b2980 con 0x7f04f806bf30 2023-10-14T22:44:38.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f7fff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04f80af140 con 0x7f04f80cd980 2023-10-14T22:44:38.037 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f7fff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04f8149b40 con 0x7f04f8159c00 2023-10-14T22:44:38.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f80c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:38.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f6ffd640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f80c1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:36882/0 (socket says 172.21.15.64:36882) 2023-10-14T22:44:38.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f6ffd640 1 -- 172.21.15.64:0/863842830 learned_addr learned my addr 172.21.15.64:0/863842830 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:38.038 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f67fc640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f80cd980 0x7f04f814a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:38.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f6ffd640 1 -- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f8159c00 msgr2=0x7f04f80ae560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:38.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f6ffd640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f8159c00 0x7f04f80ae560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.039 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f6ffd640 1 -- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f80cd980 msgr2=0x7f04f814a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:38.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.029+0000 7f04f6ffd640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f80cd980 0x7f04f814a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04f6ffd640 1 -- 172.21.15.64:0/863842830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f0009b30 con 0x7f04f806bf30 2023-10-14T22:44:38.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04f67fc640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f80cd980 0x7f04f814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:38.040 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04f6ffd640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f80c1d10 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f04e000d800 tx=0x7f04e000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:38.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04ef7fe640 1 -- 172.21.15.64:0/863842830 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000b6c0 con 0x7f04f806bf30 2023-10-14T22:44:38.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04ef7fe640 1 -- 172.21.15.64:0/863842830 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04e000b820 con 0x7f04f806bf30 2023-10-14T22:44:38.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04ef7fe640 1 -- 172.21.15.64:0/863842830 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e000bbd0 con 0x7f04f806bf30 2023-10-14T22:44:38.041 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04f8149e20 con 0x7f04f806bf30 2023-10-14T22:44:38.042 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.030+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04f814a3e0 con 0x7f04f806bf30 2023-10-14T22:44:38.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.031+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04f804e9b0 con 0x7f04f806bf30 2023-10-14T22:44:38.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.032+0000 7f04ef7fe640 1 -- 172.21.15.64:0/863842830 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f04e000bd30 con 0x7f04f806bf30 2023-10-14T22:44:38.043 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.034+0000 7f04ef7fe640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04d806ae70 0x7f04d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:38.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.034+0000 7f04ef7fe640 1 -- 172.21.15.64:0/863842830 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f04e0089930 con 0x7f04f806bf30 2023-10-14T22:44:38.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.035+0000 7f04f67fc640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04d806ae70 0x7f04d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:38.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.036+0000 7f04f67fc640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04d806ae70 0x7f04d806d330 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f04f80b25c0 tx=0x7f04e8008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:38.044 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.038+0000 7f04ef7fe640 1 -- 172.21.15.64:0/863842830 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f04e0054c30 con 0x7f04f806bf30 2023-10-14T22:44:38.234 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.233+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04f8149cb0 con 0x7f04d806ae70 2023-10-14T22:44:38.241 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.240+0000 7f04ef7fe640 1 -- 172.21.15.64:0/863842830 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48333 (secure 0 0 0) 0x7f04f8149cb0 con 0x7f04d806ae70 2023-10-14T22:44:38.242 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:38.243 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T22:44:38.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04d806ae70 msgr2=0x7f04d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:38.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04d806ae70 0x7f04d806d330 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f04f80b25c0 tx=0x7f04e8008040 comp rx=0 tx=0).stop 2023-10-14T22:44:38.245 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 msgr2=0x7f04f80c1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:38.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f80c1d10 secure :-1 s=READY pgs=2297 cs=0 l=1 rev1=1 crypto rx=0x7f04e000d800 tx=0x7f04e000dcc0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 shutdown_connections 2023-10-14T22:44:38.246 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f04d806ae70 0x7f04d806d330 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f04f8159c00 0x7f04f80ae560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f04f80cd980 0x7f04f814a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 --2- 172.21.15.64:0/863842830 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f04f806bf30 0x7f04f80c1d10 unknown :-1 s=CLOSED pgs=2297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:38.247 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 >> 172.21.15.64:0/863842830 conn(0x7f04f806a470 msgr2=0x7f04f81577f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:38.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 shutdown_connections 2023-10-14T22:44:38.248 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:38.243+0000 7f04f7fff640 1 -- 172.21.15.64:0/863842830 wait complete. 2023-10-14T22:44:38.268 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":18511,"stamp":"2023-10-14T22:44:36.842204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11981256,"kb_used_data":5384,"kb_used_omap":2929,"kb_used_meta":11972878,"kb_avail":742993464,"statfs":{"total":773094113280,"available":760825307136,"internally_reserved":0,"allocated":5513216,"data_stored":3065752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2999830,"internal_metadata":12260227562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.872795"},"pg_stats":[{"pgid":"1.0","version":"19'117","reported_seq":493,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-10-14T22:44:23.978999+0000","last_change":"2023-10-14T12:28:41.645761+0000","last_active":"2023-10-14T22:44:23.978999+0000","last_peered":"2023-10-14T22:44:23.978999+0000","last_clean":"2023-10-14T22:44:23.978999+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T22:44:23.978999+0000","last_undegraded":"2023-10-14T22:44:23.978999+0000","last_fullsized":"2023-10-14T22:44:23.978999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-14T12:28:40.504496+0000","last_clean_scrub_stamp":"2023-10-14T12:28:40.504496+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:15:07.141790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129549536,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1547548,"kb_used_data":1108,"kb_used_omap":333,"kb_used_meta":1546098,"kb_avail":92824292,"statfs":{"total":96636764160,"available":95052075008,"internally_reserved":0,"allocated":1134592,"data_stored":825995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341850,"internal_metadata":1583204518},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.036,"15min":1.0189999999999999},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.949999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":1.1579999999999999},{"interface":"front","average":{"1min":2.2519999999999998,"5min":1.2,"15min":1.1479999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":25.702999999999999,"5min":25.702999999999999,"15min":25.702999999999999},"last":1.107}]},{"osd":1,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":4.1310000000000002,"5min":1.821,"15min":1.4890000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.35799999999999998},"max":{"1min":36.848999999999997,"5min":36.848999999999997,"15min":43.484999999999999},"last":0.98299999999999998},{"interface":"front","average":{"1min":2.782,"5min":1.48,"15min":1.4259999999999999},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":30.545000000000002,"5min":30.545000000000002,"15min":47.561},"last":1.038}]},{"osd":2,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":1.498,"15min":1.288},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":8.7270000000000003,"5min":8.7270000000000003,"15min":8.7270000000000003},"last":1.516},{"interface":"front","average":{"1min":3.427,"5min":1.611,"15min":1.3640000000000001},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":28.446000000000002,"5min":28.446000000000002,"15min":28.446000000000002},"last":1.581}]},{"osd":3,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":1.4930000000000001,"15min":1.349},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.432},"max":{"1min":12.698,"5min":12.773999999999999,"15min":12.773999999999999},"last":1.466},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":19.802,"5min":19.802,"15min":19.802},"last":1.675}]},{"osd":4,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.94199999999999995,"15min":0.98299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.3530000000000002,"5min":3.3530000000000002,"15min":5.2649999999999997},"last":1.97},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.087,"15min":1.056},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.373},"max":{"1min":9.7859999999999996,"5min":9.7859999999999996,"15min":9.7859999999999996},"last":1.7350000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.1240000000000001,"15min":1.028},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":16.484999999999999,"5min":16.484999999999999,"15min":16.484999999999999},"last":1.794},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.0720000000000001,"15min":1.0900000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.36499999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":2.0379999999999998}]},{"osd":6,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.399,"5min":3.399,"15min":5.1500000000000004},"last":2.2080000000000002},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.1779999999999999,"15min":1.133},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":9.7390000000000008,"5min":9.7390000000000008,"15min":9.7390000000000008},"last":1.8600000000000001}]}]},{"osd":6,"up_from":14,"seq":60129549536,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1279064,"kb_used_data":528,"kb_used_omap":259,"kb_used_meta":1278268,"kb_avail":93092776,"statfs":{"total":96636764160,"available":95327002624,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265300,"internal_metadata":1308947372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.601,"15min":1.272},"min":{"1min":0.56699999999999995,"5min":0.312,"15min":0.312},"max":{"1min":19.954000000000001,"5min":26.696999999999999,"15min":26.696999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.5489999999999999,"15min":1.246},"min":{"1min":0.435,"5min":0.371,"15min":0.34200000000000003},"max":{"1min":12.029999999999999,"5min":26.645,"15min":26.645},"last":0.90900000000000003}]},{"osd":1,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9910000000000001,"5min":1.617,"15min":1.764},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":11.016,"5min":22.859000000000002,"15min":102.004},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.7709999999999999,"5min":1.4630000000000001,"15min":1.7130000000000001},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.35299999999999998},"max":{"1min":9.5570000000000004,"5min":19.837,"15min":106.91800000000001},"last":1.216}]},{"osd":2,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":3.4119999999999999,"5min":1.8740000000000001,"15min":1.5209999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":40.963999999999999,"5min":40.963999999999999,"15min":40.963999999999999},"last":1.335},{"interface":"front","average":{"1min":5.3300000000000001,"5min":2.3109999999999999,"15min":1.6639999999999999},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":44.948,"5min":44.948,"15min":44.948},"last":1.4039999999999999}]},{"osd":3,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":5.6790000000000003,"5min":2.391,"15min":1.639},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"max":{"1min":45.972999999999999,"5min":45.972999999999999,"15min":45.972999999999999},"last":1.302},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.4159999999999999,"15min":1.3009999999999999},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.42799999999999999},"max":{"1min":9.0879999999999992,"5min":18.366,"15min":18.366},"last":1.359}]},{"osd":4,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.1399999999999999,"15min":1.0669999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":13.894,"5min":13.894,"15min":13.894},"last":1.6990000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.2,"15min":1.0860000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":11.987,"5min":11.987,"15min":11.987},"last":1.8919999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":2.1400000000000001,"15min":1.4219999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":68.251000000000005,"5min":68.251000000000005,"15min":68.251000000000005},"last":1.746},{"interface":"front","average":{"1min":5.0800000000000001,"5min":1.8740000000000001,"15min":1.3799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":67.287999999999997,"5min":67.287999999999997,"15min":67.287999999999997},"last":1.782}]},{"osd":7,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":4.2069999999999999,"5min":1.758,"15min":1.3300000000000001},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":45.869999999999997,"5min":45.869999999999997,"15min":45.869999999999997},"last":2.004},{"interface":"front","average":{"1min":2.3090000000000002,"5min":1.411,"15min":1.2410000000000001},"min":{"1min":0.57699999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":11.73,"5min":11.73,"15min":11.73},"last":1.964}]}]},{"osd":5,"up_from":14,"seq":60129549531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1463192,"kb_used_data":528,"kb_used_omap":373,"kb_used_meta":1462282,"kb_avail":92908648,"statfs":{"total":96636764160,"available":95138455552,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":382088,"internal_metadata":1497377656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.347,"15min":1.1200000000000001},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.30599999999999999},"max":{"1min":18.402000000000001,"5min":24.623999999999999,"15min":24.623999999999999},"last":1.0649999999999999},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.484,"15min":1.2190000000000001},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.33800000000000002},"max":{"1min":14.494,"5min":21.686,"15min":21.686},"last":1.3069999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":1.736,"15min":1.7410000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":26.164000000000001,"5min":26.164000000000001,"15min":89.793999999999997},"last":1.1080000000000001},{"interface":"front","average":{"1min":1.875,"5min":1.4990000000000001,"15min":1.673},"min":{"1min":0.60799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.6150000000000002,"5min":25.41,"15min":88.759},"last":1.0149999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.244,"15min":1.2849999999999999},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40899999999999997},"max":{"1min":10.307,"5min":10.307,"15min":18.366},"last":1.349},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.1599999999999999,"15min":1.194},"min":{"1min":0.57599999999999996,"5min":0.442,"15min":0.35499999999999998},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":17.277000000000001},"last":1.1779999999999999}]},{"osd":3,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":1.857,"15min":1.5960000000000001},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":25.887,"5min":25.887,"15min":25.887},"last":1.222},{"interface":"front","average":{"1min":2.589,"5min":1.6240000000000001,"15min":1.532},"min":{"1min":0.58699999999999997,"5min":0.51300000000000001,"15min":0.48599999999999999},"max":{"1min":10.269,"5min":10.269,"15min":16.033999999999999},"last":1.4750000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.1259999999999999,"15min":1.0329999999999999},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":18.32,"5min":18.32,"15min":18.32},"last":1.4410000000000001},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.387,"15min":1.1299999999999999},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.35599999999999998},"max":{"1min":35.996000000000002,"5min":35.996000000000002,"15min":35.996000000000002},"last":1.591}]},{"osd":6,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.1459999999999999,"15min":1.101},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.40799999999999997},"max":{"1min":18.574999999999999,"5min":18.574999999999999,"15min":18.574999999999999},"last":1.5720000000000001},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":6.2430000000000003},"last":1.7390000000000001}]},{"osd":7,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.2130000000000001,"15min":1.131},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.443},"max":{"1min":12.337,"5min":12.337,"15min":12.337},"last":1.897},{"interface":"front","average":{"1min":3.5750000000000002,"5min":1.4910000000000001,"15min":1.264},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.504},"max":{"1min":42.744999999999997,"5min":42.744999999999997,"15min":42.744999999999997},"last":1.6719999999999999}]}]},{"osd":4,"up_from":14,"seq":60129549537,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1464984,"kb_used_data":528,"kb_used_omap":895,"kb_used_meta":1463552,"kb_avail":92906856,"statfs":{"total":96636764160,"available":95136620544,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":917343,"internal_metadata":1498677409},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.52,"15min":1.1379999999999999},"min":{"1min":0.35499999999999998,"5min":0.314,"15min":0.314},"max":{"1min":9.1950000000000003,"5min":29.893000000000001,"15min":29.893000000000001},"last":1.081},{"interface":"front","average":{"1min":1.74,"5min":1.615,"15min":1.29},"min":{"1min":0.379,"5min":0.371,"15min":0.316},"max":{"1min":9.3900000000000006,"5min":26.690999999999999,"15min":26.690999999999999},"last":1.159}]},{"osd":1,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":4.226,"5min":2.1899999999999999,"15min":1.9279999999999999},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":63.497,"5min":63.497,"15min":137.398},"last":1.266},{"interface":"front","average":{"1min":3.6070000000000002,"5min":1.929,"15min":1.8029999999999999},"min":{"1min":0.40100000000000002,"5min":0.36399999999999999,"15min":0.33600000000000002},"max":{"1min":42.393000000000001,"5min":42.393000000000001,"15min":142.18299999999999},"last":1.5680000000000001}]},{"osd":2,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.468,"5min":1.6930000000000001,"15min":1.3879999999999999},"min":{"1min":0.60799999999999998,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":16.384,"5min":21.434000000000001,"15min":21.434000000000001},"last":1.381},{"interface":"front","average":{"1min":2.4119999999999999,"5min":1.8420000000000001,"15min":1.4430000000000001},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":13.545,"5min":24.052,"15min":24.052},"last":1.7270000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.7549999999999999,"5min":1.8759999999999999,"15min":2.1339999999999999},"min":{"1min":0.54100000000000004,"5min":0.41999999999999998,"15min":0.41199999999999998},"max":{"1min":19.736999999999998,"5min":22.067,"15min":163.07900000000001},"last":1.339},{"interface":"front","average":{"1min":2.1699999999999999,"5min":1.6799999999999999,"15min":2.0529999999999999},"min":{"1min":0.56200000000000006,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":16.422000000000001,"5min":21.585000000000001,"15min":161.60400000000001},"last":1.671}]},{"osd":5,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.1909999999999998,"5min":1.222,"15min":1.044},"min":{"1min":0.442,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":11.791,"5min":11.791,"15min":11.791},"last":1.839},{"interface":"front","average":{"1min":1.9630000000000001,"5min":1.4950000000000001,"15min":1.224},"min":{"1min":0.48599999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":9.4770000000000003,"5min":13.093,"15min":13.093},"last":1.6279999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":2.0649999999999999,"5min":1.212,"15min":1.129},"min":{"1min":0.443,"5min":0.443,"15min":0.39200000000000002},"max":{"1min":16.257999999999999,"5min":16.257999999999999,"15min":16.257999999999999},"last":1.782},{"interface":"front","average":{"1min":2.1930000000000001,"5min":1.4059999999999999,"15min":1.175},"min":{"1min":0.60699999999999998,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":13.500999999999999,"5min":13.500999999999999,"15min":13.500999999999999},"last":1.954}]},{"osd":7,"last update":"Sat Oct 14 22:43:36 2023","interfaces":[{"interface":"back","average":{"1min":1.7569999999999999,"5min":1.3049999999999999,"15min":1.222},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.432},"max":{"1min":9.4339999999999993,"5min":9.4339999999999993,"15min":9.4339999999999993},"last":1.901},{"interface":"front","average":{"1min":2.9489999999999998,"5min":1.585,"15min":1.286},"min":{"1min":0.54400000000000004,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":27.295000000000002,"5min":27.295000000000002,"15min":27.295000000000002},"last":2.0179999999999998}]}]},{"osd":3,"up_from":14,"seq":60129549501,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1269400,"kb_used_data":528,"kb_used_omap":507,"kb_used_meta":1268356,"kb_avail":93102440,"statfs":{"total":96636764160,"available":95336898560,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":519900,"internal_metadata":1298796836},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.5279999999999996,"5min":2.073,"15min":1.694},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":31.922999999999998,"5min":31.922999999999998,"15min":31.922999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":4.5609999999999999,"5min":2.1699999999999999,"15min":1.823},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":37.823999999999998,"5min":37.823999999999998,"15min":37.823999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4180000000000001,"5min":15.904999999999999,"15min":7.1029999999999998},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":17.184999999999999,"5min":1547.634,"15min":1547.634},"last":0.56100000000000005},{"interface":"front","average":{"1min":4.133,"5min":16.254000000000001,"15min":7.258},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":31.963999999999999,"5min":1552.8879999999999,"15min":1552.8879999999999},"last":0.67900000000000005}]},{"osd":2,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.2489999999999997,"5min":1.97,"15min":1.857},"min":{"1min":0.60699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":28.045000000000002,"5min":28.045000000000002,"15min":28.045000000000002},"last":0.73599999999999999},{"interface":"front","average":{"1min":3.415,"5min":1.99,"15min":1.8300000000000001},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":18.495999999999999,"5min":18.495999999999999,"15min":18.495999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":1.762,"15min":1.661},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.134999999999998,"5min":36.134999999999998,"15min":36.134999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":3.4009999999999998,"5min":2.012,"15min":1.7549999999999999},"min":{"1min":0.77500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":18.535,"5min":18.535,"15min":18.535},"last":1.087}]},{"osd":5,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.3029999999999999,"5min":1.893,"15min":1.724},"min":{"1min":0.57599999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":36.192,"5min":36.192,"15min":36.192},"last":0.95399999999999996},{"interface":"front","average":{"1min":3.677,"5min":2.1800000000000002,"15min":1.8640000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":31.771000000000001,"5min":31.771000000000001,"15min":31.771000000000001},"last":1.05}]},{"osd":6,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":1.9510000000000001,"15min":1.8029999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":21.146999999999998,"5min":21.146999999999998,"15min":21.146999999999998},"last":1.2370000000000001},{"interface":"front","average":{"1min":3.5089999999999999,"5min":2.1019999999999999,"15min":1.8979999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":34.142000000000003,"5min":34.142000000000003,"15min":34.142000000000003},"last":0.92300000000000004}]},{"osd":7,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.1930000000000001,"15min":1.901},"min":{"1min":0.70699999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":32.061999999999998,"5min":32.061999999999998,"15min":32.061999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":3.375,"5min":1.79,"15min":1.772},"min":{"1min":0.66000000000000003,"5min":0.59599999999999997,"15min":0.56299999999999994},"max":{"1min":17.132000000000001,"5min":17.132000000000001,"15min":17.132000000000001},"last":1.103}]}]},{"osd":2,"up_from":14,"seq":60129549507,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1731352,"kb_used_data":528,"kb_used_omap":91,"kb_used_meta":1730724,"kb_avail":92640488,"statfs":{"total":96636764160,"available":94863859712,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93223,"internal_metadata":1772262361},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.9470000000000001,"5min":1.46,"15min":1.542},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":12.6,"5min":12.6,"15min":12.82},"last":1.6879999999999999},{"interface":"front","average":{"1min":2.754,"5min":1.754,"15min":1.7090000000000001},"min":{"1min":0.51500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":20.664000000000001,"5min":20.664000000000001,"15min":20.664000000000001},"last":1.0600000000000001}]},{"osd":1,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.8530000000000002,"5min":2.0859999999999999,"15min":2.4409999999999998},"min":{"1min":0.435,"5min":0.36799999999999999,"15min":0.33400000000000002},"max":{"1min":37.893000000000001,"5min":37.893000000000001,"15min":126.84099999999999},"last":0.93500000000000005},{"interface":"front","average":{"1min":3.2890000000000001,"5min":2.028,"15min":2.5049999999999999},"min":{"1min":0.46100000000000002,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":25.445,"5min":25.445,"15min":129.59100000000001},"last":0.88600000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":1.774,"5min":1.744,"15min":1.708},"min":{"1min":0.46200000000000002,"5min":0.36599999999999999,"15min":0.32200000000000001},"max":{"1min":5.0659999999999998,"5min":5.1379999999999999,"15min":6.7460000000000004},"last":1.0860000000000001},{"interface":"front","average":{"1min":2.4319999999999999,"5min":1.9079999999999999,"15min":1.7310000000000001},"min":{"1min":0.65100000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":12.564,"5min":12.564,"15min":12.564},"last":1.8340000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.863,"5min":1.7609999999999999,"15min":1.6899999999999999},"min":{"1min":0.63,"5min":0.501,"15min":0.46000000000000002},"max":{"1min":20.613,"5min":20.613,"15min":20.613},"last":1.6499999999999999},{"interface":"front","average":{"1min":1.6890000000000001,"5min":1.659,"15min":1.528},"min":{"1min":0.51800000000000002,"5min":0.47299999999999998,"15min":0.46700000000000003},"max":{"1min":5.1950000000000003,"5min":7.9939999999999998,"15min":7.9939999999999998},"last":1.4179999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.1840000000000002,"5min":1.6339999999999999,"15min":1.6499999999999999},"min":{"1min":0.627,"5min":0.48199999999999998,"15min":0.47599999999999998},"max":{"1min":12.507,"5min":12.507,"15min":12.507},"last":1.9339999999999999},{"interface":"front","average":{"1min":2.3719999999999999,"5min":1.7070000000000001,"15min":1.71},"min":{"1min":0.57999999999999996,"5min":0.56599999999999995,"15min":0.48899999999999999},"max":{"1min":11.375,"5min":11.375,"15min":11.375},"last":1.5269999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":1.792,"15min":1.643},"min":{"1min":0.47999999999999998,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":14.448,"5min":14.448,"15min":14.448},"last":1.6000000000000001},{"interface":"front","average":{"1min":2.2229999999999999,"5min":1.6990000000000001,"15min":1.679},"min":{"1min":0.67000000000000004,"5min":0.57199999999999995,"15min":0.53700000000000003},"max":{"1min":12.631,"5min":12.631,"15min":12.631},"last":1.994}]},{"osd":7,"last update":"Sat Oct 14 22:43:32 2023","interfaces":[{"interface":"back","average":{"1min":3.569,"5min":2.0110000000000001,"15min":1.8700000000000001},"min":{"1min":0.68000000000000005,"5min":0.64400000000000002,"15min":0.54800000000000004},"max":{"1min":30.634,"5min":30.634,"15min":30.634},"last":1.7490000000000001},{"interface":"front","average":{"1min":3.2869999999999999,"5min":2.0649999999999999,"15min":1.819},"min":{"1min":0.90800000000000003,"5min":0.53800000000000003,"15min":0.50800000000000001},"max":{"1min":27.34,"5min":27.34,"15min":27.34},"last":1.7909999999999999}]}]},{"osd":1,"up_from":14,"seq":60129549519,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1556440,"kb_used_data":528,"kb_used_omap":431,"kb_used_meta":1555472,"kb_avail":92815400,"statfs":{"total":96636764160,"available":95042969600,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":442347,"internal_metadata":1592803349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.3399999999999999,"5min":1.923,"15min":1.5149999999999999},"min":{"1min":0.29099999999999998,"5min":0.26000000000000001,"15min":0.253},"max":{"1min":34.283999999999999,"5min":34.283999999999999,"15min":34.283999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":4.1870000000000003,"5min":1.97,"15min":1.639},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.27900000000000003},"max":{"1min":35.313000000000002,"5min":35.313000000000002,"15min":35.313000000000002},"last":0.97799999999999998}]},{"osd":2,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.4109999999999996,"5min":2.1480000000000001,"15min":1.956},"min":{"1min":0.53000000000000003,"5min":0.32900000000000001,"15min":0.28000000000000003},"max":{"1min":34.624000000000002,"5min":34.624000000000002,"15min":54.386000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":6.2590000000000003,"5min":2.4740000000000002,"15min":2.1560000000000001},"min":{"1min":0.497,"5min":0.38500000000000001,"15min":0.32500000000000001},"max":{"1min":34.396000000000001,"5min":34.396000000000001,"15min":52.030000000000001},"last":0.72399999999999998}]},{"osd":3,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.8869999999999996,"5min":2.419,"15min":1.9570000000000001},"min":{"1min":0.435,"5min":0.435,"15min":0.41499999999999998},"max":{"1min":34.362000000000002,"5min":34.362000000000002,"15min":34.362000000000002},"last":0.79200000000000004},{"interface":"front","average":{"1min":5.2469999999999999,"5min":2.4390000000000001,"15min":1.913},"min":{"1min":0.51700000000000002,"5min":0.40799999999999997,"15min":0.40200000000000002},"max":{"1min":35.412999999999997,"5min":35.412999999999997,"15min":35.412999999999997},"last":0.46300000000000002}]},{"osd":4,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.3260000000000001,"5min":1.9419999999999999,"15min":1.6970000000000001},"min":{"1min":0.61099999999999999,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":34.481999999999999,"5min":34.481999999999999,"15min":34.481999999999999},"last":1.202},{"interface":"front","average":{"1min":7.891,"5min":2.7109999999999999,"15min":2.0760000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":63.896999999999998,"5min":63.896999999999998,"15min":63.896999999999998},"last":0.93700000000000006}]},{"osd":5,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":5.2830000000000004,"5min":2.4329999999999998,"15min":2.218},"min":{"1min":0.47099999999999997,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":35.222000000000001,"5min":35.222000000000001,"15min":85.819999999999993},"last":1.222},{"interface":"front","average":{"1min":2.9199999999999999,"5min":1.9650000000000001,"15min":1.9870000000000001},"min":{"1min":0.57099999999999995,"5min":0.46300000000000002,"15min":0.441},"max":{"1min":17.254000000000001,"5min":17.254000000000001,"15min":81.944000000000003},"last":0.95699999999999996}]},{"osd":6,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":3.8450000000000002,"5min":1.9299999999999999,"15min":1.863},"min":{"1min":0.52900000000000003,"5min":0.52500000000000002,"15min":0.52100000000000002},"max":{"1min":36.453000000000003,"5min":36.453000000000003,"15min":36.453000000000003},"last":1.1140000000000001},{"interface":"front","average":{"1min":4.6429999999999998,"5min":2.3119999999999998,"15min":1.96},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.497},"max":{"1min":35.542000000000002,"5min":35.542000000000002,"15min":35.926000000000002},"last":1.363}]},{"osd":7,"last update":"Sat Oct 14 22:43:47 2023","interfaces":[{"interface":"back","average":{"1min":4.5019999999999998,"5min":2.3029999999999999,"15min":1.8759999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.53400000000000003},"max":{"1min":35.277999999999999,"5min":35.277999999999999,"15min":35.277999999999999},"last":1.123},{"interface":"front","average":{"1min":3.4350000000000001,"5min":2.089,"15min":1.7869999999999999},"min":{"1min":0.60199999999999998,"5min":0.499,"15min":0.499},"max":{"1min":34.590000000000003,"5min":34.590000000000003,"15min":34.590000000000003},"last":1.04}]}]},{"osd":0,"up_from":14,"seq":60129549515,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1669276,"kb_used_data":1108,"kb_used_omap":36,"kb_used_meta":1668123,"kb_avail":92702564,"statfs":{"total":96636764160,"available":94927425536,"internally_reserved":0,"allocated":1134592,"data_stored":825995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37779,"internal_metadata":1708158061},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.7490000000000001,"5min":6.8129999999999997,"15min":3.8660000000000001},"min":{"1min":0.316,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":23.366,"5min":437.22399999999999,"15min":437.22399999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":2.6309999999999998,"5min":6.7460000000000004,"15min":3.8820000000000001},"min":{"1min":0.36199999999999999,"5min":0.30599999999999999,"15min":0.27500000000000002},"max":{"1min":16.048999999999999,"5min":439.05700000000002,"15min":439.05700000000002},"last":0.82799999999999996}]},{"osd":2,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.7599999999999998,"5min":1.861,"15min":1.726},"min":{"1min":0.35399999999999998,"5min":0.315,"15min":0.314},"max":{"1min":18.789000000000001,"5min":18.789000000000001,"15min":18.789000000000001},"last":1.0629999999999999},{"interface":"front","average":{"1min":2.891,"5min":1.766,"15min":1.7470000000000001},"min":{"1min":0.435,"5min":0.35699999999999998,"15min":0.32300000000000001},"max":{"1min":16.006,"5min":16.006,"15min":19.305},"last":0.997}]},{"osd":3,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":2.948,"5min":1.7689999999999999,"15min":2.0550000000000002},"min":{"1min":0.53500000000000003,"5min":0.42499999999999999,"15min":0.36699999999999999},"max":{"1min":17.547000000000001,"5min":17.547000000000001,"15min":88.554000000000002},"last":0.89500000000000002},{"interface":"front","average":{"1min":3.617,"5min":2.0680000000000001,"15min":2.198},"min":{"1min":0.432,"5min":0.432,"15min":0.35299999999999998},"max":{"1min":23.32,"5min":23.32,"15min":83.847999999999999},"last":1.371}]},{"osd":4,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.137,"5min":1.752,"15min":1.6180000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":31.427,"5min":31.427,"15min":31.427},"last":1.165},{"interface":"front","average":{"1min":3.7789999999999999,"5min":1.956,"15min":1.718},"min":{"1min":0.67100000000000004,"5min":0.46700000000000003,"15min":0.433},"max":{"1min":31.443999999999999,"5min":31.443999999999999,"15min":31.443999999999999},"last":1.4139999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.6040000000000001,"5min":2.2589999999999999,"15min":1.8300000000000001},"min":{"1min":0.54200000000000004,"5min":0.47899999999999998,"15min":0.46100000000000002},"max":{"1min":51.655999999999999,"5min":51.655999999999999,"15min":51.655999999999999},"last":1.55},{"interface":"front","average":{"1min":3.6419999999999999,"5min":1.9319999999999999,"15min":1.7030000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":31.558,"5min":31.558,"15min":31.558},"last":1.341}]},{"osd":6,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":5.093,"5min":2.3069999999999999,"15min":1.915},"min":{"1min":0.64200000000000002,"5min":0.53000000000000003,"15min":0.46999999999999997},"max":{"1min":51.612000000000002,"5min":51.612000000000002,"15min":51.612000000000002},"last":1.3109999999999999},{"interface":"front","average":{"1min":3.891,"5min":1.9730000000000001,"15min":1.8009999999999999},"min":{"1min":0.55400000000000005,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":23.242000000000001,"5min":23.242000000000001,"15min":23.242000000000001},"last":1.6200000000000001}]},{"osd":7,"last update":"Sat Oct 14 22:43:39 2023","interfaces":[{"interface":"back","average":{"1min":3.306,"5min":1.8939999999999999,"15min":1.778},"min":{"1min":0.77600000000000002,"5min":0.62,"15min":0.45500000000000002},"max":{"1min":31.504000000000001,"5min":31.504000000000001,"15min":31.504000000000001},"last":1.575},{"interface":"front","average":{"1min":2.7360000000000002,"5min":1.887,"15min":1.7869999999999999},"min":{"1min":0.75900000000000001,"5min":0.59799999999999998,"15min":0.51600000000000001},"max":{"1min":12.771000000000001,"5min":12.771000000000001,"15min":12.771000000000001},"last":1.1060000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T22:44:38.272 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-14T12:28:40.504496+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=12, tm_min=28, tm_sec=40, tm_wday=5, tm_yday=287, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=14, tm_hour=22, tm_min=44, tm_sec=30, tm_wday=5, tm_yday=287, tm_isdst=0) 2023-10-14T22:44:38.272 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-14T22:44:58.274 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-14T22:44:58.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.484+0000 7ff61bfff640 1 Processor -- start 2023-10-14T22:44:58.487 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.484+0000 7ff61bfff640 1 -- start start 2023-10-14T22:44:58.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.486+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 0x7ff61c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.486+0000 7ff61bfff640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7ff61c0cdd90 0x7ff61c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.489 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.486+0000 7ff61bfff640 1 -- --> v1:172.21.15.64:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff61c15d570 con 0x7ff61c0cad30 2023-10-14T22:44:58.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.486+0000 7ff61bfff640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff61c15cf80 con 0x7ff61c0cdd90 2023-10-14T22:44:58.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.486+0000 7ff61bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15df40 con 0x7ff61c15cba0 2023-10-14T22:44:58.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.487+0000 7ff61b7fe640 1 --1- >> v1:172.21.15.64:6789/0 conn(0x7ff61c0cad30 0x7ff61c1605e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.64:6789/0 says I am v1:172.21.15.64:34630/0 (socket says 172.21.15.64:34630) 2023-10-14T22:44:58.490 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.487+0000 7ff61b7fe640 1 -- 172.21.15.64:0/2500641069 learned_addr learned my addr 172.21.15.64:0/2500641069 (peer_addr_for_me v1:172.21.15.64:0/0) 2023-10-14T22:44:58.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.487+0000 7ff61affd640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 0x7ff61c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.487+0000 7ff613fff640 1 --2- 172.21.15.64:0/2500641069 >> v2:172.21.15.177:3300/0 conn(0x7ff61c0cdd90 0x7ff61c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.487+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 <== mon.0 v1:172.21.15.64:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2907897245 0 0) 0x7ff61c15d570 con 0x7ff61c0cad30 2023-10-14T22:44:58.493 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.487+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 --> v1:172.21.15.64:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff608003520 con 0x7ff61c0cad30 2023-10-14T22:44:58.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 <== mon.0 v1:172.21.15.64:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2684444485 0 0) 0x7ff608003520 con 0x7ff61c0cad30 2023-10-14T22:44:58.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 msgr2=0x7ff61c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:58.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 0x7ff61c15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.494 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 >> v2:172.21.15.177:3300/0 conn(0x7ff61c0cdd90 msgr2=0x7ff61c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:58.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 --2- 172.21.15.64:0/2500641069 >> v2:172.21.15.177:3300/0 conn(0x7ff61c0cdd90 0x7ff61c0cc650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 --> v1:172.21.15.64:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c0ccfc0 con 0x7ff61c0cad30 2023-10-14T22:44:58.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 <== mon.0 v1:172.21.15.64:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3109573836 0 0) 0x7ff6140019f0 con 0x7ff61c0cad30 2023-10-14T22:44:58.495 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 >> v1:172.21.15.64:6789/0 conn(0x7ff61c0cad30 legacy=0x7ff61c1605e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 0x7ff608003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff608003f40 0x7ff6080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608004d00 0x7ff608005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.496 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15cf80 con 0x7ff608003f40 2023-10-14T22:44:58.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15df40 con 0x7ff608004d00 2023-10-14T22:44:58.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60800b980 con 0x7ff61c15cba0 2023-10-14T22:44:58.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff613fff640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff608003f40 0x7ff6080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.497 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.488+0000 7ff61affd640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 0x7ff608003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.489+0000 7ff61b7fe640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608004d00 0x7ff608005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.489+0000 7ff613fff640 1 -- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 msgr2=0x7ff608003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:58.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.489+0000 7ff613fff640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15cba0 0x7ff608003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.498 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.489+0000 7ff613fff640 1 -- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608004d00 msgr2=0x7ff608005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:58.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.489+0000 7ff613fff640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608004d00 0x7ff608005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.489+0000 7ff613fff640 1 -- 172.21.15.64:0/2500641069 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff608003520 con 0x7ff608003f40 2023-10-14T22:44:58.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.489+0000 7ff61b7fe640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608004d00 0x7ff608005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-14T22:44:58.499 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.490+0000 7ff613fff640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff608003f40 0x7ff6080047c0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7ff604009ac0 tx=0x7ff6080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94e0e5461e577c7d server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:58.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.490+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60402c6b0 con 0x7ff608003f40 2023-10-14T22:44:58.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.490+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60402c810 con 0x7ff608003f40 2023-10-14T22:44:58.500 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.490+0000 7ff61a7fc640 1 -- 172.21.15.64:0/2500641069 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60402cba0 con 0x7ff608003f40 2023-10-14T22:44:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.491+0000 7ff61bfff640 1 -- 172.21.15.64:0/2500641069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff608003f40 msgr2=0x7ff6080047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.491+0000 7ff61bfff640 1 --2- 172.21.15.64:0/2500641069 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff608003f40 0x7ff6080047c0 secure :-1 s=READY pgs=2299 cs=0 l=1 rev1=1 crypto rx=0x7ff604009ac0 tx=0x7ff6080057f0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.503 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.491+0000 7ff61b7fe640 1 -- 172.21.15.64:0/2500641069 reap_dead start 2023-10-14T22:44:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.491+0000 7ff61bfff640 1 -- 172.21.15.64:0/2500641069 shutdown_connections 2023-10-14T22:44:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.491+0000 7ff61bfff640 1 -- 172.21.15.64:0/2500641069 >> 172.21.15.64:0/2500641069 conn(0x7ff61c06a470 msgr2=0x7ff61c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.491+0000 7ff61bfff640 1 -- 172.21.15.64:0/2500641069 shutdown_connections 2023-10-14T22:44:58.504 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.491+0000 7ff61bfff640 1 -- 172.21.15.64:0/2500641069 wait complete. 2023-10-14T22:44:58.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.495+0000 7ff61bfff640 1 Processor -- start 2023-10-14T22:44:58.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.495+0000 7ff61bfff640 1 -- start start 2023-10-14T22:44:58.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608003f40 0x7ff61c1f6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.505 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15f510 0x7ff61c1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff61c15fe90 0x7ff61c160310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61bfff640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c160850 con 0x7ff61c15fe90 2023-10-14T22:44:58.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61bfff640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15e470 con 0x7ff608003f40 2023-10-14T22:44:58.506 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61bfff640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61c15e750 con 0x7ff61c15f510 2023-10-14T22:44:58.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff61c15fe90 0x7ff61c160310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61b7fe640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff61c15fe90 0x7ff61c160310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41726/0 (socket says 172.21.15.64:41726) 2023-10-14T22:44:58.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61b7fe640 1 -- 172.21.15.64:0/2843738163 learned_addr learned my addr 172.21.15.64:0/2843738163 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:58.507 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.497+0000 7ff61affd640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608003f40 0x7ff61c1f6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff613fff640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15f510 0x7ff61c1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61b7fe640 1 -- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15f510 msgr2=0x7ff61c1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.508 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61b7fe640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15f510 0x7ff61c1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61b7fe640 1 -- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608003f40 msgr2=0x7ff61c1f6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61b7fe640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608003f40 0x7ff61c1f6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61b7fe640 1 -- 172.21.15.64:0/2843738163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c15ea30 con 0x7ff61c15fe90 2023-10-14T22:44:58.509 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61b7fe640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff61c15fe90 0x7ff61c160310 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7ff614001370 tx=0x7ff61400b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:58.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff6137fe640 1 -- 172.21.15.64:0/2843738163 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614004d70 con 0x7ff61c15fe90 2023-10-14T22:44:58.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff6137fe640 1 -- 172.21.15.64:0/2843738163 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61400bb80 con 0x7ff61c15fe90 2023-10-14T22:44:58.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff61c15ed10 con 0x7ff61c15fe90 2023-10-14T22:44:58.510 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff6137fe640 1 -- 172.21.15.64:0/2843738163 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614007070 con 0x7ff61c15fe90 2023-10-14T22:44:58.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.498+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff61c157c20 con 0x7ff61c15fe90 2023-10-14T22:44:58.511 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.500+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff61c0ccb50 con 0x7ff61c15fe90 2023-10-14T22:44:58.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.501+0000 7ff6137fe640 1 -- 172.21.15.64:0/2843738163 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7ff6140071d0 con 0x7ff61c15fe90 2023-10-14T22:44:58.512 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.502+0000 7ff6137fe640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff5fc06ae70 0x7ff5fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.502+0000 7ff6137fe640 1 -- 172.21.15.64:0/2843738163 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7ff6140898f0 con 0x7ff61c15fe90 2023-10-14T22:44:58.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.502+0000 7ff61affd640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff5fc06ae70 0x7ff5fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.503+0000 7ff61affd640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff5fc06ae70 0x7ff5fc06d330 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009920 tx=0x7ff60c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:58.513 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.506+0000 7ff6137fe640 1 -- 172.21.15.64:0/2843738163 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7ff614054ac0 con 0x7ff61c15fe90 2023-10-14T22:44:58.693 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.691+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 --> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff61c15d200 con 0x7ff5fc06ae70 2023-10-14T22:44:58.697 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.694+0000 7ff6137fe640 1 -- 172.21.15.64:0/2843738163 <== mgr.4108 v2:172.21.15.177:6832/55986901 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+48596 (secure 0 0 0) 0x7ff60c0095b0 con 0x7ff5fc06ae70 2023-10-14T22:44:58.698 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:58.698 INFO:teuthology.orchestra.run.smithi064.stderr:dumped all 2023-10-14T22:44:58.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff5fc06ae70 msgr2=0x7ff5fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff5fc06ae70 0x7ff5fc06d330 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff60c009920 tx=0x7ff60c008040 comp rx=0 tx=0).stop 2023-10-14T22:44:58.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff61c15fe90 msgr2=0x7ff61c160310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.700 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff61c15fe90 0x7ff61c160310 secure :-1 s=READY pgs=2300 cs=0 l=1 rev1=1 crypto rx=0x7ff614001370 tx=0x7ff61400b4a0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 shutdown_connections 2023-10-14T22:44:58.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7ff5fc06ae70 0x7ff5fc06d330 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7ff61c15fe90 0x7ff61c160310 unknown :-1 s=CLOSED pgs=2300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.701 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7ff61c15f510 0x7ff61c1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 --2- 172.21.15.64:0/2843738163 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7ff608003f40 0x7ff61c1f6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 >> 172.21.15.64:0/2843738163 conn(0x7ff61c06a470 msgr2=0x7ff61c0aea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:58.702 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 shutdown_connections 2023-10-14T22:44:58.703 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.697+0000 7ff61bfff640 1 -- 172.21.15.64:0/2843738163 wait complete. 2023-10-14T22:44:58.717 INFO:teuthology.orchestra.run.smithi064.stdout:{"pg_ready":true,"pg_map":{"version":18521,"stamp":"2023-10-14T22:44:56.848027+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":11981256,"kb_used_data":5384,"kb_used_omap":2929,"kb_used_meta":11972878,"kb_avail":742993464,"statfs":{"total":773094113280,"available":760825307136,"internally_reserved":0,"allocated":5513216,"data_stored":3065752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2999830,"internal_metadata":12260227562},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003345"},"pg_stats":[{"pgid":"1.0","version":"46'119","reported_seq":505,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-10-14T22:44:40.163392+0000","last_change":"2023-10-14T22:44:40.163459+0000","last_active":"2023-10-14T22:44:40.163392+0000","last_peered":"2023-10-14T22:44:40.163392+0000","last_clean":"2023-10-14T22:44:40.163392+0000","last_became_active":"2023-10-14T12:28:41.643667+0000","last_became_peered":"2023-10-14T12:28:41.643667+0000","last_unstale":"2023-10-14T22:44:40.163392+0000","last_undegraded":"2023-10-14T22:44:40.163392+0000","last_fullsized":"2023-10-14T22:44:40.163392+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"46'119","last_scrub_stamp":"2023-10-14T22:44:40.163326+0000","last_deep_scrub":"46'119","last_deep_scrub_stamp":"2023-10-14T22:44:40.163326+0000","last_clean_scrub_stamp":"2023-10-14T22:44:40.163326+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-15T23:37:00.039859+0000","scrub_duration":0.25919463100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129549540,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1547548,"kb_used_data":1108,"kb_used_omap":333,"kb_used_meta":1546098,"kb_avail":92824292,"statfs":{"total":96636764160,"available":95052075008,"internally_reserved":0,"allocated":1134592,"data_stored":825995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341850,"internal_metadata":1583204518},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.036,"15min":1.0189999999999999},"min":{"1min":0.34300000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":11.949999999999999,"5min":11.949999999999999,"15min":11.949999999999999},"last":1.3169999999999999},{"interface":"front","average":{"1min":2.2519999999999998,"5min":1.2,"15min":1.1479999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":25.702999999999999,"5min":25.702999999999999,"15min":25.702999999999999},"last":1.0309999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":4.1310000000000002,"5min":1.821,"15min":1.4890000000000001},"min":{"1min":0.373,"5min":0.373,"15min":0.35799999999999998},"max":{"1min":36.848999999999997,"5min":36.848999999999997,"15min":43.484999999999999},"last":1.621},{"interface":"front","average":{"1min":2.782,"5min":1.48,"15min":1.4259999999999999},"min":{"1min":0.41299999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":30.545000000000002,"5min":30.545000000000002,"15min":47.561},"last":0.99099999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":1.498,"15min":1.288},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40400000000000003},"max":{"1min":8.7270000000000003,"5min":8.7270000000000003,"15min":8.7270000000000003},"last":1.107},{"interface":"front","average":{"1min":3.427,"5min":1.611,"15min":1.3640000000000001},"min":{"1min":0.48899999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":28.446000000000002,"5min":28.446000000000002,"15min":28.446000000000002},"last":1.157}]},{"osd":3,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":2.2970000000000002,"5min":1.4930000000000001,"15min":1.349},"min":{"1min":0.47399999999999998,"5min":0.45600000000000002,"15min":0.432},"max":{"1min":12.698,"5min":12.773999999999999,"15min":12.773999999999999},"last":1.369},{"interface":"front","average":{"1min":2.0619999999999998,"5min":1.395,"15min":1.3260000000000001},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":19.802,"5min":19.802,"15min":19.802},"last":1.2090000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":0.94199999999999995,"15min":0.98299999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":3.3530000000000002,"5min":3.3530000000000002,"15min":5.2649999999999997},"last":1.288},{"interface":"front","average":{"1min":1.5409999999999999,"5min":1.087,"15min":1.056},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.373},"max":{"1min":9.7859999999999996,"5min":9.7859999999999996,"15min":9.7859999999999996},"last":1.712}]},{"osd":5,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.5660000000000001,"5min":1.1240000000000001,"15min":1.028},"min":{"1min":0.45900000000000002,"5min":0.42099999999999999,"15min":0.40100000000000002},"max":{"1min":16.484999999999999,"5min":16.484999999999999,"15min":16.484999999999999},"last":1.425},{"interface":"front","average":{"1min":1.2430000000000001,"5min":1.0720000000000001,"15min":1.0900000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.36499999999999999},"max":{"1min":7.2000000000000002,"5min":7.2000000000000002,"15min":7.2000000000000002},"last":1.468}]},{"osd":6,"last update":"Sat Oct 14 22:44:11 2023","interfaces":[{"interface":"back","average":{"1min":1.101,"5min":1.0640000000000001,"15min":1.1000000000000001},"min":{"1min":0.54100000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":3.399,"5min":3.399,"15min":5.1500000000000004},"last":1.5760000000000001},{"interface":"front","average":{"1min":1.7470000000000001,"5min":1.1779999999999999,"15min":1.133},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42299999999999999},"max":{"1min":9.7390000000000008,"5min":9.7390000000000008,"15min":9.7390000000000008},"last":1.827}]}]},{"osd":6,"up_from":14,"seq":60129549540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1279064,"kb_used_data":528,"kb_used_omap":259,"kb_used_meta":1278268,"kb_avail":93092776,"statfs":{"total":96636764160,"available":95327002624,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265300,"internal_metadata":1308947372},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":2.4140000000000001,"5min":1.601,"15min":1.272},"min":{"1min":0.56699999999999995,"5min":0.312,"15min":0.312},"max":{"1min":19.954000000000001,"5min":26.696999999999999,"15min":26.696999999999999},"last":0.95499999999999996},{"interface":"front","average":{"1min":1.9399999999999999,"5min":1.5489999999999999,"15min":1.246},"min":{"1min":0.435,"5min":0.371,"15min":0.34200000000000003},"max":{"1min":12.029999999999999,"5min":26.645,"15min":26.645},"last":1.113}]},{"osd":1,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.9910000000000001,"5min":1.617,"15min":1.764},"min":{"1min":0.41299999999999998,"5min":0.372,"15min":0.372},"max":{"1min":11.016,"5min":22.859000000000002,"15min":102.004},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.7709999999999999,"5min":1.4630000000000001,"15min":1.7130000000000001},"min":{"1min":0.45300000000000001,"5min":0.39600000000000002,"15min":0.35299999999999998},"max":{"1min":9.5570000000000004,"5min":19.837,"15min":106.91800000000001},"last":1.655}]},{"osd":2,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":3.4119999999999999,"5min":1.8740000000000001,"15min":1.5209999999999999},"min":{"1min":0.41299999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":40.963999999999999,"5min":40.963999999999999,"15min":40.963999999999999},"last":1.4219999999999999},{"interface":"front","average":{"1min":5.3300000000000001,"5min":2.3109999999999999,"15min":1.6639999999999999},"min":{"1min":0.57499999999999996,"5min":0.47199999999999998,"15min":0.439},"max":{"1min":44.948,"5min":44.948,"15min":44.948},"last":1.2629999999999999}]},{"osd":3,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":5.6790000000000003,"5min":2.391,"15min":1.639},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.43099999999999999},"max":{"1min":45.972999999999999,"5min":45.972999999999999,"15min":45.972999999999999},"last":1.381},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.4159999999999999,"15min":1.3009999999999999},"min":{"1min":0.52700000000000002,"5min":0.47399999999999998,"15min":0.42799999999999999},"max":{"1min":9.0879999999999992,"5min":18.366,"15min":18.366},"last":1.4710000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.1399999999999999,"15min":1.0669999999999999},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":13.894,"5min":13.894,"15min":13.894},"last":1.8360000000000001},{"interface":"front","average":{"1min":1.8080000000000001,"5min":1.2,"15min":1.0860000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.40300000000000002},"max":{"1min":11.987,"5min":11.987,"15min":11.987},"last":1.764}]},{"osd":5,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":6.5940000000000003,"5min":2.1400000000000001,"15min":1.4219999999999999},"min":{"1min":0.40600000000000003,"5min":0.40300000000000002,"15min":0.38100000000000001},"max":{"1min":68.251000000000005,"5min":68.251000000000005,"15min":68.251000000000005},"last":1.6220000000000001},{"interface":"front","average":{"1min":5.0800000000000001,"5min":1.8740000000000001,"15min":1.3799999999999999},"min":{"1min":0.51400000000000001,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":67.287999999999997,"5min":67.287999999999997,"15min":67.287999999999997},"last":1.964}]},{"osd":7,"last update":"Sat Oct 14 22:44:06 2023","interfaces":[{"interface":"back","average":{"1min":4.2069999999999999,"5min":1.758,"15min":1.3300000000000001},"min":{"1min":0.55700000000000005,"5min":0.47099999999999997,"15min":0.45300000000000001},"max":{"1min":45.869999999999997,"5min":45.869999999999997,"15min":45.869999999999997},"last":1.542},{"interface":"front","average":{"1min":2.3090000000000002,"5min":1.411,"15min":1.2410000000000001},"min":{"1min":0.57699999999999996,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":11.73,"5min":11.73,"15min":11.73},"last":1.724}]}]},{"osd":5,"up_from":14,"seq":60129549535,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1463192,"kb_used_data":528,"kb_used_omap":373,"kb_used_meta":1462282,"kb_avail":92908648,"statfs":{"total":96636764160,"available":95138455552,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":382088,"internal_metadata":1497377656},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.8899999999999999,"5min":1.347,"15min":1.1200000000000001},"min":{"1min":0.39900000000000002,"5min":0.315,"15min":0.30599999999999999},"max":{"1min":18.402000000000001,"5min":24.623999999999999,"15min":24.623999999999999},"last":1.113},{"interface":"front","average":{"1min":2.0249999999999999,"5min":1.484,"15min":1.2190000000000001},"min":{"1min":0.42299999999999999,"5min":0.36499999999999999,"15min":0.33800000000000002},"max":{"1min":14.494,"5min":21.686,"15min":21.686},"last":1.5600000000000001}]},{"osd":1,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.4430000000000001,"5min":1.736,"15min":1.7410000000000001},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.33500000000000002},"max":{"1min":26.164000000000001,"5min":26.164000000000001,"15min":89.793999999999997},"last":1.198},{"interface":"front","average":{"1min":1.875,"5min":1.4990000000000001,"15min":1.673},"min":{"1min":0.60799999999999998,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":7.6150000000000002,"5min":25.41,"15min":88.759},"last":1.363}]},{"osd":2,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.244,"15min":1.2849999999999999},"min":{"1min":0.46000000000000002,"5min":0.40999999999999998,"15min":0.40899999999999997},"max":{"1min":10.307,"5min":10.307,"15min":18.366},"last":1.04},{"interface":"front","average":{"1min":1.4450000000000001,"5min":1.1599999999999999,"15min":1.194},"min":{"1min":0.57599999999999996,"5min":0.442,"15min":0.35499999999999998},"max":{"1min":4.4829999999999997,"5min":4.4829999999999997,"15min":17.277000000000001},"last":1.6890000000000001}]},{"osd":3,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":3.5259999999999998,"5min":1.857,"15min":1.5960000000000001},"min":{"1min":0.59399999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":25.887,"5min":25.887,"15min":25.887},"last":1.841},{"interface":"front","average":{"1min":2.589,"5min":1.6240000000000001,"15min":1.532},"min":{"1min":0.58699999999999997,"5min":0.51300000000000001,"15min":0.48599999999999999},"max":{"1min":10.269,"5min":10.269,"15min":16.033999999999999},"last":1.627}]},{"osd":4,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.962,"5min":1.1259999999999999,"15min":1.0329999999999999},"min":{"1min":0.45000000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":18.32,"5min":18.32,"15min":18.32},"last":1.8919999999999999},{"interface":"front","average":{"1min":2.8359999999999999,"5min":1.387,"15min":1.1299999999999999},"min":{"1min":0.51800000000000002,"5min":0.42999999999999999,"15min":0.35599999999999998},"max":{"1min":35.996000000000002,"5min":35.996000000000002,"15min":35.996000000000002},"last":1.768}]},{"osd":6,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":2.1400000000000001,"5min":1.1459999999999999,"15min":1.101},"min":{"1min":0.443,"5min":0.42299999999999999,"15min":0.40799999999999997},"max":{"1min":18.574999999999999,"5min":18.574999999999999,"15min":18.574999999999999},"last":1.802},{"interface":"front","average":{"1min":1.2869999999999999,"5min":1.0549999999999999,"15min":1.091},"min":{"1min":0.50800000000000001,"5min":0.443,"15min":0.41599999999999998},"max":{"1min":4.4370000000000003,"5min":4.4370000000000003,"15min":6.2430000000000003},"last":1.984}]},{"osd":7,"last update":"Sat Oct 14 22:44:00 2023","interfaces":[{"interface":"back","average":{"1min":1.637,"5min":1.2130000000000001,"15min":1.131},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.443},"max":{"1min":12.337,"5min":12.337,"15min":12.337},"last":1.9399999999999999},{"interface":"front","average":{"1min":3.5750000000000002,"5min":1.4910000000000001,"15min":1.264},"min":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.504},"max":{"1min":42.744999999999997,"5min":42.744999999999997,"15min":42.744999999999997},"last":1.863}]}]},{"osd":4,"up_from":14,"seq":60129549541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1464984,"kb_used_data":528,"kb_used_omap":895,"kb_used_meta":1463552,"kb_avail":92906856,"statfs":{"total":96636764160,"available":95136620544,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":917343,"internal_metadata":1498677409},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.5980000000000001,"15min":1.1899999999999999},"min":{"1min":0.48199999999999998,"5min":0.35499999999999998,"15min":0.314},"max":{"1min":7.6120000000000001,"5min":29.893000000000001,"15min":29.893000000000001},"last":1.73},{"interface":"front","average":{"1min":5.6319999999999997,"5min":2.5009999999999999,"15min":1.552},"min":{"1min":0.39200000000000002,"5min":0.379,"15min":0.316},"max":{"1min":80.792000000000002,"5min":80.792000000000002,"15min":80.792000000000002},"last":1.165}]},{"osd":1,"last update":"Sat Oct 14 22:44:40 2023","interfaces":[{"interface":"back","average":{"1min":2.141,"5min":2.419,"15min":1.97},"min":{"1min":0.377,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":20.399000000000001,"5min":63.497,"15min":137.398},"last":1.6839999999999999},{"interface":"front","average":{"1min":3.8380000000000001,"5min":2.5070000000000001,"15min":1.99},"min":{"1min":0.41199999999999998,"5min":0.36399999999999999,"15min":0.33600000000000002},"max":{"1min":40.225000000000001,"5min":42.393000000000001,"15min":142.18299999999999},"last":1.23}]},{"osd":2,"last update":"Sat Oct 14 22:44:40 2023","interfaces":[{"interface":"back","average":{"1min":2.8100000000000001,"5min":2.0219999999999998,"15min":1.486},"min":{"1min":0.54500000000000004,"5min":0.46800000000000003,"15min":0.45300000000000001},"max":{"1min":25.568000000000001,"5min":25.568000000000001,"15min":25.568000000000001},"last":1.2849999999999999},{"interface":"front","average":{"1min":3.274,"5min":2.2690000000000001,"15min":1.5800000000000001},"min":{"1min":0.45300000000000001,"5min":0.45100000000000001,"15min":0.42799999999999999},"max":{"1min":28.617999999999999,"5min":28.617999999999999,"15min":28.617999999999999},"last":1.629}]},{"osd":3,"last update":"Sat Oct 14 22:44:40 2023","interfaces":[{"interface":"back","average":{"1min":6.8680000000000003,"5min":3.0409999999999999,"15min":2.4830000000000001},"min":{"1min":0.52600000000000002,"5min":0.48399999999999999,"15min":0.41199999999999998},"max":{"1min":61.146000000000001,"5min":61.146000000000001,"15min":163.07900000000001},"last":1.4430000000000001},{"interface":"front","average":{"1min":7.5750000000000002,"5min":2.9820000000000002,"15min":2.4550000000000001},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":63.427,"5min":63.427,"15min":161.60400000000001},"last":1.4890000000000001}]},{"osd":5,"last update":"Sat Oct 14 22:44:40 2023","interfaces":[{"interface":"back","average":{"1min":1.611,"5min":1.3799999999999999,"15min":1.095},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.38100000000000001},"max":{"1min":5.9800000000000004,"5min":11.791,"15min":11.791},"last":1.4019999999999999},{"interface":"front","average":{"1min":3.9409999999999998,"5min":2.0939999999999999,"15min":1.403},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42799999999999999},"max":{"1min":27.593,"5min":27.593,"15min":27.593},"last":1.5469999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:44:40 2023","interfaces":[{"interface":"back","average":{"1min":2.3149999999999999,"5min":1.4730000000000001,"15min":1.216},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.39200000000000002},"max":{"1min":17.227,"5min":17.227,"15min":17.227},"last":1.7989999999999999},{"interface":"front","average":{"1min":2.524,"5min":1.6990000000000001,"15min":1.286},"min":{"1min":0.497,"5min":0.497,"15min":0.45700000000000002},"max":{"1min":10.236000000000001,"5min":13.500999999999999,"15min":13.500999999999999},"last":1.839}]},{"osd":7,"last update":"Sat Oct 14 22:44:40 2023","interfaces":[{"interface":"back","average":{"1min":2.4860000000000002,"5min":1.621,"15min":1.298},"min":{"1min":0.52300000000000002,"5min":0.432,"15min":0.432},"max":{"1min":13.617000000000001,"5min":13.617000000000001,"15min":13.617000000000001},"last":1.774},{"interface":"front","average":{"1min":1.752,"5min":1.742,"15min":1.3200000000000001},"min":{"1min":0.59299999999999997,"5min":0.54400000000000004,"15min":0.52600000000000002},"max":{"1min":6.335,"5min":27.295000000000002,"15min":27.295000000000002},"last":1.8600000000000001}]}]},{"osd":3,"up_from":14,"seq":60129549505,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1269400,"kb_used_data":528,"kb_used_omap":507,"kb_used_meta":1268356,"kb_avail":93102440,"statfs":{"total":96636764160,"available":95336898560,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":519900,"internal_metadata":1298796836},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.5279999999999996,"5min":2.073,"15min":1.694},"min":{"1min":0.35999999999999999,"5min":0.28399999999999997,"15min":0.26500000000000001},"max":{"1min":31.922999999999998,"5min":31.922999999999998,"15min":31.922999999999998},"last":0.94299999999999995},{"interface":"front","average":{"1min":4.5609999999999999,"5min":2.1699999999999999,"15min":1.823},"min":{"1min":0.33100000000000002,"5min":0.29099999999999998,"15min":0.27200000000000002},"max":{"1min":37.823999999999998,"5min":37.823999999999998,"15min":37.823999999999998},"last":1.169}]},{"osd":1,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.4180000000000001,"5min":15.904999999999999,"15min":7.1029999999999998},"min":{"1min":0.32400000000000001,"5min":0.313,"15min":0.313},"max":{"1min":17.184999999999999,"5min":1547.634,"15min":1547.634},"last":0.82499999999999996},{"interface":"front","average":{"1min":4.133,"5min":16.254000000000001,"15min":7.258},"min":{"1min":0.39100000000000001,"5min":0.36199999999999999,"15min":0.33600000000000002},"max":{"1min":31.963999999999999,"5min":1552.8879999999999,"15min":1552.8879999999999},"last":1.2190000000000001}]},{"osd":2,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.2489999999999997,"5min":1.97,"15min":1.857},"min":{"1min":0.60699999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":28.045000000000002,"5min":28.045000000000002,"15min":28.045000000000002},"last":1.2450000000000001},{"interface":"front","average":{"1min":3.415,"5min":1.99,"15min":1.8300000000000001},"min":{"1min":0.375,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":18.495999999999999,"5min":18.495999999999999,"15min":18.495999999999999},"last":1.0669999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.77,"5min":1.762,"15min":1.661},"min":{"1min":0.53300000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":36.134999999999998,"5min":36.134999999999998,"15min":36.134999999999998},"last":1.5409999999999999},{"interface":"front","average":{"1min":3.4009999999999998,"5min":2.012,"15min":1.7549999999999999},"min":{"1min":0.77500000000000002,"5min":0.45200000000000001,"15min":0.44800000000000001},"max":{"1min":18.535,"5min":18.535,"15min":18.535},"last":1.292}]},{"osd":5,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":4.3029999999999999,"5min":1.893,"15min":1.724},"min":{"1min":0.57599999999999996,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":36.192,"5min":36.192,"15min":36.192},"last":1.3859999999999999},{"interface":"front","average":{"1min":3.677,"5min":2.1800000000000002,"15min":1.8640000000000001},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":31.771000000000001,"5min":31.771000000000001,"15min":31.771000000000001},"last":1.4330000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":2.9990000000000001,"5min":1.9510000000000001,"15min":1.8029999999999999},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":21.146999999999998,"5min":21.146999999999998,"15min":21.146999999999998},"last":1.71},{"interface":"front","average":{"1min":3.5089999999999999,"5min":2.1019999999999999,"15min":1.8979999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":34.142000000000003,"5min":34.142000000000003,"15min":34.142000000000003},"last":1.889}]},{"osd":7,"last update":"Sat Oct 14 22:44:01 2023","interfaces":[{"interface":"back","average":{"1min":3.9180000000000001,"5min":2.1930000000000001,"15min":1.901},"min":{"1min":0.70699999999999996,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":32.061999999999998,"5min":32.061999999999998,"15min":32.061999999999998},"last":1.792},{"interface":"front","average":{"1min":3.375,"5min":1.79,"15min":1.772},"min":{"1min":0.66000000000000003,"5min":0.59599999999999997,"15min":0.56299999999999994},"max":{"1min":17.132000000000001,"5min":17.132000000000001,"15min":17.132000000000001},"last":1.7549999999999999}]}]},{"osd":2,"up_from":14,"seq":60129549511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1731352,"kb_used_data":528,"kb_used_omap":91,"kb_used_meta":1730724,"kb_avail":92640488,"statfs":{"total":96636764160,"available":94863859712,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":93223,"internal_metadata":1772262361},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:34 2023","interfaces":[{"interface":"back","average":{"1min":1.6659999999999999,"5min":1.5649999999999999,"15min":1.5620000000000001},"min":{"1min":0.41099999999999998,"5min":0.26300000000000001,"15min":0.247},"max":{"1min":11.571,"5min":12.6,"15min":12.82},"last":0.91700000000000004},{"interface":"front","average":{"1min":2.202,"5min":1.9079999999999999,"15min":1.726},"min":{"1min":0.378,"5min":0.314,"15min":0.314},"max":{"1min":17.457999999999998,"5min":20.664000000000001,"15min":20.664000000000001},"last":1.2569999999999999}]},{"osd":1,"last update":"Sat Oct 14 22:44:34 2023","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":2.5430000000000001,"15min":2.5819999999999999},"min":{"1min":0.53700000000000003,"5min":0.36799999999999999,"15min":0.34100000000000003},"max":{"1min":31.556000000000001,"5min":37.893000000000001,"15min":126.84099999999999},"last":1.488},{"interface":"front","average":{"1min":2.9449999999999998,"5min":2.3319999999999999,"15min":2.597},"min":{"1min":0.437,"5min":0.40799999999999997,"15min":0.38800000000000001},"max":{"1min":17.491,"5min":25.445,"15min":129.59100000000001},"last":1.121}]},{"osd":3,"last update":"Sat Oct 14 22:44:34 2023","interfaces":[{"interface":"back","average":{"1min":2.2000000000000002,"5min":1.9390000000000001,"15min":1.7689999999999999},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.32200000000000001},"max":{"1min":17.277000000000001,"5min":17.277000000000001,"15min":17.277000000000001},"last":0.88300000000000001},{"interface":"front","average":{"1min":2.04,"5min":2.0299999999999998,"15min":1.7749999999999999},"min":{"1min":0.40200000000000002,"5min":0.38100000000000001,"15min":0.36299999999999999},"max":{"1min":12.864000000000001,"5min":12.864000000000001,"15min":12.864000000000001},"last":1.7110000000000001}]},{"osd":4,"last update":"Sat Oct 14 22:44:34 2023","interfaces":[{"interface":"back","average":{"1min":2.7999999999999998,"5min":2.0190000000000001,"15min":1.7829999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":17.378,"5min":20.613,"15min":20.613},"last":1.419},{"interface":"front","average":{"1min":2.5150000000000001,"5min":1.9279999999999999,"15min":1.6240000000000001},"min":{"1min":0.66200000000000003,"5min":0.49299999999999999,"15min":0.46700000000000003},"max":{"1min":17.166,"5min":17.166,"15min":17.166},"last":1.54}]},{"osd":5,"last update":"Sat Oct 14 22:44:34 2023","interfaces":[{"interface":"back","average":{"1min":2.1749999999999998,"5min":1.744,"15min":1.7090000000000001},"min":{"1min":0.64800000000000002,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":11.525,"5min":12.507,"15min":12.507},"last":1.9530000000000001},{"interface":"front","average":{"1min":2.9340000000000002,"5min":1.96,"15min":1.8180000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.48899999999999999},"max":{"1min":17.414999999999999,"5min":17.414999999999999,"15min":17.414999999999999},"last":1.8899999999999999}]},{"osd":6,"last update":"Sat Oct 14 22:44:34 2023","interfaces":[{"interface":"back","average":{"1min":2.8260000000000001,"5min":2.105,"15min":1.7350000000000001},"min":{"1min":0.54300000000000004,"5min":0.44700000000000001,"15min":0.42999999999999999},"max":{"1min":17.234000000000002,"5min":17.234000000000002,"15min":17.234000000000002},"last":1.341},{"interface":"front","average":{"1min":2.4079999999999999,"5min":1.8500000000000001,"15min":1.746},"min":{"1min":0.60299999999999998,"5min":0.57199999999999995,"15min":0.54000000000000004},"max":{"1min":11.606999999999999,"5min":12.631,"15min":12.631},"last":1.8400000000000001}]},{"osd":7,"last update":"Sat Oct 14 22:44:34 2023","interfaces":[{"interface":"back","average":{"1min":5.71,"5min":2.7959999999999998,"15min":2.1539999999999999},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":69.781999999999996,"5min":69.781999999999996,"15min":69.781999999999996},"last":1.758},{"interface":"front","average":{"1min":5.6760000000000002,"5min":2.9340000000000002,"15min":2.0960000000000001},"min":{"1min":0.62,"5min":0.53800000000000003,"15min":0.50800000000000001},"max":{"1min":69.534999999999997,"5min":69.534999999999997,"15min":69.534999999999997},"last":1.6619999999999999}]}]},{"osd":1,"up_from":14,"seq":60129549523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1556440,"kb_used_data":528,"kb_used_omap":431,"kb_used_meta":1555472,"kb_avail":92815400,"statfs":{"total":96636764160,"available":95042969600,"internally_reserved":0,"allocated":540672,"data_stored":235627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":442347,"internal_metadata":1592803349},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Oct 14 22:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83799999999999997,"5min":1.794,"15min":1.4670000000000001},"min":{"1min":0.31,"5min":0.26700000000000002,"15min":0.253},"max":{"1min":3.2669999999999999,"5min":34.283999999999999,"15min":34.283999999999999},"last":0.875},{"interface":"front","average":{"1min":2.202,"5min":2.0790000000000002,"15min":1.6539999999999999},"min":{"1min":0.441,"5min":0.30499999999999999,"15min":0.29299999999999998},"max":{"1min":26.257000000000001,"5min":35.313000000000002,"15min":35.313000000000002},"last":1.2769999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:44:51 2023","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":1.966,"15min":1.712},"min":{"1min":0.39300000000000002,"5min":0.32900000000000001,"15min":0.28000000000000003},"max":{"1min":3.867,"5min":34.624000000000002,"15min":34.624000000000002},"last":0.80200000000000005},{"interface":"front","average":{"1min":1.1200000000000001,"5min":2.302,"15min":1.905},"min":{"1min":0.57199999999999995,"5min":0.40300000000000002,"15min":0.32500000000000001},"max":{"1min":5.1639999999999997,"5min":34.396000000000001,"15min":34.396000000000001},"last":1.0289999999999999}]},{"osd":3,"last update":"Sat Oct 14 22:44:51 2023","interfaces":[{"interface":"back","average":{"1min":2.3679999999999999,"5min":2.492,"15min":1.982},"min":{"1min":0.52100000000000002,"5min":0.435,"15min":0.41499999999999998},"max":{"1min":28.475000000000001,"5min":34.362000000000002,"15min":34.362000000000002},"last":1.159},{"interface":"front","average":{"1min":1.9319999999999999,"5min":2.4950000000000001,"15min":1.891},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":17.768000000000001,"5min":35.412999999999997,"15min":35.412999999999997},"last":0.95999999999999996}]},{"osd":4,"last update":"Sat Oct 14 22:44:51 2023","interfaces":[{"interface":"back","average":{"1min":1.3740000000000001,"5min":1.8899999999999999,"15min":1.6910000000000001},"min":{"1min":0.51000000000000001,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":6.4020000000000001,"5min":34.481999999999999,"15min":34.481999999999999},"last":1.099},{"interface":"front","average":{"1min":2.3340000000000001,"5min":2.8599999999999999,"15min":2.1030000000000002},"min":{"1min":0.499,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":28.388000000000002,"5min":63.896999999999998,"15min":63.896999999999998},"last":1.3999999999999999}]},{"osd":5,"last update":"Sat Oct 14 22:44:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":2.3849999999999998,"15min":1.863},"min":{"1min":0.52000000000000002,"5min":0.47099999999999997,"15min":0.45900000000000002},"max":{"1min":4.1689999999999996,"5min":35.222000000000001,"15min":35.222000000000001},"last":1.8560000000000001},{"interface":"front","average":{"1min":1.3939999999999999,"5min":1.9119999999999999,"15min":1.675},"min":{"1min":0.58199999999999996,"5min":0.46300000000000002,"15min":0.441},"max":{"1min":6.3540000000000001,"5min":17.254000000000001,"15min":17.254000000000001},"last":1.2170000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:44:51 2023","interfaces":[{"interface":"back","average":{"1min":1.4670000000000001,"5min":1.873,"15min":1.833},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":7.9240000000000004,"5min":36.453000000000003,"15min":36.453000000000003},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.4379999999999999,"5min":2.2530000000000001,"15min":1.913},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":4.1269999999999998,"5min":35.542000000000002,"15min":35.926000000000002},"last":1.4710000000000001}]},{"osd":7,"last update":"Sat Oct 14 22:44:51 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":2.278,"15min":1.8380000000000001},"min":{"1min":0.57399999999999995,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":6.4269999999999996,"5min":35.277999999999999,"15min":35.277999999999999},"last":1.7509999999999999},{"interface":"front","average":{"1min":1.446,"5min":1.9930000000000001,"15min":1.774},"min":{"1min":0.64300000000000002,"5min":0.499,"15min":0.499},"max":{"1min":7.2519999999999998,"5min":34.590000000000003,"15min":34.590000000000003},"last":1.6419999999999999}]}]},{"osd":0,"up_from":14,"seq":60129549519,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1669276,"kb_used_data":1108,"kb_used_omap":36,"kb_used_meta":1668123,"kb_avail":92702564,"statfs":{"total":96636764160,"available":94927425536,"internally_reserved":0,"allocated":1134592,"data_stored":825995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37779,"internal_metadata":1708158061},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Oct 14 22:44:39 2023","interfaces":[{"interface":"back","average":{"1min":2.1030000000000002,"5min":6.9820000000000002,"15min":3.8929999999999998},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":20.145,"5min":437.22399999999999,"15min":437.22399999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":2.2029999999999998,"5min":6.9459999999999997,"15min":3.9289999999999998},"min":{"1min":0.432,"5min":0.30599999999999999,"15min":0.27500000000000002},"max":{"1min":23.707000000000001,"5min":439.05700000000002,"15min":439.05700000000002},"last":1.0329999999999999}]},{"osd":2,"last update":"Sat Oct 14 22:44:39 2023","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":1.8600000000000001,"15min":1.7270000000000001},"min":{"1min":0.40000000000000002,"5min":0.315,"15min":0.314},"max":{"1min":12.657999999999999,"5min":18.789000000000001,"15min":18.789000000000001},"last":1.103},{"interface":"front","average":{"1min":1.8280000000000001,"5min":1.879,"15min":1.758},"min":{"1min":0.379,"5min":0.372,"15min":0.32300000000000001},"max":{"1min":9.9939999999999998,"5min":16.006,"15min":19.305},"last":1.3089999999999999}]},{"osd":3,"last update":"Sat Oct 14 22:44:39 2023","interfaces":[{"interface":"back","average":{"1min":3.504,"5min":2.2370000000000001,"15min":2.1640000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.36699999999999999},"max":{"1min":34.185000000000002,"5min":34.185000000000002,"15min":88.554000000000002},"last":0.86499999999999999},{"interface":"front","average":{"1min":3.0489999999999999,"5min":2.3199999999999998,"15min":2.2599999999999998},"min":{"1min":0.49299999999999999,"5min":0.432,"15min":0.35299999999999998},"max":{"1min":28.949999999999999,"5min":28.949999999999999,"15min":83.847999999999999},"last":1.3859999999999999}]},{"osd":4,"last update":"Sat Oct 14 22:44:39 2023","interfaces":[{"interface":"back","average":{"1min":2.706,"5min":2.0739999999999998,"15min":1.696},"min":{"1min":0.47299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":26.547000000000001,"5min":31.427,"15min":31.427},"last":1.5489999999999999},{"interface":"front","average":{"1min":1.6200000000000001,"5min":2.0419999999999998,"15min":1.698},"min":{"1min":0.47599999999999998,"5min":0.46700000000000003,"15min":0.433},"max":{"1min":6.6529999999999996,"5min":31.443999999999999,"15min":31.443999999999999},"last":1.149}]},{"osd":5,"last update":"Sat Oct 14 22:44:39 2023","interfaces":[{"interface":"back","average":{"1min":2.992,"5min":2.5339999999999998,"15min":1.8859999999999999},"min":{"1min":0.57799999999999996,"5min":0.49199999999999999,"15min":0.46100000000000002},"max":{"1min":28.902000000000001,"5min":51.655999999999999,"15min":51.655999999999999},"last":1.8320000000000001},{"interface":"front","average":{"1min":2.8639999999999999,"5min":2.2330000000000001,"15min":1.784},"min":{"1min":0.52200000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":26.605,"5min":31.558,"15min":31.558},"last":1.9510000000000001}]},{"osd":6,"last update":"Sat Oct 14 22:44:39 2023","interfaces":[{"interface":"back","average":{"1min":3.2629999999999999,"5min":2.7330000000000001,"15min":1.9990000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.46999999999999997},"max":{"1min":30.466000000000001,"5min":51.612000000000002,"15min":51.612000000000002},"last":1.5089999999999999},{"interface":"front","average":{"1min":2.899,"5min":2.2040000000000002,"15min":1.8520000000000001},"min":{"1min":0.76200000000000001,"5min":0.55400000000000005,"15min":0.54300000000000004},"max":{"1min":27.672000000000001,"5min":27.672000000000001,"15min":27.672000000000001},"last":1.911}]},{"osd":7,"last update":"Sat Oct 14 22:44:39 2023","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":2.0209999999999999,"15min":1.7949999999999999},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.45500000000000002},"max":{"1min":10.215,"5min":31.504000000000001,"15min":31.504000000000001},"last":1.8700000000000001},{"interface":"front","average":{"1min":3.4319999999999999,"5min":2.3239999999999998,"15min":1.8799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.51600000000000001},"max":{"1min":34.131999999999998,"5min":34.131999999999998,"15min":34.131999999999998},"last":1.589}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-14T22:44:58.719 DEBUG:teuthology.orchestra.run.smithi064:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-14T22:44:58.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.920+0000 7f7370a9e640 1 Processor -- start 2023-10-14T22:44:58.923 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.920+0000 7f7370a9e640 1 -- start start 2023-10-14T22:44:58.924 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f7370a9e640 1 --2- >> v2:172.21.15.177:3300/0 conn(0x7f736c0d0d80 0x7f736c0d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f7370a9e640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f736c0b5fd0 0x7f736c0b6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f7370a9e640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c0ce810 con 0x7f736c15c940 2023-10-14T22:44:58.925 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f7370a9e640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0d1740 con 0x7f736c0b5fd0 2023-10-14T22:44:58.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f7370a9e640 1 -- --> v2:172.21.15.177:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c0b5b40 con 0x7f736c0d0d80 2023-10-14T22:44:58.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f736bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f736c0b5fd0 0x7f736c0b6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f736bfff640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f736c0b5fd0 0x7f736c0b6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41738/0 (socket says 172.21.15.64:41738) 2023-10-14T22:44:58.926 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f736bfff640 1 -- 172.21.15.64:0/1626156884 learned_addr learned my addr 172.21.15.64:0/1626156884 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:58.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.922+0000 7f7363fff640 1 --2- 172.21.15.64:0/1626156884 >> v2:172.21.15.177:3300/0 conn(0x7f736c0d0d80 0x7f736c0d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.928 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.923+0000 7f736bfff640 1 -- 172.21.15.64:0/1626156884 >> v2:172.21.15.177:3300/0 conn(0x7f736c0d0d80 msgr2=0x7f736c0d1200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:58.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.923+0000 7f736bfff640 1 --2- 172.21.15.64:0/1626156884 >> v2:172.21.15.177:3300/0 conn(0x7f736c0d0d80 0x7f736c0d1200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.923+0000 7f736bfff640 1 -- 172.21.15.64:0/1626156884 >> v1:172.21.15.177:6789/0 conn(0x7f736c15c940 legacy=0x7f736c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:58.929 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.923+0000 7f736bfff640 1 -- 172.21.15.64:0/1626156884 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c0d0b10 con 0x7f736c0b5fd0 2023-10-14T22:44:58.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.924+0000 7f736bfff640 1 --2- 172.21.15.64:0/1626156884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c0b5fd0 0x7f736c0b6420 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f736c0b88e0 tx=0x7f736402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b70be9920210944 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:58.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f736affd640 1 -- 172.21.15.64:0/1626156884 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73640317e0 con 0x7f736c0b5fd0 2023-10-14T22:44:58.930 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f736affd640 1 -- 172.21.15.64:0/1626156884 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364031940 con 0x7f736c0b5fd0 2023-10-14T22:44:58.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f736affd640 1 -- 172.21.15.64:0/1626156884 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364031cd0 con 0x7f736c0b5fd0 2023-10-14T22:44:58.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 -- 172.21.15.64:0/1626156884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c0b5fd0 msgr2=0x7f736c0b6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 --2- 172.21.15.64:0/1626156884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c0b5fd0 0x7f736c0b6420 secure :-1 s=READY pgs=2301 cs=0 l=1 rev1=1 crypto rx=0x7f736c0b88e0 tx=0x7f736402b880 comp rx=0 tx=0).stop 2023-10-14T22:44:58.931 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 -- 172.21.15.64:0/1626156884 shutdown_connections 2023-10-14T22:44:58.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 --2- 172.21.15.64:0/1626156884 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c0b5fd0 0x7f736c0b6420 unknown :-1 s=CLOSED pgs=2301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 --2- 172.21.15.64:0/1626156884 >> v2:172.21.15.177:3300/0 conn(0x7f736c0d0d80 0x7f736c0d1200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.932 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 -- 172.21.15.64:0/1626156884 >> 172.21.15.64:0/1626156884 conn(0x7f736c09bb30 msgr2=0x7f736c0d2850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:58.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 -- 172.21.15.64:0/1626156884 shutdown_connections 2023-10-14T22:44:58.933 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.925+0000 7f7370a9e640 1 -- 172.21.15.64:0/1626156884 wait complete. 2023-10-14T22:44:58.935 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.927+0000 7f7370a9e640 1 Processor -- start 2023-10-14T22:44:58.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.928+0000 7f7370a9e640 1 -- start start 2023-10-14T22:44:58.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f7370a9e640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f736c0b5fd0 0x7f736c09fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.936 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f7370a9e640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f736c0d0d80 0x7f736c0ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f7370a9e640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c15c940 0x7f736c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f7370a9e640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0cabb0 con 0x7f736c15c940 2023-10-14T22:44:58.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f7370a9e640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0cae90 con 0x7f736c0d0d80 2023-10-14T22:44:58.937 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f7370a9e640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c0cb170 con 0x7f736c0b5fd0 2023-10-14T22:44:58.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f736bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c15c940 0x7f736c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f736bfff640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c15c940 0x7f736c0c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41752/0 (socket says 172.21.15.64:41752) 2023-10-14T22:44:58.938 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f736bfff640 1 -- 172.21.15.64:0/3117334702 learned_addr learned my addr 172.21.15.64:0/3117334702 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:58.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f736b7fe640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f736c0b5fd0 0x7f736c09fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.929+0000 7f7363fff640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f736c0d0d80 0x7f736c0ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.939 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f736bfff640 1 -- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f736c0b5fd0 msgr2=0x7f736c09fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f736bfff640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f736c0b5fd0 0x7f736c09fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f736bfff640 1 -- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f736c0d0d80 msgr2=0x7f736c0ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:58.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f736bfff640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f736c0d0d80 0x7f736c0ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:58.940 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f736bfff640 1 -- 172.21.15.64:0/3117334702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73640094d0 con 0x7f736c15c940 2023-10-14T22:44:58.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f736bfff640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c15c940 0x7f736c0c81d0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f73640090b0 tx=0x7f73640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:58.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364032880 con 0x7f736c15c940 2023-10-14T22:44:58.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7364032a00 con 0x7f736c15c940 2023-10-14T22:44:58.941 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7364032db0 con 0x7f736c15c940 2023-10-14T22:44:58.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.930+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c0cb450 con 0x7f736c15c940 2023-10-14T22:44:58.942 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.931+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c0a00e0 con 0x7f736c15c940 2023-10-14T22:44:58.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.932+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c04e9b0 con 0x7f736c15c940 2023-10-14T22:44:58.943 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.933+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f736404d3f0 con 0x7f736c15c940 2023-10-14T22:44:58.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.934+0000 7f7368ff9640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f734c06ae70 0x7f734c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:58.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.934+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f73640ab1f0 con 0x7f736c15c940 2023-10-14T22:44:58.944 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.935+0000 7f736b7fe640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f734c06ae70 0x7f734c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:58.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.936+0000 7f736b7fe640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f734c06ae70 0x7f734c06d330 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f736c0cfc20 tx=0x7f735c0094f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:58.945 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:58.940+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f7364076500 con 0x7f736c15c940 2023-10-14T22:44:59.141 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.139+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f736c0a04e0 con 0x7f736c15c940 2023-10-14T22:44:59.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.143+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7f7364079b20 con 0x7f736c15c940 2023-10-14T22:44:59.146 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.144+0000 7f7368ff9640 1 -- 172.21.15.64:0/3117334702 <== mon.0 v2:172.21.15.64:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7364076500 con 0x7f736c15c940 2023-10-14T22:44:59.149 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f734c06ae70 msgr2=0x7f734c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:59.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f734c06ae70 0x7f734c06d330 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f736c0cfc20 tx=0x7f735c0094f0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c15c940 msgr2=0x7f736c0c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:59.150 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c15c940 0x7f736c0c81d0 secure :-1 s=READY pgs=2302 cs=0 l=1 rev1=1 crypto rx=0x7f73640090b0 tx=0x7f73640046c0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 shutdown_connections 2023-10-14T22:44:59.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f734c06ae70 0x7f734c06d330 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f736c15c940 0x7f736c0c81d0 unknown :-1 s=CLOSED pgs=2302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.151 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f736c0d0d80 0x7f736c0ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 --2- 172.21.15.64:0/3117334702 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f736c0b5fd0 0x7f736c09fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.146+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 >> 172.21.15.64:0/3117334702 conn(0x7f736c09bb30 msgr2=0x7f736c06afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:59.152 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.147+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 shutdown_connections 2023-10-14T22:44:59.153 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.147+0000 7f7370a9e640 1 -- 172.21.15.64:0/3117334702 wait complete. 2023-10-14T22:44:59.166 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-14T22:44:59.166 DEBUG:teuthology.orchestra.run.smithi064:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-14T22:44:59.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.354+0000 7f4d83b25640 1 Processor -- start 2023-10-14T22:44:59.357 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.354+0000 7f4d83b25640 1 -- start start 2023-10-14T22:44:59.358 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d83b25640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c15ca80 0x7f4d7c0ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:59.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d83b25640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d7c0c9e70 0x7f4d7c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:59.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d83b25640 1 -- --> v1:172.21.15.177:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c161250 con 0x7f4d7c15ce60 2023-10-14T22:44:59.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d83b25640 1 -- --> v2:172.21.15.64:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c0ce320 con 0x7f4d7c0c9e70 2023-10-14T22:44:59.359 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d83b25640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1614f0 con 0x7f4d7c15ca80 2023-10-14T22:44:59.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d810c0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d7c0c9e70 0x7f4d7c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:59.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d810c0640 1 --2- >> v2:172.21.15.64:3300/0 conn(0x7f4d7c0c9e70 0x7f4d7c069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41762/0 (socket says 172.21.15.64:41762) 2023-10-14T22:44:59.360 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d810c0640 1 -- 172.21.15.64:0/1549397497 learned_addr learned my addr 172.21.15.64:0/1549397497 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:59.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.356+0000 7f4d818c1640 1 --2- 172.21.15.64:0/1549397497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c15ca80 0x7f4d7c0ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:59.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.357+0000 7f4d810c0640 1 -- 172.21.15.64:0/1549397497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c15ca80 msgr2=0x7f4d7c0ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:59.362 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.357+0000 7f4d810c0640 1 --2- 172.21.15.64:0/1549397497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c15ca80 0x7f4d7c0ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.357+0000 7f4d810c0640 1 -- 172.21.15.64:0/1549397497 >> v1:172.21.15.177:6789/0 conn(0x7f4d7c15ce60 legacy=0x7f4d7c0b10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-14T22:44:59.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.357+0000 7f4d810c0640 1 -- 172.21.15.64:0/1549397497 --> v2:172.21.15.64:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c071ed0 con 0x7f4d7c0c9e70 2023-10-14T22:44:59.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.358+0000 7f4d810c0640 1 --2- 172.21.15.64:0/1549397497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c0c9e70 0x7f4d7c069de0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009870 tx=0x7f4d6c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe9bb51446afacba server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:59.363 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.358+0000 7f4d808bf640 1 -- 172.21.15.64:0/1549397497 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c031640 con 0x7f4d7c0c9e70 2023-10-14T22:44:59.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.358+0000 7f4d808bf640 1 -- 172.21.15.64:0/1549397497 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d6c0317a0 con 0x7f4d7c0c9e70 2023-10-14T22:44:59.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.358+0000 7f4d808bf640 1 -- 172.21.15.64:0/1549397497 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c031b50 con 0x7f4d7c0c9e70 2023-10-14T22:44:59.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 -- 172.21.15.64:0/1549397497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c0c9e70 msgr2=0x7f4d7c069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:59.364 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 --2- 172.21.15.64:0/1549397497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c0c9e70 0x7f4d7c069de0 secure :-1 s=READY pgs=2303 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c009870 tx=0x7f4d6c02b8f0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 -- 172.21.15.64:0/1549397497 shutdown_connections 2023-10-14T22:44:59.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 --2- 172.21.15.64:0/1549397497 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c0c9e70 0x7f4d7c069de0 unknown :-1 s=CLOSED pgs=2303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 --2- 172.21.15.64:0/1549397497 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c15ca80 0x7f4d7c0ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.365 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 -- 172.21.15.64:0/1549397497 >> 172.21.15.64:0/1549397497 conn(0x7f4d7c0cc0c0 msgr2=0x7f4d7c0cc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:59.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 -- 172.21.15.64:0/1549397497 shutdown_connections 2023-10-14T22:44:59.366 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.359+0000 7f4d83b25640 1 -- 172.21.15.64:0/1549397497 wait complete. 2023-10-14T22:44:59.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.361+0000 7f4d83b25640 1 Processor -- start 2023-10-14T22:44:59.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.361+0000 7f4d83b25640 1 -- start start 2023-10-14T22:44:59.368 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d83b25640 1 --2- >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c0c9e70 0x7f4d7c1f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:59.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d83b25640 1 --2- >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d7c15ca80 0x7f4d7c0b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:59.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d83b25640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c15ce60 0x7f4d7c0b0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:59.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d83b25640 1 -- --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c1f33d0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.369 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d83b25640 1 -- --> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0c44b0 con 0x7f4d7c15ca80 2023-10-14T22:44:59.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d83b25640 1 -- --> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0c4790 con 0x7f4d7c0c9e70 2023-10-14T22:44:59.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d820c2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c15ce60 0x7f4d7c0b0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:59.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d820c2640 1 --2- >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c15ce60 0x7f4d7c0b0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.64:3300/0 says I am v2:172.21.15.64:41768/0 (socket says 172.21.15.64:41768) 2023-10-14T22:44:59.370 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.362+0000 7f4d820c2640 1 -- 172.21.15.64:0/2996235975 learned_addr learned my addr 172.21.15.64:0/2996235975 (peer_addr_for_me v2:172.21.15.64:0/0) 2023-10-14T22:44:59.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d810c0640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d7c15ca80 0x7f4d7c0b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:59.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d818c1640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c0c9e70 0x7f4d7c1f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:59.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d820c2640 1 -- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c0c9e70 msgr2=0x7f4d7c1f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:59.371 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d820c2640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c0c9e70 0x7f4d7c1f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d820c2640 1 -- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d7c15ca80 msgr2=0x7f4d7c0b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:59.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d820c2640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d7c15ca80 0x7f4d7c0b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d820c2640 1 -- 172.21.15.64:0/2996235975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d6c0094d0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.372 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d820c2640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c15ce60 0x7f4d7c0b0700 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b9e0 tx=0x7f4d7400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:59.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d727fc640 1 -- 172.21.15.64:0/2996235975 <== mon.0 v2:172.21.15.64:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74003b70 con 0x7f4d7c15ce60 2023-10-14T22:44:59.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d727fc640 1 -- 172.21.15.64:0/2996235975 <== mon.0 v2:172.21.15.64:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f4d74003cd0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.373 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d727fc640 1 -- 172.21.15.64:0/2996235975 <== mon.0 v2:172.21.15.64:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400cb80 con 0x7f4d7c15ce60 2023-10-14T22:44:59.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.363+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c0c4a70 con 0x7f4d7c15ce60 2023-10-14T22:44:59.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.364+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c0c5030 con 0x7f4d7c15ce60 2023-10-14T22:44:59.374 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.365+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c073ef0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.366+0000 7f4d727fc640 1 -- 172.21.15.64:0/2996235975 <== mon.0 v2:172.21.15.64:3300/0 4 ==== mgrmap(e 5) v1 ==== 89229+0+0 (secure 0 0 0) 0x7f4d7400cce0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.375 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.367+0000 7f4d727fc640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4d6006aea0 0x7f4d6006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-14T22:44:59.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.367+0000 7f4d727fc640 1 -- 172.21.15.64:0/2996235975 <== mon.0 v2:172.21.15.64:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4d740890f0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.368+0000 7f4d818c1640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4d6006aea0 0x7f4d6006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-14T22:44:59.376 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.369+0000 7f4d818c1640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4d6006aea0 0x7f4d6006d360 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f4d78006fd0 tx=0x7f4d78008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-14T22:44:59.377 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.375+0000 7f4d727fc640 1 -- 172.21.15.64:0/2996235975 <== mon.0 v2:172.21.15.64:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179335 (secure 0 0 0) 0x7f4d740543f0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.599 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.597+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 --> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4d7c0b55c0 con 0x7f4d7c15ce60 2023-10-14T22:44:59.600 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.598+0000 7f4d727fc640 1 -- 172.21.15.64:0/2996235975 <== mon.0 v2:172.21.15.64:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3694 (secure 0 0 0) 0x7f4d74057a10 con 0x7f4d7c15ce60 2023-10-14T22:44:59.601 INFO:teuthology.orchestra.run.smithi064.stdout: 2023-10-14T22:44:59.601 INFO:teuthology.orchestra.run.smithi064.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4808,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6837/2123710189","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6835","nonce":2123710189},{"type":"v1","addr":"172.21.15.177:6837","nonce":2123710189}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5062,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.177:6836/1971405270","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6834","nonce":1971405270},{"type":"v1","addr":"172.21.15.177:6836","nonce":1971405270}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":5068,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6833/47775465","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6832","nonce":47775465},{"type":"v1","addr":"172.21.15.64:6833","nonce":47775465}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":10461,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.64:6835/49981272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.64:6834","nonce":49981272},{"type":"v1","addr":"172.21.15.64:6835","nonce":49981272}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":20}],"filesystems":[]} 2023-10-14T22:44:59.602 INFO:teuthology.orchestra.run.smithi064.stderr:dumped fsmap epoch 20 2023-10-14T22:44:59.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.600+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4d6006aea0 msgr2=0x7f4d6006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:59.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.600+0000 7f4d83b25640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4d6006aea0 0x7f4d6006d360 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f4d78006fd0 tx=0x7f4d78008040 comp rx=0 tx=0).stop 2023-10-14T22:44:59.603 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.600+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c15ce60 msgr2=0x7f4d7c0b0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-14T22:44:59.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.600+0000 7f4d83b25640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c15ce60 0x7f4d7c0b0700 secure :-1 s=READY pgs=2304 cs=0 l=1 rev1=1 crypto rx=0x7f4d7400b9e0 tx=0x7f4d7400bea0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.604 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 shutdown_connections 2023-10-14T22:44:59.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:6832/55986901,v1:172.21.15.177:6833/55986901] conn(0x7f4d6006aea0 0x7f4d6006d360 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.64:3300/0,v1:172.21.15.64:6789/0] conn(0x7f4d7c15ce60 0x7f4d7c0b0700 unknown :-1 s=CLOSED pgs=2304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] conn(0x7f4d7c15ca80 0x7f4d7c0b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.605 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 --2- 172.21.15.64:0/2996235975 >> [v2:172.21.15.177:3301/0,v1:172.21.15.177:6790/0] conn(0x7f4d7c0c9e70 0x7f4d7c1f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-14T22:44:59.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 >> 172.21.15.64:0/2996235975 conn(0x7f4d7c0cc0c0 msgr2=0x7f4d7c0ca250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-14T22:44:59.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 shutdown_connections 2023-10-14T22:44:59.606 INFO:teuthology.orchestra.run.smithi064.stderr:2023-10-14T22:44:59.601+0000 7f4d83b25640 1 -- 172.21.15.64:0/2996235975 wait complete. 2023-10-14T22:44:59.621 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-14T22:44:59.621 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-14T22:44:59.622 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-14T22:44:59.622 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:44:59.645 INFO:tasks.ceph.mds.a:Stopped 2023-10-14T22:44:59.645 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-14T22:44:59.646 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:44:59.715 INFO:tasks.ceph.mds.c:Stopped 2023-10-14T22:44:59.716 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-14T22:44:59.716 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:44:59.738 INFO:tasks.ceph.mds.b:Stopped 2023-10-14T22:44:59.739 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-14T22:44:59.739 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:44:59.804 INFO:tasks.ceph.mds.d:Stopped 2023-10-14T22:44:59.804 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-14T22:44:59.805 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-14T22:44:59.805 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:02.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-10-14T22:45:05.907 INFO:tasks.ceph.osd.0:Stopped 2023-10-14T22:45:05.908 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-14T22:45:05.908 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:08.822 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-10-14T22:45:08.823 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-10-14T22:45:12.010 INFO:tasks.ceph.osd.1:Stopped 2023-10-14T22:45:12.011 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-14T22:45:12.011 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:14.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-14T22:45:14.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-10-14T22:45:18.113 INFO:tasks.ceph.osd.2:Stopped 2023-10-14T22:45:18.114 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-14T22:45:18.115 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:20.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-14T22:45:20.738 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-14T22:45:24.216 INFO:tasks.ceph.osd.3:Stopped 2023-10-14T22:45:24.217 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-14T22:45:24.217 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-14T22:45:26.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-14T22:45:30.319 INFO:tasks.ceph.osd.4:Stopped 2023-10-14T22:45:30.320 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-14T22:45:30.321 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:32.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-14T22:45:32.250 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-14T22:45:36.423 INFO:tasks.ceph.osd.5:Stopped 2023-10-14T22:45:36.424 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-14T22:45:36.424 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:37.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-14T22:45:37.855 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-14T22:45:42.527 INFO:tasks.ceph.osd.6:Stopped 2023-10-14T22:45:42.527 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-14T22:45:42.528 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:43.359 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-14T22:45:43.360 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-14T22:45:48.629 INFO:tasks.ceph.osd.7:Stopped 2023-10-14T22:45:48.631 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-14T22:45:48.631 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-14T22:45:48.632 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:48.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2023-10-14T22:45:54.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2023-10-14T22:45:54.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-14T22:45:54.733 INFO:tasks.ceph.mgr.y:Stopped 2023-10-14T22:45:54.734 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-14T22:45:54.734 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:45:59.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2023-10-14T22:45:59.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2023-10-14T22:46:00.836 INFO:tasks.ceph.mgr.x:Stopped 2023-10-14T22:46:00.837 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-14T22:46:00.837 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-14T22:46:00.837 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:46:04.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-14T22:46:04.775 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2023-10-14T22:46:06.940 INFO:tasks.ceph.mon.a:Stopped 2023-10-14T22:46:06.940 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-14T22:46:06.941 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:46:07.039 INFO:tasks.ceph.mon.b:Stopped 2023-10-14T22:46:07.040 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-14T22:46:07.040 INFO:teuthology.orchestra.run:waiting for 300 2023-10-14T22:46:07.097 INFO:tasks.ceph.mon.c:Stopped 2023-10-14T22:46:07.098 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-14T22:46:07.098 DEBUG:teuthology.orchestra.run.smithi064:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-10-14T22:46:07.298 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T22:46:07.298 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-14T22:46:07.664 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T22:46:07.665 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-14T22:46:07.956 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T22:46:07.957 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-14T22:46:08.264 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi064.front.sepia.ceph.com 2023-10-14T22:46:08.265 DEBUG:teuthology.orchestra.run.smithi064:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-14T22:46:08.523 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T22:46:08.524 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-14T22:46:09.064 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T22:46:09.065 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-14T22:46:09.685 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T22:46:09.686 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-14T22:46:09.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-14T22:46:10.112 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi177.front.sepia.ceph.com 2023-10-14T22:46:10.113 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-14T22:46:10.561 INFO:tasks.ceph:Archiving mon data... 2023-10-14T22:46:10.563 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313/data/mon.a.tgz 2023-10-14T22:46:10.564 DEBUG:teuthology.orchestra.run.smithi064:> mktemp 2023-10-14T22:46:10.621 INFO:teuthology.orchestra.run.smithi064.stdout:/tmp/tmp.SPTatjdy4W 2023-10-14T22:46:10.622 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.SPTatjdy4W 2023-10-14T22:46:10.916 DEBUG:teuthology.orchestra.run.smithi064:> sudo chmod 0666 /tmp/tmp.SPTatjdy4W 2023-10-14T22:46:11.140 DEBUG:teuthology.orchestra.remote:smithi064:/tmp/tmp.SPTatjdy4W is 578KB 2023-10-14T22:46:11.252 DEBUG:teuthology.orchestra.run.smithi064:> rm -fr /tmp/tmp.SPTatjdy4W 2023-10-14T22:46:11.306 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313/data/mon.b.tgz 2023-10-14T22:46:11.307 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2023-10-14T22:46:11.372 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.TtdhyTSKxG 2023-10-14T22:46:11.373 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.TtdhyTSKxG 2023-10-14T22:46:11.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.TtdhyTSKxG 2023-10-14T22:46:11.738 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.TtdhyTSKxG is 578KB 2023-10-14T22:46:11.863 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.TtdhyTSKxG 2023-10-14T22:46:11.929 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313/data/mon.c.tgz 2023-10-14T22:46:11.930 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2023-10-14T22:46:11.986 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.h6xYxP6WO4 2023-10-14T22:46:11.987 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.h6xYxP6WO4 2023-10-14T22:46:12.177 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.h6xYxP6WO4 2023-10-14T22:46:12.333 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.h6xYxP6WO4 is 578KB 2023-10-14T22:46:12.449 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.h6xYxP6WO4 2023-10-14T22:46:12.507 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-14T22:46:12.507 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T22:46:12.516 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-14T22:46:12.627 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-14T22:46:12.628 DEBUG:teuthology.orchestra.run.smithi064:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T22:46:12.636 DEBUG:teuthology.orchestra.run.smithi177:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-14T22:46:12.739 INFO:teuthology.orchestra.run.smithi064.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T22:46:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-14T22:46:12.763 INFO:tasks.ceph:Archiving crash dumps... 2023-10-14T22:46:12.766 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313/remote/smithi064/crash 2023-10-14T22:46:12.767 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T22:46:12.842 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313/remote/smithi177/crash 2023-10-14T22:46:12.843 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-14T22:46:12.941 INFO:tasks.ceph:Shutting down logrotate 2023-10-14T22:49:01.034 DEBUG:teuthology.orchestra.run.smithi064:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T22:49:01.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-14T22:49:01.232 INFO:tasks.ceph:Compressing logs... 2023-10-14T22:49:01.233 DEBUG:teuthology.orchestra.run.smithi064:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T22:49:01.242 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-14T22:49:01.358 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140803.log 2023-10-14T22:49:01.359 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354050.log 2023-10-14T22:49:01.360 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.140803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93295.log 2023-10-14T22:49:01.362 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.354050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454038.log 2023-10-14T22:49:01.363 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261952.log 2023-10-14T22:49:01.364 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.454038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457888.log 2023-10-14T22:49:01.365 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.261952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220364.log 2023-10-14T22:49:01.367 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.457888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429878.log 2023-10-14T22:49:01.368 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.220364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92077.log 2023-10-14T22:49:01.369 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.429878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303362.log 2023-10-14T22:49:01.369 INFO:teuthology.orchestra.run.smithi064.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.261952.log.gz 2023-10-14T22:49:01.370 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-14T22:49:01.371 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167737.log 2023-10-14T22:49:01.371 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87274.log 2023-10-14T22:49:01.372 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.303362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555103.log 2023-10-14T22:49:01.373 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.93295.log.gz 2023-10-14T22:49:01.373 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.167737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151043.log 2023-10-14T22:49:01.374 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.93746.log 2023-10-14T22:49:01.375 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.555103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290499.log 2023-10-14T22:49:01.375 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.151043.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.457888.log.gz 2023-10-14T22:49:01.375 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576903.log 2023-10-14T22:49:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.94254.log 2023-10-14T22:49:01.377 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.1.93746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87394.log 2023-10-14T22:49:01.377 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.290499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558446.log 2023-10-14T22:49:01.378 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.303362.log.gz 2023-10-14T22:49:01.378 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.576903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95006.log 2023-10-14T22:49:01.380 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.3.94254.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T22:49:01.380 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87394.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-14T22:49:01.381 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-14T22:49:01.381 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.558446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358229.log 2023-10-14T22:49:01.382 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214960.log 2023-10-14T22:49:01.382 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.454038.log.gz 2023-10-14T22:49:01.383 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.358229.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.576903.log.gz 2023-10-14T22:49:01.383 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160951.log 2023-10-14T22:49:01.383 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.214960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432587.log 2023-10-14T22:49:01.386 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.160951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228660.log 2023-10-14T22:49:01.386 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.432587.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.167737.log.gz 2023-10-14T22:49:01.386 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475266.log 2023-10-14T22:49:01.387 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.228660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441177.log 2023-10-14T22:49:01.387 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87434.log 2023-10-14T22:49:01.388 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-14T22:49:01.388 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87434.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-14T22:49:01.388 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87354.log 2023-10-14T22:49:01.388 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87554.log 2023-10-14T22:49:01.389 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87314.log 2023-10-14T22:49:01.391 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87554.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-14T22:49:01.391 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87314.log: 92.3% -- replaced with /var/log/ceph/ceph-client.3.94254.log.gz 2023-10-14T22:49:01.392 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87474.log 2023-10-14T22:49:01.392 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T22:49:01.392 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87474.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-14T22:49:01.394 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.475266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496480.log 2023-10-14T22:49:01.395 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.441177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237552.log 2023-10-14T22:49:01.395 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.496480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367677.log 2023-10-14T22:49:01.395 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.237552.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.140803.log.gz 2023-10-14T22:49:01.396 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571234.log 2023-10-14T22:49:01.396 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.367677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461243.log 2023-10-14T22:49:01.396 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.571234.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.151043.log.gz 2023-10-14T22:49:01.396 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278711.log 2023-10-14T22:49:01.397 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.571234.log.gz 2023-10-14T22:49:01.397 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.461243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361599.log 2023-10-14T22:49:01.397 INFO:teuthology.orchestra.run.smithi064.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.237552.log.gz 2023-10-14T22:49:01.398 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.278711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427283.log 2023-10-14T22:49:01.398 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.361599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391727.log 2023-10-14T22:49:01.400 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87514.log 2023-10-14T22:49:01.401 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-14T22:49:01.401 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.87514.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-14T22:49:01.401 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.1.93746.log.gz 2023-10-14T22:49:01.403 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.427283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170680.log 2023-10-14T22:49:01.403 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.391727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248173.log 2023-10-14T22:49:01.403 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.170680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353628.log 2023-10-14T22:49:01.403 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.248173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457461.log 2023-10-14T22:49:01.404 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.290499.log.gz 2023-10-14T22:49:01.404 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.353628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579973.log 2023-10-14T22:49:01.404 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.457461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523194.log 2023-10-14T22:49:01.405 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.579973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524456.log 2023-10-14T22:49:01.405 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.441177.log.gz 2023-10-14T22:49:01.405 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.523194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405886.log 2023-10-14T22:49:01.407 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.524456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261440.log 2023-10-14T22:49:01.407 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.405886.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.358229.log.gz 2023-10-14T22:49:01.407 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-14T22:49:01.408 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.261440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366834.log 2023-10-14T22:49:01.408 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584876.log 2023-10-14T22:49:01.409 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.87274.log.gz 2023-10-14T22:49:01.409 INFO:teuthology.orchestra.run.smithi177.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.87314.log.gz 2023-10-14T22:49:01.410 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87354.log.gz 2023-10-14T22:49:01.410 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87394.log.gz 2023-10-14T22:49:01.411 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.366834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587132.log 2023-10-14T22:49:01.411 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.584876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426378.log 2023-10-14T22:49:01.412 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.587132.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.584876.log.gz 2023-10-14T22:49:01.412 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301631.log 2023-10-14T22:49:01.412 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.587132.log.gz 2023-10-14T22:49:01.412 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.426378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99617.log 2023-10-14T22:49:01.414 INFO:teuthology.orchestra.run.smithi177.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.87434.log.gz 2023-10-14T22:49:01.414 INFO:teuthology.orchestra.run.smithi177.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.87474.log.gz 2023-10-14T22:49:01.414 INFO:teuthology.orchestra.run.smithi177.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.87514.log.gz 2023-10-14T22:49:01.415 INFO:teuthology.orchestra.run.smithi177.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.87554.log.gz 2023-10-14T22:49:01.416 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.301631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166486.log 2023-10-14T22:49:01.416 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264949.log 2023-10-14T22:49:01.416 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.166486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556347.log 2023-10-14T22:49:01.417 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.264949.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92077.log.gz 2023-10-14T22:49:01.417 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163129.log 2023-10-14T22:49:01.417 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.556347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499418.log 2023-10-14T22:49:01.418 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.163129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101031.log 2023-10-14T22:49:01.418 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287558.log 2023-10-14T22:49:01.419 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398726.log 2023-10-14T22:49:01.419 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265784.log 2023-10-14T22:49:01.420 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245525.log 2023-10-14T22:49:01.421 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586798.log 2023-10-14T22:49:01.422 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541266.log 2023-10-14T22:49:01.423 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525782.log 2023-10-14T22:49:01.424 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515863.log 2023-10-14T22:49:01.425 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583991.log 2023-10-14T22:49:01.426 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474850.log 2023-10-14T22:49:01.427 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386887.log 2023-10-14T22:49:01.428 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553841.log 2023-10-14T22:49:01.429 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309772.log 2023-10-14T22:49:01.430 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171564.log 2023-10-14T22:49:01.431 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575134.log 2023-10-14T22:49:01.432 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186889.log 2023-10-14T22:49:01.434 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569973.log 2023-10-14T22:49:01.434 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226455.log 2023-10-14T22:49:01.435 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299964.log 2023-10-14T22:49:01.436 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498587.log 2023-10-14T22:49:01.437 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527875.log 2023-10-14T22:49:01.438 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262836.log 2023-10-14T22:49:01.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.499418.log: /var/log/ceph/ceph-client.admin.586798.log: /var/log/ceph/ceph-client.admin.226455.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.367677.log.gz 2023-10-14T22:49:01.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.541266.log: /var/log/ceph/ceph-client.admin.527875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252572.log 2023-10-14T22:49:01.441 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.525782.log: /var/log/ceph/ceph-client.admin.515863.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.220364.log.gz 2023-10-14T22:49:01.443 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.583991.log: /var/log/ceph/ceph-client.admin.474850.log: /var/log/ceph/ceph-client.admin.553841.log: /var/log/ceph/ceph-client.admin.575134.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.228660.log.gz 2023-10-14T22:49:01.443 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.166486.log.gz 2023-10-14T22:49:01.443 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.583991.log.gz 2023-10-14T22:49:01.443 INFO:teuthology.orchestra.run.smithi064.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.366834.log.gz 2023-10-14T22:49:01.444 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.569973.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.278711.log.gz 2023-10-14T22:49:01.444 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.498587.log: /var/log/ceph/ceph-client.admin.287558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393002.log 2023-10-14T22:49:01.444 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101031.log: /var/log/ceph/ceph-client.admin.398726.log: /var/log/ceph/ceph-client.admin.245525.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.405886.log.gz 2023-10-14T22:49:01.445 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.265784.log: /var/log/ceph/ceph-client.admin.309772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168563.log 2023-10-14T22:49:01.445 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.432587.log.gz 2023-10-14T22:49:01.446 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.186889.log: /var/log/ceph/ceph-client.admin.299964.log: /var/log/ceph/ceph-client.admin.386887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580844.log 2023-10-14T22:49:01.447 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302048.log 2023-10-14T22:49:01.447 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142652.log 2023-10-14T22:49:01.447 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220787.log 2023-10-14T22:49:01.448 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505140.log 2023-10-14T22:49:01.449 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263245.log 2023-10-14T22:49:01.449 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292624.log 2023-10-14T22:49:01.450 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576015.log 2023-10-14T22:49:01.451 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356556.log 2023-10-14T22:49:01.453 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155946.log 2023-10-14T22:49:01.454 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457879.log 2023-10-14T22:49:01.455 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358238.log 2023-10-14T22:49:01.456 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273195.log 2023-10-14T22:49:01.457 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157121.log 2023-10-14T22:49:01.457 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514855.log 2023-10-14T22:49:01.458 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161372.log 2023-10-14T22:49:01.460 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380326.log 2023-10-14T22:49:01.460 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586009.log 2023-10-14T22:49:01.461 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489040.log 2023-10-14T22:49:01.462 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297044.log 2023-10-14T22:49:01.463 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183405.log 2023-10-14T22:49:01.464 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573828.log 2023-10-14T22:49:01.465 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373962.log 2023-10-14T22:49:01.466 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377403.log 2023-10-14T22:49:01.467 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148787.log 2023-10-14T22:49:01.468 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393411.log 2023-10-14T22:49:01.469 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574277.log 2023-10-14T22:49:01.470 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552597.log 2023-10-14T22:49:01.471 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473138.log 2023-10-14T22:49:01.472 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585390.log 2023-10-14T22:49:01.473 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99927.log 2023-10-14T22:49:01.474 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101321.log 2023-10-14T22:49:01.475 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492423.log 2023-10-14T22:49:01.476 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365496.log 2023-10-14T22:49:01.477 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142642.log 2023-10-14T22:49:01.478 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460826.log 2023-10-14T22:49:01.478 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543644.log 2023-10-14T22:49:01.479 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451538.log 2023-10-14T22:49:01.480 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365913.log 2023-10-14T22:49:01.481 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547434.log 2023-10-14T22:49:01.482 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586588.log 2023-10-14T22:49:01.483 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98510.log 2023-10-14T22:49:01.484 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442050.log 2023-10-14T22:49:01.485 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456179.log 2023-10-14T22:49:01.486 INFO:teuthology.orchestra.run.smithi177.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T22:49:01.486 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476429.log 2023-10-14T22:49:01.487 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581733.log 2023-10-14T22:49:01.488 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240080.log 2023-10-14T22:49:01.489 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143208.log 2023-10-14T22:49:01.489 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384546.log 2023-10-14T22:49:01.490 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366338.log 2023-10-14T22:49:01.491 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268339.log 2023-10-14T22:49:01.492 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389101.log 2023-10-14T22:49:01.493 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227770.log 2023-10-14T22:49:01.494 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165652.log 2023-10-14T22:49:01.495 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224258.log 2023-10-14T22:49:01.496 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510692.log 2023-10-14T22:49:01.497 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356982.log 2023-10-14T22:49:01.497 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174208.log 2023-10-14T22:49:01.498 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267913.log 2023-10-14T22:49:01.501 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367668.log 2023-10-14T22:49:01.502 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519264.log 2023-10-14T22:49:01.502 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454893.log 2023-10-14T22:49:01.503 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390400.log 2023-10-14T22:49:01.503 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394274.log 2023-10-14T22:49:01.504 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379492.log 2023-10-14T22:49:01.505 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459144.log 2023-10-14T22:49:01.506 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455306.log 2023-10-14T22:49:01.507 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374379.log 2023-10-14T22:49:01.508 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186417.log 2023-10-14T22:49:01.508 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280013.log 2023-10-14T22:49:01.509 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456170.log 2023-10-14T22:49:01.510 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.575134.log.gz 2023-10-14T22:49:01.511 INFO:teuthology.orchestra.run.smithi064.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.586798.log.gz 2023-10-14T22:49:01.511 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.579973.log.gz 2023-10-14T22:49:01.511 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284916.log 2023-10-14T22:49:01.512 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449411.log 2023-10-14T22:49:01.513 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554259.log 2023-10-14T22:49:01.513 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304652.log 2023-10-14T22:49:01.514 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166069.log 2023-10-14T22:49:01.515 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358651.log 2023-10-14T22:49:01.516 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535282.log 2023-10-14T22:49:01.517 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569538.log 2023-10-14T22:49:01.520 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.171564.log: /var/log/ceph/ceph-client.admin.442050.log: 92.3% 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99617.log.gz -- replaced with /var/log/ceph/ceph-client.admin.569973.log.gz 2023-10-14T22:49:01.520 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:01.521 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.186417.log: /var/log/ceph/ceph-client.admin.580844.log: /var/log/ceph/ceph-client.admin.304652.log: /var/log/ceph/ceph-client.admin.358651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511117.log 2023-10-14T22:49:01.521 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.353628.log.gz 2023-10-14T22:49:01.521 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.171564.log.gz 2023-10-14T22:49:01.521 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.580844.log.gz 2023-10-14T22:49:01.522 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.505140.log: -- replaced with /var/log/ceph/ceph-client.admin.354050.log.gz 2023-10-14T22:49:01.522 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.264949.log.gz 2023-10-14T22:49:01.522 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.576015.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.475266.log.gz 2023-10-14T22:49:01.523 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.457879.log: /var/log/ceph/ceph-client.admin.514855.log: /var/log/ceph/ceph-client.admin.569538.log: /var/log/ceph/ceph-client.admin.586009.log: /var/log/ceph/ceph-client.admin.489040.log: /var/log/ceph/ceph-client.admin.573828.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.576015.log.gz 2023-10-14T22:49:01.526 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.574277.log: /var/log/ceph/ceph-client.admin.552597.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.569538.log.gz 2023-10-14T22:49:01.527 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.473138.log: /var/log/ceph/ceph-client.admin.585390.log: 88.2%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.586009.log.gz -- 2023-10-14T22:49:01.527 INFO:teuthology.orchestra.run.smithi064.stderr: /var/log/ceph/ceph-client.admin.259585.log 2023-10-14T22:49:01.527 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% 90.0%/var/log/ceph/ceph-client.admin.492423.log: -- replaced with /var/log/ceph/ceph-client.admin.427283.log.gz 2023-10-14T22:49:01.527 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.511117.log: -- replaced with /var/log/ceph/ceph-client.admin.426378.log.gz 2023-10-14T22:49:01.528 INFO:teuthology.orchestra.run.smithi064.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.248173.log.gz 2023-10-14T22:49:01.528 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.442050.log.gz 2023-10-14T22:49:01.528 INFO:teuthology.orchestra.run.smithi064.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.299964.log.gz 2023-10-14T22:49:01.529 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.460826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508845.log 2023-10-14T22:49:01.529 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.309772.log.gz 2023-10-14T22:49:01.529 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.543644.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101031.log.gz 2023-10-14T22:49:01.529 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.451538.log: /var/log/ceph/ceph-client.admin.547434.log: /var/log/ceph/ceph-client.admin.586588.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.499418.log.gz 2023-10-14T22:49:01.530 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.429878.log.gz 2023-10-14T22:49:01.530 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.498587.log.gz/var/log/ceph/ceph-client.admin.456179.log: 2023-10-14T22:49:01.530 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476429.log: /var/log/ceph/ceph-client.admin.581733.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.558446.log.gz 2023-10-14T22:49:01.531 INFO:teuthology.orchestra.run.smithi064.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.474850.log.gz 2023-10-14T22:49:01.531 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.510692.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.586588.log.gz 2023-10-14T22:49:01.531 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.519264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542422.log 2023-10-14T22:49:01.531 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.386887.log.gz 2023-10-14T22:49:01.532 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.454893.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.287558.log.gz 2023-10-14T22:49:01.532 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.459144.log: /var/log/ceph/ceph-client.admin.455306.log: /var/log/ceph/ceph-client.admin.508845.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.515863.log.gz 2023-10-14T22:49:01.532 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.456170.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.527875.log.gz 2023-10-14T22:49:01.532 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.449411.log: /var/log/ceph/ceph-client.admin.554259.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.556347.log.gz 2023-10-14T22:49:01.533 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.245525.log.gz 2023-10-14T22:49:01.533 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.252572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311070.log/var/log/ceph/ceph-client.admin.262836.log: 2023-10-14T22:49:01.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.168563.log: /var/log/ceph/ceph-client.admin.220787.log: /var/log/ceph/ceph-client.admin.393002.log: /var/log/ceph/ceph-client.admin.142652.log: /var/log/ceph/ceph-client.admin.542422.log: /var/log/ceph/ceph-client.admin.99927.log: /var/log/ceph/ceph-client.admin.302048.log: /var/log/ceph/ceph-client.admin.148787.log: /var/log/ceph/ceph-client.admin.273195.log: /var/log/ceph/ceph-client.admin.365913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272183.log 2023-10-14T22:49:01.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.263245.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.581733.log.gz 2023-10-14T22:49:01.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.292624.log: /var/log/ceph/ceph-client.admin.98510.log: /var/log/ceph/ceph-client.admin.311070.log: /var/log/ceph/ceph-client.admin.358238.log: /var/log/ceph/ceph-client.admin.155946.log: /var/log/ceph/ceph-client.admin.297044.log: /var/log/ceph/ceph-client.admin.366338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97953.log 2023-10-14T22:49:01.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.157121.log: /var/log/ceph/ceph-client.admin.143208.log: /var/log/ceph/ceph-client.admin.356556.log: /var/log/ceph/ceph-client.admin.535282.log: /var/log/ceph/ceph-client.admin.161372.log: /var/log/ceph/ceph-client.admin.380326.log: /var/log/ceph/ceph-client.admin.272183.log: /var/log/ceph/ceph-client.admin.377403.log: /var/log/ceph/ceph-client.admin.389101.log: /var/log/ceph/ceph-client.admin.224258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546225.log 2023-10-14T22:49:01.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.280013.log: /var/log/ceph/ceph-client.admin.373962.log: /var/log/ceph/ceph-client.admin.393411.log: /var/log/ceph/ceph-client.admin.183405.log: /var/log/ceph/ceph-client.admin.174208.log: /var/log/ceph/ceph-client.admin.356982.log: /var/log/ceph/ceph-client.admin.384546.log: /var/log/ceph/ceph-client.admin.284916.log: /var/log/ceph/ceph-client.admin.142642.log: /var/log/ceph/ceph-client.admin.101321.log: /var/log/ceph/ceph-client.admin.165652.log: /var/log/ceph/ceph-client.admin.367668.log: gzip/var/log/ceph/ceph-client.admin.267913.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.585559.log 2023-10-14T22:49:01.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.268339.log: /var/log/ceph/ceph-client.admin.166069.log: /var/log/ceph/ceph-client.admin.365496.log: /var/log/ceph/ceph-client.admin.390400.log: /var/log/ceph/ceph-client.admin.379492.log: /var/log/ceph/ceph-client.admin.374379.log: /var/log/ceph/ceph-client.admin.394274.log: /var/log/ceph/ceph-client.admin.546225.log: /var/log/ceph/ceph-client.admin.227770.log: /var/log/ceph/ceph-client.admin.240080.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.585390.log.gz 2023-10-14T22:49:01.541 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.574277.log.gz 2023-10-14T22:49:01.542 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97953.log: gzip -5/var/log/ceph/ceph-client.admin.259585.log: --verbose -- /var/log/ceph/ceph-client.admin.284063.log 2023-10-14T22:49:01.542 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585559.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.585559.log.gz 2023-10-14T22:49:01.542 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237561.log 2023-10-14T22:49:01.543 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.265784.log.gz 2023-10-14T22:49:01.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.284063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99068.log 2023-10-14T22:49:01.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.237561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462935.log 2023-10-14T22:49:01.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532959.log 2023-10-14T22:49:01.544 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.462935.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.358651.log.gz 2023-10-14T22:49:01.544 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293046.log 2023-10-14T22:49:01.544 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.532959.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.361599.log.gz 2023-10-14T22:49:01.546 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460409.log 2023-10-14T22:49:01.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.293046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544879.log 2023-10-14T22:49:01.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.460409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176338.log 2023-10-14T22:49:01.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.544879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239663.log 2023-10-14T22:49:01.548 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.176338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193925.log 2023-10-14T22:49:01.548 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.398726.log.gz 2023-10-14T22:49:01.548 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.239663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397823.log 2023-10-14T22:49:01.548 INFO:teuthology.orchestra.run.smithi064.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.573828.log.gz 2023-10-14T22:49:01.549 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.193925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522770.log 2023-10-14T22:49:01.550 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.397823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236219.log 2023-10-14T22:49:01.550 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.522770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215929.log 2023-10-14T22:49:01.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.236219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218556.log 2023-10-14T22:49:01.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.215929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583073.log 2023-10-14T22:49:01.552 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.218556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310194.log 2023-10-14T22:49:01.552 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.301631.log.gz 2023-10-14T22:49:01.553 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.583073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489031.log 2023-10-14T22:49:01.553 INFO:teuthology.orchestra.run.smithi064.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.583073.log.gz 2023-10-14T22:49:01.554 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.310194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442467.log 2023-10-14T22:49:01.554 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.489031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148778.log 2023-10-14T22:49:01.555 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.442467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561971.log 2023-10-14T22:49:01.556 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.365913.log.gz 2023-10-14T22:49:01.556 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.148778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462944.log 2023-10-14T22:49:01.557 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.561971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391270.log 2023-10-14T22:49:01.557 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.302048.log.gz 2023-10-14T22:49:01.558 INFO:teuthology.orchestra.run.smithi064.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.273195.log.gz 2023-10-14T22:49:01.558 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.462944.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.561971.log.gz 2023-10-14T22:49:01.559 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519691.log 2023-10-14T22:49:01.559 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.391270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100779.log 2023-10-14T22:49:01.560 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.519691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97827.log 2023-10-14T22:49:01.561 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551761.log 2023-10-14T22:49:01.562 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.310194.log.gz 2023-10-14T22:49:01.562 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97827.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99927.log.gz 2023-10-14T22:49:01.563 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476550.log 2023-10-14T22:49:01.564 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.551761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93211.log 2023-10-14T22:49:01.564 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.358238.log.gz 2023-10-14T22:49:01.565 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376976.log 2023-10-14T22:49:01.566 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93211.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.457879.log.gz 2023-10-14T22:49:01.566 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586504.log 2023-10-14T22:49:01.567 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.376976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402530.log 2023-10-14T22:49:01.568 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586504.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.586504.log.gz 2023-10-14T22:49:01.568 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98205.log 2023-10-14T22:49:01.568 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98510.log.gz 2023-10-14T22:49:01.569 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.402530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577783.log 2023-10-14T22:49:01.570 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371048.log 2023-10-14T22:49:01.571 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.577783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191083.log 2023-10-14T22:49:01.573 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.371048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435989.log 2023-10-14T22:49:01.573 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95006.log.gz 2023-10-14T22:49:01.573 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.577783.log.gz 2023-10-14T22:49:01.574 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.191083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553015.log 2023-10-14T22:49:01.575 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.435989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454047.log 2023-10-14T22:49:01.576 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.186417.log.gz 2023-10-14T22:49:01.576 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.553015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509262.log 2023-10-14T22:49:01.577 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.454047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384128.log 2023-10-14T22:49:01.578 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.509262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148537.log 2023-10-14T22:49:01.579 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.384128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369788.log 2023-10-14T22:49:01.580 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.148537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353619.log 2023-10-14T22:49:01.581 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.455306.log.gz 2023-10-14T22:49:01.581 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.369788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242591.log 2023-10-14T22:49:01.582 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.456170.log.gz 2023-10-14T22:49:01.582 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.454893.log.gz 2023-10-14T22:49:01.582 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.353619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264508.log 2023-10-14T22:49:01.583 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.242591.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.459144.log.gz 2023-10-14T22:49:01.584 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561962.log 2023-10-14T22:49:01.585 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.264508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286714.log 2023-10-14T22:49:01.585 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.460409.log.gz 2023-10-14T22:49:01.585 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.561962.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.460826.log.gz 2023-10-14T22:49:01.586 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.561962.log.gz 2023-10-14T22:49:01.586 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395951.log 2023-10-14T22:49:01.587 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.286714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445959.log 2023-10-14T22:49:01.587 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.395951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396423.log 2023-10-14T22:49:01.588 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.445959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445968.log 2023-10-14T22:49:01.589 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.462935.log.gz 2023-10-14T22:49:01.590 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.396423.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.462944.log.gz 2023-10-14T22:49:01.590 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.163129.log.gz 2023-10-14T22:49:01.590 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373128.log 2023-10-14T22:49:01.591 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.445968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428118.log 2023-10-14T22:49:01.591 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.373128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459982.log 2023-10-14T22:49:01.592 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.428118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99026.log 2023-10-14T22:49:01.593 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.459982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99110.log 2023-10-14T22:49:01.594 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475692.log 2023-10-14T22:49:01.595 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229114.log 2023-10-14T22:49:01.595 INFO:teuthology.orchestra.run.smithi064.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.148778.log.gz 2023-10-14T22:49:01.596 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.475692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232656.log 2023-10-14T22:49:01.597 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.229114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557610.log 2023-10-14T22:49:01.598 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164818.log 2023-10-14T22:49:01.598 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.232656.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.242591.log.gz 2023-10-14T22:49:01.599 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.557610.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.160951.log.gz 2023-10-14T22:49:01.600 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238820.log 2023-10-14T22:49:01.600 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.164818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260063.log 2023-10-14T22:49:01.601 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.238820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302503.log 2023-10-14T22:49:01.601 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.174208.log.gz 2023-10-14T22:49:01.602 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.260063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443307.log 2023-10-14T22:49:01.603 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.302503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472314.log 2023-10-14T22:49:01.604 INFO:teuthology.orchestra.run.smithi064.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.252572.log.gz 2023-10-14T22:49:01.604 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294298.log 2023-10-14T22:49:01.605 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.472314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449402.log 2023-10-14T22:49:01.606 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.294298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378657.log 2023-10-14T22:49:01.607 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.449402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458309.log 2023-10-14T22:49:01.607 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.391727.log.gz 2023-10-14T22:49:01.608 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.378657.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.393411.log.gz 2023-10-14T22:49:01.609 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163971.log 2023-10-14T22:49:01.609 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.393002.log.gz 2023-10-14T22:49:01.610 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.458309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236665.log 2023-10-14T22:49:01.610 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.163971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263254.log 2023-10-14T22:49:01.611 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.451538.log.gz 2023-10-14T22:49:01.612 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.236665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500391.log 2023-10-14T22:49:01.612 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.263254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291752.log 2023-10-14T22:49:01.613 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.500391.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.286714.log.gz 2023-10-14T22:49:01.613 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586546.log 2023-10-14T22:49:01.614 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.291752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439320.log 2023-10-14T22:49:01.615 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586546.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.170680.log.gz 2023-10-14T22:49:01.616 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.586546.log.gz 2023-10-14T22:49:01.616 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221262.log 2023-10-14T22:49:01.617 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.439320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437285.log 2023-10-14T22:49:01.618 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.221262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276289.log 2023-10-14T22:49:01.619 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.437285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311573.log 2023-10-14T22:49:01.620 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.276289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101529.log 2023-10-14T22:49:01.620 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.311573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453625.log 2023-10-14T22:49:01.621 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272174.log 2023-10-14T22:49:01.623 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102299.log 2023-10-14T22:49:01.623 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.453625.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.525782.log.gz 2023-10-14T22:49:01.624 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.272174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555094.log 2023-10-14T22:49:01.624 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247307.log 2023-10-14T22:49:01.625 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.555094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571651.log 2023-10-14T22:49:01.626 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286723.log 2023-10-14T22:49:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.247307.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.551761.log.gz 2023-10-14T22:49:01.627 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.571651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530467.log 2023-10-14T22:49:01.628 INFO:teuthology.orchestra.run.smithi064.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.571651.log.gz 2023-10-14T22:49:01.628 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181239.log 2023-10-14T22:49:01.629 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.286723.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.492423.log.gz 2023-10-14T22:49:01.630 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.530467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141220.log 2023-10-14T22:49:01.630 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.181239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503834.log 2023-10-14T22:49:01.631 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.141220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235319.log 2023-10-14T22:49:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.503834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440629.log 2023-10-14T22:49:01.632 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.235319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162712.log 2023-10-14T22:49:01.633 INFO:teuthology.orchestra.run.smithi064.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.547434.log.gz 2023-10-14T22:49:01.634 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.440629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212228.log 2023-10-14T22:49:01.635 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.162712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577774.log 2023-10-14T22:49:01.635 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.212228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102089.log 2023-10-14T22:49:01.636 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.577774.log: 84.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.577774.log.gz 2023-10-14T22:49:01.637 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.166903.log 2023-10-14T22:49:01.637 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293037.log 2023-10-14T22:49:01.638 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.166903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500809.log 2023-10-14T22:49:01.639 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.293037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373119.log 2023-10-14T22:49:01.640 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.500809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568146.log 2023-10-14T22:49:01.641 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.373119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98553.log 2023-10-14T22:49:01.642 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.511117.log.gz 2023-10-14T22:49:01.642 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.568146.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.510692.log.gz 2023-10-14T22:49:01.643 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310618.log 2023-10-14T22:49:01.643 INFO:teuthology.orchestra.run.smithi064.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.568146.log.gz 2023-10-14T22:49:01.644 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97305.log 2023-10-14T22:49:01.645 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.310618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393847.log 2023-10-14T22:49:01.646 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.473138.log.gz 2023-10-14T22:49:01.646 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518019.log 2023-10-14T22:49:01.647 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.393847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103758.log 2023-10-14T22:49:01.648 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.518019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236210.log 2023-10-14T22:49:01.649 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.103758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304207.log 2023-10-14T22:49:01.650 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.236210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440638.log 2023-10-14T22:49:01.651 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.304207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582605.log 2023-10-14T22:49:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.440638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282177.log 2023-10-14T22:49:01.652 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.582605.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.582605.log.gz 2023-10-14T22:49:01.653 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218973.log 2023-10-14T22:49:01.654 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.282177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177754.log 2023-10-14T22:49:01.655 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.218973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402012.log 2023-10-14T22:49:01.656 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.177754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253824.log 2023-10-14T22:49:01.657 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.402012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94329.log 2023-10-14T22:49:01.657 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.253824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211389.log 2023-10-14T22:49:01.658 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159701.log 2023-10-14T22:49:01.659 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.552597.log.gz 2023-10-14T22:49:01.660 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.553015.log.gz 2023-10-14T22:49:01.660 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.211389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299120.log 2023-10-14T22:49:01.661 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.159701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194502.log 2023-10-14T22:49:01.661 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.496480.log.gz 2023-10-14T22:49:01.662 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.299120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149312.log 2023-10-14T22:49:01.663 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.194502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513850.log 2023-10-14T22:49:01.664 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.149312.log: gzip 84.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.519264.log.gz --verbose -- 2023-10-14T22:49:01.664 INFO:teuthology.orchestra.run.smithi064.stderr: /var/log/ceph/ceph-client.admin.280426.log 2023-10-14T22:49:01.665 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.513850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94019.log 2023-10-14T22:49:01.665 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.543644.log.gz 2023-10-14T22:49:01.666 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.280426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431653.log 2023-10-14T22:49:01.667 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580414.log 2023-10-14T22:49:01.668 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.431653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371871.log 2023-10-14T22:49:01.669 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.580414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234874.log 2023-10-14T22:49:01.669 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.580414.log.gz 2023-10-14T22:49:01.670 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.371871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100611.log 2023-10-14T22:49:01.671 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.234874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435572.log 2023-10-14T22:49:01.672 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101867.log 2023-10-14T22:49:01.672 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.435572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396432.log 2023-10-14T22:49:01.673 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439329.log 2023-10-14T22:49:01.674 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.396432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373545.log 2023-10-14T22:49:01.675 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.439329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472305.log 2023-10-14T22:49:01.676 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.373545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93851.log 2023-10-14T22:49:01.677 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.553841.log.gz 2023-10-14T22:49:01.677 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.472305.log: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.554259.log.gz 2023-10-14T22:49:01.678 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536564.log 2023-10-14T22:49:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506405.log 2023-10-14T22:49:01.679 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.536564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474438.log 2023-10-14T22:49:01.680 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.506405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447681.log 2023-10-14T22:49:01.681 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.449411.log.gz 2023-10-14T22:49:01.681 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.474438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359500.log 2023-10-14T22:49:01.682 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.447681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580423.log 2023-10-14T22:49:01.684 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.359500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477645.log 2023-10-14T22:49:01.685 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.580423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507405.log 2023-10-14T22:49:01.686 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.477645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295784.log 2023-10-14T22:49:01.688 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.507405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536987.log 2023-10-14T22:49:01.688 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.580423.log.gz 2023-10-14T22:49:01.688 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.295784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433860.log 2023-10-14T22:49:01.689 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.536987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395098.log 2023-10-14T22:49:01.690 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.524456.log.gz 2023-10-14T22:49:01.690 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.433860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585925.log 2023-10-14T22:49:01.691 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.395098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575143.log 2023-10-14T22:49:01.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571243.log 2023-10-14T22:49:01.692 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.585925.log.gz 2023-10-14T22:49:01.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.575143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373536.log 2023-10-14T22:49:01.694 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.571243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254241.log 2023-10-14T22:49:01.694 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.571243.log.gz 2023-10-14T22:49:01.695 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.373536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171573.log 2023-10-14T22:49:01.695 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.575143.log.gz 2023-10-14T22:49:01.696 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.254241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95549.log 2023-10-14T22:49:01.697 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.171573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443720.log 2023-10-14T22:49:01.698 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554677.log 2023-10-14T22:49:01.699 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175509.log 2023-10-14T22:49:01.700 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.554677.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518846.log 2023-10-14T22:49:01.701 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.175509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235765.log 2023-10-14T22:49:01.701 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.518846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182555.log 2023-10-14T22:49:01.703 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.235765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584438.log 2023-10-14T22:49:01.706 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.182555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457034.log 2023-10-14T22:49:01.707 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.584438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379073.log 2023-10-14T22:49:01.707 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.584438.log.gz 2023-10-14T22:49:01.707 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.457034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499004.log 2023-10-14T22:49:01.708 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.379073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370205.log 2023-10-14T22:49:01.709 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.499004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360324.log 2023-10-14T22:49:01.709 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.370205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174217.log 2023-10-14T22:49:01.710 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.360324.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562389.log 2023-10-14T22:49:01.710 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.174217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268757.log 2023-10-14T22:49:01.711 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.562389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570394.log 2023-10-14T22:49:01.712 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.268757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404445.log 2023-10-14T22:49:01.713 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.570394.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.570394.log.gz 2023-10-14T22:49:01.713 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94163.log 2023-10-14T22:49:01.714 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.404445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255961.log 2023-10-14T22:49:01.715 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.297044.log.gz 2023-10-14T22:49:01.715 INFO:teuthology.orchestra.run.smithi064.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.562389.log.gz 2023-10-14T22:49:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98984.log 2023-10-14T22:49:01.716 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.255961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311061.log 2023-10-14T22:49:01.717 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238820.log.gz 2023-10-14T22:49:01.717 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245970.log 2023-10-14T22:49:01.718 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.311061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263672.log 2023-10-14T22:49:01.719 INFO:teuthology.orchestra.run.smithi064.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.532959.log.gz 2023-10-14T22:49:01.720 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151451.log 2023-10-14T22:49:01.720 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.245970.log: /var/log/ceph/ceph-client.admin.263672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451955.log 2023-10-14T22:49:01.721 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.151451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99743.log 2023-10-14T22:49:01.722 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.451955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585601.log 2023-10-14T22:49:01.723 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155477.log 2023-10-14T22:49:01.724 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585601.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.585601.log.gz 2023-10-14T22:49:01.724 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586714.log 2023-10-14T22:49:01.725 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.155477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392152.log 2023-10-14T22:49:01.726 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586714.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.586714.log.gz 2023-10-14T22:49:01.726 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192148.log 2023-10-14T22:49:01.727 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.157121.log.gz 2023-10-14T22:49:01.727 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.392152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256804.log 2023-10-14T22:49:01.728 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.192148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258549.log 2023-10-14T22:49:01.729 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.256804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99195.log 2023-10-14T22:49:01.730 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.258549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371039.log 2023-10-14T22:49:01.731 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98906.log 2023-10-14T22:49:01.732 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.371039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490291.log 2023-10-14T22:49:01.733 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233547.log 2023-10-14T22:49:01.734 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.490291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427274.log 2023-10-14T22:49:01.734 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.233547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562870.log 2023-10-14T22:49:01.736 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.427274.log: 84.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.353619.log.gz 2023-10-14T22:49:01.736 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.243001.log 2023-10-14T22:49:01.737 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.562870.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.562870.log.gz 2023-10-14T22:49:01.737 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358660.log 2023-10-14T22:49:01.738 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.243001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150209.log 2023-10-14T22:49:01.738 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.358660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379082.log 2023-10-14T22:49:01.739 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.150209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102341.log 2023-10-14T22:49:01.740 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.379082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436822.log 2023-10-14T22:49:01.741 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102341.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.378657.log.gz 2023-10-14T22:49:01.742 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210142.log 2023-10-14T22:49:01.743 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.436822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289246.log 2023-10-14T22:49:01.743 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.439320.log.gz 2023-10-14T22:49:01.744 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.440629.log.gz 2023-10-14T22:49:01.744 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.210142.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.439329.log.gz 2023-10-14T22:49:01.745 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403014.log 2023-10-14T22:49:01.746 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.449402.log.gz 2023-10-14T22:49:01.746 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.289246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241331.log 2023-10-14T22:49:01.746 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.403014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93725.log 2023-10-14T22:49:01.747 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.241331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168992.log 2023-10-14T22:49:01.748 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8%/var/log/ceph/ceph-client.admin.93725.log: -- replaced with /var/log/ceph/ceph-client.admin.389101.log.gz 2023-10-14T22:49:01.748 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475683.log 2023-10-14T22:49:01.748 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.168992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519682.log 2023-10-14T22:49:01.750 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.475683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387368.log 2023-10-14T22:49:01.750 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.519682.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.392152.log.gz 2023-10-14T22:49:01.751 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266202.log 2023-10-14T22:49:01.752 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.427274.log.gz 2023-10-14T22:49:01.752 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.387368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374370.log 2023-10-14T22:49:01.753 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.266202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521002.log 2023-10-14T22:49:01.753 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.459982.log.gz 2023-10-14T22:49:01.754 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.374370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532715.log 2023-10-14T22:49:01.755 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.521002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432596.log 2023-10-14T22:49:01.756 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.532715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493390.log 2023-10-14T22:49:01.757 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.432596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296618.log 2023-10-14T22:49:01.758 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.493390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586840.log 2023-10-14T22:49:01.759 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.296618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454884.log 2023-10-14T22:49:01.760 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534863.log 2023-10-14T22:49:01.760 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.264508.log.gz 2023-10-14T22:49:01.761 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.586840.log.gz 2023-10-14T22:49:01.761 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.454884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458731.log 2023-10-14T22:49:01.762 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.534863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237102.log 2023-10-14T22:49:01.763 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.458731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564169.log 2023-10-14T22:49:01.764 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.237102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496903.log 2023-10-14T22:49:01.765 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.564169.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.564169.log.gz 2023-10-14T22:49:01.765 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95255.log 2023-10-14T22:49:01.766 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.496903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285453.log 2023-10-14T22:49:01.767 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95255.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.293037.log.gz 2023-10-14T22:49:01.768 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99375.log 2023-10-14T22:49:01.768 INFO:teuthology.orchestra.run.smithi064.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.292624.log.gz 2023-10-14T22:49:01.769 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.285453.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.293046.log.gz 2023-10-14T22:49:01.769 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143627.log 2023-10-14T22:49:01.770 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.166903.log.gz 2023-10-14T22:49:01.771 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245516.log 2023-10-14T22:49:01.771 INFO:teuthology.orchestra.run.smithi064.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.370205.log.gz 2023-10-14T22:49:01.771 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.143627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394690.log 2023-10-14T22:49:01.772 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.245516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549835.log 2023-10-14T22:49:01.773 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.394690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194919.log 2023-10-14T22:49:01.774 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.549835.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.210142.log.gz 2023-10-14T22:49:01.774 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431153.log 2023-10-14T22:49:01.775 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.194919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384964.log 2023-10-14T22:49:01.775 INFO:teuthology.orchestra.run.smithi064.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.234874.log.gz 2023-10-14T22:49:01.776 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.431153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428127.log 2023-10-14T22:49:01.777 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.384964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510270.log 2023-10-14T22:49:01.778 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.428127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140794.log 2023-10-14T22:49:01.779 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.510270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491985.log 2023-10-14T22:49:01.780 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.140794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451529.log 2023-10-14T22:49:01.780 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.491985.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.311070.log.gz 2023-10-14T22:49:01.781 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.519682.log.gz 2023-10-14T22:49:01.781 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309763.log 2023-10-14T22:49:01.782 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.168563.log.gz 2023-10-14T22:49:01.782 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.451529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379909.log 2023-10-14T22:49:01.783 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.309763.log: 79.3% -- replaced with /var/log/ceph/ceph-client.admin.267913.log.gz 2023-10-14T22:49:01.784 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287145.log 2023-10-14T22:49:01.785 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.379909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471887.log 2023-10-14T22:49:01.786 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.287145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224666.log 2023-10-14T22:49:01.787 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.471887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492898.log 2023-10-14T22:49:01.788 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.224666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436831.log 2023-10-14T22:49:01.789 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.492898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501217.log 2023-10-14T22:49:01.789 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.457461.log.gz 2023-10-14T22:49:01.790 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.436831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220778.log 2023-10-14T22:49:01.790 INFO:teuthology.orchestra.run.smithi064.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.489031.log.gz 2023-10-14T22:49:01.791 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.501217.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.489040.log.gz 2023-10-14T22:49:01.791 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.472305.log.gz 2023-10-14T22:49:01.792 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497334.log 2023-10-14T22:49:01.792 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.220778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553424.log 2023-10-14T22:49:01.793 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.497334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101073.log 2023-10-14T22:49:01.794 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.553424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505986.log 2023-10-14T22:49:01.796 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452372.log 2023-10-14T22:49:01.796 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.374379.log.gz 2023-10-14T22:49:01.797 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.505986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498995.log 2023-10-14T22:49:01.798 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.452372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160535.log 2023-10-14T22:49:01.798 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.94329.log.gz 2023-10-14T22:49:01.799 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.498995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359917.log 2023-10-14T22:49:01.800 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.160535.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97305.log.gz 2023-10-14T22:49:01.800 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239672.log 2023-10-14T22:49:01.801 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.359917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100653.log 2023-10-14T22:49:01.801 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98553.log.gz 2023-10-14T22:49:01.802 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.456179.log.gz 2023-10-14T22:49:01.803 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94681.log 2023-10-14T22:49:01.804 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.239672.log: /var/log/ceph/ceph-client.admin.100653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491125.log 2023-10-14T22:49:01.804 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.239663.log.gz 2023-10-14T22:49:01.804 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94681.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.150209.log.gz 2023-10-14T22:49:01.805 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92997.log 2023-10-14T22:49:01.806 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.296618.log.gz 2023-10-14T22:49:01.806 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.266202.log.gz 2023-10-14T22:49:01.806 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.491125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95591.log 2023-10-14T22:49:01.808 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92997.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.475683.log.gz 2023-10-14T22:49:01.808 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.163971.log.gz 2023-10-14T22:49:01.808 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315050.log 2023-10-14T22:49:01.809 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.498995.log.gz 2023-10-14T22:49:01.809 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262419.log 2023-10-14T22:49:01.810 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.315050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242174.log 2023-10-14T22:49:01.810 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.262419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443574.log 2023-10-14T22:49:01.811 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97827.log.gz 2023-10-14T22:49:01.811 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97953.log.gz 2023-10-14T22:49:01.812 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.242174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283654.log 2023-10-14T22:49:01.812 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99375.log.gz 2023-10-14T22:49:01.813 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531299.log 2023-10-14T22:49:01.813 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99743.log.gz 2023-10-14T22:49:01.814 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.283654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158867.log 2023-10-14T22:49:01.814 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.211389.log.gz 2023-10-14T22:49:01.814 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.531299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552588.log 2023-10-14T22:49:01.815 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.158867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175071.log 2023-10-14T22:49:01.816 INFO:teuthology.orchestra.run.smithi064.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.280426.log.gz 2023-10-14T22:49:01.817 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.552588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177745.log 2023-10-14T22:49:01.817 INFO:teuthology.orchestra.run.smithi064.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.284063.log.gz 2023-10-14T22:49:01.818 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.175071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279586.log 2023-10-14T22:49:01.819 INFO:teuthology.orchestra.run.smithi064.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.284916.log.gz 2023-10-14T22:49:01.819 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.365496.log.gz 2023-10-14T22:49:01.819 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.177745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576024.log 2023-10-14T22:49:01.820 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.279586.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.359917.log.gz 2023-10-14T22:49:01.820 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400523.log 2023-10-14T22:49:01.821 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.576024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376076.log 2023-10-14T22:49:01.822 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.400523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255970.log 2023-10-14T22:49:01.822 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.376076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140190.log 2023-10-14T22:49:01.823 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.576024.log.gz 2023-10-14T22:49:01.824 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.255970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273663.log 2023-10-14T22:49:01.825 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.140190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227312.log 2023-10-14T22:49:01.826 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.273663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561110.log 2023-10-14T22:49:01.827 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.227312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377394.log 2023-10-14T22:49:01.828 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.561110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312538.log 2023-10-14T22:49:01.828 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.561110.log.gz 2023-10-14T22:49:01.829 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.377394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265775.log 2023-10-14T22:49:01.830 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.312538.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.149312.log.gz 2023-10-14T22:49:01.830 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530000.log 2023-10-14T22:49:01.831 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.265775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175930.log 2023-10-14T22:49:01.832 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.530000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314638.log 2023-10-14T22:49:01.832 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.175930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99417.log 2023-10-14T22:49:01.833 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.314638.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.186889.log.gz 2023-10-14T22:49:01.834 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226892.log 2023-10-14T22:49:01.835 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99417.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.254241.log.gz 2023-10-14T22:49:01.835 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273672.log 2023-10-14T22:49:01.836 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.255961.log.gz 2023-10-14T22:49:01.836 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.226892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363267.log 2023-10-14T22:49:01.837 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.273672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438405.log 2023-10-14T22:49:01.837 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.431153.log.gz 2023-10-14T22:49:01.838 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.363267.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.309763.log.gz 2023-10-14T22:49:01.838 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286292.log 2023-10-14T22:49:01.839 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.438405.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.312538.log.gz 2023-10-14T22:49:01.840 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251140.log 2023-10-14T22:49:01.840 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.286292.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94681.log.gz 2023-10-14T22:49:01.841 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155955.log 2023-10-14T22:49:01.842 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.251140.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101321.log.gz 2023-10-14T22:49:01.842 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265358.log 2023-10-14T22:49:01.843 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.155955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453616.log 2023-10-14T22:49:01.843 INFO:teuthology.orchestra.run.smithi064.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102089.log.gz 2023-10-14T22:49:01.844 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.265358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534038.log 2023-10-14T22:49:01.844 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102341.log.gz 2023-10-14T22:49:01.845 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.453616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533612.log 2023-10-14T22:49:01.845 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.534038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101697.log 2023-10-14T22:49:01.846 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.533612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91637.log 2023-10-14T22:49:01.847 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446803.log 2023-10-14T22:49:01.848 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355717.log 2023-10-14T22:49:01.849 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.446803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511995.log 2023-10-14T22:49:01.849 INFO:teuthology.orchestra.run.smithi064.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.508845.log.gz 2023-10-14T22:49:01.850 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.355717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231321.log 2023-10-14T22:49:01.851 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.511995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431162.log 2023-10-14T22:49:01.851 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.451529.log.gz 2023-10-14T22:49:01.852 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.231321.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.432596.log.gz 2023-10-14T22:49:01.853 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361168.log 2023-10-14T22:49:01.853 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.431162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100131.log 2023-10-14T22:49:01.854 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.361168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228215.log 2023-10-14T22:49:01.855 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97533.log 2023-10-14T22:49:01.856 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.286723.log.gz 2023-10-14T22:49:01.856 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.228215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102131.log 2023-10-14T22:49:01.858 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385902.log 2023-10-14T22:49:01.858 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.387368.log.gz 2023-10-14T22:49:01.859 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94330.log 2023-10-14T22:49:01.859 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.534863.log.gz 2023-10-14T22:49:01.860 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.385902.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.531299.log.gz 2023-10-14T22:49:01.861 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572141.log 2023-10-14T22:49:01.861 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.453616.log.gz 2023-10-14T22:49:01.862 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443960.log 2023-10-14T22:49:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.572141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371880.log 2023-10-14T22:49:01.863 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.572141.log.gz 2023-10-14T22:49:01.863 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489874.log 2023-10-14T22:49:01.864 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.476550.log.gz 2023-10-14T22:49:01.865 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.371880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169838.log 2023-10-14T22:49:01.865 INFO:teuthology.orchestra.run.smithi064.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.101529.log.gz 2023-10-14T22:49:01.866 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.489874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263663.log 2023-10-14T22:49:01.866 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.169838.log: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.384128.log.gz 2023-10-14T22:49:01.867 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388257.log 2023-10-14T22:49:01.867 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.384546.log.gz 2023-10-14T22:49:01.868 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.384964.log.gz 2023-10-14T22:49:01.868 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.140794.log.gz 2023-10-14T22:49:01.868 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.140190.log.gz 2023-10-14T22:49:01.869 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.263663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.373953.log 2023-10-14T22:49:01.870 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.388257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356143.log 2023-10-14T22:49:01.870 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.373953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509825.log 2023-10-14T22:49:01.870 INFO:teuthology.orchestra.run.smithi064.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.443574.log.gz 2023-10-14T22:49:01.871 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.356143.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.160535.log.gz 2023-10-14T22:49:01.872 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150200.log 2023-10-14T22:49:01.872 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.509825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158004.log 2023-10-14T22:49:01.873 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.150200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217239.log 2023-10-14T22:49:01.874 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.158004.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.92997.log.gz 2023-10-14T22:49:01.874 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181704.log 2023-10-14T22:49:01.875 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.217239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555938.log 2023-10-14T22:49:01.876 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.394274.log.gz 2023-10-14T22:49:01.876 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.181704.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.396423.log.gz 2023-10-14T22:49:01.877 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94343.log 2023-10-14T22:49:01.878 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.555938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512959.log 2023-10-14T22:49:01.879 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570813.log 2023-10-14T22:49:01.880 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.512959.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.226892.log.gz 2023-10-14T22:49:01.881 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.279586.log.gz 2023-10-14T22:49:01.881 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155008.log 2023-10-14T22:49:01.881 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.235319.log.gz 2023-10-14T22:49:01.882 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.570813.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.570813.log.gz 2023-10-14T22:49:01.882 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247298.log 2023-10-14T22:49:01.883 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.155008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462101.log 2023-10-14T22:49:01.883 INFO:teuthology.orchestra.run.smithi064.stderr: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.177745.log.gz 2023-10-14T22:49:01.884 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.247298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218102.log 2023-10-14T22:49:01.885 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.462101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449828.log 89.9% 2023-10-14T22:49:01.885 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.242174.log.gz 2023-10-14T22:49:01.885 INFO:teuthology.orchestra.run.smithi064.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.175071.log.gz 2023-10-14T22:49:01.886 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.218102.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.175930.log.gz 2023-10-14T22:49:01.887 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.286292.log.gz 2023-10-14T22:49:01.887 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100989.log 2023-10-14T22:49:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.449828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506886.log 2023-10-14T22:49:01.888 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238403.log 2023-10-14T22:49:01.889 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.506886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100191.log 2023-10-14T22:49:01.890 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.371048.log.gz 2023-10-14T22:49:01.891 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354459.log 2023-10-14T22:49:01.891 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.238403.log: /var/log/ceph/ceph-client.admin.100191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369797.log 2023-10-14T22:49:01.892 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.354459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362015.log 2023-10-14T22:49:01.893 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.369797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97068.log 2023-10-14T22:49:01.894 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.362015.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.143627.log.gz 2023-10-14T22:49:01.894 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100275.log 2023-10-14T22:49:01.895 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95885.log 2023-10-14T22:49:01.896 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157558.log 2023-10-14T22:49:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98426.log 2023-10-14T22:49:01.897 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.157558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437276.log 2023-10-14T22:49:01.898 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315059.log 2023-10-14T22:49:01.899 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.437276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268330.log 2023-10-14T22:49:01.900 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5/var/log/ceph/ceph-client.admin.315059.log: --verbose -- /var/log/ceph/ceph-client.admin.182974.log 2023-10-14T22:49:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.268330.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.438405.log.gz 2023-10-14T22:49:01.901 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395515.log 2023-10-14T22:49:01.902 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.182974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229568.log 2023-10-14T22:49:01.903 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.395515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292615.log 2023-10-14T22:49:01.904 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.229568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235328.log 2023-10-14T22:49:01.905 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.292615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162294.log 2023-10-14T22:49:01.906 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.235328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97869.log 2023-10-14T22:49:01.907 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.162294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160118.log 2023-10-14T22:49:01.907 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284072.log 2023-10-14T22:49:01.908 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.160118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172919.log 2023-10-14T22:49:01.909 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.284072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275383.log 2023-10-14T22:49:01.910 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.172919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526199.log 2023-10-14T22:49:01.914 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.275383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502542.log 2023-10-14T22:49:01.914 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213502.log 2023-10-14T22:49:01.914 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.251140.log.gz 2023-10-14T22:49:01.915 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.526199.log: /var/log/ceph/ceph-client.admin.502542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270032.log 2023-10-14T22:49:01.916 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.213502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96055.log 2023-10-14T22:49:01.916 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.270032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283645.log 2023-10-14T22:49:01.917 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.96055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176902.log 2023-10-14T22:49:01.917 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.373953.log.gz 2023-10-14T22:49:01.917 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.283645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531707.log 2023-10-14T22:49:01.918 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.176902.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.400523.log.gz 2023-10-14T22:49:01.919 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271765.log 2023-10-14T22:49:01.920 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.238403.log.gz 2023-10-14T22:49:01.920 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.531707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586419.log 2023-10-14T22:49:01.921 INFO:teuthology.orchestra.run.smithi064.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.304652.log.gz 2023-10-14T22:49:01.921 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.271765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101823.log 2023-10-14T22:49:01.922 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586419.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.224666.log.gz 2023-10-14T22:49:01.923 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.586419.log.gz 2023-10-14T22:49:01.923 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517173.log 2023-10-14T22:49:01.924 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300806.log 2023-10-14T22:49:01.924 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.262419.log.gz 2023-10-14T22:49:01.925 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.263245.log.gz 2023-10-14T22:49:01.926 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.517173.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.263663.log.gz 2023-10-14T22:49:01.926 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.262836.log.gz 2023-10-14T22:49:01.926 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.263254.log.gz 2023-10-14T22:49:01.926 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459569.log 2023-10-14T22:49:01.928 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.489874.log.gz 2023-10-14T22:49:01.928 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.300806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460817.log 2023-10-14T22:49:01.928 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99417.log.gz 2023-10-14T22:49:01.929 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.459569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313377.log 2023-10-14T22:49:01.929 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.460817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586966.log 2023-10-14T22:49:01.930 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.313377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525362.log 2023-10-14T22:49:01.931 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458300.log 2023-10-14T22:49:01.931 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.586966.log.gz 2023-10-14T22:49:01.932 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.525362.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.512959.log.gz 2023-10-14T22:49:01.932 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572971.log 2023-10-14T22:49:01.933 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.458300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144055.log 2023-10-14T22:49:01.934 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.572971.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.572971.log.gz 2023-10-14T22:49:01.934 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219422.log 2023-10-14T22:49:01.935 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239672.log.gz 2023-10-14T22:49:01.936 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.144055.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.371880.log.gz 2023-10-14T22:49:01.936 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.385902.log.gz 2023-10-14T22:49:01.936 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.543654.log 2023-10-14T22:49:01.937 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.219422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142143.log 2023-10-14T22:49:01.938 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.543654.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100191.log.gz 2023-10-14T22:49:01.938 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100131.log.gz 2023-10-14T22:49:01.939 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301223.log 2023-10-14T22:49:01.939 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.142143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560589.log 2023-10-14T22:49:01.940 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.101073.log.gz 2023-10-14T22:49:01.940 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.301223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427696.log 2023-10-14T22:49:01.941 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.560589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476783.log 2023-10-14T22:49:01.942 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.427696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234429.log 2023-10-14T22:49:01.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429452.log 2023-10-14T22:49:01.945 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.234429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270451.log 2023-10-14T22:49:01.946 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.429452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185539.log 2023-10-14T22:49:01.947 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.270451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362838.log 2023-10-14T22:49:01.948 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.185539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144064.log 2023-10-14T22:49:01.949 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.362838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252990.log 2023-10-14T22:49:01.950 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.144064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304198.log 2023-10-14T22:49:01.951 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.252990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93647.log 2023-10-14T22:49:01.952 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.304198.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.300806.log.gz 2023-10-14T22:49:01.952 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244258.log 2023-10-14T22:49:01.953 INFO:teuthology.orchestra.run.smithi064.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.299120.log.gz 2023-10-14T22:49:01.954 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568630.log 2023-10-14T22:49:01.954 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.244258.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97533.log.gz 2023-10-14T22:49:01.955 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226446.log 2023-10-14T22:49:01.955 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.568630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260054.log 2023-10-14T22:49:01.956 INFO:teuthology.orchestra.run.smithi064.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.354459.log.gz 2023-10-14T22:49:01.957 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.226446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261431.log 2023-10-14T22:49:01.957 INFO:teuthology.orchestra.run.smithi064.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.568630.log.gz 2023-10-14T22:49:01.958 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.260054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169847.log 2023-10-14T22:49:01.959 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.395098.log.gz 2023-10-14T22:49:01.959 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.261431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376564.log 2023-10-14T22:49:01.961 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.169847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283236.log 2023-10-14T22:49:01.961 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.395951.log.gz 2023-10-14T22:49:01.961 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.531707.log.gz 2023-10-14T22:49:01.962 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.376564.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.362015.log.gz 2023-10-14T22:49:01.962 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585643.log 2023-10-14T22:49:01.963 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.283236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435139.log 2023-10-14T22:49:01.965 INFO:teuthology.orchestra.run.smithi064.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.402012.log.gz 2023-10-14T22:49:01.965 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585643.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.460817.log.gz 2023-10-14T22:49:01.965 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.459569.log.gz 2023-10-14T22:49:01.965 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.462101.log.gz 2023-10-14T22:49:01.966 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376555.log 2023-10-14T22:49:01.966 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.101823.log.gz 2023-10-14T22:49:01.966 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.585643.log.gz 2023-10-14T22:49:01.967 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.435139.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-14T22:49:01.968 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.376555.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.176902.log.gz 2023-10-14T22:49:01.968 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587008.log 2023-10-14T22:49:01.969 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223415.log 2023-10-14T22:49:01.969 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.587008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291339.log 2023-10-14T22:49:01.970 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.587008.log.gz 2023-10-14T22:49:01.971 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.223415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93379.log 2023-10-14T22:49:01.971 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.449828.log.gz 2023-10-14T22:49:01.972 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.291339.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.218102.log.gz 2023-10-14T22:49:01.972 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295793.log 2023-10-14T22:49:01.973 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93379.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.81391.log 2023-10-14T22:49:01.974 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.390400.log.gz 2023-10-14T22:49:01.974 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.295793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144975.log 2023-10-14T22:49:01.975 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.tmp-client.admin.81391.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.81391.log.gz 2023-10-14T22:49:01.976 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379918.log 2023-10-14T22:49:01.976 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.259585.log.gz 2023-10-14T22:49:01.976 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.265358.log.gz 2023-10-14T22:49:01.977 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297452.log 2023-10-14T22:49:01.978 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.144975.log: /var/log/ceph/ceph-client.admin.379918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93479.log 2023-10-14T22:49:01.978 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.297452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96563.log 2023-10-14T22:49:01.979 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288815.log 2023-10-14T22:49:01.980 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.96563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567722.log 2023-10-14T22:49:01.980 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.288815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302953.log 2023-10-14T22:49:01.981 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.567722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281260.log 2023-10-14T22:49:01.982 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.567722.log.gz 2023-10-14T22:49:01.983 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.302953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378239.log 2023-10-14T22:49:01.984 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.281260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151034.log 2023-10-14T22:49:01.985 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.378239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353202.log 2023-10-14T22:49:01.985 INFO:teuthology.orchestra.run.smithi064.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.217239.log.gz 2023-10-14T22:49:01.986 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.151034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368952.log 2023-10-14T22:49:01.987 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.353202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387840.log 2023-10-14T22:49:01.987 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.283654.log.gz 2023-10-14T22:49:01.988 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.368952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463357.log 2023-10-14T22:49:01.989 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.387840.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.268330.log.gz 2023-10-14T22:49:01.989 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219871.log 2023-10-14T22:49:01.991 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.463357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500382.log 2023-10-14T22:49:01.992 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.219871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166477.log 2023-10-14T22:49:01.992 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.247298.log.gz 2023-10-14T22:49:01.993 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.500382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164401.log 2023-10-14T22:49:01.994 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.166477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174630.log 2023-10-14T22:49:01.995 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.164401.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.283645.log.gz 2023-10-14T22:49:01.995 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290490.log 2023-10-14T22:49:01.996 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.174630.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.283236.log.gz 2023-10-14T22:49:01.996 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161847.log 2023-10-14T22:49:01.997 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.290490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474859.log 2023-10-14T22:49:01.998 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.244258.log.gz 2023-10-14T22:49:01.998 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.526199.log.gz 2023-10-14T22:49:01.999 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.161847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401512.log 2023-10-14T22:49:02.000 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.474859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433012.log 2023-10-14T22:49:02.001 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.401512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256387.log 2023-10-14T22:49:02.001 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.433012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99238.log 2023-10-14T22:49:02.002 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.256387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233092.log 2023-10-14T22:49:02.003 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514846.log 2023-10-14T22:49:02.005 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.233092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92205.log 2023-10-14T22:49:02.006 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.514846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.542413.log 2023-10-14T22:49:02.006 INFO:teuthology.orchestra.run.smithi064.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.144055.log.gz 2023-10-14T22:49:02.007 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242582.log 2023-10-14T22:49:02.008 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92205.log: /var/log/ceph/ceph-client.admin.542413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255542.log 2023-10-14T22:49:02.009 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.177754.log.gz 2023-10-14T22:49:02.009 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.242582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288393.log 2023-10-14T22:49:02.010 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.255542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101781.log 2023-10-14T22:49:02.011 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.288393.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.270032.log.gz 2023-10-14T22:49:02.012 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586290.log 2023-10-14T22:49:02.012 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249862.log 2023-10-14T22:49:02.013 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302944.log 2023-10-14T22:49:02.014 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.586290.log.gz 2023-10-14T22:49:02.017 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.249862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459991.log 2023-10-14T22:49:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.302944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441587.log 2023-10-14T22:49:02.019 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.263672.log.gz 2023-10-14T22:49:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.459991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556765.log 2023-10-14T22:49:02.019 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.441587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395942.log 2023-10-14T22:49:02.020 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.556765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576894.log 2023-10-14T22:49:02.021 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.395942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450251.log 2023-10-14T22:49:02.021 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.576894.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.576894.log.gz 2023-10-14T22:49:02.021 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157995.log 2023-10-14T22:49:02.022 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.450251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230875.log 2023-10-14T22:49:02.023 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.157995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499967.log 2023-10-14T22:49:02.024 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.93647.log.gz 2023-10-14T22:49:02.025 INFO:teuthology.orchestra.run.smithi064.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.93725.log.gz 2023-10-14T22:49:02.025 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.93851.log.gz 2023-10-14T22:49:02.025 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.230875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183846.log 2023-10-14T22:49:02.026 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.499967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499958.log 2023-10-14T22:49:02.027 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.183846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259138.log 2023-10-14T22:49:02.027 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.98984.log.gz 2023-10-14T22:49:02.028 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.499958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235774.log 2023-10-14T22:49:02.029 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.259138.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.379073.log.gz 2023-10-14T22:49:02.029 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398717.log 2023-10-14T22:49:02.030 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.235774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397390.log 2023-10-14T22:49:02.031 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.398717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507888.log 2023-10-14T22:49:02.032 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.397390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496471.log 2023-10-14T22:49:02.032 INFO:teuthology.orchestra.run.smithi064.stderr: 83.7% -- replaced with /var/log/ceph/ceph-client.admin.355717.log.gz 2023-10-14T22:49:02.033 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.356556.log.gz 2023-10-14T22:49:02.033 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.507888.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.356143.log.gz 2023-10-14T22:49:02.034 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209720.log 2023-10-14T22:49:02.034 INFO:teuthology.orchestra.run.smithi064.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.353202.log.gz 2023-10-14T22:49:02.035 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.496471.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.376555.log.gz 2023-10-14T22:49:02.036 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227761.log 2023-10-14T22:49:02.036 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.376976.log.gz 2023-10-14T22:49:02.036 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.376564.log.gz 2023-10-14T22:49:02.037 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.209720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.458722.log 2023-10-14T22:49:02.038 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.260054.log.gz 2023-10-14T22:49:02.038 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.227761.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.256387.log.gz 2023-10-14T22:49:02.038 INFO:teuthology.orchestra.run.smithi064.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.302944.log.gz 2023-10-14T22:49:02.039 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98289.log 2023-10-14T22:49:02.039 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.311061.log.gz 2023-10-14T22:49:02.039 INFO:teuthology.orchestra.run.smithi064.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.310618.log.gz 2023-10-14T22:49:02.040 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.458722.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.445959.log.gz 2023-10-14T22:49:02.041 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502123.log 2023-10-14T22:49:02.041 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.445968.log.gz 2023-10-14T22:49:02.041 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505149.log 2023-10-14T22:49:02.042 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.502123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567294.log 2023-10-14T22:49:02.043 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.505149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368085.log 2023-10-14T22:49:02.044 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.567294.log: 81.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.567294.log.gz 2023-10-14T22:49:02.044 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.240923.log 2023-10-14T22:49:02.045 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.368085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148527.log 2023-10-14T22:49:02.045 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.240923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393420.log 2023-10-14T22:49:02.046 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.148527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513368.log 2023-10-14T22:49:02.047 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.393420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524039.log 2023-10-14T22:49:02.048 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.513368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359491.log 2023-10-14T22:49:02.048 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.290490.log.gz 2023-10-14T22:49:02.049 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.524039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312075.log 2023-10-14T22:49:02.050 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.359491.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.291339.log.gz 2023-10-14T22:49:02.050 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527442.log 2023-10-14T22:49:02.051 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.312075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386383.log 2023-10-14T22:49:02.052 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.527442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503408.log 2023-10-14T22:49:02.052 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.301223.log.gz 2023-10-14T22:49:02.053 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.386383.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98289.log.gz 2023-10-14T22:49:02.053 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360333.log 2023-10-14T22:49:02.054 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.503408.log: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.252990.log.gz 2023-10-14T22:49:02.055 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103716.log 2023-10-14T22:49:02.055 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.360333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257223.log 2023-10-14T22:49:02.056 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.103716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100569.log 2023-10-14T22:49:02.057 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.257223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98163.log 2023-10-14T22:49:02.058 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95843.log 2023-10-14T22:49:02.059 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.463366.log 2023-10-14T22:49:02.060 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457043.log 2023-10-14T22:49:02.062 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.463366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95339.log 2023-10-14T22:49:02.063 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.457043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94671.log 2023-10-14T22:49:02.064 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95339.log: gzip -5 --verbose 85.5% -- -- replaced with /var/log/ceph/ceph-client.admin.360324.log.gz /var/log/ceph/ceph-client.admin.534446.log 2023-10-14T22:49:02.064 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:02.065 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574268.log 2023-10-14T22:49:02.066 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.534446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243848.log 2023-10-14T22:49:02.067 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.574268.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.574268.log.gz 2023-10-14T22:49:02.068 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365505.log 2023-10-14T22:49:02.069 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.243848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562380.log 2023-10-14T22:49:02.070 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.365505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472721.log 2023-10-14T22:49:02.071 INFO:teuthology.orchestra.run.smithi064.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.501217.log.gz 2023-10-14T22:49:02.071 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.500391.log.gz 2023-10-14T22:49:02.071 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.562380.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.562380.log.gz 2023-10-14T22:49:02.072 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193090.log 2023-10-14T22:49:02.073 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.472721.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.394690.log.gz 2023-10-14T22:49:02.073 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538885.log 2023-10-14T22:49:02.073 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.395942.log.gz 2023-10-14T22:49:02.074 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.193090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165226.log 2023-10-14T22:49:02.075 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.538885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566881.log 2023-10-14T22:49:02.075 INFO:teuthology.orchestra.run.smithi064.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.552588.log.gz 2023-10-14T22:49:02.076 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.165226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232647.log 2023-10-14T22:49:02.077 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.566881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225122.log 2023-10-14T22:49:02.078 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.232647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494712.log 2023-10-14T22:49:02.078 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.566881.log.gz 2023-10-14T22:49:02.079 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.225122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273204.log 2023-10-14T22:49:02.080 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.494712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305103.log 2023-10-14T22:49:02.081 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.273204.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.457034.log.gz 2023-10-14T22:49:02.081 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504668.log 2023-10-14T22:49:02.082 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.458722.log.gz 2023-10-14T22:49:02.082 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.457043.log.gz 2023-10-14T22:49:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.305103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266619.log 2023-10-14T22:49:02.083 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.504668.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.536987.log.gz 2023-10-14T22:49:02.084 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190652.log 2023-10-14T22:49:02.085 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.266619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453198.log 2023-10-14T22:49:02.086 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.190652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.404454.log 2023-10-14T22:49:02.088 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.453198.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.505140.log.gz 2023-10-14T22:49:02.088 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504242.log 2023-10-14T22:49:02.089 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.404454.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.525362.log.gz 2023-10-14T22:49:02.089 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171986.log 2023-10-14T22:49:02.090 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.504242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568621.log 2023-10-14T22:49:02.092 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.171986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293468.log 2023-10-14T22:49:02.093 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.568621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98696.log 2023-10-14T22:49:02.093 INFO:teuthology.orchestra.run.smithi064.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.568621.log.gz 2023-10-14T22:49:02.094 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.293468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95012.log 2023-10-14T22:49:02.096 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503417.log 2023-10-14T22:49:02.097 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91541.log 2023-10-14T22:49:02.098 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.503417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446381.log 2023-10-14T22:49:02.099 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258558.log 2023-10-14T22:49:02.101 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.446381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240089.log 2023-10-14T22:49:02.101 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.511995.log.gz 2023-10-14T22:49:02.102 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.258558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184270.log 2023-10-14T22:49:02.103 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.240089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249871.log 2023-10-14T22:49:02.104 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.184270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241748.log 2023-10-14T22:49:02.106 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.249871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99969.log 2023-10-14T22:49:02.107 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290921.log 2023-10-14T22:49:02.108 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.241748.log: /var/log/ceph/ceph-client.admin.99969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522353.log 2023-10-14T22:49:02.108 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.209720.log.gz 2023-10-14T22:49:02.109 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447259.log 2023-10-14T22:49:02.110 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.290921.log: /var/log/ceph/ceph-client.admin.522353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281729.log 2023-10-14T22:49:02.111 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.447259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244267.log 2023-10-14T22:49:02.111 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.281729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461234.log 2023-10-14T22:49:02.112 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.244267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495175.log 2023-10-14T22:49:02.113 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.461234.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.235765.log.gz 2023-10-14T22:49:02.114 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443632.log 2023-10-14T22:49:02.118 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.495175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511535.log 2023-10-14T22:49:02.119 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95297.log 2023-10-14T22:49:02.119 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.511535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391718.log 2023-10-14T22:49:02.119 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93767.log 2023-10-14T22:49:02.120 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.391718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314216.log 2023-10-14T22:49:02.120 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.500800.log 2023-10-14T22:49:02.121 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.314216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281269.log 2023-10-14T22:49:02.121 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.500800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584447.log 2023-10-14T22:49:02.122 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.281269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96459.log 2023-10-14T22:49:02.123 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.584447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221766.log 2023-10-14T22:49:02.124 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.96459.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.584447.log.gz 2023-10-14T22:49:02.124 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360746.log 2023-10-14T22:49:02.125 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.221766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93337.log 2023-10-14T22:49:02.126 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.360746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491556.log 2023-10-14T22:49:02.127 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292202.log 2023-10-14T22:49:02.128 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.491556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282168.log 2023-10-14T22:49:02.128 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.169838.log.gz 2023-10-14T22:49:02.129 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.169847.log.gz 2023-10-14T22:49:02.129 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.237102.log.gz 2023-10-14T22:49:02.130 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.292202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528712.log 2023-10-14T22:49:02.130 INFO:teuthology.orchestra.run.smithi064.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.242582.log.gz 2023-10-14T22:49:02.131 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.282168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252581.log 2023-10-14T22:49:02.132 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.528712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267452.log 2023-10-14T22:49:02.133 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.252581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300797.log 2023-10-14T22:49:02.134 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.267452.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.435139.log.gz 2023-10-14T22:49:02.134 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194228.log 2023-10-14T22:49:02.135 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.300797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258058.log 2023-10-14T22:49:02.135 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.194228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435563.log 2023-10-14T22:49:02.136 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.258058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.379501.log 2023-10-14T22:49:02.137 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.435563.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.387840.log.gz 2023-10-14T22:49:02.138 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356134.log 2023-10-14T22:49:02.139 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.379501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168572.log 2023-10-14T22:49:02.139 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.356134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434731.log 2023-10-14T22:49:02.140 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.168572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528721.log 2023-10-14T22:49:02.141 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.434731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284498.log 2023-10-14T22:49:02.142 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.304207.log.gz 2023-10-14T22:49:02.143 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.528721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191690.log 2023-10-14T22:49:02.144 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.284498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95003.log 2023-10-14T22:49:02.145 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.191690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225539.log 2023-10-14T22:49:02.146 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95003.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.223415.log.gz 2023-10-14T22:49:02.146 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169428.log 2023-10-14T22:49:02.147 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.225539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289237.log 2023-10-14T22:49:02.148 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.169428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249030.log 2023-10-14T22:49:02.149 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.289237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279171.log 2023-10-14T22:49:02.150 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.249030.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.435989.log.gz 2023-10-14T22:49:02.151 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97575.log 2023-10-14T22:49:02.152 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.279171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256795.log 2023-10-14T22:49:02.153 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.249871.log.gz 2023-10-14T22:49:02.154 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426369.log 2023-10-14T22:49:02.154 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.256795.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.155008.log.gz 2023-10-14T22:49:02.155 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.155477.log.gz 2023-10-14T22:49:02.155 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579542.log 2023-10-14T22:49:02.156 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.471887.log.gz 2023-10-14T22:49:02.157 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.426369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97347.log 2023-10-14T22:49:02.158 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.165226.log.gz 2023-10-14T22:49:02.158 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.579542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158858.log 2023-10-14T22:49:02.158 INFO:teuthology.orchestra.run.smithi064.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.472721.log.gz 2023-10-14T22:49:02.159 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161363.log 2023-10-14T22:49:02.160 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.158858.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.527442.log.gz 2023-10-14T22:49:02.160 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555520.log 2023-10-14T22:49:02.161 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.161363.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.579542.log.gz 2023-10-14T22:49:02.161 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.240080.log.gz 2023-10-14T22:49:02.162 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585475.log 2023-10-14T22:49:02.163 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.373962.log.gz 2023-10-14T22:49:02.163 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.240089.log.gz 2023-10-14T22:49:02.163 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.555520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493873.log 2023-10-14T22:49:02.164 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585475.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.405895.log 2023-10-14T22:49:02.164 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.585475.log.gz 2023-10-14T22:49:02.165 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.493873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564638.log 2023-10-14T22:49:02.166 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.405895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187330.log 2023-10-14T22:49:02.167 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.564638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102635.log 2023-10-14T22:49:02.169 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.187330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172910.log 2023-10-14T22:49:02.170 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288824.log 2023-10-14T22:49:02.171 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.172910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95423.log 2023-10-14T22:49:02.172 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.288824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101739.log 2023-10-14T22:49:02.174 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440208.log 2023-10-14T22:49:02.174 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.183846.log.gz 2023-10-14T22:49:02.175 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101401.log 2023-10-14T22:49:02.176 INFO:teuthology.orchestra.run.smithi064.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.193090.log.gz 2023-10-14T22:49:02.177 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.440208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232202.log 2023-10-14T22:49:02.178 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257214.log 2023-10-14T22:49:02.179 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.232202.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99969.log.gz 2023-10-14T22:49:02.180 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93169.log 2023-10-14T22:49:02.180 INFO:teuthology.orchestra.run.smithi064.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.379492.log.gz 2023-10-14T22:49:02.180 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.365505.log.gz 2023-10-14T22:49:02.181 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.257214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170689.log 2023-10-14T22:49:02.182 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93169.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.440208.log.gz 2023-10-14T22:49:02.182 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100011.log 2023-10-14T22:49:02.184 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.170689.log: 81.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.514846.log.gz -5 2023-10-14T22:49:02.184 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.243839.log 2023-10-14T22:49:02.184 INFO:teuthology.orchestra.run.smithi064.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.356134.log.gz 2023-10-14T22:49:02.185 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509834.log 2023-10-14T22:49:02.186 INFO:teuthology.orchestra.run.smithi064.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.359491.log.gz 2023-10-14T22:49:02.186 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.243839.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97347.log.gz 2023-10-14T22:49:02.187 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584000.log 2023-10-14T22:49:02.188 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.509834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377812.log 2023-10-14T22:49:02.189 INFO:teuthology.orchestra.run.smithi064.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.93379.log.gz 2023-10-14T22:49:02.189 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.584000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157549.log 2023-10-14T22:49:02.191 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.377812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514280.log 2023-10-14T22:49:02.191 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.227761.log.gz 2023-10-14T22:49:02.192 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.157549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299537.log 2023-10-14T22:49:02.193 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.514280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87774.log 2023-10-14T22:49:02.195 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.299537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521455.log 2023-10-14T22:49:02.196 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384137.log 2023-10-14T22:49:02.197 INFO:teuthology.orchestra.run.smithi064.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.584000.log.gz 2023-10-14T22:49:02.198 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.521455.log: gzip 84.2% -- replaced with /var/log/ceph/ceph-client.admin.426369.log.gz -5 2023-10-14T22:49:02.198 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.186880.log 2023-10-14T22:49:02.199 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.247307.log.gz 2023-10-14T22:49:02.199 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.384137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553433.log 2023-10-14T22:49:02.200 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.186880.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.292202.log.gz 2023-10-14T22:49:02.201 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100863.log 2023-10-14T22:49:02.201 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.553433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435980.log 2023-10-14T22:49:02.203 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260518.log 2023-10-14T22:49:02.204 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.435980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233984.log 2023-10-14T22:49:02.205 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.279171.log.gz 2023-10-14T22:49:02.205 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.260518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165643.log 2023-10-14T22:49:02.206 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.495175.log.gz 2023-10-14T22:49:02.208 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.233984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102527.log 2023-10-14T22:49:02.208 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.165643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.514289.log 2023-10-14T22:49:02.209 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303789.log 2023-10-14T22:49:02.211 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.514289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.377821.log 2023-10-14T22:49:02.212 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.303789.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.453198.log.gz 2023-10-14T22:49:02.213 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518855.log 2023-10-14T22:49:02.214 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.377821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102215.log 2023-10-14T22:49:02.215 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.518855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403981.log 2023-10-14T22:49:02.217 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381177.log 2023-10-14T22:49:02.218 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.403981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574694.log 2023-10-14T22:49:02.220 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.381177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357399.log 2023-10-14T22:49:02.221 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.574694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536117.log 2023-10-14T22:49:02.222 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93169.log.gz 2023-10-14T22:49:02.222 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.357399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400091.log 2023-10-14T22:49:02.223 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95255.log.gz 2023-10-14T22:49:02.223 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.536117.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.161363.log.gz 2023-10-14T22:49:02.224 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275392.log 2023-10-14T22:49:02.225 INFO:teuthology.orchestra.run.smithi064.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.225539.log.gz 2023-10-14T22:49:02.226 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.400091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561119.log 2023-10-14T22:49:02.226 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.172910.log.gz 2023-10-14T22:49:02.227 INFO:teuthology.orchestra.run.smithi064.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.243839.log.gz 2023-10-14T22:49:02.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.275392.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.268339.log.gz 2023-10-14T22:49:02.227 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521936.log 2023-10-14T22:49:02.228 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.244267.log.gz 2023-10-14T22:49:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.561119.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.232202.log.gz 2023-10-14T22:49:02.229 INFO:teuthology.orchestra.run.smithi064.stderr:gzip 86.2% -5 -- replaced with /var/log/ceph/ceph-client.admin.162712.log.gz --verbose 2023-10-14T22:49:02.229 INFO:teuthology.orchestra.run.smithi064.stderr: -- /var/log/ceph/ceph-client.admin.266193.log 2023-10-14T22:49:02.230 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% 81.1% -- replaced with /var/log/ceph/ceph-client.admin.561119.log.gz 2023-10-14T22:49:02.231 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.233984.log.gz 2023-10-14T22:49:02.231 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.521936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218964.log 2023-10-14T22:49:02.231 INFO:teuthology.orchestra.run.smithi064.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.158858.log.gz 2023-10-14T22:49:02.232 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.266193.log: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.243001.log.gz 2023-10-14T22:49:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218111.log 2023-10-14T22:49:02.233 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.218964.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.87774.log.gz 2023-10-14T22:49:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586333.log 2023-10-14T22:49:02.234 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.218111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211806.log 2023-10-14T22:49:02.235 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.528712.log.gz 2023-10-14T22:49:02.236 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586333.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.528721.log.gz 2023-10-14T22:49:02.236 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94121.log 2023-10-14T22:49:02.237 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.586333.log.gz 2023-10-14T22:49:02.237 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.211806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101961.log 2023-10-14T22:49:02.238 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101157.log 2023-10-14T22:49:02.240 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490282.log 2023-10-14T22:49:02.241 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.472730.log 2023-10-14T22:49:02.242 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.490282.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.434731.log.gz 2023-10-14T22:49:02.243 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314207.log 2023-10-14T22:49:02.244 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.472730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97785.log 2023-10-14T22:49:02.246 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.314207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384555.log 2023-10-14T22:49:02.247 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388266.log 2023-10-14T22:49:02.249 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.384555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532271.log 2023-10-14T22:49:02.250 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.388266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219862.log 2023-10-14T22:49:02.251 INFO:teuthology.orchestra.run.smithi064.stderr: 96.1% -- replaced with /var/log/ceph/ceph-client.admin.574694.log.gz 2023-10-14T22:49:02.252 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.532271.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.249030.log.gz 2023-10-14T22:49:02.252 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368961.log 2023-10-14T22:49:02.253 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.219862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355304.log 2023-10-14T22:49:02.254 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.368961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365079.log 2023-10-14T22:49:02.255 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.355304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100359.log 2023-10-14T22:49:02.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.365079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312949.log 2023-10-14T22:49:02.259 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399135.log 2023-10-14T22:49:02.259 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.282168.log.gz 2023-10-14T22:49:02.260 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.312949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177310.log 2023-10-14T22:49:02.261 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.399135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274547.log 2023-10-14T22:49:02.263 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.177310.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-14T22:49:02.264 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.274547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312529.log 2023-10-14T22:49:02.265 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.435148.log 2023-10-14T22:49:02.266 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94344.log 2023-10-14T22:49:02.267 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.312529.log: /var/log/ceph/ceph-client.admin.435148.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.150200.log.gz 2023-10-14T22:49:02.268 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182123.log 2023-10-14T22:49:02.269 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94344.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.157549.log.gz 2023-10-14T22:49:02.270 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.168992.log.gz 2023-10-14T22:49:02.270 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249455.log 2023-10-14T22:49:02.271 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.182123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176893.log 2023-10-14T22:49:02.272 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.249455.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.158004.log.gz 2023-10-14T22:49:02.273 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162721.log 2023-10-14T22:49:02.274 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.490282.log.gz 2023-10-14T22:49:02.274 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94163.log.gz 2023-10-14T22:49:02.274 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.176893.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100011.log.gz 2023-10-14T22:49:02.275 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362431.log 2023-10-14T22:49:02.276 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.162721.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100359.log.gz 2023-10-14T22:49:02.276 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558864.log 2023-10-14T22:49:02.276 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100653.log.gz 2023-10-14T22:49:02.277 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.362431.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103758.log.gz 2023-10-14T22:49:02.277 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573411.log 2023-10-14T22:49:02.279 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.558864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260966.log 2023-10-14T22:49:02.280 INFO:teuthology.orchestra.run.smithi064.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.365079.log.gz 2023-10-14T22:49:02.280 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.573411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.547444.log 2023-10-14T22:49:02.281 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.573411.log.gz 2023-10-14T22:49:02.282 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.260966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217657.log 2023-10-14T22:49:02.282 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.547444.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.447681.log.gz 2023-10-14T22:49:02.283 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.377812.log.gz 2023-10-14T22:49:02.284 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216803.log 2023-10-14T22:49:02.285 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.217657.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.245970.log.gz 2023-10-14T22:49:02.285 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525773.log 2023-10-14T22:49:02.286 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.216803.log: gzip -5 --verbose -- 89.9% /var/log/ceph/ceph-client.admin.521446.log -- replaced with /var/log/ceph/ceph-client.admin.255970.log.gz 2023-10-14T22:49:02.286 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:02.288 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.525773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523612.log 2023-10-14T22:49:02.289 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.521446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576454.log 2023-10-14T22:49:02.289 INFO:teuthology.orchestra.run.smithi064.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.215929.log.gz 2023-10-14T22:49:02.291 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.523612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268748.log 2023-10-14T22:49:02.291 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.446803.log.gz 2023-10-14T22:49:02.292 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.280013.log.gz 2023-10-14T22:49:02.292 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.576454.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.576454.log.gz 2023-10-14T22:49:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585735.log 2023-10-14T22:49:02.293 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.268748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87406.log 2023-10-14T22:49:02.294 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585735.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.585735.log.gz 2023-10-14T22:49:02.295 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516699.log 2023-10-14T22:49:02.296 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298286.log 2023-10-14T22:49:02.298 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.516699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92565.log 2023-10-14T22:49:02.300 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.298286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507879.log 2023-10-14T22:49:02.301 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99332.log 2023-10-14T22:49:02.302 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.496471.log.gz 2023-10-14T22:49:02.303 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.507879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390391.log 2023-10-14T22:49:02.304 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357816.log 2023-10-14T22:49:02.306 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.390391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248613.log 2023-10-14T22:49:02.307 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.357816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212650.log 2023-10-14T22:49:02.309 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.248613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247756.log 2023-10-14T22:49:02.310 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.212650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221271.log 2023-10-14T22:49:02.311 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.302503.log.gz 2023-10-14T22:49:02.312 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.247756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240506.log 2023-10-14T22:49:02.313 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.221271.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.357399.log.gz 2023-10-14T22:49:02.314 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394265.log 2023-10-14T22:49:02.314 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.240506.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.315050.log.gz 2023-10-14T22:49:02.315 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302057.log 2023-10-14T22:49:02.315 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.314638.log.gz 2023-10-14T22:49:02.316 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.394265.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.362431.log.gz 2023-10-14T22:49:02.317 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.94330.log.gz 2023-10-14T22:49:02.317 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.435980.log.gz 2023-10-14T22:49:02.317 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.533612.log.gz 2023-10-14T22:49:02.318 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91981.log 2023-10-14T22:49:02.318 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.302057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554686.log 2023-10-14T22:49:02.320 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260957.log 2023-10-14T22:49:02.321 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.554686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386374.log 2023-10-14T22:49:02.323 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.260957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443671.log 2023-10-14T22:49:02.324 INFO:teuthology.orchestra.run.smithi064.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.507879.log.gz 2023-10-14T22:49:02.325 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.386374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261961.log 2023-10-14T22:49:02.325 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.435148.log.gz 2023-10-14T22:49:02.326 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443671.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290082.log 2023-10-14T22:49:02.328 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.261961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439737.log 2023-10-14T22:49:02.329 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.290082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285870.log 2023-10-14T22:49:02.331 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.439737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95465.log 2023-10-14T22:49:02.331 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.285870.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.94019.log.gz 2023-10-14T22:49:02.332 INFO:teuthology.orchestra.run.smithi064.stderr: 91.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.404454.log.gz 2023-10-14T22:49:02.332 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.155486.log 2023-10-14T22:49:02.333 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.391270.log.gz 2023-10-14T22:49:02.333 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95465.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101697.log.gz 2023-10-14T22:49:02.334 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426793.log 2023-10-14T22:49:02.334 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.176893.log.gz 2023-10-14T22:49:02.335 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.144975.log.gz 2023-10-14T22:49:02.335 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.155486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234883.log 2023-10-14T22:49:02.336 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.426793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493381.log 2023-10-14T22:49:02.338 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.234883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520146.log 2023-10-14T22:49:02.339 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.493381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567303.log 2023-10-14T22:49:02.340 INFO:teuthology.orchestra.run.smithi064.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.400091.log.gz 2023-10-14T22:49:02.341 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.520146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173800.log 2023-10-14T22:49:02.341 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.218964.log.gz 2023-10-14T22:49:02.342 INFO:teuthology.orchestra.run.smithi064.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.268748.log.gz 2023-10-14T22:49:02.342 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.567303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171111.log 2023-10-14T22:49:02.343 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.567303.log.gz 2023-10-14T22:49:02.343 INFO:teuthology.orchestra.run.smithi064.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.376076.log.gz 2023-10-14T22:49:02.344 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.173800.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.217657.log.gz 2023-10-14T22:49:02.345 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193516.log 2023-10-14T22:49:02.345 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.171111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246861.log 2023-10-14T22:49:02.347 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.193516.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.211806.log.gz 2023-10-14T22:49:02.347 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530883.log 2023-10-14T22:49:02.348 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.246861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381186.log 2023-10-14T22:49:02.349 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.530883.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.249455.log.gz 2023-10-14T22:49:02.349 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158422.log 2023-10-14T22:49:02.350 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.220778.log.gz 2023-10-14T22:49:02.351 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.381186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294757.log 2023-10-14T22:49:02.353 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.158422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143199.log 2023-10-14T22:49:02.354 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.294757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98780.log 2023-10-14T22:49:02.354 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.285870.log.gz 2023-10-14T22:49:02.355 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.143199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228206.log 2023-10-14T22:49:02.356 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.142642.log.gz 2023-10-14T22:49:02.357 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151460.log 2023-10-14T22:49:02.358 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.228206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165235.log 2023-10-14T22:49:02.360 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.151460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100233.log 2023-10-14T22:49:02.361 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.165235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476774.log 2023-10-14T22:49:02.362 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402021.log 2023-10-14T22:49:02.364 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476774.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.453625.log.gz 2023-10-14T22:49:02.364 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149738.log 2023-10-14T22:49:02.365 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.402021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585779.log 2023-10-14T22:49:02.367 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.149738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92289.log 2023-10-14T22:49:02.368 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244685.log 2023-10-14T22:49:02.368 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.585779.log.gz 2023-10-14T22:49:02.369 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491547.log 2023-10-14T22:49:02.371 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.244685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560598.log 2023-10-14T22:49:02.372 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.491547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496053.log 2023-10-14T22:49:02.373 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.560598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95801.log 2023-10-14T22:49:02.375 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.496053.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91718.log 2023-10-14T22:49:02.376 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455315.log 2023-10-14T22:49:02.377 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496062.log 2023-10-14T22:49:02.379 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.455315.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.449819.log 2023-10-14T22:49:02.380 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.496062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92119.log 2023-10-14T22:49:02.381 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.449819.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.159701.log.gz 2023-10-14T22:49:02.381 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451946.log 2023-10-14T22:49:02.382 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557183.log 2023-10-14T22:49:02.383 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.451946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.541256.log 2023-10-14T22:49:02.385 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.557183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565087.log 2023-10-14T22:49:02.386 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.541256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370623.log 2023-10-14T22:49:02.387 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.565087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94341.log 2023-10-14T22:49:02.388 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.370623.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.555103.log.gz 2023-10-14T22:49:02.389 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473560.log 2023-10-14T22:49:02.389 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.557610.log.gz 2023-10-14T22:49:02.390 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536573.log 2023-10-14T22:49:02.391 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.473560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167320.log 2023-10-14T22:49:02.393 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.536573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476541.log 2023-10-14T22:49:02.394 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.167320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363276.log 2023-10-14T22:49:02.396 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513377.log 2023-10-14T22:49:02.397 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.363276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97263.log 2023-10-14T22:49:02.399 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.513377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102569.log 2023-10-14T22:49:02.401 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168154.log 2023-10-14T22:49:02.401 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437702.log 2023-10-14T22:49:02.403 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.168154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92331.log 2023-10-14T22:49:02.403 INFO:teuthology.orchestra.run.smithi064.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.564638.log.gz 2023-10-14T22:49:02.404 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.437702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100947.log 2023-10-14T22:49:02.406 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585517.log 2023-10-14T22:49:02.407 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457452.log 2023-10-14T22:49:02.408 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585517.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.585517.log.gz 2023-10-14T22:49:02.408 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367260.log 2023-10-14T22:49:02.410 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.457452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95213.log 2023-10-14T22:49:02.411 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.367260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275845.log 2023-10-14T22:49:02.412 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295376.log 2023-10-14T22:49:02.413 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.275845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251988.log 2023-10-14T22:49:02.413 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.295376.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.522770.log.gz 2023-10-14T22:49:02.414 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.524039.log.gz 2023-10-14T22:49:02.415 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454454.log 2023-10-14T22:49:02.415 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.373545.log.gz 2023-10-14T22:49:02.416 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.251988.log: 81.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.476774.log.gz 2023-10-14T22:49:02.416 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.512469.log 2023-10-14T22:49:02.417 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.454454.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.240506.log.gz 2023-10-14T22:49:02.417 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.361168.log.gz 2023-10-14T22:49:02.418 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274965.log 2023-10-14T22:49:02.418 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.512469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535710.log 2023-10-14T22:49:02.420 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.274965.log: gzip 85.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.503408.log.gz -- 2023-10-14T22:49:02.420 INFO:teuthology.orchestra.run.smithi064.stderr: /var/log/ceph/ceph-client.admin.538876.log 2023-10-14T22:49:02.421 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.535710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241757.log 2023-10-14T22:49:02.422 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.504668.log.gz 2023-10-14T22:49:02.422 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.503417.log.gz 2023-10-14T22:49:02.423 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.538876.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.439737.log.gz 2023-10-14T22:49:02.424 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.370623.log.gz 2023-10-14T22:49:02.424 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396909.log 2023-10-14T22:49:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.241757.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.536117.log.gz 2023-10-14T22:49:02.425 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98037.log 2023-10-14T22:49:02.425 INFO:teuthology.orchestra.run.smithi064.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.371871.log.gz 2023-10-14T22:49:02.426 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.396909.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.380326.log.gz 2023-10-14T22:49:02.426 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160526.log 2023-10-14T22:49:02.427 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278720.log 2023-10-14T22:49:02.428 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.493381.log.gz 2023-10-14T22:49:02.429 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.160526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442458.log 2023-10-14T22:49:02.429 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.493390.log.gz 2023-10-14T22:49:02.430 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.292615.log.gz 2023-10-14T22:49:02.430 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.278720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587090.log 2023-10-14T22:49:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.442458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372712.log 2023-10-14T22:49:02.432 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.587090.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.356982.log.gz 2023-10-14T22:49:02.433 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.587090.log.gz 2023-10-14T22:49:02.433 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.426802.log 2023-10-14T22:49:02.434 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529546.log 2023-10-14T22:49:02.434 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9%/var/log/ceph/ceph-client.admin.372712.log: -- replaced with /var/log/ceph/ceph-client.admin.553424.log.gz 2023-10-14T22:49:02.435 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.426802.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.553433.log.gz 2023-10-14T22:49:02.436 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.94341.log.gz 2023-10-14T22:49:02.436 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385893.log 2023-10-14T22:49:02.436 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.529546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523185.log 2023-10-14T22:49:02.438 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.385893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516281.log 2023-10-14T22:49:02.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.523185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232211.log 2023-10-14T22:49:02.441 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.516281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214392.log 2023-10-14T22:49:02.442 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.232211.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.394265.log.gz 2023-10-14T22:49:02.443 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93935.log 2023-10-14T22:49:02.444 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.214392.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.395515.log.gz 2023-10-14T22:49:02.444 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166060.log 2023-10-14T22:49:02.445 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497325.log 2023-10-14T22:49:02.446 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.166060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476420.log 2023-10-14T22:49:02.447 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.497325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310627.log 2023-10-14T22:49:02.449 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99701.log 2023-10-14T22:49:02.450 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.310627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231766.log 2023-10-14T22:49:02.451 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561542.log 2023-10-14T22:49:02.452 INFO:teuthology.orchestra.run.smithi064.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.443671.log.gz/var/log/ceph/ceph-client.admin.231766.log: 2023-10-14T22:49:02.453 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95013.log 2023-10-14T22:49:02.454 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.561542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97491.log 2023-10-14T22:49:02.455 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259594.log 2023-10-14T22:49:02.456 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97491.log: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.561542.log.gz 2023-10-14T22:49:02.457 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 91.9% --verbose -- replaced with /var/log/ceph/ceph-client.admin.523194.log.gz -- 2023-10-14T22:49:02.457 INFO:teuthology.orchestra.run.smithi064.stderr: /var/log/ceph/ceph-client.admin.101241.log 2023-10-14T22:49:02.458 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.259594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100695.log 2023-10-14T22:49:02.459 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361177.log 2023-10-14T22:49:02.460 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.386374.log.gz 2023-10-14T22:49:02.460 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100695.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.454454.log.gz 2023-10-14T22:49:02.461 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.457452.log.gz 2023-10-14T22:49:02.461 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175500.log 2023-10-14T22:49:02.462 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.361177.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.93211.log.gz 2023-10-14T22:49:02.462 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397399.log 2023-10-14T22:49:02.463 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.175500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401013.log 2023-10-14T22:49:02.464 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.397399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259129.log 2023-10-14T22:49:02.466 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.401013.log: /var/log/ceph/ceph-client.admin.259129.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.303789.log.gz 2023-10-14T22:49:02.466 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163980.log 2023-10-14T22:49:02.467 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98331.log 2023-10-14T22:49:02.467 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97263.log.gz 2023-10-14T22:49:02.468 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.163980.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.396909.log.gz 2023-10-14T22:49:02.468 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478061.log 2023-10-14T22:49:02.469 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.173800.log.gz 2023-10-14T22:49:02.470 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240497.log 2023-10-14T22:49:02.471 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.478061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193507.log 2023-10-14T22:49:02.472 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.240497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100443.log 2023-10-14T22:49:02.474 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.193507.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.87406.log.gz 2023-10-14T22:49:02.474 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570822.log 2023-10-14T22:49:02.475 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91842.log 2023-10-14T22:49:02.476 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.570822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279162.log 2023-10-14T22:49:02.477 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91842.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.570822.log.gz 2023-10-14T22:49:02.478 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287984.log 2023-10-14T22:49:02.480 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.279162.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.193516.log.gz 2023-10-14T22:49:02.480 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270869.log 2023-10-14T22:49:02.481 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.287984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294748.log 2023-10-14T22:49:02.482 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.270869.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.426793.log.gz 2023-10-14T22:49:02.482 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.426802.log.gz 2023-10-14T22:49:02.483 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97111.log 2023-10-14T22:49:02.484 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.294748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505557.log 2023-10-14T22:49:02.485 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.530883.log.gz 2023-10-14T22:49:02.485 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97111.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.442458.log.gz 2023-10-14T22:49:02.486 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.442467.log.gz 2023-10-14T22:49:02.487 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501689.log 2023-10-14T22:49:02.487 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.505557.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.449819.log.gz 2023-10-14T22:49:02.488 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368502.log 2023-10-14T22:49:02.489 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.501689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578654.log 2023-10-14T22:49:02.490 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.368502.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95465.log.gz 2023-10-14T22:49:02.490 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.523185.log.gz 2023-10-14T22:49:02.491 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536996.log 2023-10-14T22:49:02.492 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.578654.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.578654.log.gz 2023-10-14T22:49:02.492 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554268.log 2023-10-14T22:49:02.493 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.536996.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98780.log.gz 2023-10-14T22:49:02.494 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563295.log 2023-10-14T22:49:02.494 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99026.log.gz 2023-10-14T22:49:02.495 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99068.log.gz 2023-10-14T22:49:02.496 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.554268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398282.log 2023-10-14T22:49:02.496 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.563295.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.563295.log.gz 2023-10-14T22:49:02.497 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275836.log 2023-10-14T22:49:02.499 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.398282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432169.log 2023-10-14T22:49:02.500 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.275836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245094.log 2023-10-14T22:49:02.500 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.432169.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.512469.log.gz 2023-10-14T22:49:02.501 INFO:teuthology.orchestra.run.smithi064.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.532715.log.gz 2023-10-14T22:49:02.502 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172448.log 2023-10-14T22:49:02.502 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.245094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354041.log 2023-10-14T22:49:02.504 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.172448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102401.log 2023-10-14T22:49:02.505 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.354041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388674.log 2023-10-14T22:49:02.507 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.509271.log 2023-10-14T22:49:02.508 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.388674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524871.log 2023-10-14T22:49:02.508 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.167320.log.gz 2023-10-14T22:49:02.509 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.509271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584867.log 2023-10-14T22:49:02.510 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.524871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97701.log 2023-10-14T22:49:02.511 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.295376.log.gz 2023-10-14T22:49:02.512 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.584867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565980.log 2023-10-14T22:49:02.512 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.584867.log.gz 2023-10-14T22:49:02.513 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.427705.log 2023-10-14T22:49:02.514 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.565980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293881.log 2023-10-14T22:49:02.514 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.565980.log.gz 2023-10-14T22:49:02.515 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.427705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298712.log 2023-10-14T22:49:02.517 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.293881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.440217.log 2023-10-14T22:49:02.518 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.298712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150626.log 2023-10-14T22:49:02.519 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.440217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95381.log 2023-10-14T22:49:02.520 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.372712.log.gz 2023-10-14T22:49:02.521 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.150626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287975.log 2023-10-14T22:49:02.522 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231757.log 2023-10-14T22:49:02.523 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.287975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150617.log 2023-10-14T22:49:02.523 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.231757.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.233092.log.gz 2023-10-14T22:49:02.524 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250723.log 2023-10-14T22:49:02.525 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.150617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392143.log 2023-10-14T22:49:02.527 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.250723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301640.log 2023-10-14T22:49:02.528 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.392143.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.241757.log.gz 2023-10-14T22:49:02.528 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401521.log 2023-10-14T22:49:02.529 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.301640.log: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.279162.log.gz 2023-10-14T22:49:02.529 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559274.log 2023-10-14T22:49:02.530 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.401521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579103.log 2023-10-14T22:49:02.532 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.559274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.454463.log 2023-10-14T22:49:02.533 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.579103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534872.log 2023-10-14T22:49:02.534 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.454463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157130.log 2023-10-14T22:49:02.535 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.534872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217666.log 2023-10-14T22:49:02.536 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.157130.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.579103.log.gz 2023-10-14T22:49:02.537 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271319.log 2023-10-14T22:49:02.538 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.217666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213947.log 2023-10-14T22:49:02.539 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.271319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101199.log 2023-10-14T22:49:02.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.213947.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100695.log.gz 2023-10-14T22:49:02.541 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253407.log 2023-10-14T22:49:02.542 INFO:teuthology.orchestra.run.smithi064.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100779.log.gz 2023-10-14T22:49:02.542 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221775.log 2023-10-14T22:49:02.543 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.100989.log.gz 2023-10-14T22:49:02.544 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.253407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269195.log 2023-10-14T22:49:02.545 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.221775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227321.log 2023-10-14T22:49:02.546 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.269195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442041.log 2023-10-14T22:49:02.547 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.227321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394681.log 2023-10-14T22:49:02.549 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.442041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271310.log 2023-10-14T22:49:02.550 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.379082.log.gz 2023-10-14T22:49:02.550 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.394681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100737.log 2023-10-14T22:49:02.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.271310.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.440217.log.gz 2023-10-14T22:49:02.552 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389092.log 2023-10-14T22:49:02.553 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100737.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.538876.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183855.log 2023-10-14T22:49:02.553 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:02.554 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.389092.log: 89.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97911.log 2023-10-14T22:49:02.555 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.301640.log.gz 2023-10-14T22:49:02.555 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.183855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168983.log 2023-10-14T22:49:02.556 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99459.log 2023-10-14T22:49:02.558 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.168983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243429.log 2023-10-14T22:49:02.559 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533621.log 2023-10-14T22:49:02.560 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.385893.log.gz 2023-10-14T22:49:02.561 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.243429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97449.log 2023-10-14T22:49:02.562 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.533621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92457.log 2023-10-14T22:49:02.564 INFO:teuthology.orchestra.run.smithi064.stderr:gzip/var/log/ceph/ceph-client.admin.97449.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.237111.log 2023-10-14T22:49:02.564 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92457.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.501689.log.gz 2023-10-14T22:49:02.565 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533199.log 2023-10-14T22:49:02.566 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.237111.log: /var/log/ceph/ceph-client.admin.533199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370632.log 2023-10-14T22:49:02.568 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.157558.log.gz 2023-10-14T22:49:02.568 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163550.log 2023-10-14T22:49:02.569 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.304198.log.gz 2023-10-14T22:49:02.569 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.370632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517593.log 2023-10-14T22:49:02.570 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.163550.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.271765.log.gz 2023-10-14T22:49:02.571 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.368094.log 2023-10-14T22:49:02.571 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.275836.log.gz 2023-10-14T22:49:02.572 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.517593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563304.log 2023-10-14T22:49:02.573 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.295793.log.gz 2023-10-14T22:49:02.574 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.368094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522344.log 2023-10-14T22:49:02.575 INFO:teuthology.orchestra.run.smithi064.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97449.log.gz 2023-10-14T22:49:02.575 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.563304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448556.log 2023-10-14T22:49:02.576 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.563304.log.gz 2023-10-14T22:49:02.577 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.522344.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.432169.log.gz 2023-10-14T22:49:02.577 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98331.log.gz 2023-10-14T22:49:02.578 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305094.log 2023-10-14T22:49:02.578 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.448556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254708.log 2023-10-14T22:49:02.579 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.294748.log.gz 2023-10-14T22:49:02.580 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.305094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243420.log 2023-10-14T22:49:02.581 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.254708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375226.log 2023-10-14T22:49:02.582 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.243420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251557.log 2023-10-14T22:49:02.584 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.375226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560152.log 2023-10-14T22:49:02.584 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.361177.log.gz 2023-10-14T22:49:02.585 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.251557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375217.log 2023-10-14T22:49:02.587 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.560152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97221.log 2023-10-14T22:49:02.588 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.375217.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.388674.log.gz 2023-10-14T22:49:02.589 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-14T22:49:02.589 INFO:teuthology.orchestra.run.smithi064.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.389092.log.gz 2023-10-14T22:49:02.590 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557601.log 2023-10-14T22:49:02.590 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.392143.log.gz 2023-10-14T22:49:02.591 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276280.log 2023-10-14T22:49:02.592 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.557601.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.394681.log.gz 2023-10-14T22:49:02.593 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282789.log 2023-10-14T22:49:02.594 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.276280.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.397399.log.gz 2023-10-14T22:49:02.594 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298703.log 2023-10-14T22:49:02.595 INFO:teuthology.orchestra.run.smithi064.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.448556.log.gz 2023-10-14T22:49:02.596 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.282789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291761.log 2023-10-14T22:49:02.598 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.298703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241340.log 2023-10-14T22:49:02.598 INFO:teuthology.orchestra.run.smithi064.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.427696.log.gz 2023-10-14T22:49:02.599 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.291761.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.427705.log.gz 2023-10-14T22:49:02.599 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.437693.log 2023-10-14T22:49:02.601 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.241340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280852.log 2023-10-14T22:49:02.601 INFO:teuthology.orchestra.run.smithi064.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97221.log.gz 2023-10-14T22:49:02.602 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.437693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184695.log 2023-10-14T22:49:02.603 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.280852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568892.log 2023-10-14T22:49:02.605 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.184695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99152.log 2023-10-14T22:49:02.606 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.568892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242165.log 2023-10-14T22:49:02.607 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99152.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.193507.log.gz 2023-10-14T22:49:02.608 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.231757.log.gz 2023-10-14T22:49:02.608 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155017.log 2023-10-14T22:49:02.610 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.242165.log: /var/log/ceph/ceph-client.admin.155017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223841.log 2023-10-14T22:49:02.611 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93521.log 2023-10-14T22:49:02.613 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.223841.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.521446.log.gz 2023-10-14T22:49:02.613 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.521455.log.gz 2023-10-14T22:49:02.613 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572132.log 2023-10-14T22:49:02.614 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.521936.log.gz 2023-10-14T22:49:02.615 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194493.log 2023-10-14T22:49:02.616 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.572132.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.572132.log.gz 2023-10-14T22:49:02.616 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214383.log 2023-10-14T22:49:02.618 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.194493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94665.log 2023-10-14T22:49:02.619 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.214383.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.505557.log.gz 2023-10-14T22:49:02.619 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.557601.log.gz 2023-10-14T22:49:02.620 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212659.log 2023-10-14T22:49:02.621 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355726.log 2023-10-14T22:49:02.622 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.212659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95927.log 2023-10-14T22:49:02.624 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.355726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225131.log 2023-10-14T22:49:02.626 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167728.log 2023-10-14T22:49:02.627 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.225131.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.522344.log.gz 2023-10-14T22:49:02.628 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168145.log 2023-10-14T22:49:02.629 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.167728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291330.log 2023-10-14T22:49:02.630 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.168145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170267.log 2023-10-14T22:49:02.632 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.565087.log.gz 2023-10-14T22:49:02.632 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.291330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389518.log 2023-10-14T22:49:02.633 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.170267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266610.log 2023-10-14T22:49:02.635 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.389518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511986.log 2023-10-14T22:49:02.636 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.266610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218547.log 2023-10-14T22:49:02.638 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.511986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101571.log 2023-10-14T22:49:02.639 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.218547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213938.log 2023-10-14T22:49:02.640 INFO:teuthology.orchestra.run.smithi064.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.168983.log.gz 2023-10-14T22:49:02.641 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289664.log 2023-10-14T22:49:02.642 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.213938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429461.log 2023-10-14T22:49:02.643 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.289664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455755.log 2023-10-14T22:49:02.645 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.429461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376067.log 2023-10-14T22:49:02.646 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.455755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297035.log 2023-10-14T22:49:02.648 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.376067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462527.log 2023-10-14T22:49:02.649 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.297035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94659.log 2023-10-14T22:49:02.651 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.462527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233101.log 2023-10-14T22:49:02.652 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267922.log 2023-10-14T22:49:02.654 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.233101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372703.log 2023-10-14T22:49:02.655 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.267922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558855.log 2023-10-14T22:49:02.656 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.372703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141640.log 2023-10-14T22:49:02.659 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.558855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.388683.log 2023-10-14T22:49:02.659 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.141640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583533.log 2023-10-14T22:49:02.660 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.388683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581284.log 2023-10-14T22:49:02.662 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.583533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312958.log 2023-10-14T22:49:02.662 INFO:teuthology.orchestra.run.smithi064.stderr: 79.9% -- replaced with /var/log/ceph/ceph-client.admin.583533.log.gz 2023-10-14T22:49:02.663 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.581284.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.581284.log.gz 2023-10-14T22:49:02.663 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553006.log 2023-10-14T22:49:02.665 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.312958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558028.log 2023-10-14T22:49:02.665 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.553006.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.241340.log.gz 2023-10-14T22:49:02.666 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102003.log 2023-10-14T22:49:02.667 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.558028.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.305094.log.gz 2023-10-14T22:49:02.667 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.297452.log.gz 2023-10-14T22:49:02.668 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246852.log 2023-10-14T22:49:02.668 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95017.log 2023-10-14T22:49:02.670 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.246852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284507.log 2023-10-14T22:49:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95017.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.517593.log.gz 2023-10-14T22:49:02.671 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159284.log 2023-10-14T22:49:02.673 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.284507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193934.log 2023-10-14T22:49:02.673 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.490291.log.gz 2023-10-14T22:49:02.674 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.159284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156694.log 2023-10-14T22:49:02.675 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.193934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526607.log 2023-10-14T22:49:02.676 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.156694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238394.log 2023-10-14T22:49:02.678 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.526607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.523621.log 2023-10-14T22:49:02.679 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.238394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399665.log 2023-10-14T22:49:02.681 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.523621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257641.log 2023-10-14T22:49:02.681 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.399665.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99152.log.gz 2023-10-14T22:49:02.682 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443298.log 2023-10-14T22:49:02.683 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.257641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527451.log 2023-10-14T22:49:02.684 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177319.log 2023-10-14T22:49:02.685 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.527451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303371.log 2023-10-14T22:49:02.687 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.177319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.96954.log 2023-10-14T22:49:02.688 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.303371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280004.log 2023-10-14T22:49:02.688 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.2.96954.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.223841.log.gz 2023-10-14T22:49:02.690 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578663.log 2023-10-14T22:49:02.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.280004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98738.log 2023-10-14T22:49:02.692 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100737.log.gz 2023-10-14T22:49:02.692 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101199.log.gz 2023-10-14T22:49:02.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.578663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537461.log 2023-10-14T22:49:02.694 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98738.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98163.log.gz 2023-10-14T22:49:02.695 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462110.log 2023-10-14T22:49:02.695 INFO:teuthology.orchestra.run.smithi064.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.461243.log.gz 2023-10-14T22:49:02.696 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102527.log.gz 2023-10-14T22:49:02.696 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.578663.log.gz 2023-10-14T22:49:02.696 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.537461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297461.log 2023-10-14T22:49:02.697 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.462110.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.102569.log.gz 2023-10-14T22:49:02.698 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280435.log 2023-10-14T22:49:02.699 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.297461.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93521.log.gz 2023-10-14T22:49:02.699 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.371039.log.gz 2023-10-14T22:49:02.699 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582173.log 2023-10-14T22:49:02.700 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.370632.log.gz 2023-10-14T22:49:02.701 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.276280.log.gz 2023-10-14T22:49:02.701 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.280435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224249.log 2023-10-14T22:49:02.702 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.582173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433429.log 2023-10-14T22:49:02.704 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.224249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102485.log 2023-10-14T22:49:02.705 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.433429.log: 92.5% -- replaced with /var/log/ceph/ceph-client.2.96954.log.gz 2023-10-14T22:49:02.705 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.433012.log.gz 2023-10-14T22:49:02.706 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97743.log 2023-10-14T22:49:02.706 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.582173.log.gz 2023-10-14T22:49:02.707 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380747.log 2023-10-14T22:49:02.708 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254717.log 2023-10-14T22:49:02.710 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.380747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491116.log 2023-10-14T22:49:02.711 INFO:teuthology.orchestra.run.smithi064.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.536996.log.gz 2023-10-14T22:49:02.711 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.254717.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.558028.log.gz 2023-10-14T22:49:02.712 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586672.log 2023-10-14T22:49:02.713 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.491116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520155.log 2023-10-14T22:49:02.714 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586672.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.312958.log.gz 2023-10-14T22:49:02.715 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563724.log 2023-10-14T22:49:02.715 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.586672.log.gz 2023-10-14T22:49:02.716 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.520155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502533.log 2023-10-14T22:49:02.717 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.563724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181713.log 2023-10-14T22:49:02.719 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.502533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551343.log 2023-10-14T22:49:02.719 INFO:teuthology.orchestra.run.smithi064.stderr: 89.1% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94659.log.gz 2023-10-14T22:49:02.720 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94665.log.gz 2023-10-14T22:49:02.720 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.181713.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.563724.log.gz 2023-10-14T22:49:02.721 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99533.log 2023-10-14T22:49:02.722 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.253407.log.gz 2023-10-14T22:49:02.722 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.246861.log.gz 2023-10-14T22:49:02.722 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97743.log.gz 2023-10-14T22:49:02.723 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.551343.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.393420.log.gz 2023-10-14T22:49:02.724 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171102.log 2023-10-14T22:49:02.724 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.163550.log.gz 2023-10-14T22:49:02.725 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99533.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.163980.log.gz 2023-10-14T22:49:02.725 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.454884.log.gz 2023-10-14T22:49:02.725 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565536.log 2023-10-14T22:49:02.726 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.171102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223832.log 2023-10-14T22:49:02.727 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.565536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468091.log 2023-10-14T22:49:02.728 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.455755.log.gz 2023-10-14T22:49:02.729 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.223832.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.459991.log.gz 2023-10-14T22:49:02.729 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585821.log 2023-10-14T22:49:02.734 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.468091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443680.log 2023-10-14T22:49:02.734 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.462110.log.gz 2023-10-14T22:49:02.735 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585821.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.585821.log.gz 2023-10-14T22:49:02.735 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.95017.log.gz 2023-10-14T22:49:02.735 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264940.log 2023-10-14T22:49:02.736 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443680.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.102003.log.gz 2023-10-14T22:49:02.737 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.171102.log.gz 2023-10-14T22:49:02.737 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.174630.log.gz 2023-10-14T22:49:02.737 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524447.log 2023-10-14T22:49:02.737 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.264940.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.213947.log.gz 2023-10-14T22:49:02.738 INFO:teuthology.orchestra.run.smithi064.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.148527.log.gz 2023-10-14T22:49:02.738 INFO:teuthology.orchestra.run.smithi064.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99238.log.gz 2023-10-14T22:49:02.738 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.99195.log.gz 2023-10-14T22:49:02.739 INFO:teuthology.orchestra.run.smithi064.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.218547.log.gz 2023-10-14T22:49:02.740 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100401.log 2023-10-14T22:49:02.740 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.225122.log.gz 2023-10-14T22:49:02.740 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.524447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552169.log 2023-10-14T22:49:02.740 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.360333.log.gz 2023-10-14T22:49:02.741 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.375217.log.gz 2023-10-14T22:49:02.742 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550926.log 2023-10-14T22:49:02.742 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.401512.log.gz 2023-10-14T22:49:02.743 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.552169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451112.log 2023-10-14T22:49:02.743 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.225131.log.gz 2023-10-14T22:49:02.744 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.550926.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.254708.log.gz 2023-10-14T22:49:02.744 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274974.log 2023-10-14T22:49:02.745 INFO:teuthology.orchestra.run.smithi064.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.214383.log.gz 2023-10-14T22:49:02.745 INFO:teuthology.orchestra.run.smithi064.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.213938.log.gz 2023-10-14T22:49:02.746 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.451112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562879.log 2023-10-14T22:49:02.747 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.274974.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.266619.log.gz 2023-10-14T22:49:02.747 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430296.log 2023-10-14T22:49:02.749 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.562879.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.212659.log.gz 2023-10-14T22:49:02.749 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550083.log 2023-10-14T22:49:02.750 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.562879.log.gz 2023-10-14T22:49:02.750 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.430296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93809.log 2023-10-14T22:49:02.751 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.433429.log.gz 2023-10-14T22:49:02.752 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.550083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527033.log 2023-10-14T22:49:02.753 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229976.log 2023-10-14T22:49:02.755 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.527033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381598.log 2023-10-14T22:49:02.757 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.229976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100905.log 2023-10-14T22:49:02.758 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.381598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310185.log 2023-10-14T22:49:02.760 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100905.log: gzip -5 89.3% --verbose -- /var/log/ceph/ceph-client.admin.282780.log 2023-10-14T22:49:02.760 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97911.log.gz 2023-10-14T22:49:02.761 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97869.log.gz 2023-10-14T22:49:02.761 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.310185.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98037.log.gz 2023-10-14T22:49:02.762 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.156694.log.gz 2023-10-14T22:49:02.763 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264090.log 2023-10-14T22:49:02.763 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.282780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.370214.log 2023-10-14T22:49:02.765 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.264090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471896.log 2023-10-14T22:49:02.766 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.370214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586756.log 2023-10-14T22:49:02.767 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.181713.log.gz 2023-10-14T22:49:02.768 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.471896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288402.log 2023-10-14T22:49:02.768 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.175500.log.gz 2023-10-14T22:49:02.770 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586756.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.586756.log.gz 2023-10-14T22:49:02.770 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430734.log 2023-10-14T22:49:02.771 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.288402.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.399665.log.gz 2023-10-14T22:49:02.772 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550509.log 2023-10-14T22:49:02.772 INFO:teuthology.orchestra.run.smithi064.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.224249.log.gz 2023-10-14T22:49:02.772 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.241331.log.gz 2023-10-14T22:49:02.773 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.430734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192682.log 2023-10-14T22:49:02.774 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.241748.log.gz 2023-10-14T22:49:02.775 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.550509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267443.log 2023-10-14T22:49:02.777 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.192682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250714.log 2023-10-14T22:49:02.777 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.297461.log.gz 2023-10-14T22:49:02.777 INFO:teuthology.orchestra.run.smithi064.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98738.log.gz 2023-10-14T22:49:02.778 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.267443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572550.log 2023-10-14T22:49:02.779 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.250714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.381607.log 2023-10-14T22:49:02.781 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.572550.log: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.572550.log.gz 2023-10-14T22:49:02.781 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.513368.log.gz 2023-10-14T22:49:02.782 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176347.log 2023-10-14T22:49:02.782 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100401.log.gz 2023-10-14T22:49:02.783 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.381607.log: 89.8% 87.4% -- replaced with /var/log/ceph/ceph-client.admin.100905.log.gz 2023-10-14T22:49:02.783 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.254717.log.gz 2023-10-14T22:49:02.784 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258049.log 2023-10-14T22:49:02.786 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.176347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167311.log 2023-10-14T22:49:02.787 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.258049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178168.log 2023-10-14T22:49:02.789 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.167311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392577.log 2023-10-14T22:49:02.790 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.178168.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.93767.log.gz 2023-10-14T22:49:02.791 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.281729.log.gz 2023-10-14T22:49:02.791 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289655.log 2023-10-14T22:49:02.792 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.392577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354468.log 2023-10-14T22:49:02.794 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.289655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262410.log 2023-10-14T22:49:02.795 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.354468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585687.log 2023-10-14T22:49:02.796 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.491556.log.gz 2023-10-14T22:49:02.797 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.262410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550500.log 2023-10-14T22:49:02.798 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585687.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.368085.log.gz 2023-10-14T22:49:02.799 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.585687.log.gz 2023-10-14T22:49:02.799 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142152.log 2023-10-14T22:49:02.800 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.550500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163138.log 2023-10-14T22:49:02.801 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.267922.log.gz 2023-10-14T22:49:02.802 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.142152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94679.log 2023-10-14T22:49:02.803 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.163138.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91541.log.gz 2023-10-14T22:49:02.804 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269186.log 2023-10-14T22:49:02.805 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569125.log 2023-10-14T22:49:02.807 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.269186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249039.log 2023-10-14T22:49:02.809 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.569125.log: gzip -5 90.0% -- replaced with /var/log/ceph/ceph-client.admin.291761.log.gz 2023-10-14T22:49:02.809 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.386878.log 2023-10-14T22:49:02.809 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.312075.log.gz 2023-10-14T22:49:02.810 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.249039.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.569125.log.gz 2023-10-14T22:49:02.811 INFO:teuthology.orchestra.run.smithi064.stderr: 79.6% -- replaced with /var/log/ceph/ceph-client.admin.529546.log.gz 2023-10-14T22:49:02.811 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144984.log 2023-10-14T22:49:02.812 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.386878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389509.log 2023-10-14T22:49:02.814 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.144984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395107.log 2023-10-14T22:49:02.815 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.389509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561533.log 2023-10-14T22:49:02.817 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.395107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438822.log 2023-10-14T22:49:02.818 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.561533.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.561533.log.gz 2023-10-14T22:49:02.819 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585883.log 2023-10-14T22:49:02.820 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.438822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265367.log 2023-10-14T22:49:02.822 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585883.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.585883.log.gz 2023-10-14T22:49:02.822 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.392577.log.gz 2023-10-14T22:49:02.822 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.237111.log.gz 2023-10-14T22:49:02.823 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526190.log 2023-10-14T22:49:02.823 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.265367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.183396.log 2023-10-14T22:49:02.824 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.395107.log.gz 2023-10-14T22:49:02.825 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.526190.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.267443.log.gz 2023-10-14T22:49:02.825 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511126.log 2023-10-14T22:49:02.827 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.183396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98079.log 2023-10-14T22:49:02.828 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.511126.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99533.log.gz 2023-10-14T22:49:02.829 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161838.log 2023-10-14T22:49:02.830 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502114.log 2023-10-14T22:49:02.831 INFO:teuthology.orchestra.run.smithi064.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.403014.log.gz 2023-10-14T22:49:02.832 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.161838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284925.log 2023-10-14T22:49:02.833 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.502114.log: 80.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.436822.log.gz 2023-10-14T22:49:02.833 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.98638.log 2023-10-14T22:49:02.834 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.284925.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.451112.log.gz 2023-10-14T22:49:02.835 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234438.log 2023-10-14T22:49:02.837 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102257.log 2023-10-14T22:49:02.838 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.234438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442881.log 2023-10-14T22:49:02.839 INFO:teuthology.orchestra.run.smithi064.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.446381.log.gz 2023-10-14T22:49:02.839 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.435563.log.gz 2023-10-14T22:49:02.840 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102257.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.171986.log.gz 2023-10-14T22:49:02.840 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556356.log 2023-10-14T22:49:02.842 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.442881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.546234.log 2023-10-14T22:49:02.842 INFO:teuthology.orchestra.run.smithi064.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.141220.log.gz 2023-10-14T22:49:02.843 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.556356.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.178168.log.gz 2023-10-14T22:49:02.844 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.161838.log.gz 2023-10-14T22:49:02.844 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175080.log 2023-10-14T22:49:02.845 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.546234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229123.log 2023-10-14T22:49:02.846 INFO:teuthology.orchestra.run.smithi064.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.227321.log.gz 2023-10-14T22:49:02.847 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.175080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495166.log 2023-10-14T22:49:02.848 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.229123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299129.log 2023-10-14T22:49:02.850 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.495166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387849.log 2023-10-14T22:49:02.850 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.430734.log.gz 2023-10-14T22:49:02.851 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.299129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357807.log 2023-10-14T22:49:02.853 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.387849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430287.log 2023-10-14T22:49:02.854 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.357807.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.192682.log.gz 2023-10-14T22:49:02.855 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250279.log 2023-10-14T22:49:02.856 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.430287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185113.log 2023-10-14T22:49:02.858 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.250279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566872.log 2023-10-14T22:49:02.860 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.185113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.511544.log 2023-10-14T22:49:02.860 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.265367.log.gz 2023-10-14T22:49:02.861 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.243848.log.gz 2023-10-14T22:49:02.861 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.566872.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.566872.log.gz 2023-10-14T22:49:02.862 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164392.log 2023-10-14T22:49:02.862 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.511544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236656.log 2023-10-14T22:49:02.864 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.164392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520573.log 2023-10-14T22:49:02.865 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.236656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312084.log 2023-10-14T22:49:02.867 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.520573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528289.log 2023-10-14T22:49:02.867 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.194228.log.gz 2023-10-14T22:49:02.868 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.312084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220355.log 2023-10-14T22:49:02.870 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.528289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95008.log 2023-10-14T22:49:02.872 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.220355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.512950.log 2023-10-14T22:49:02.874 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230866.log 2023-10-14T22:49:02.875 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.512950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532262.log 2023-10-14T22:49:02.877 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.230866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210976.log 2023-10-14T22:49:02.877 INFO:teuthology.orchestra.run.smithi064.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.293468.log.gz 2023-10-14T22:49:02.878 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.532262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229985.log 2023-10-14T22:49:02.880 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.210976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290073.log 2023-10-14T22:49:02.881 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.229985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558437.log 2023-10-14T22:49:02.882 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0%/var/log/ceph/ceph-client.admin.290073.log: -- replaced with /var/log/ceph/ceph-client.admin.163138.log.gz 2023-10-14T22:49:02.883 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489865.log 2023-10-14T22:49:02.884 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.558437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149729.log 2023-10-14T22:49:02.886 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.489865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392993.log 2023-10-14T22:49:02.886 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.249039.log.gz 2023-10-14T22:49:02.887 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.149729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434722.log 2023-10-14T22:49:02.888 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.392993.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.252581.log.gz 2023-10-14T22:49:02.888 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.503834.log.gz 2023-10-14T22:49:02.889 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490708.log 2023-10-14T22:49:02.890 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.434722.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.288402.log.gz 2023-10-14T22:49:02.891 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239237.log 2023-10-14T22:49:02.891 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.522353.log.gz 2023-10-14T22:49:02.893 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.490708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366843.log 2023-10-14T22:49:02.894 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.239237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210559.log 2023-10-14T22:49:02.895 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.366843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.429869.log 2023-10-14T22:49:02.897 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.210559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94668.log 2023-10-14T22:49:02.898 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.429869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527866.log 2023-10-14T22:49:02.900 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461693.log 2023-10-14T22:49:02.902 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.527866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586630.log 2023-10-14T22:49:02.902 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.491985.log.gz 2023-10-14T22:49:02.903 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.461693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.432178.log 2023-10-14T22:49:02.903 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586630.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.586630.log.gz 2023-10-14T22:49:02.904 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.462518.log 2023-10-14T22:49:02.905 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.432178.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.526190.log.gz 2023-10-14T22:49:02.906 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.462518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191074.log 2023-10-14T22:49:02.907 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558019.log 2023-10-14T22:49:02.908 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102485.log.gz 2023-10-14T22:49:02.908 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.550083.log.gz 2023-10-14T22:49:02.909 INFO:teuthology.orchestra.run.smithi064.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.550500.log.gz 2023-10-14T22:49:02.909 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.191074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473147.log 2023-10-14T22:49:02.910 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.558019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565527.log 2023-10-14T22:49:02.912 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.473147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501680.log 2023-10-14T22:49:02.913 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.565527.log: gzip 80.4% -- replaced with /var/log/ceph/ceph-client.admin.565527.log.gz -5 2023-10-14T22:49:02.914 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.185952.log 2023-10-14T22:49:02.915 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.501680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359908.log 2023-10-14T22:49:02.916 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.185952.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-14T22:49:02.917 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.535710.log.gz 2023-10-14T22:49:02.918 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.359908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374787.log 2023-10-14T22:49:02.919 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101613.log 2023-10-14T22:49:02.921 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.374787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508371.log 2023-10-14T22:49:02.922 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400532.log 2023-10-14T22:49:02.924 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.508371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.431644.log 2023-10-14T22:49:02.925 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.400532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492414.log 2023-10-14T22:49:02.926 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.431644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515446.log 2023-10-14T22:49:02.928 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.492414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585967.log 2023-10-14T22:49:02.930 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.515446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428998.log 2023-10-14T22:49:02.931 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585967.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.585967.log.gz 2023-10-14T22:49:02.932 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.507396.log 2023-10-14T22:49:02.933 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.428998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193099.log 2023-10-14T22:49:02.934 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.507396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210133.log 2023-10-14T22:49:02.936 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.193099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.513859.log 2023-10-14T22:49:02.937 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.210133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534455.log 2023-10-14T22:49:02.938 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.513859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557192.log 2023-10-14T22:49:02.940 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.534455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532706.log 2023-10-14T22:49:02.941 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.557192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243010.log 2023-10-14T22:49:02.943 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.532706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94676.log 2023-10-14T22:49:02.944 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.243010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428568.log 2023-10-14T22:49:02.946 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535701.log 2023-10-14T22:49:02.947 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.428568.log: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.429869.log.gz 2023-10-14T22:49:02.947 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456626.log 2023-10-14T22:49:02.948 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.430287.log.gz 2023-10-14T22:49:02.949 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.535701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94678.log 2023-10-14T22:49:02.950 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.456626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.393856.log 2023-10-14T22:49:02.951 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.239237.log.gz 2023-10-14T22:49:02.951 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.367668.log.gz 2023-10-14T22:49:02.952 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94678.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.386878.log.gz 2023-10-14T22:49:02.952 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91787.log 2023-10-14T22:49:02.953 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.354468.log.gz 2023-10-14T22:49:02.953 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.393856.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.256795.log.gz 2023-10-14T22:49:02.954 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.432178.log.gz 2023-10-14T22:49:02.955 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586206.log 2023-10-14T22:49:02.955 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91787.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.299537.log.gz 2023-10-14T22:49:02.956 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.299129.log.gz 2023-10-14T22:49:02.956 INFO:teuthology.orchestra.run.smithi064.stderr:gzip 88.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.97575.log.gz --verbose 2023-10-14T22:49:02.956 INFO:teuthology.orchestra.run.smithi064.stderr: -- /var/log/ceph/ceph-client.admin.99885.log 2023-10-14T22:49:02.957 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.224258.log.gz 2023-10-14T22:49:02.957 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94678.log.gz 2023-10-14T22:49:02.958 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586206.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.586206.log.gz 2023-10-14T22:49:02.958 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555929.log 2023-10-14T22:49:02.960 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246407.log 2023-10-14T22:49:02.960 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.558019.log.gz 2023-10-14T22:49:02.960 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.556356.log.gz 2023-10-14T22:49:02.961 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.555929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185530.log 2023-10-14T22:49:02.961 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.392993.log.gz 2023-10-14T22:49:02.963 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.246407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518010.log 2023-10-14T22:49:02.963 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.185530.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.393856.log.gz 2023-10-14T22:49:02.964 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.491994.log 2023-10-14T22:49:02.964 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.290073.log.gz 2023-10-14T22:49:02.965 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.518010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579094.log 2023-10-14T22:49:02.966 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.514280.log.gz 2023-10-14T22:49:02.967 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.491994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.492907.log 2023-10-14T22:49:02.968 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.98638.log.gz 2023-10-14T22:49:02.968 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.579094.log: 79.5% -- replaced with /var/log/ceph/ceph-client.admin.579094.log.gz 2023-10-14T22:49:02.969 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270860.log 2023-10-14T22:49:02.971 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.492907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517182.log 2023-10-14T22:49:02.971 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.357807.log.gz 2023-10-14T22:49:02.972 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.270860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287567.log 2023-10-14T22:49:02.975 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.517182.log: /var/log/ceph/ceph-client.admin.287567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.517602.log 2023-10-14T22:49:02.975 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.565536.log.gz 2023-10-14T22:49:02.976 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.442881.log.gz 2023-10-14T22:49:02.977 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144473.log 2023-10-14T22:49:02.977 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.226455.log.gz 2023-10-14T22:49:02.977 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.517602.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.456626.log.gz 2023-10-14T22:49:02.979 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504659.log 2023-10-14T22:49:02.980 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.144473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185961.log 2023-10-14T22:49:02.981 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.93337.log.gz 2023-10-14T22:49:02.981 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.504659.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95008.log.gz 2023-10-14T22:49:02.982 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228651.log 2023-10-14T22:49:02.983 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.185961.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101613.log.gz 2023-10-14T22:49:02.984 INFO:teuthology.orchestra.run.smithi064.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101739.log.gz 2023-10-14T22:49:02.984 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552178.log 2023-10-14T22:49:02.985 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95423.log.gz 2023-10-14T22:49:02.985 INFO:teuthology.orchestra.run.smithi064.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.102215.log.gz 2023-10-14T22:49:02.985 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.228651.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102257.log.gz 2023-10-14T22:49:02.986 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158413.log 2023-10-14T22:49:02.987 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.164392.log.gz 2023-10-14T22:49:02.987 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.552178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264499.log 2023-10-14T22:49:02.988 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.158413.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.186880.log.gz 2023-10-14T22:49:02.988 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215920.log 2023-10-14T22:49:02.989 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.264499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403023.log 2023-10-14T22:49:02.991 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.215920.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.228651.log.gz 2023-10-14T22:49:02.991 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477636.log 2023-10-14T22:49:02.992 INFO:teuthology.orchestra.run.smithi064.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.434722.log.gz 2023-10-14T22:49:02.993 INFO:teuthology.orchestra.run.smithi064.stderr: 85.5%/var/log/ceph/ceph-client.admin.403023.log: -- replaced with /var/log/ceph/ceph-client.admin.230866.log.gz 2023-10-14T22:49:02.993 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565989.log 2023-10-14T22:49:02.994 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.477636.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.144473.log.gz 2023-10-14T22:49:02.995 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566452.log 2023-10-14T22:49:02.996 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.565989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95507.log 2023-10-14T22:49:02.996 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.185530.log.gz 2023-10-14T22:49:02.997 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.566452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580853.log 2023-10-14T22:49:02.998 INFO:teuthology.orchestra.run.smithi064.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.565989.log.gz 2023-10-14T22:49:02.998 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.566452.log.gz 2023-10-14T22:49:02.999 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548656.log 2023-10-14T22:49:03.000 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.288824.log.gz 2023-10-14T22:49:03.001 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.580853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515437.log 2023-10-14T22:49:03.003 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.548656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.526616.log 2023-10-14T22:49:03.003 INFO:teuthology.orchestra.run.smithi064.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.273663.log.gz 2023-10-14T22:49:03.004 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.580853.log.gz 2023-10-14T22:49:03.004 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.515437.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.285453.log.gz 2023-10-14T22:49:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389961.log 2023-10-14T22:49:03.005 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.526616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156703.log 2023-10-14T22:49:03.007 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.389961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510279.log 2023-10-14T22:49:03.008 INFO:teuthology.orchestra.run.smithi064.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.183396.log.gz 2023-10-14T22:49:03.008 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.168572.log.gz 2023-10-14T22:49:03.008 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.185952.log.gz 2023-10-14T22:49:03.009 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.156703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508362.log 2023-10-14T22:49:03.009 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.525773.log.gz 2023-10-14T22:49:03.010 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.491994.log.gz 2023-10-14T22:49:03.011 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.510279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583082.log 2023-10-14T22:49:03.011 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.508362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.534029.log 2023-10-14T22:49:03.013 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.583082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92033.log 2023-10-14T22:49:03.014 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.534029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577334.log 2023-10-14T22:49:03.016 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274556.log 2023-10-14T22:49:03.016 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.583082.log.gz 2023-10-14T22:49:03.017 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.577334.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.577334.log.gz 2023-10-14T22:49:03.018 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140199.log 2023-10-14T22:49:03.019 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.274556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97995.log 2023-10-14T22:49:03.020 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.140199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.442890.log 2023-10-14T22:49:03.021 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.439746.log 2023-10-14T22:49:03.023 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.442890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489457.log 2023-10-14T22:49:03.023 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.535701.log.gz 2023-10-14T22:49:03.024 INFO:teuthology.orchestra.run.smithi064.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.504659.log.gz 2023-10-14T22:49:03.024 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.439746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530009.log 2023-10-14T22:49:03.026 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.489457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452780.log 2023-10-14T22:49:03.027 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.530009.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586377.log 2023-10-14T22:49:03.028 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.452780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194910.log 2023-10-14T22:49:03.029 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586377.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.586377.log.gz 2023-10-14T22:49:03.030 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102173.log 2023-10-14T22:49:03.032 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.194910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.528298.log 2023-10-14T22:49:03.033 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.389970.log 2023-10-14T22:49:03.034 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.528298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.468082.log 2023-10-14T22:49:03.036 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.389970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573402.log 2023-10-14T22:49:03.037 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.468082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530874.log 2023-10-14T22:49:03.038 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.554686.log.gz 2023-10-14T22:49:03.039 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.573402.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438396.log 2023-10-14T22:49:03.039 INFO:teuthology.orchestra.run.smithi064.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.573402.log.gz 2023-10-14T22:49:03.040 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.530874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433420.log 2023-10-14T22:49:03.042 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.438396.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.523612.log.gz 2023-10-14T22:49:03.042 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459560.log 2023-10-14T22:49:03.043 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.433420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518438.log 2023-10-14T22:49:03.045 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.459560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302494.log 2023-10-14T22:49:03.046 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.518438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498578.log 2023-10-14T22:49:03.048 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.302494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313790.log 2023-10-14T22:49:03.048 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.526616.log.gz 2023-10-14T22:49:03.049 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.498578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559283.log 2023-10-14T22:49:03.051 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.313790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.375656.log 2023-10-14T22:49:03.052 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.559283.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.490708.log.gz 2023-10-14T22:49:03.053 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.492907.log.gz 2023-10-14T22:49:03.054 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98121.log 2023-10-14T22:49:03.055 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.375656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452363.log 2023-10-14T22:49:03.057 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141211.log 2023-10-14T22:49:03.058 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.534455.log.gz 2023-10-14T22:49:03.059 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.452363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520564.log 2023-10-14T22:49:03.060 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.141211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238811.log 2023-10-14T22:49:03.062 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.520564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450242.log 2023-10-14T22:49:03.063 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.238811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497742.log 2023-10-14T22:49:03.065 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.450242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380335.log 2023-10-14T22:49:03.066 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.497742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531290.log 2023-10-14T22:49:03.067 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.380335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385412.log 2023-10-14T22:49:03.069 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.531290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94345.log 2023-10-14T22:49:03.070 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.385412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100317.log 2023-10-14T22:49:03.072 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355295.log 2023-10-14T22:49:03.072 INFO:teuthology.orchestra.run.smithi177.stderr: 94.3% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T22:49:03.073 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441596.log 2023-10-14T22:49:03.075 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.355295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.502991.log 2023-10-14T22:49:03.076 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.441596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210967.log 2023-10-14T22:49:03.077 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.502991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239228.log 2023-10-14T22:49:03.078 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.210967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.544888.log 2023-10-14T22:49:03.080 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.239228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299546.log 2023-10-14T22:49:03.081 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.544888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506414.log 2023-10-14T22:49:03.082 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.91787.log.gz 2023-10-14T22:49:03.083 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.299546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149321.log 2023-10-14T22:49:03.084 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.506414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267026.log 2023-10-14T22:49:03.086 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.149321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529555.log 2023-10-14T22:49:03.087 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.267026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.392568.log 2023-10-14T22:49:03.088 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.529555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286301.log 2023-10-14T22:49:03.090 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.392568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255125.log 2023-10-14T22:49:03.091 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.286301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101655.log 2023-10-14T22:49:03.092 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.255125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.438813.log 2023-10-14T22:49:03.094 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247747.log 2023-10-14T22:49:03.095 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.438813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434282.log 2023-10-14T22:49:03.097 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.247747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95759.log 2023-10-14T22:49:03.097 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.92033.log.gz 2023-10-14T22:49:03.098 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.434282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182983.log 2023-10-14T22:49:03.099 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95759.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.403981.log.gz 2023-10-14T22:49:03.100 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240914.log 2023-10-14T22:49:03.101 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.182983.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.302494.log.gz 2023-10-14T22:49:03.101 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145453.log 2023-10-14T22:49:03.103 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.240914.log: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.270860.log.gz 2023-10-14T22:49:03.103 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293890.log 2023-10-14T22:49:03.104 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.294298.log.gz 2023-10-14T22:49:03.105 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.145453.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.312529.log.gz 2023-10-14T22:49:03.105 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.506895.log 2023-10-14T22:49:03.106 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.360746.log.gz 2023-10-14T22:49:03.106 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.293890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582164.log 2023-10-14T22:49:03.108 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.506895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.489448.log 2023-10-14T22:49:03.109 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.582164.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.582164.log.gz 2023-10-14T22:49:03.110 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360755.log 2023-10-14T22:49:03.110 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.389961.log.gz 2023-10-14T22:49:03.110 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.389970.log.gz 2023-10-14T22:49:03.111 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.489448.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.392568.log.gz 2023-10-14T22:49:03.112 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253416.log 2023-10-14T22:49:03.112 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.360755.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99885.log.gz 2023-10-14T22:49:03.113 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- 85.0% /var/log/ceph/ceph-client.admin.226901.log 2023-10-14T22:49:03.113 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.438396.log.gz 2023-10-14T22:49:03.115 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.253416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184279.log 2023-10-14T22:49:03.116 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.226901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99659.log 2023-10-14T22:49:03.116 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.234438.log.gz 2023-10-14T22:49:03.117 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.184279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540049.log 2023-10-14T22:49:03.119 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283227.log 2023-10-14T22:49:03.120 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.540049.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.450242.log.gz 2023-10-14T22:49:03.121 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.508854.log 2023-10-14T22:49:03.122 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.283227.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-14T22:49:03.124 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.508854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396918.log 2023-10-14T22:49:03.125 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473569.log 2023-10-14T22:49:03.126 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95507.log.gz 2023-10-14T22:49:03.127 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.396918.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.176338.log.gz 2023-10-14T22:49:03.127 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99843.log 2023-10-14T22:49:03.129 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.473569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212237.log 2023-10-14T22:49:03.129 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.359500.log.gz 2023-10-14T22:49:03.130 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300382.log 2023-10-14T22:49:03.132 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.212237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494281.log 2023-10-14T22:49:03.133 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.191690.log.gz 2023-10-14T22:49:03.133 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.300382.log: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.215920.log.gz 2023-10-14T22:49:03.134 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256378.log 2023-10-14T22:49:03.135 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.260957.log.gz 2023-10-14T22:49:03.135 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.247756.log.gz 2023-10-14T22:49:03.136 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.494281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586462.log 2023-10-14T22:49:03.136 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.515437.log.gz 2023-10-14T22:49:03.137 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.256378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356565.log 2023-10-14T22:49:03.137 INFO:teuthology.orchestra.run.smithi064.stderr: 79.1% -- replaced with /var/log/ceph/ceph-client.admin.266193.log.gz 2023-10-14T22:49:03.138 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586462.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.586462.log.gz 2023-10-14T22:49:03.139 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230421.log 2023-10-14T22:49:03.140 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.356565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.397814.log 2023-10-14T22:49:03.142 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.230421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494290.log 2023-10-14T22:49:03.143 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.397814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95675.log 2023-10-14T22:49:03.144 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.494290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.446390.log 2023-10-14T22:49:03.146 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191699.log 2023-10-14T22:49:03.147 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.446390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.499427.log 2023-10-14T22:49:03.148 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.191699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269613.log 2023-10-14T22:49:03.150 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.499427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384973.log 2023-10-14T22:49:03.150 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.530874.log.gz 2023-10-14T22:49:03.151 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.531290.log.gz 2023-10-14T22:49:03.152 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.269613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251979.log 2023-10-14T22:49:03.153 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.384973.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.506895.log.gz 2023-10-14T22:49:03.153 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.459153.log 2023-10-14T22:49:03.154 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.251979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.451121.log 2023-10-14T22:49:03.154 INFO:teuthology.orchestra.run.smithi064.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.194910.log.gz 2023-10-14T22:49:03.155 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.459153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371455.log 2023-10-14T22:49:03.157 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.451121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.398291.log 2023-10-14T22:49:03.159 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.371455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505566.log 2023-10-14T22:49:03.160 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.398291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230430.log 2023-10-14T22:49:03.162 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.505566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173791.log 2023-10-14T22:49:03.164 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.230430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297869.log 2023-10-14T22:49:03.165 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.173791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578214.log 2023-10-14T22:49:03.167 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.297869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399144.log 2023-10-14T22:49:03.168 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.578214.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.578214.log.gz 2023-10-14T22:49:03.169 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364122.log 2023-10-14T22:49:03.170 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.399144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184704.log 2023-10-14T22:49:03.171 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.364122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.376985.log 2023-10-14T22:49:03.173 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.184704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577343.log 2023-10-14T22:49:03.174 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.376985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245103.log 2023-10-14T22:49:03.177 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.577343.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.559283.log.gz 2023-10-14T22:49:03.178 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.245103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296210.log 2023-10-14T22:49:03.179 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.460400.log 2023-10-14T22:49:03.179 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.577343.log.gz 2023-10-14T22:49:03.181 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.296210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567713.log 2023-10-14T22:49:03.182 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.460400.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.256378.log.gz 2023-10-14T22:49:03.182 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390817.log 2023-10-14T22:49:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.567713.log: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.567713.log.gz 2023-10-14T22:49:03.184 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585433.log 2023-10-14T22:49:03.184 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.300382.log.gz 2023-10-14T22:49:03.185 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.390817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443951.log 2023-10-14T22:49:03.187 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585433.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.585433.log.gz 2023-10-14T22:49:03.187 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255134.log 2023-10-14T22:49:03.189 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524030.log 2023-10-14T22:49:03.190 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.255134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144482.log 2023-10-14T22:49:03.192 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.524030.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98247.log 2023-10-14T22:49:03.193 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.144482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.298295.log 2023-10-14T22:49:03.195 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255552.log 2023-10-14T22:49:03.196 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.298295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313368.log 2023-10-14T22:49:03.198 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.255552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568883.log 2023-10-14T22:49:03.199 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.313368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219413.log 2023-10-14T22:49:03.201 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.568883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356973.log 2023-10-14T22:49:03.202 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.219413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369381.log 2023-10-14T22:49:03.204 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.356973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428989.log 2023-10-14T22:49:03.205 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.369381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279595.log 2023-10-14T22:49:03.206 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.428989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223424.log 2023-10-14T22:49:03.207 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92119.log.gz 2023-10-14T22:49:03.208 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.279595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.519273.log 2023-10-14T22:49:03.209 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.223424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166894.log 2023-10-14T22:49:03.210 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.519273.log: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.434282.log.gz 2023-10-14T22:49:03.211 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.361590.log 2023-10-14T22:49:03.212 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.166894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477223.log 2023-10-14T22:49:03.214 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.361590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274130.log 2023-10-14T22:49:03.215 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.477223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575584.log 2023-10-14T22:49:03.217 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.274130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294307.log 2023-10-14T22:49:03.217 INFO:teuthology.orchestra.run.smithi064.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.555929.log.gz 2023-10-14T22:49:03.218 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.575584.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.428989.log.gz 2023-10-14T22:49:03.218 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95717.log 2023-10-14T22:49:03.220 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.294307.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.293890.log.gz 2023-10-14T22:49:03.220 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.461684.log 2023-10-14T22:49:03.221 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95717.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.575584.log.gz 2023-10-14T22:49:03.222 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252999.log 2023-10-14T22:49:03.224 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.461684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262827.log 2023-10-14T22:49:03.224 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.552169.log.gz 2023-10-14T22:49:03.224 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.550926.log.gz 2023-10-14T22:49:03.225 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.252999.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.552178.log.gz 2023-10-14T22:49:03.225 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359069.log 2023-10-14T22:49:03.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.262827.log: gzip 77.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.393847.log.gz -- 2023-10-14T22:49:03.227 INFO:teuthology.orchestra.run.smithi064.stderr: /var/log/ceph/ceph-client.admin.97389.log 2023-10-14T22:49:03.227 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.359069.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.396918.log.gz 2023-10-14T22:49:03.228 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246416.log 2023-10-14T22:49:03.229 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.267452.log.gz 2023-10-14T22:49:03.230 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445537.log 2023-10-14T22:49:03.231 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.246416.log: 89.3% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.92565.log.gz -- replaced with /var/log/ceph/ceph-client.admin.458300.log.gz 2023-10-14T22:49:03.231 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:03.232 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171995.log 2023-10-14T22:49:03.233 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.445537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95633.log 2023-10-14T22:49:03.234 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.171995.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.253416.log.gz 2023-10-14T22:49:03.235 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443584.log 2023-10-14T22:49:03.236 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.95633.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.269613.log.gz 2023-10-14T22:49:03.237 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-14T22:49:03.238 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.532968.log 2023-10-14T22:49:03.238 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.357816.log.gz 2023-10-14T22:49:03.239 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.494703.log 2023-10-14T22:49:03.242 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.532968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478469.log 2023-10-14T22:49:03.243 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.494703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280843.log 2023-10-14T22:49:03.244 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.219413.log.gz 2023-10-14T22:49:03.245 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.478469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436407.log 2023-10-14T22:49:03.246 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.280843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270023.log 2023-10-14T22:49:03.247 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.436407.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.248613.log.gz 2023-10-14T22:49:03.248 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.452789.log 2023-10-14T22:49:03.249 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.270023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565078.log 2023-10-14T22:49:03.250 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.252999.log.gz 2023-10-14T22:49:03.251 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.452789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159692.log 2023-10-14T22:49:03.253 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.565078.log: 92.1% 80.8% -- replaced with /var/log/ceph/ceph-client.admin.565078.log.gz 2023-10-14T22:49:03.253 INFO:teuthology.orchestra.run.smithi064.stderr:gzip 77.4% -- replaced with /var/log/ceph/ceph-client.admin.364122.log.gz -5 2023-10-14T22:49:03.253 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.173338.log 2023-10-14T22:49:03.254 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.156703.log.gz 2023-10-14T22:49:03.254 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.159692.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.369797.log.gz 2023-10-14T22:49:03.255 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170258.log 2023-10-14T22:49:03.256 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.173338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473983.log 2023-10-14T22:49:03.257 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.170258.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.245103.log.gz 2023-10-14T22:49:03.258 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94970.log 2023-10-14T22:49:03.258 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.274965.log.gz 2023-10-14T22:49:03.259 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.473983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93977.log 2023-10-14T22:49:03.261 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94970.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.451946.log.gz 2023-10-14T22:49:03.261 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101911.log 2023-10-14T22:49:03.262 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581293.log 2023-10-14T22:49:03.264 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229559.log 2023-10-14T22:49:03.265 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.581293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209711.log 2023-10-14T22:49:03.269 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.229559.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-14T22:49:03.269 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.181704.log.gz 2023-10-14T22:49:03.269 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.209711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387359.log 2023-10-14T22:49:03.269 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.581293.log.gz 2023-10-14T22:49:03.270 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476136.log 2023-10-14T22:49:03.272 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.387359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516690.log 2023-10-14T22:49:03.272 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.185961.log.gz 2023-10-14T22:49:03.273 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94061.log 2023-10-14T22:49:03.275 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.516690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211398.log 2023-10-14T22:49:03.276 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94963.log 2023-10-14T22:49:03.278 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.211398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91939.log 2023-10-14T22:49:03.279 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.400082.log 2023-10-14T22:49:03.281 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579533.log 2023-10-14T22:49:03.282 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.400082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.473992.log 2023-10-14T22:49:03.284 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.579533.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.579533.log.gzgzip 2023-10-14T22:49:03.284 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.375647.log 2023-10-14T22:49:03.286 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.473992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498160.log 2023-10-14T22:49:03.287 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.375647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163559.log 2023-10-14T22:49:03.289 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.498160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.447268.log 2023-10-14T22:49:03.290 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.163559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586924.log 2023-10-14T22:49:03.292 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.447268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353211.log 2023-10-14T22:49:03.294 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586924.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.496053.log.gz 2023-10-14T22:49:03.294 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.535291.log 2023-10-14T22:49:03.295 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.586924.log.gz 2023-10-14T22:49:03.295 INFO:teuthology.orchestra.run.smithi064.stderr: 89.4% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-14T22:49:03.295 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.496062.log.gz 2023-10-14T22:49:03.297 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.353211.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.499958.log.gz 2023-10-14T22:49:03.297 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.499967.log.gz -5 2023-10-14T22:49:03.297 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.93893.log 2023-10-14T22:49:03.297 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.535291.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.518010.log.gz 2023-10-14T22:49:03.298 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.517602.log.gzgzip 2023-10-14T22:49:03.298 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.583542.log 2023-10-14T22:49:03.299 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93893.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.519273.log.gz 2023-10-14T22:49:03.299 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92373.log 2023-10-14T22:49:03.300 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.513377.log.gz 2023-10-14T22:49:03.300 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.583542.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-14T22:49:03.301 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.494281.log.gz 2023-10-14T22:49:03.302 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564629.log 2023-10-14T22:49:03.304 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98864.log 2023-10-14T22:49:03.306 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.564629.log: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.583542.log.gz 2023-10-14T22:49:03.307 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.564629.log.gz 2023-10-14T22:49:03.307 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443729.log 2023-10-14T22:49:03.308 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92161.log 2023-10-14T22:49:03.308 INFO:teuthology.orchestra.run.smithi064.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.489448.log.gz 2023-10-14T22:49:03.309 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363689.log 2023-10-14T22:49:03.309 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.498160.log.gz 2023-10-14T22:49:03.310 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.100233.log.gz 2023-10-14T22:49:03.311 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.102912.log 2023-10-14T22:49:03.312 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.363689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550917.log 2023-10-14T22:49:03.312 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.540049.log.gz 2023-10-14T22:49:03.313 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.0.102912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569964.log 2023-10-14T22:49:03.314 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.550917.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.297869.log.gz 2023-10-14T22:49:03.315 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185122.log 2023-10-14T22:49:03.316 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.569964.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.569964.log.gz 2023-10-14T22:49:03.317 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145444.log 2023-10-14T22:49:03.317 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.264499.log.gz 2023-10-14T22:49:03.318 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.185122.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.240914.log.gz 2023-10-14T22:49:03.318 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495583.log 2023-10-14T22:49:03.320 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.145444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216349.log 2023-10-14T22:49:03.320 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.353211.log.gz 2023-10-14T22:49:03.321 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.495583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569547.log 2023-10-14T22:49:03.322 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.216349.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.368952.log.gz 2023-10-14T22:49:03.323 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.501226.log 2023-10-14T22:49:03.324 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.569547.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.377403.log.gz 2023-10-14T22:49:03.324 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248622.log 2023-10-14T22:49:03.325 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.569547.log.gz 2023-10-14T22:49:03.326 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.501226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.436398.log 2023-10-14T22:49:03.327 INFO:teuthology.orchestra.run.smithi064.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.445537.log.gz 2023-10-14T22:49:03.327 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.248622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529137.log 2023-10-14T22:49:03.329 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.436398.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.521002.log.gz 2023-10-14T22:49:03.329 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.181230.log 2023-10-14T22:49:03.331 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.529137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.581724.log 2023-10-14T22:49:03.331 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92161.log.gz 2023-10-14T22:49:03.332 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92373.log.gz 2023-10-14T22:49:03.332 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.181230.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.298286.log.gz 2023-10-14T22:49:03.333 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586882.log 2023-10-14T22:49:03.333 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.581724.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.93935.log.gz 2023-10-14T22:49:03.334 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.93977.log.gz 2023-10-14T22:49:03.334 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.581724.log.gz 2023-10-14T22:49:03.335 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.490699.log 2023-10-14T22:49:03.336 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478478.log 2023-10-14T22:49:03.336 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.586882.log.gz 2023-10-14T22:49:03.336 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.255552.log.gz 2023-10-14T22:49:03.337 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.274130.log.gz 2023-10-14T22:49:03.337 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.490699.log: gzip -5 --verbose -- 87.6% /var/log/ceph/ceph-client.admin.512478.log 2023-10-14T22:49:03.338 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.94061.log.gz 2023-10-14T22:49:03.339 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.478478.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94343.log.gz 2023-10-14T22:49:03.339 INFO:teuthology.orchestra.run.smithi064.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.390391.log.gz 2023-10-14T22:49:03.339 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.520993.log 2023-10-14T22:49:03.341 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.512478.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.436407.log.gz 2023-10-14T22:49:03.341 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.436398.log.gz 2023-10-14T22:49:03.341 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.93893.log.gz 2023-10-14T22:49:03.342 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98468.log 2023-10-14T22:49:03.346 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.520993.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94970.log.gz 2023-10-14T22:49:03.347 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195355.log 2023-10-14T22:49:03.347 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.95013.log.gz -- replaced with /var/log/ceph/ceph-client.admin.94963.log.gz 2023-10-14T22:49:03.347 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:03.348 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93437.log 2023-10-14T22:49:03.348 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5%/var/log/ceph/ceph-client.admin.195355.log: -- replaced with /var/log/ceph/ceph-client.admin.101867.log.gz 2023-10-14T22:49:03.348 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.518429.log 2023-10-14T22:49:03.348 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93437.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.390817.log.gz 2023-10-14T22:49:03.350 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365922.log 2023-10-14T22:49:03.350 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.518429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270442.log 2023-10-14T22:49:03.351 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.365922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100821.log 2023-10-14T22:49:03.352 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.270442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290912.log 2023-10-14T22:49:03.353 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559722.log 2023-10-14T22:49:03.355 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.290912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278279.log 2023-10-14T22:49:03.356 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.559722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403990.log 2023-10-14T22:49:03.357 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.278279.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.280843.log.gz 2023-10-14T22:49:03.358 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169419.log 2023-10-14T22:49:03.359 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.403990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274139.log 2023-10-14T22:49:03.361 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.169419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250288.log 2023-10-14T22:49:03.362 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.274139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564178.log 2023-10-14T22:49:03.364 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.250288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192139.log 2023-10-14T22:49:03.365 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.564178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503825.log 2023-10-14T22:49:03.366 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.181230.log.gz 2023-10-14T22:49:03.367 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.192139.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248164.log 2023-10-14T22:49:03.368 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.503825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164809.log 2023-10-14T22:49:03.369 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.174217.log.gz 2023-10-14T22:49:03.371 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.248164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378230.log 2023-10-14T22:49:03.371 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.145444.log.gz 2023-10-14T22:49:03.372 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.164809.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.151034.log.gz 2023-10-14T22:49:03.375 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.401004.log 85.3% -- replaced with /var/log/ceph/ceph-client.admin.159692.log.gz 2023-10-14T22:49:03.375 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:03.376 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.378230.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.195355.log.gz 2023-10-14T22:49:03.376 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267035.log 2023-10-14T22:49:03.376 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.401004.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.229559.log.gz 2023-10-14T22:49:03.376 INFO:teuthology.orchestra.run.smithi064.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.234429.log.gz 2023-10-14T22:49:03.378 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362422.log 2023-10-14T22:49:03.378 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.229568.log.gz 2023-10-14T22:49:03.378 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.267035.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.261431.log.gz 2023-10-14T22:49:03.378 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224675.log 2023-10-14T22:49:03.379 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.248622.log.gz 2023-10-14T22:49:03.379 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.516281.log.gz 2023-10-14T22:49:03.380 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.362422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214951.log 2023-10-14T22:49:03.381 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.224675.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.390808.log 2023-10-14T22:49:03.383 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.214951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93563.log 2023-10-14T22:49:03.384 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.390808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.504251.log 2023-10-14T22:49:03.384 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.185122.log.gz 2023-10-14T22:49:03.385 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93563.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.216349.log.gz 2023-10-14T22:49:03.385 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.221262.log.gz 2023-10-14T22:49:03.386 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.297878.log 2023-10-14T22:49:03.387 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.504251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.493864.log 2023-10-14T22:49:03.389 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.297878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190661.log 2023-10-14T22:49:03.390 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.493864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403509.log 2023-10-14T22:49:03.392 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.190661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101443.log 2023-10-14T22:49:03.394 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.403509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292193.log 2023-10-14T22:49:03.395 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.529137.log.gz 2023-10-14T22:49:03.397 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101443.log: /var/log/ceph/ceph-client.admin.292193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225548.log 2023-10-14T22:49:03.399 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101487.log 2023-10-14T22:49:03.401 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.225548.log: /var/log/ceph/ceph-client.admin.101487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587050.log 2023-10-14T22:49:03.402 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.490699.log.gz 2023-10-14T22:49:03.403 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281738.log 2023-10-14T22:49:03.404 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.587050.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.587050.log.gz 2023-10-14T22:49:03.405 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99575.log 2023-10-14T22:49:03.406 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.281738.log: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.520146.log.gz 2023-10-14T22:49:03.407 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160942.log 2023-10-14T22:49:03.407 INFO:teuthology.orchestra.run.smithi064.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.520993.log.gz 2023-10-14T22:49:03.408 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.505995.log 2023-10-14T22:49:03.409 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.535291.log.gz 2023-10-14T22:49:03.409 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.160942.log: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.503825.log.gz 2023-10-14T22:49:03.410 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.504251.log.gz 2023-10-14T22:49:03.410 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572559.log 2023-10-14T22:49:03.412 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.505995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362847.log 2023-10-14T22:49:03.413 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.572559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233538.log 2023-10-14T22:49:03.414 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.572559.log.gz 2023-10-14T22:49:03.415 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.362847.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372287.log 2023-10-14T22:49:03.417 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.233538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448980.log 2023-10-14T22:49:03.418 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.372287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.478052.log 2023-10-14T22:49:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.448980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.515854.log 2023-10-14T22:49:03.421 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.478052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.365088.log 2023-10-14T22:49:03.423 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.515854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.456617.log 2023-10-14T22:49:03.425 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.365088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92247.log 2023-10-14T22:49:03.426 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.456617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572980.log 2023-10-14T22:49:03.427 INFO:teuthology.orchestra.run.smithi064.stderr: 79.4%/var/log/ceph/ceph-client.admin.92247.log: -- replaced with /var/log/ceph/ceph-client.admin.270023.log.gz 2023-10-14T22:49:03.428 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575575.log 2023-10-14T22:49:03.429 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.572980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510701.log 2023-10-14T22:49:03.430 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.572980.log.gz 2023-10-14T22:49:03.431 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.575575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395524.log 2023-10-14T22:49:03.431 INFO:teuthology.orchestra.run.smithi064.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.575575.log.gz 2023-10-14T22:49:03.433 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.510701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217248.log 2023-10-14T22:49:03.434 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.395524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.550092.log 2023-10-14T22:49:03.435 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.217248.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.560589.log.gz 2023-10-14T22:49:03.436 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296201.log 2023-10-14T22:49:03.437 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.550092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571660.log 2023-10-14T22:49:03.439 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.296201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300373.log 2023-10-14T22:49:03.440 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.571660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271756.log 2023-10-14T22:49:03.442 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.300373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.530458.log 2023-10-14T22:49:03.443 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.271756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.402521.log 2023-10-14T22:49:03.444 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.571660.log.gz 2023-10-14T22:49:03.445 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.530458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182132.log 2023-10-14T22:49:03.447 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.402521.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.532968.log.gz 2023-10-14T22:49:03.447 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257632.log 2023-10-14T22:49:03.448 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.182132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559731.log 2023-10-14T22:49:03.449 INFO:teuthology.orchestra.run.smithi064.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.477636.log.gz 2023-10-14T22:49:03.450 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.257632.log: gzip 85.8% -- replaced with /var/log/ceph/ceph-client.admin.478469.log.gz -5 2023-10-14T22:49:03.450 INFO:teuthology.orchestra.run.smithi064.stderr: --verbose -- /var/log/ceph/ceph-client.admin.551752.log 2023-10-14T22:49:03.452 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.559731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143636.log 2023-10-14T22:49:03.453 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.551752.log: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.495583.log.gz 2023-10-14T22:49:03.454 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.380756.log 2023-10-14T22:49:03.455 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.143636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.453207.log 2023-10-14T22:49:03.456 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.380756.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.544879.log.gz 2023-10-14T22:49:03.457 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101115.log 2023-10-14T22:49:03.457 INFO:teuthology.orchestra.run.smithi064.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.546225.log.gz 2023-10-14T22:49:03.458 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.257632.log.gz 2023-10-14T22:49:03.458 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.453207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87660.log 2023-10-14T22:49:03.459 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99575.log.gz 2023-10-14T22:49:03.460 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100821.log.gz 2023-10-14T22:49:03.460 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.101115.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.100947.log.gz 2023-10-14T22:49:03.460 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.367251.log 2023-10-14T22:49:03.461 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.365922.log.gz 2023-10-14T22:49:03.462 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.87660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100089.log 2023-10-14T22:49:03.462 INFO:teuthology.orchestra.run.smithi064.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.378230.log.gz 2023-10-14T22:49:03.464 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.367251.log: 80.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295367.log 2023-10-14T22:49:03.464 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.267035.log.gz 2023-10-14T22:49:03.465 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100089.log: -- replaced with /var/log/ceph/ceph-client.admin.300373.log.gz 2023-10-14T22:49:03.466 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582614.log 2023-10-14T22:49:03.468 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.295367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364639.log 2023-10-14T22:49:03.470 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.582614.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.380756.log.gz 2023-10-14T22:49:03.471 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.364639.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.403509.log.gz 2023-10-14T22:49:03.472 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293459.log 2023-10-14T22:49:03.473 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.582614.log.gz 2023-10-14T22:49:03.473 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585348.log 2023-10-14T22:49:03.475 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.293459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.455746.log 2023-10-14T22:49:03.475 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98468.log.gz 2023-10-14T22:49:03.476 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.585348.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.390808.log.gz 2023-10-14T22:49:03.477 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.585348.log.gz 2023-10-14T22:49:03.477 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.513850.log.gz 2023-10-14T22:49:03.478 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.455746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450700.log 2023-10-14T22:49:03.479 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.472730.log.gz 2023-10-14T22:49:03.480 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.450700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244676.log 2023-10-14T22:49:03.481 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.501680.log.gz 2023-10-14T22:49:03.482 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose 80.3% -- -- replaced with /var/log/ceph/ceph-client.admin.502533.log.gz /var/log/ceph/ceph-client.admin.447690.log 2023-10-14T22:49:03.482 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:03.484 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.244676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.399674.log 2023-10-14T22:49:03.484 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.510279.log.gz 2023-10-14T22:49:03.485 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.447690.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.463357.log.gz 2023-10-14T22:49:03.485 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.512478.log.gz 2023-10-14T22:49:03.486 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.296627.log 2023-10-14T22:49:03.486 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.399674.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101487.log.gz 2023-10-14T22:49:03.487 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% 80.6% -- replaced with /var/log/ceph/ceph-client.admin.150617.log.gz -- replaced with /var/log/ceph/ceph-client.admin.102401.log.gz 2023-10-14T22:49:03.487 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:03.488 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.164809.log.gz 2023-10-14T22:49:03.489 INFO:teuthology.orchestra.run.smithi064.stderr:gzip 80.6% -- replaced with /var/log/ceph/ceph-client.admin.151451.log.gz 2023-10-14T22:49:03.490 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.446812.log/var/log/ceph/ceph-client.admin.296627.log: 2023-10-14T22:49:03.490 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.183855.log.gz 2023-10-14T22:49:03.490 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.194493.log.gz 2023-10-14T22:49:03.490 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.217248.log.gz 2023-10-14T22:49:03.491 INFO:teuthology.orchestra.run.smithi064.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.245094.log.gz 2023-10-14T22:49:03.491 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.246852.log.gz 2023-10-14T22:49:03.492 INFO:teuthology.orchestra.run.smithi064.stderr:gzip 89.9% -- replaced with /var/log/ceph/ceph-client.admin.194502.log.gz 2023-10-14T22:49:03.492 INFO:teuthology.orchestra.run.smithi064.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.368511.log 2023-10-14T22:49:03.493 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.446812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211815.log 2023-10-14T22:49:03.494 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.368511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.525353.log 2023-10-14T22:49:03.495 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.211815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178177.log 2023-10-14T22:49:03.497 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.525353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251548.log 2023-10-14T22:49:03.499 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.178177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.540058.log 2023-10-14T22:49:03.500 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.251548.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.559731.log.gz 2023-10-14T22:49:03.500 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.516272.log 2023-10-14T22:49:03.502 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.540058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254250.log 2023-10-14T22:49:03.503 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.516272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433869.log 2023-10-14T22:49:03.504 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.557183.log.gz 2023-10-14T22:49:03.505 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.254250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569116.log 2023-10-14T22:49:03.506 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.433869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141649.log 2023-10-14T22:49:03.508 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.569116.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.569116.log.gz 2023-10-14T22:49:03.509 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448989.log 2023-10-14T22:49:03.510 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.141649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488529.log 2023-10-14T22:49:03.512 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.448989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364131.log 2023-10-14T22:49:03.513 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.488529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496912.log 2023-10-14T22:49:03.515 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.364131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443623.log 2023-10-14T22:49:03.516 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.496912.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.497325.log.gz 2023-10-14T22:49:03.516 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568137.log 2023-10-14T22:49:03.518 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.443623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100485.log 2023-10-14T22:49:03.520 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.568137.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.568137.log.gz 2023-10-14T22:49:03.520 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.549825.log 2023-10-14T22:49:03.521 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162303.log 2023-10-14T22:49:03.523 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.549825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573819.log 2023-10-14T22:49:03.525 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.162303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92415.log 2023-10-14T22:49:03.526 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.573819.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.573819.log.gz 2023-10-14T22:49:03.526 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213077.log 2023-10-14T22:49:03.528 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566443.log 2023-10-14T22:49:03.530 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.213077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.536126.log 2023-10-14T22:49:03.531 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.566443.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.566443.log.gz 2023-10-14T22:49:03.531 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94325.log 2023-10-14T22:49:03.533 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.536126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301214.log 2023-10-14T22:49:03.534 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.474429.log 2023-10-14T22:49:03.536 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.301214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.369372.log 2023-10-14T22:49:03.538 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.474429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.497751.log 2023-10-14T22:49:03.540 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.369372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.475275.log 2023-10-14T22:49:03.541 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.497751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.366329.log 2023-10-14T22:49:03.543 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.475275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354877.log 2023-10-14T22:49:03.545 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.366329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99801.log 2023-10-14T22:49:03.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.354877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175921.log 2023-10-14T22:49:03.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448112.log 2023-10-14T22:49:03.551 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.175921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524880.log 2023-10-14T22:49:03.552 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.448112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186426.log 2023-10-14T22:49:03.552 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.524880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357390.log 2023-10-14T22:49:03.554 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.186426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99288.log 2023-10-14T22:49:03.555 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.357390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.450691.log 2023-10-14T22:49:03.557 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.99288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.529128.log 2023-10-14T22:49:03.558 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.450691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.364630.log 2023-10-14T22:49:03.560 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.529128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570403.log 2023-10-14T22:49:03.562 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.364630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213086.log 2023-10-14T22:49:03.563 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.570403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285879.log 2023-10-14T22:49:03.564 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.570403.log.gz 2023-10-14T22:49:03.564 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.213086.log: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.550917.log.gz 2023-10-14T22:49:03.565 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98822.log 2023-10-14T22:49:03.566 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.285879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555511.log 2023-10-14T22:49:03.568 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.531716.log 2023-10-14T22:49:03.569 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.555511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245961.log 2023-10-14T22:49:03.571 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.531716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.264081.log 2023-10-14T22:49:03.572 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.245961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.533190.log 2023-10-14T22:49:03.574 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.264081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.522761.log 2023-10-14T22:49:03.575 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.530458.log.gz 2023-10-14T22:49:03.576 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.533190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194237.log 2023-10-14T22:49:03.577 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.442041.log.gz 2023-10-14T22:49:03.577 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.522761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174639.log 2023-10-14T22:49:03.579 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.194237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.391261.log 2023-10-14T22:49:03.580 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.453207.log.gz 2023-10-14T22:49:03.580 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.174639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260509.log 2023-10-14T22:49:03.581 INFO:teuthology.orchestra.run.smithi064.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.362422.log.gz 2023-10-14T22:49:03.582 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.391261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249446.log 2023-10-14T22:49:03.584 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.260509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.374796.log 2023-10-14T22:49:03.585 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.249446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94340.log 2023-10-14T22:49:03.587 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.374796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91897.log 2023-10-14T22:49:03.588 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.274139.log.gz 2023-10-14T22:49:03.588 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.94340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578223.log 2023-10-14T22:49:03.590 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.91897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303780.log 2023-10-14T22:49:03.592 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.578223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314628.log 2023-10-14T22:49:03.592 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.213502.log.gz 2023-10-14T22:49:03.594 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.303780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311582.log 2023-10-14T22:49:03.594 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.98121.log.gz 2023-10-14T22:49:03.595 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.314628.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.578223.log.gz 2023-10-14T22:49:03.595 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.495592.log 2023-10-14T22:49:03.597 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.311582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93605.log 2023-10-14T22:49:03.597 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.475275.log.gz 2023-10-14T22:49:03.598 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.495592.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.262827.log.gz 2023-10-14T22:49:03.599 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.477214.log 2023-10-14T22:49:03.600 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92499.log 2023-10-14T22:49:03.601 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.477214.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.362847.log.gz 2023-10-14T22:49:03.602 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213493.log 2023-10-14T22:49:03.603 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.92499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210550.log 2023-10-14T22:49:03.604 INFO:teuthology.orchestra.run.smithi064.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.374370.log.gz 2023-10-14T22:49:03.605 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.213493.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.401004.log.gz 2023-10-14T22:49:03.605 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237973.log 2023-10-14T22:49:03.606 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.399674.log.gz 2023-10-14T22:49:03.606 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.210550.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.100089.log.gz 2023-10-14T22:49:03.607 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.371464.log 2023-10-14T22:49:03.608 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.237973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.476145.log 2023-10-14T22:49:03.609 INFO:teuthology.orchestra.run.smithi064.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.101115.log.gz 2023-10-14T22:49:03.609 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.371464.log: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.253824.log.gz 2023-10-14T22:49:03.610 INFO:teuthology.orchestra.run.smithi064.stderr: 81.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97617.log 2023-10-14T22:49:03.611 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.368502.log.gz 2023-10-14T22:49:03.611 INFO:teuthology.orchestra.run.smithi064.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.369372.log.gz 2023-10-14T22:49:03.612 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.476145.log: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.447259.log.gz 2023-10-14T22:49:03.612 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237982.log 2023-10-14T22:49:03.613 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.314628.log.gz 2023-10-14T22:49:03.614 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97617.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.278279.log.gz 2023-10-14T22:49:03.614 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278270.log 2023-10-14T22:49:03.614 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.293459.log.gz 2023-10-14T22:49:03.615 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.446812.log.gz 2023-10-14T22:49:03.616 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.237982.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.391261.log.gz 2023-10-14T22:49:03.616 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.287984.log.gz 2023-10-14T22:49:03.616 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553850.log 2023-10-14T22:49:03.617 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.450691.log.gz 2023-10-14T22:49:03.618 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.278270.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.437276.log.gz 2023-10-14T22:49:03.618 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.450700.log.gz 2023-10-14T22:49:03.620 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563715.log 2023-10-14T22:49:03.620 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.475692.log.gz 2023-10-14T22:49:03.620 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.533190.log.gz 2023-10-14T22:49:03.621 INFO:teuthology.orchestra.run.smithi064.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97111.log.gz 2023-10-14T22:49:03.621 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.553850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.488538.log 2023-10-14T22:49:03.622 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.563715.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.563715.log.gz 2023-10-14T22:49:03.622 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.159284.log.gz 2023-10-14T22:49:03.622 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.441168.log 2023-10-14T22:49:03.623 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.488538.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.160942.log.gz 2023-10-14T22:49:03.624 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.162303.log.gz 2023-10-14T22:49:03.624 INFO:teuthology.orchestra.run.smithi064.stderr: 79.2% -- replaced with /var/log/ceph/ceph-client.admin.226446.log.gz 2023-10-14T22:49:03.624 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.441168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231312.log 2023-10-14T22:49:03.626 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.249446.log.gz 2023-10-14T22:49:03.627 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.560161.log 2023-10-14T22:49:03.627 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.499004.log.gz 2023-10-14T22:49:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.231312.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.91897.log.gz 2023-10-14T22:49:03.629 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.560161.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251131.log 2023-10-14T22:49:03.631 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574685.log 2023-10-14T22:49:03.632 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.251131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354886.log 2023-10-14T22:49:03.634 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.574685.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.574685.log.gz 2023-10-14T22:49:03.634 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172457.log 2023-10-14T22:49:03.635 INFO:teuthology.orchestra.run.smithi064.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.496912.log.gz 2023-10-14T22:49:03.635 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.354886.log: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.500382.log.gz 2023-10-14T22:49:03.636 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.445546.log 2023-10-14T22:49:03.636 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.447690.log.gz 2023-10-14T22:49:03.637 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.172457.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.560161.log.gz 2023-10-14T22:49:03.638 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.537452.log 2023-10-14T22:49:03.639 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.445546.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.535282.log.gz 2023-10-14T22:49:03.639 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253833.log 2023-10-14T22:49:03.640 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.564178.log.gz 2023-10-14T22:49:03.641 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.537452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385421.log 2023-10-14T22:49:03.644 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.253833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.503000.log 2023-10-14T22:49:03.644 INFO:teuthology.orchestra.run.smithi064.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.170258.log.gz 2023-10-14T22:49:03.646 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.385421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428559.log 2023-10-14T22:49:03.646 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.170267.log.gz 2023-10-14T22:49:03.647 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.503000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216794.log 2023-10-14T22:49:03.648 INFO:teuthology.orchestra.run.smithi064.stderr: 78.2% -- replaced with /var/log/ceph/ceph-client.admin.210550.log.gz 2023-10-14T22:49:03.649 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.428559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233993.log 2023-10-14T22:49:03.649 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.213077.log.gz 2023-10-14T22:49:03.650 INFO:teuthology.orchestra.run.smithi064.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.213493.log.gz 2023-10-14T22:49:03.650 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.216794.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.213086.log.gz 2023-10-14T22:49:03.651 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-14T22:49:03.652 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.233993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299955.log 2023-10-14T22:49:03.653 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.182546.log 2023-10-14T22:49:03.655 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.299955.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.285879.log.gz 2023-10-14T22:49:03.655 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.372296.log 2023-10-14T22:49:03.657 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.182546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576463.log 2023-10-14T22:49:03.659 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.372296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313799.log 2023-10-14T22:49:03.660 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.576463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.548646.log 2023-10-14T22:49:03.660 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98906.log.gz 2023-10-14T22:49:03.662 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.313799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362006.log 2023-10-14T22:49:03.663 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.548646.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.576463.log.gz 2023-10-14T22:49:03.663 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98596.log 2023-10-14T22:49:03.665 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.362006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.433003.log 2023-10-14T22:49:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.98596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269604.log 2023-10-14T22:49:03.667 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.433003.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.95633.log.gz 2023-10-14T22:49:03.668 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.95675.log.gz 2023-10-14T22:49:03.668 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95717.log.gz 2023-10-14T22:49:03.669 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187339.log 2023-10-14T22:49:03.669 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.95759.log.gz 2023-10-14T22:49:03.670 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.269604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173329.log 2023-10-14T22:49:03.671 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.187339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.527024.log 2023-10-14T22:49:03.673 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.173329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586157.log 2023-10-14T22:49:03.673 INFO:teuthology.orchestra.run.smithi064.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.428127.log.gz 2023-10-14T22:49:03.674 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.527024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102443.log 2023-10-14T22:49:03.676 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159275.log 2023-10-14T22:49:03.676 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.586157.log.gz 2023-10-14T22:49:03.678 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102443.log: gzip -5 --verbose 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100569.log.gz 2023-10-14T22:49:03.678 INFO:teuthology.orchestra.run.smithi064.stderr: -- /var/log/ceph/ceph-client.admin.195364.log 2023-10-14T22:49:03.680 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.159275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304643.log 2023-10-14T22:49:03.681 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.195364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160109.log 2023-10-14T22:49:03.683 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.304643.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102047.log 2023-10-14T22:49:03.684 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.160109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.378648.log 2023-10-14T22:49:03.686 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.102047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.521927.log 2023-10-14T22:49:03.687 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.378648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.434291.log 2023-10-14T22:49:03.689 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.521927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216358.log 2023-10-14T22:49:03.690 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.160118.log.gz 2023-10-14T22:49:03.690 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.434291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556774.log 2023-10-14T22:49:03.692 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.216358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.403500.log 2023-10-14T22:49:03.692 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.556765.log.gz 2023-10-14T22:49:03.693 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.556774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579982.log 2023-10-14T22:49:03.695 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.403500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100527.log 2023-10-14T22:49:03.697 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.579982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285462.log 2023-10-14T22:49:03.697 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.87660.log.gz 2023-10-14T22:49:03.698 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.100527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.430743.log 2023-10-14T22:49:03.699 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.285462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448565.log 2023-10-14T22:49:03.700 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.579982.log.gz 2023-10-14T22:49:03.700 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.430743.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.260063.log.gz 2023-10-14T22:49:03.701 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192673.log 2023-10-14T22:49:03.703 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.448565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.498169.log 2023-10-14T22:49:03.705 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.192673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.448103.log 2023-10-14T22:49:03.706 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.498169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359078.log 2023-10-14T22:49:03.708 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.448103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287136.log 2023-10-14T22:49:03.709 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.359078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586248.log 2023-10-14T22:49:03.710 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.503000.log.gz/var/log/ceph/ceph-client.admin.287136.log: 2023-10-14T22:49:03.711 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93253.log 2023-10-14T22:49:03.712 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.586248.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.586248.log.gz 2023-10-14T22:49:03.713 INFO:teuthology.orchestra.run.smithi064.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.363698.log 2023-10-14T22:49:03.714 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.93253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551334.log 2023-10-14T22:49:03.714 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.296627.log.gz 2023-10-14T22:49:03.716 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.363698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97659.log 2023-10-14T22:49:03.716 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.428559.log.gz 2023-10-14T22:49:03.717 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.551334.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.430743.log.gz 2023-10-14T22:49:03.718 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.433003.log.gz 2023-10-14T22:49:03.719 INFO:teuthology.orchestra.run.smithi064.stderr:/var/log/ceph/ceph-client.admin.97659.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97617.log.gz 2023-10-14T22:49:03.722 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.385421.log.gz 2023-10-14T22:49:03.724 INFO:teuthology.orchestra.run.smithi064.stderr: 94.3% -- replaced with /var/log/ceph/ceph-client.admin.194237.log.gz 2023-10-14T22:49:03.727 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.441168.log.gz 2023-10-14T22:49:03.730 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93253.log.gz 2023-10-14T22:49:03.731 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102047.log.gz 2023-10-14T22:49:03.735 INFO:teuthology.orchestra.run.smithi064.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.admin.159275.log.gz 2023-10-14T22:49:03.738 INFO:teuthology.orchestra.run.smithi064.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.216794.log.gz 2023-10-14T22:49:03.739 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.221766.log.gz 2023-10-14T22:49:03.739 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.313799.log.gz 2023-10-14T22:49:03.743 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103716.log.gz 2023-10-14T22:49:03.749 INFO:teuthology.orchestra.run.smithi064.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.admin.231312.log.gz 2023-10-14T22:49:03.750 INFO:teuthology.orchestra.run.smithi064.stderr: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.551334.log.gz 2023-10-14T22:49:03.750 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.504242.log.gz 2023-10-14T22:49:03.755 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.497334.log.gz 2023-10-14T22:49:03.755 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.519691.log.gz 2023-10-14T22:49:03.756 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.142143.log.gz 2023-10-14T22:49:03.757 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.173329.log.gz 2023-10-14T22:49:03.761 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.251131.log.gz 2023-10-14T22:49:03.763 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.287136.log.gz 2023-10-14T22:49:03.764 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98205.log.gz 2023-10-14T22:49:03.768 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.95927.log.gz 2023-10-14T22:49:03.773 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.373128.log.gz 2023-10-14T22:49:03.773 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.373536.log.gz 2023-10-14T22:49:03.775 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.429461.log.gz 2023-10-14T22:49:03.778 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.240923.log.gz 2023-10-14T22:49:03.779 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.257223.log.gz 2023-10-14T22:49:03.799 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.476783.log.gz 2023-10-14T22:49:03.804 INFO:teuthology.orchestra.run.smithi064.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.521927.log.gz 2023-10-14T22:49:03.805 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.522761.log.gz 2023-10-14T22:49:03.807 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100527.log.gz 2023-10-14T22:49:03.840 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.94671.log.gz 2023-10-14T22:49:03.841 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97659.log.gz 2023-10-14T22:49:03.853 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.388683.log.gz 2023-10-14T22:49:03.853 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.397390.log.gz 2023-10-14T22:49:03.854 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.379501.log.gz 2023-10-14T22:49:03.855 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.398717.log.gz 2023-10-14T22:49:03.863 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.462527.log.gz 2023-10-14T22:49:03.864 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.505995.log.gz 2023-10-14T22:49:03.866 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.536564.log.gz 2023-10-14T22:49:03.869 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.553850.log.gz 2023-10-14T22:49:03.871 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.95012.log.gz 2023-10-14T22:49:03.871 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.554268.log.gz 2023-10-14T22:49:03.873 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.250279.log.gz 2023-10-14T22:49:03.873 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101781.log.gz 2023-10-14T22:49:03.875 INFO:teuthology.orchestra.run.smithi064.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.250714.log.gz 2023-10-14T22:49:03.891 INFO:teuthology.orchestra.run.smithi064.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.161372.log.gz 2023-10-14T22:49:03.894 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.303371.log.gz 2023-10-14T22:49:03.894 INFO:teuthology.orchestra.run.smithi064.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.282789.log.gz 2023-10-14T22:49:03.899 INFO:teuthology.orchestra.run.smithi064.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.227312.log.gz 2023-10-14T22:49:03.902 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.268757.log.gz 2023-10-14T22:49:03.908 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.354886.log.gz 2023-10-14T22:49:03.909 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.237982.log.gz 2023-10-14T22:49:03.911 INFO:teuthology.orchestra.run.smithi064.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.157130.log.gz 2023-10-14T22:49:03.917 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.428118.log.gz 2023-10-14T22:49:03.922 INFO:teuthology.orchestra.run.smithi064.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.502114.log.gz 2023-10-14T22:49:03.925 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.510270.log.gz 2023-10-14T22:49:03.925 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.230875.log.gz 2023-10-14T22:49:03.926 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.511535.log.gz 2023-10-14T22:49:03.928 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.498169.log.gz 2023-10-14T22:49:03.932 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.402530.log.gz 2023-10-14T22:49:03.933 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.371464.log.gz 2023-10-14T22:49:03.934 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.379918.log.gz 2023-10-14T22:49:03.936 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.372703.log.gz 2023-10-14T22:49:03.937 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.476145.log.gz 2023-10-14T22:49:03.940 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.255542.log.gz 2023-10-14T22:49:03.962 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.94668.log.gz 2023-10-14T22:49:03.963 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.380747.log.gz 2023-10-14T22:49:03.964 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.314216.log.gz 2023-10-14T22:49:03.964 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94679.log.gz 2023-10-14T22:49:03.965 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.311573.log.gz 2023-10-14T22:49:03.965 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.387849.log.gz 2023-10-14T22:49:03.974 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.508371.log.gz 2023-10-14T22:49:03.976 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.534446.log.gz 2023-10-14T22:49:03.979 INFO:teuthology.orchestra.run.smithi064.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.192148.log.gz 2023-10-14T22:49:03.981 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.232656.log.gz 2023-10-14T22:49:03.985 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.461693.log.gz 2023-10-14T22:49:03.985 INFO:teuthology.orchestra.run.smithi064.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102299.log.gz 2023-10-14T22:49:03.986 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.233101.log.gz 2023-10-14T22:49:03.987 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.233547.log.gz 2023-10-14T22:49:03.990 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.370214.log.gz 2023-10-14T22:49:03.990 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.280004.log.gz 2023-10-14T22:49:03.997 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.386383.log.gz 2023-10-14T22:49:03.999 INFO:teuthology.orchestra.run.smithi064.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.185113.log.gz 2023-10-14T22:49:04.005 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.141640.log.gz 2023-10-14T22:49:04.006 INFO:teuthology.orchestra.run.smithi064.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.155946.log.gz 2023-10-14T22:49:04.008 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.496903.log.gz 2023-10-14T22:49:04.008 INFO:teuthology.orchestra.run.smithi064.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.184270.log.gz 2023-10-14T22:49:04.009 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.500800.log.gz 2023-10-14T22:49:04.012 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.518019.log.gz 2023-10-14T22:49:04.032 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.520155.log.gz 2023-10-14T22:49:04.042 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.528289.log.gz 2023-10-14T22:49:04.044 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.527451.log.gz 2023-10-14T22:49:04.046 INFO:teuthology.orchestra.run.smithi064.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.511126.log.gz 2023-10-14T22:49:04.049 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.542413.log.gz 2023-10-14T22:49:04.051 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.550509.log.gz 2023-10-14T22:49:04.051 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.568892.log.gz 2023-10-14T22:49:04.053 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.505986.log.gz 2023-10-14T22:49:04.065 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.374787.log.gz 2023-10-14T22:49:04.067 INFO:teuthology.orchestra.run.smithi064.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.311582.log.gz 2023-10-14T22:49:04.089 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.381598.log.gz 2023-10-14T22:49:04.122 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.461234.log.gz 2023-10-14T22:49:04.124 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.458731.log.gz 2023-10-14T22:49:04.125 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.458309.log.gz 2023-10-14T22:49:04.149 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.290921.log.gz 2023-10-14T22:49:04.150 INFO:teuthology.orchestra.run.smithi064.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.284498.log.gz 2023-10-14T22:49:04.156 INFO:teuthology.orchestra.run.smithi064.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.264940.log.gz 2023-10-14T22:49:04.159 INFO:teuthology.orchestra.run.smithi064.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.194919.log.gz 2023-10-14T22:49:04.166 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.452372.log.gz 2023-10-14T22:49:04.166 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.366843.log.gz 2023-10-14T22:49:04.171 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.169428.log.gz 2023-10-14T22:49:04.174 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.167311.log.gz 2023-10-14T22:49:04.176 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.265775.log.gz 2023-10-14T22:49:04.179 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.193099.log.gz 2023-10-14T22:49:04.182 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.289237.log.gz 2023-10-14T22:49:04.184 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.190652.log.gz 2023-10-14T22:49:04.188 INFO:teuthology.orchestra.run.smithi064.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.223832.log.gz 2023-10-14T22:49:04.190 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93809.log.gz 2023-10-14T22:49:04.198 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.232647.log.gz 2023-10-14T22:49:04.199 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.238394.log.gz 2023-10-14T22:49:04.199 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.237973.log.gz 2023-10-14T22:49:04.220 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.472314.log.gz 2023-10-14T22:49:04.258 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.523621.log.gz 2023-10-14T22:49:04.270 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.100317.log.gz 2023-10-14T22:49:04.281 INFO:teuthology.orchestra.run.smithi064.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.313790.log.gz 2023-10-14T22:49:04.282 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94676.log.gz 2023-10-14T22:49:04.282 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.505149.log.gz 2023-10-14T22:49:04.283 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.527033.log.gz 2023-10-14T22:49:04.290 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.391718.log.gz 2023-10-14T22:49:04.290 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.389509.log.gz 2023-10-14T22:49:04.292 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.452363.log.gz 2023-10-14T22:49:04.294 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.555520.log.gz 2023-10-14T22:49:04.303 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.493873.log.gz 2023-10-14T22:49:04.308 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.102173.log.gz 2023-10-14T22:49:04.309 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.95297.log.gz 2023-10-14T22:49:04.325 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.219422.log.gz 2023-10-14T22:49:04.326 INFO:teuthology.orchestra.run.smithi064.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.98696.log.gz 2023-10-14T22:49:04.329 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.218556.log.gz 2023-10-14T22:49:04.331 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.210133.log.gz 2023-10-14T22:49:04.333 INFO:teuthology.orchestra.run.smithi064.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.220355.log.gz 2023-10-14T22:49:04.334 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.210976.log.gz 2023-10-14T22:49:04.334 INFO:teuthology.orchestra.run.smithi064.stderr: 78.5% -- replaced with /var/log/ceph/ceph-client.admin.219862.log.gz 2023-10-14T22:49:04.340 INFO:teuthology.orchestra.run.smithi064.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.428568.log.gz 2023-10-14T22:49:04.341 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.454047.log.gz 2023-10-14T22:49:04.341 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.385412.log.gz 2023-10-14T22:49:04.343 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.269186.log.gz 2023-10-14T22:49:04.347 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.287145.log.gz 2023-10-14T22:49:04.350 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.515446.log.gz 2023-10-14T22:49:04.351 INFO:teuthology.orchestra.run.smithi064.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.246407.log.gz 2023-10-14T22:49:04.369 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95591.log.gz 2023-10-14T22:49:04.370 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.495592.log.gz 2023-10-14T22:49:04.377 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.171573.log.gz 2023-10-14T22:49:04.378 INFO:teuthology.orchestra.run.smithi064.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.182123.log.gz 2023-10-14T22:49:04.383 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.260518.log.gz 2023-10-14T22:49:04.397 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.518438.log.gz 2023-10-14T22:49:04.398 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.520573.log.gz 2023-10-14T22:49:04.417 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.236210.log.gz 2023-10-14T22:49:04.418 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.400532.log.gz 2023-10-14T22:49:04.471 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.473147.log.gz 2023-10-14T22:49:04.473 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.473569.log.gz 2023-10-14T22:49:04.473 INFO:teuthology.orchestra.run.smithi064.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.379909.log.gz 2023-10-14T22:49:04.490 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.509262.log.gz 2023-10-14T22:49:04.492 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.530000.log.gz 2023-10-14T22:49:04.498 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.459560.log.gz 2023-10-14T22:49:04.499 INFO:teuthology.orchestra.run.smithi064.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.462518.log.gz 2023-10-14T22:49:04.505 INFO:teuthology.orchestra.run.smithi064.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.102131.log.gz 2023-10-14T22:49:04.522 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.212228.log.gz 2023-10-14T22:49:04.525 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.164818.log.gz 2023-10-14T22:49:04.525 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.527866.log.gz 2023-10-14T22:49:04.528 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99659.log.gz 2023-10-14T22:49:04.537 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.397823.log.gz 2023-10-14T22:49:04.539 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.507396.log.gz 2023-10-14T22:49:04.540 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.508362.log.gz 2023-10-14T22:49:04.541 INFO:teuthology.orchestra.run.smithi064.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.224675.log.gz 2023-10-14T22:49:04.543 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.558437.log.gz 2023-10-14T22:49:04.544 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.517182.log.gz 2023-10-14T22:49:04.557 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.94121.log.gz 2023-10-14T22:49:04.559 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.437285.log.gz 2023-10-14T22:49:04.559 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.438813.log.gz 2023-10-14T22:49:04.562 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.359908.log.gz 2023-10-14T22:49:04.564 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.92289.log.gz 2023-10-14T22:49:04.568 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.380335.log.gz 2023-10-14T22:49:04.577 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.516699.log.gz 2023-10-14T22:49:04.603 INFO:teuthology.orchestra.run.smithi064.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.568883.log.gz 2023-10-14T22:49:04.608 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.373119.log.gz 2023-10-14T22:49:04.609 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.239228.log.gz 2023-10-14T22:49:04.644 INFO:teuthology.orchestra.run.smithi064.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.377394.log.gz 2023-10-14T22:49:04.660 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.314207.log.gz 2023-10-14T22:49:04.664 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.94344.log.gz 2023-10-14T22:49:04.683 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.264090.log.gz 2023-10-14T22:49:04.686 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99110.log.gz 2023-10-14T22:49:04.686 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99332.log.gz 2023-10-14T22:49:04.687 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.460400.log.gz 2023-10-14T22:49:04.698 INFO:teuthology.orchestra.run.smithi064.stderr: 77.9% 88.9% -- replaced with /var/log/ceph/ceph-client.admin.101157.log.gz 2023-10-14T22:49:04.698 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.165643.log.gz 2023-10-14T22:49:04.699 INFO:teuthology.orchestra.run.smithi064.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.299546.log.gz 2023-10-14T22:49:04.701 INFO:teuthology.orchestra.run.smithi064.stderr: 78.4% -- replaced with /var/log/ceph/ceph-client.admin.443951.log.gz 2023-10-14T22:49:04.704 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.287567.log.gz 2023-10-14T22:49:04.710 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.229123.log.gz 2023-10-14T22:49:04.710 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.255125.log.gz 2023-10-14T22:49:04.718 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.375656.log.gz 2023-10-14T22:49:04.721 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91842.log.gz 2023-10-14T22:49:04.724 INFO:teuthology.orchestra.run.smithi064.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.355726.log.gz 2023-10-14T22:49:04.725 INFO:teuthology.orchestra.run.smithi064.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.356565.log.gz 2023-10-14T22:49:04.726 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.520564.log.gz 2023-10-14T22:49:04.728 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.272174.log.gz 2023-10-14T22:49:04.739 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.162721.log.gz 2023-10-14T22:49:04.741 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.158867.log.gz 2023-10-14T22:49:04.742 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.229114.log.gz 2023-10-14T22:49:04.749 INFO:teuthology.orchestra.run.smithi064.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.489865.log.gz 2023-10-14T22:49:04.750 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.398291.log.gz 2023-10-14T22:49:04.751 INFO:teuthology.orchestra.run.smithi064.stderr: 79.7% -- replaced with /var/log/ceph/ceph-client.admin.498578.log.gz 2023-10-14T22:49:04.803 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.400082.log.gz 2023-10-14T22:49:04.804 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.363267.log.gz 2023-10-14T22:49:04.805 INFO:teuthology.orchestra.run.smithi064.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.468082.log.gz 2023-10-14T22:49:04.807 INFO:teuthology.orchestra.run.smithi177.stderr: 93.7% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-14T22:49:04.816 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100611.log.gz 2023-10-14T22:49:04.822 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.183405.log.gz 2023-10-14T22:49:04.848 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94345.log.gz 2023-10-14T22:49:04.849 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97389.log.gz 2023-10-14T22:49:04.878 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.361590.log.gz 2023-10-14T22:49:04.881 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.452789.log.gz 2023-10-14T22:49:04.881 INFO:teuthology.orchestra.run.smithi064.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.461684.log.gz 2023-10-14T22:49:04.884 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95885.log.gz 2023-10-14T22:49:04.885 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97785.log.gz 2023-10-14T22:49:04.887 INFO:teuthology.orchestra.run.smithi064.stderr: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.166060.log.gz 2023-10-14T22:49:04.887 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.101911.log.gz 2023-10-14T22:49:04.889 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.302057.log.gz 2023-10-14T22:49:04.890 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.433420.log.gz 2023-10-14T22:49:04.890 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.223424.log.gz 2023-10-14T22:49:04.897 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.491125.log.gz 2023-10-14T22:49:04.900 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.149729.log.gz 2023-10-14T22:49:04.902 INFO:teuthology.orchestra.run.smithi064.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.247747.log.gz 2023-10-14T22:49:04.904 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.541256.log.gz 2023-10-14T22:49:04.907 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.286301.log.gz 2023-10-14T22:49:04.908 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.528298.log.gz 2023-10-14T22:49:04.914 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.212650.log.gz 2023-10-14T22:49:04.916 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.177310.log.gz 2023-10-14T22:49:04.917 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.192139.log.gz 2023-10-14T22:49:04.919 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.283227.log.gz 2023-10-14T22:49:04.920 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.500809.log.gz 2023-10-14T22:49:04.922 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.141211.log.gz 2023-10-14T22:49:04.924 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.166894.log.gz 2023-10-14T22:49:04.934 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.230430.log.gz 2023-10-14T22:49:04.939 INFO:teuthology.orchestra.run.smithi064.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.91981.log.gz 2023-10-14T22:49:04.960 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.231321.log.gz 2023-10-14T22:49:04.961 INFO:teuthology.orchestra.run.smithi064.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.473560.log.gz 2023-10-14T22:49:04.968 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.172919.log.gz 2023-10-14T22:49:04.970 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.369381.log.gz 2023-10-14T22:49:04.972 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.446390.log.gz 2023-10-14T22:49:04.981 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.399135.log.gz 2023-10-14T22:49:04.992 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.220787.log.gz 2023-10-14T22:49:04.993 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.459153.log.gz 2023-10-14T22:49:05.000 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.165235.log.gz 2023-10-14T22:49:05.014 INFO:teuthology.orchestra.run.smithi064.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.524030.log.gz 2023-10-14T22:49:05.018 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.477645.log.gz 2023-10-14T22:49:05.032 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.509825.log.gz 2023-10-14T22:49:05.065 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.211398.log.gz 2023-10-14T22:49:05.089 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.296210.log.gz 2023-10-14T22:49:05.095 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.355295.log.gz 2023-10-14T22:49:05.116 INFO:teuthology.orchestra.run.smithi064.stderr: 80.0% -- replaced with /var/log/ceph/ceph-client.admin.559722.log.gz 2023-10-14T22:49:05.128 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97491.log.gz 2023-10-14T22:49:05.130 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98426.log.gz -- replaced with /var/log/ceph/ceph-client.admin.98247.log.gz 2023-10-14T22:49:05.130 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:05.131 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.290082.log.gz 2023-10-14T22:49:05.135 INFO:teuthology.orchestra.run.smithi064.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.293881.log.gz 2023-10-14T22:49:05.146 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.236219.log.gz 2023-10-14T22:49:05.149 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.259129.log.gz 2023-10-14T22:49:05.152 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.279595.log.gz 2023-10-14T22:49:05.153 INFO:teuthology.orchestra.run.smithi064.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.214951.log.gz 2023-10-14T22:49:05.160 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.555938.log.gz 2023-10-14T22:49:05.175 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.536573.log.gz 2023-10-14T22:49:05.178 INFO:teuthology.orchestra.run.smithi064.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.555094.log.gz 2023-10-14T22:49:05.182 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.478052.log.gz 2023-10-14T22:49:05.207 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.363689.log.gz 2023-10-14T22:49:05.212 INFO:teuthology.orchestra.run.smithi064.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.356973.log.gz 2023-10-14T22:49:05.213 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.297878.log.gz 2023-10-14T22:49:05.252 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.448980.log.gz 2023-10-14T22:49:05.255 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.367251.log.gz 2023-10-14T22:49:05.256 INFO:teuthology.orchestra.run.smithi064.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.371455.log.gz 2023-10-14T22:49:05.257 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.372287.log.gz 2023-10-14T22:49:05.258 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.91939.log.gz 2023-10-14T22:49:05.262 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.251979.log.gz 2023-10-14T22:49:05.264 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101241.log.gz 2023-10-14T22:49:05.267 INFO:teuthology.orchestra.run.smithi064.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.270442.log.gz 2023-10-14T22:49:05.268 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.173791.log.gz 2023-10-14T22:49:05.269 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.290912.log.gz 2023-10-14T22:49:05.271 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.175509.log.gz 2023-10-14T22:49:05.272 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.476541.log.gz 2023-10-14T22:49:05.273 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.375647.log.gz 2023-10-14T22:49:05.277 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.255134.log.gz 2023-10-14T22:49:05.280 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.182974.log.gz 2023-10-14T22:49:05.280 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.454463.log.gz 2023-10-14T22:49:05.282 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.216803.log.gz 2023-10-14T22:49:05.285 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96563.log.gz 2023-10-14T22:49:05.292 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.284072.log.gz 2023-10-14T22:49:05.293 INFO:teuthology.orchestra.run.smithi064.stderr: 78.1% -- replaced with /var/log/ceph/ceph-client.admin.295367.log.gz 2023-10-14T22:49:05.298 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.447268.log.gz 2023-10-14T22:49:05.304 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.513859.log.gz 2023-10-14T22:49:05.314 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.244676.log.gz 2023-10-14T22:49:05.316 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.258549.log.gz 2023-10-14T22:49:05.321 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.250723.log.gz 2023-10-14T22:49:05.323 INFO:teuthology.orchestra.run.smithi064.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.93563.log.gz 2023-10-14T22:49:05.329 INFO:teuthology.orchestra.run.smithi064.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.384973.log.gz 2023-10-14T22:49:05.350 INFO:teuthology.orchestra.run.smithi064.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.184695.log.gz 2023-10-14T22:49:05.376 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.559274.log.gz 2023-10-14T22:49:05.380 INFO:teuthology.orchestra.run.smithi064.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.525353.log.gz 2023-10-14T22:49:05.401 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.478061.log.gz 2023-10-14T22:49:05.418 INFO:teuthology.orchestra.run.smithi064.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.494703.log.gz 2023-10-14T22:49:05.426 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.491547.log.gz 2023-10-14T22:49:05.428 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.506405.log.gz 2023-10-14T22:49:05.431 INFO:teuthology.orchestra.run.smithi064.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.476420.log.gz 2023-10-14T22:49:05.431 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.280852.log.gz 2023-10-14T22:49:05.432 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.271756.log.gz 2023-10-14T22:49:05.437 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.310627.log.gz 2023-10-14T22:49:05.442 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.443623.log.gz 2023-10-14T22:49:05.442 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.455746.log.gz 2023-10-14T22:49:05.447 INFO:teuthology.orchestra.run.smithi177.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-14T22:49:05.468 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.250288.log.gz 2023-10-14T22:49:05.477 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.169419.log.gz 2023-10-14T22:49:05.478 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.473992.log.gz 2023-10-14T22:49:05.480 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.354041.log.gz 2023-10-14T22:49:05.482 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.378239.log.gz 2023-10-14T22:49:05.492 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.493864.log.gz 2023-10-14T22:49:05.495 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.162294.log.gz 2023-10-14T22:49:05.497 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.160526.log.gz 2023-10-14T22:49:05.507 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.246416.log.gz 81.2% 2023-10-14T22:49:05.508 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.264081.log.gz 2023-10-14T22:49:05.514 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.92247.log.gz 2023-10-14T22:49:05.518 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.248164.log.gz 2023-10-14T22:49:05.520 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.251548.log.gz 2023-10-14T22:49:05.524 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.164401.log.gz 2023-10-14T22:49:05.534 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.232211.log.gz 2023-10-14T22:49:05.566 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.560152.log.gz 2023-10-14T22:49:05.585 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.366329.log.gz 2023-10-14T22:49:05.589 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.297035.log.gz 2023-10-14T22:49:05.592 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.476136.log.gz 2023-10-14T22:49:05.600 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.533621.log.gz 2023-10-14T22:49:05.624 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.524880.log.gz 2023-10-14T22:49:05.629 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.92415.log.gz 2023-10-14T22:49:05.630 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.92457.log.gz 2023-10-14T22:49:05.634 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.281260.log.gz 2023-10-14T22:49:05.648 INFO:teuthology.orchestra.run.smithi064.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.94325.log.gz 2023-10-14T22:49:05.649 INFO:teuthology.orchestra.run.smithi064.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.92499.log.gz 2023-10-14T22:49:05.673 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.354877.log.gz 2023-10-14T22:49:05.673 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101571.log.gz 2023-10-14T22:49:05.674 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.404445.log.gz 2023-10-14T22:49:05.676 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.245516.log.gz 2023-10-14T22:49:05.676 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.98822.log.gz 2023-10-14T22:49:05.677 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98864.log.gz 2023-10-14T22:49:05.678 INFO:teuthology.orchestra.run.smithi064.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.99288.log.gz 2023-10-14T22:49:05.679 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.99701.log.gz 2023-10-14T22:49:05.680 INFO:teuthology.orchestra.run.smithi064.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.100485.log.gz 2023-10-14T22:49:05.685 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.387359.log.gz 2023-10-14T22:49:05.694 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.497751.log.gz 2023-10-14T22:49:05.701 INFO:teuthology.orchestra.run.smithi064.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.95801.log.gz 2023-10-14T22:49:05.705 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.474859.log.gz 2023-10-14T22:49:05.708 INFO:teuthology.orchestra.run.smithi064.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.166477.log.gz 2023-10-14T22:49:05.725 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.236656.log.gz 2023-10-14T22:49:05.726 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.242165.log.gz 2023-10-14T22:49:05.727 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.534872.log.gz 2023-10-14T22:49:05.730 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.395524.log.gz 2023-10-14T22:49:05.790 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.477214.log.gz 2023-10-14T22:49:05.828 INFO:teuthology.orchestra.run.smithi064.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99801.log.gz 2023-10-14T22:49:05.829 INFO:teuthology.orchestra.run.smithi064.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.99459.log.gz 2023-10-14T22:49:05.839 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.533199.log.gz 2023-10-14T22:49:05.841 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.537452.log.gz 2023-10-14T22:49:05.853 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.270451.log.gz 2023-10-14T22:49:05.857 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.298703.log.gz 2023-10-14T22:49:05.869 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.448103.log.gz 2023-10-14T22:49:05.871 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.357390.log.gz 2023-10-14T22:49:05.871 INFO:teuthology.orchestra.run.smithi064.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.95003.log.gz 2023-10-14T22:49:05.876 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.172448.log.gz 2023-10-14T22:49:05.876 INFO:teuthology.orchestra.run.smithi064.stderr: 78.3% -- replaced with /var/log/ceph/ceph-client.admin.160109.log.gz 2023-10-14T22:49:05.877 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.507888.log.gz 2023-10-14T22:49:05.881 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.445546.log.gz 2023-10-14T22:49:05.882 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.291330.log.gz 2023-10-14T22:49:05.884 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.301214.log.gz 2023-10-14T22:49:05.888 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.534038.log.gz 2023-10-14T22:49:05.889 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.256804.log.gz 2023-10-14T22:49:05.891 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.433869.log.gz 2023-10-14T22:49:05.894 INFO:teuthology.orchestra.run.smithi064.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.96459.log.gz 2023-10-14T22:49:05.900 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.217666.log.gz 2023-10-14T22:49:05.904 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.451955.log.gz 2023-10-14T22:49:05.906 INFO:teuthology.orchestra.run.smithi064.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.287975.log.gz 2023-10-14T22:49:05.906 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.288393.log.gz 2023-10-14T22:49:05.908 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.289246.log.gz 2023-10-14T22:49:05.908 INFO:teuthology.orchestra.run.smithi064.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.515854.log.gz 2023-10-14T22:49:05.910 INFO:teuthology.orchestra.run.smithi064.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.260509.log.gz 2023-10-14T22:49:05.916 INFO:teuthology.orchestra.run.smithi064.stderr: 77.6% -- replaced with /var/log/ceph/ceph-client.admin.376067.log.gz 2023-10-14T22:49:05.919 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.364630.log.gz 2023-10-14T22:49:05.924 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.168145.log.gz 2023-10-14T22:49:05.980 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.524447.log.gz 2023-10-14T22:49:05.992 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.298712.log.gz 2023-10-14T22:49:06.003 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.443298.log.gz 2023-10-14T22:49:06.005 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95339.log.gz 2023-10-14T22:49:06.007 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102443.log.gz 2023-10-14T22:49:06.008 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.174639.log.gz 2023-10-14T22:49:07.837 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.191074.log.gz 2023-10-14T22:49:07.943 INFO:teuthology.orchestra.run.smithi064.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.431653.log.gz 2023-10-14T22:49:07.944 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% 80.3% 81.6% -- replaced with /var/log/ceph/ceph-client.admin.558855.log.gz -- replaced with /var/log/ceph/ceph-client.admin.491116.log.gz -- replaced with /var/log/ceph/ceph-client.admin.218973.log.gz 2023-10-14T22:49:07.944 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:07.945 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:07.946 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.471896.log.gz 2023-10-14T22:49:07.946 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.553006.log.gz 2023-10-14T22:49:08.156 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.532706.log.gz 2023-10-14T22:49:08.156 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.508854.log.gz 2023-10-14T22:49:08.157 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.233538.log.gz 2023-10-14T22:49:08.157 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.369788.log.gz 2023-10-14T22:49:08.157 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.245961.log.gz 2023-10-14T22:49:08.158 INFO:teuthology.orchestra.run.smithi064.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.368511.log.gz 2023-10-14T22:49:08.158 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.167728.log.gz 2023-10-14T22:49:08.159 INFO:teuthology.orchestra.run.smithi064.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.549825.log.gz 2023-10-14T22:49:08.160 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% 84.5% -- replaced with /var/log/ceph/ceph-client.admin.292193.log.gz 2023-10-14T22:49:08.160 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.267026.log.gz 2023-10-14T22:49:08.160 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.518855.log.gz 2023-10-14T22:49:08.161 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.372296.log.gz 2023-10-14T22:49:08.161 INFO:teuthology.orchestra.run.smithi064.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.476429.log.gz 2023-10-14T22:49:08.161 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.96055.log.gz 2023-10-14T22:49:08.161 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.376985.log.gz 2023-10-14T22:49:08.162 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.514289.log.gz 2023-10-14T22:49:08.162 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.302953.log.gz 2023-10-14T22:49:08.162 INFO:teuthology.orchestra.run.smithi064.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.512950.log.gz 2023-10-14T22:49:08.165 INFO:teuthology.orchestra.run.smithi064.stderr: 92.9% 84.2% -- replaced with /var/log/ceph/ceph-client.admin.274547.log.gz 2023-10-14T22:49:08.165 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.359069.log.gz 2023-10-14T22:49:08.165 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.377821.log.gz 2023-10-14T22:49:08.165 INFO:teuthology.orchestra.run.smithi064.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.518846.log.gz 89.8% 85.9% -- replaced with /var/log/ceph/ceph-client.admin.388257.log.gz 2023-10-14T22:49:08.166 INFO:teuthology.orchestra.run.smithi064.stderr: 77.3% -- replaced with /var/log/ceph/ceph-client.admin.534029.log.gz 2023-10-14T22:49:08.166 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.219871.log.gz 2023-10-14T22:49:08.166 INFO:teuthology.orchestra.run.smithi064.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.296201.log.gz 2023-10-14T22:49:08.167 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.300797.log.gz 2023-10-14T22:49:08.167 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.167 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.238811.log.gz 2023-10-14T22:49:08.168 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.303780.log.gz 2023-10-14T22:49:08.168 INFO:teuthology.orchestra.run.smithi064.stderr: 77.7% -- replaced with /var/log/ceph/ceph-client.admin.209711.log.gz 2023-10-14T22:49:08.168 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-14T22:49:08.168 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% 85.4% -- replaced with /var/log/ceph/ceph-client.admin.192673.log.gz 2023-10-14T22:49:08.169 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.175921.log.gz 2023-10-14T22:49:08.169 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.94340.log.gz 2023-10-14T22:49:08.169 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.269195.log.gz 2023-10-14T22:49:08.170 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.95549.log.gz 2023-10-14T22:49:08.170 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.502123.log.gz 2023-10-14T22:49:08.170 INFO:teuthology.orchestra.run.smithi064.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.505566.log.gz 2023-10-14T22:49:08.170 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.228206.log.gz 2023-10-14T22:49:08.171 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.251988.log.gz 2023-10-14T22:49:08.182 INFO:teuthology.orchestra.run.smithi064.stderr: 79.4% 80.5% 77.8% -- replaced with /var/log/ceph/ceph-client.admin.313368.log.gz 2023-10-14T22:49:08.182 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.304643.log.gz 2023-10-14T22:49:08.183 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.362838.log.gz 2023-10-14T22:49:08.183 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.253833.log.gz 2023-10-14T22:49:08.183 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.510701.log.gz 2023-10-14T22:49:08.184 INFO:teuthology.orchestra.run.smithi064.stderr: 85.7% 80.5% -- replaced with /var/log/ceph/ceph-client.admin.492898.log.gz 2023-10-14T22:49:08.184 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.210559.log.gz 2023-10-14T22:49:08.184 INFO:teuthology.orchestra.run.smithi064.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98079.log.gz 2023-10-14T22:49:08.184 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.402521.log.gz 2023-10-14T22:49:08.185 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.431644.log.gz 2023-10-14T22:49:08.185 INFO:teuthology.orchestra.run.smithi064.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.269604.log.gz 88.2% 2023-10-14T22:49:08.185 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.100863.log.gz 93.4% -- replaced with /var/log/ceph/ceph-client.admin.443632.log.gz 2023-10-14T22:49:08.186 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.186 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.368094.log.gz 2023-10-14T22:49:08.186 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.554677.log.gz 2023-10-14T22:49:08.186 INFO:teuthology.orchestra.run.smithi064.stderr: 83.4% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.92205.log.gz 2023-10-14T22:49:08.187 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.218111.log.gz 2023-10-14T22:49:08.187 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.366338.log.gz 2023-10-14T22:49:08.187 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.193925.log.gz 81.2% -- replaced with /var/log/ceph/ceph-client.admin.516272.log.gz 2023-10-14T22:49:08.188 INFO:teuthology.orchestra.run.smithi064.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.558864.log.gz 2023-10-14T22:49:08.188 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% 81.5% -- replaced with /var/log/ceph/ceph-client.admin.452780.log.gz 2023-10-14T22:49:08.189 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.288815.log.gz 2023-10-14T22:49:08.189 INFO:teuthology.orchestra.run.smithi064.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.admin.381177.log.gz 2023-10-14T22:49:08.189 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.149321.log.gz 2023-10-14T22:49:08.189 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.190 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.150626.log.gz 2023-10-14T22:49:08.190 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.367260.log.gz 2023-10-14T22:49:08.190 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.285462.log.gz 2023-10-14T22:49:08.191 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.529128.log.gz 2023-10-14T22:49:08.191 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.244685.log.gz 89.7% 2023-10-14T22:49:08.191 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.384137.log.gz 2023-10-14T22:49:08.191 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.274556.log.gz 2023-10-14T22:49:08.192 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.251557.log.gz 2023-10-14T22:49:08.192 INFO:teuthology.orchestra.run.smithi064.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.210967.log.gz 2023-10-14T22:49:08.192 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.497742.log.gz 2023-10-14T22:49:08.193 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.257214.log.gz 2023-10-14T22:49:08.193 INFO:teuthology.orchestra.run.smithi064.stderr: 78.6% -- replaced with /var/log/ceph/ceph-client.admin.229976.log.gz 92.3% -- replaced with /var/log/ceph/ceph-client.admin.474438.log.gz 2023-10-14T22:49:08.193 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.193 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.190661.log.gz 2023-10-14T22:49:08.194 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.163559.log.gz -- replaced with /var/log/ceph/ceph-client.admin.212237.log.gz 2023-10-14T22:49:08.194 INFO:teuthology.orchestra.run.smithi064.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.506886.log.gz 2023-10-14T22:49:08.194 INFO:teuthology.orchestra.run.smithi064.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100443.log.gz 2023-10-14T22:49:08.195 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.195 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.95381.log.gz 2023-10-14T22:49:08.195 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.492414.log.gz 93.3% -- replaced with /var/log/ceph/ceph-client.admin.236665.log.gz 2023-10-14T22:49:08.196 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.196 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.243429.log.gz 2023-10-14T22:49:08.196 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.243010.log.gz 2023-10-14T22:49:08.196 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.193934.log.gz 2023-10-14T22:49:08.197 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.556774.log.gz 2023-10-14T22:49:08.197 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.388266.log.gz 2023-10-14T22:49:08.197 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.530467.log.gz 2023-10-14T22:49:08.197 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.557192.log.gz 2023-10-14T22:49:08.198 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.182132.log.gz 2023-10-14T22:49:08.198 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.434291.log.gz 2023-10-14T22:49:08.198 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.93605.log.gz 2023-10-14T22:49:08.199 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.436831.log.gz 2023-10-14T22:49:08.199 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.360755.log.gz 2023-10-14T22:49:08.199 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.166069.log.gz 2023-10-14T22:49:08.199 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% 89.8% -- replaced with /var/log/ceph/ceph-client.admin.494290.log.gz 2023-10-14T22:49:08.200 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.368961.log.gz 2023-10-14T22:49:08.200 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.262410.log.gz 81.1% -- replaced with /var/log/ceph/ceph-client.admin.278270.log.gz 2023-10-14T22:49:08.200 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.201 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.355304.log.gz 2023-10-14T22:49:08.201 INFO:teuthology.orchestra.run.smithi064.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.433860.log.gz 2023-10-14T22:49:08.201 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.398282.log.gz 2023-10-14T22:49:08.202 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% 78.2% -- replaced with /var/log/ceph/ceph-client.admin.258049.log.gz 2023-10-14T22:49:08.202 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.403023.log.gz 2023-10-14T22:49:08.202 INFO:teuthology.orchestra.run.smithi064.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101401.log.gz 2023-10-14T22:49:08.202 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.275845.log.gz 90.0% -- replaced with /var/log/ceph/ceph-client.admin.358660.log.gz 2023-10-14T22:49:08.203 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102635.log.gz 2023-10-14T22:49:08.203 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% 2023-10-14T22:49:08.203 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.518429.log.gz 2023-10-14T22:49:08.204 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.226901.log.gz 2023-10-14T22:49:08.204 INFO:teuthology.orchestra.run.smithi064.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.93437.log.gz 2023-10-14T22:49:08.204 INFO:teuthology.orchestra.run.smithi064.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.397814.log.gz 2023-10-14T22:49:08.204 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.289655.log.gz 2023-10-14T22:49:08.205 INFO:teuthology.orchestra.run.smithi064.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.187330.log.gz 2023-10-14T22:49:08.205 INFO:teuthology.orchestra.run.smithi064.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99843.log.gz 2023-10-14T22:49:08.205 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.280435.log.gz 2023-10-14T22:49:08.206 INFO:teuthology.orchestra.run.smithi064.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.441587.log.gz 2023-10-14T22:49:08.206 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.270869.log.gz 2023-10-14T22:49:08.206 INFO:teuthology.orchestra.run.smithi064.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.admin.402021.log.gz 2023-10-14T22:49:08.206 INFO:teuthology.orchestra.run.smithi064.stderr: 78.7% -- replaced with /var/log/ceph/ceph-client.admin.548646.log.gz 2023-10-14T22:49:08.207 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.92331.log.gz 2023-10-14T22:49:08.207 INFO:teuthology.orchestra.run.smithi064.stderr: 89.5% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.95843.log.gz 2023-10-14T22:49:08.207 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.429452.log.gz 2023-10-14T22:49:08.207 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.381186.log.gz 2023-10-14T22:49:08.208 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.93479.log.gz 2023-10-14T22:49:08.208 INFO:teuthology.orchestra.run.smithi064.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.0.102912.log.gz 2023-10-14T22:49:08.209 INFO:teuthology.orchestra.run.smithi064.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.95213.log.gz 2023-10-14T22:49:08.209 INFO:teuthology.orchestra.run.smithi064.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.495166.log.gz 2023-10-14T22:49:08.210 INFO:teuthology.orchestra.run.smithi064.stderr: 79.8% -- replaced with /var/log/ceph/ceph-client.admin.502991.log.gz 2023-10-14T22:49:08.210 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.289664.log.gz 2023-10-14T22:49:08.211 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.184279.log.gz 2023-10-14T22:49:08.211 INFO:teuthology.orchestra.run.smithi064.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.517173.log.gz 2023-10-14T22:49:08.211 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.477223.log.gz 2023-10-14T22:49:08.211 INFO:teuthology.orchestra.run.smithi064.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.271310.log.gz 2023-10-14T22:49:08.212 INFO:teuthology.orchestra.run.smithi064.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.260966.log.gz 2023-10-14T22:49:08.212 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.234883.log.gz 2023-10-14T22:49:08.212 INFO:teuthology.orchestra.run.smithi064.stderr: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.443720.log.gz 2023-10-14T22:49:08.213 INFO:teuthology.orchestra.run.smithi064.stderr: 88.0% 89.9% -- replaced with /var/log/ceph/ceph-client.admin.455315.log.gz 2023-10-14T22:49:08.213 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.168154.log.gz 2023-10-14T22:49:08.213 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101961.log.gz 2023-10-14T22:49:08.213 INFO:teuthology.orchestra.run.smithi064.stderr: 77.5% -- replaced with /var/log/ceph/ceph-client.admin.551752.log.gz 2023-10-14T22:49:08.214 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.448989.log.gz 2023-10-14T22:49:08.214 INFO:teuthology.orchestra.run.smithi064.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.144064.log.gz 2023-10-14T22:49:08.214 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.211815.log.gz 2023-10-14T22:49:08.214 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.403500.log.gz 2023-10-14T22:49:08.215 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.298295.log.gz 2023-10-14T22:49:08.215 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.182546.log.gz 2023-10-14T22:49:08.215 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.275392.log.gz 2023-10-14T22:49:08.218 INFO:teuthology.orchestra.run.smithi064.stderr: 77.5% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.227770.log.gz 2023-10-14T22:49:08.219 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.157995.log.gz 2023-10-14T22:49:08.219 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.555511.log.gz 85.0% 2023-10-14T22:49:08.219 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.240497.log.gz 2023-10-14T22:49:08.220 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.235774.log.gz 2023-10-14T22:49:08.220 INFO:teuthology.orchestra.run.smithi064.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97995.log.gz 2023-10-14T22:49:08.220 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100275.log.gz 2023-10-14T22:49:08.220 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.97068.log.gz 2023-10-14T22:49:08.221 INFO:teuthology.orchestra.run.smithi064.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.275383.log.gz 2023-10-14T22:49:08.221 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.158413.log.gz 2023-10-14T22:49:08.221 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.474429.log.gz 2023-10-14T22:49:08.222 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.511986.log.gz 2023-10-14T22:49:08.222 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.507405.log.gz 2023-10-14T22:49:08.222 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.184704.log.gz 2023-10-14T22:49:08.223 INFO:teuthology.orchestra.run.smithi064.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.273204.log.gz 89.7% 2023-10-14T22:49:08.223 INFO:teuthology.orchestra.run.smithi064.stderr: -- replaced with /var/log/ceph/ceph-client.admin.551343.log.gz 2023-10-14T22:49:08.224 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.451121.log.gz 2023-10-14T22:49:08.224 INFO:teuthology.orchestra.run.smithi064.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.143199.log.gz 2023-10-14T22:49:08.225 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.284507.log.gz 2023-10-14T22:49:08.225 INFO:teuthology.orchestra.run.smithi064.stderr: 85.1% 80.5% -- replaced with /var/log/ceph/ceph-client.admin.295784.log.gz 2023-10-14T22:49:08.226 INFO:teuthology.orchestra.run.smithi064.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.437693.log.gz -- replaced with /var/log/ceph/ceph-client.admin.378648.log.gz 2023-10-14T22:49:08.226 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-14T22:49:08.226 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.91718.log.gz 2023-10-14T22:49:08.227 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.527024.log.gz 2023-10-14T22:49:08.227 INFO:teuthology.orchestra.run.smithi064.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.182555.log.gz 2023-10-14T22:49:08.227 INFO:teuthology.orchestra.run.smithi064.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.182983.log.gz 2023-10-14T22:49:08.228 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.229985.log.gz 2023-10-14T22:49:08.228 INFO:teuthology.orchestra.run.smithi064.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.313377.log.gz 2023-10-14T22:49:08.229 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.261440.log.gz 2023-10-14T22:49:08.264 INFO:teuthology.orchestra.run.smithi064.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.526607.log.gz 2023-10-14T22:49:08.297 INFO:teuthology.orchestra.run.smithi064.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.443307.log.gz 2023-10-14T22:49:08.320 INFO:teuthology.orchestra.run.smithi064.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.473983.log.gz 2023-10-14T22:49:08.343 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.435572.log.gz 2023-10-14T22:49:08.346 INFO:teuthology.orchestra.run.smithi064.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.494712.log.gz 2023-10-14T22:49:08.353 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.259594.log.gz 2023-10-14T22:49:08.356 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.365088.log.gz 2023-10-14T22:49:08.362 INFO:teuthology.orchestra.run.smithi064.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.266610.log.gz 2023-10-14T22:49:08.365 INFO:teuthology.orchestra.run.smithi064.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101443.log.gz 2023-10-14T22:49:08.370 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.442890.log.gz 2023-10-14T22:49:08.374 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.384555.log.gz 2023-10-14T22:49:08.374 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97701.log.gz 2023-10-14T22:49:08.375 INFO:teuthology.orchestra.run.smithi064.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.98596.log.gz 2023-10-14T22:49:08.376 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.375226.log.gz 2023-10-14T22:49:08.380 INFO:teuthology.orchestra.run.smithi064.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.443729.log.gz 2023-10-14T22:49:08.384 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.243420.log.gz 2023-10-14T22:49:08.389 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.185539.log.gz 2023-10-14T22:49:08.399 INFO:teuthology.orchestra.run.smithi064.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.230421.log.gz 2023-10-14T22:49:08.402 INFO:teuthology.orchestra.run.smithi064.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.249862.log.gz 2023-10-14T22:49:08.476 INFO:teuthology.orchestra.run.smithi064.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.550092.log.gz 2023-10-14T22:49:08.558 INFO:teuthology.orchestra.run.smithi064.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.501226.log.gz 2023-10-14T22:49:08.581 INFO:teuthology.orchestra.run.smithi064.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.532262.log.gz 2023-10-14T22:49:08.749 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.532271.log.gz 2023-10-14T22:49:09.124 INFO:teuthology.orchestra.run.smithi064.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.536126.log.gz 2023-10-14T22:49:09.125 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.499427.log.gz 2023-10-14T22:49:09.178 INFO:teuthology.orchestra.run.smithi064.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.91637.log.gz 2023-10-14T22:49:09.185 INFO:teuthology.orchestra.run.smithi064.stderr: 77.8% -- replaced with /var/log/ceph/ceph-client.admin.282780.log.gz 2023-10-14T22:49:09.266 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.489457.log.gz 2023-10-14T22:49:09.273 INFO:teuthology.orchestra.run.smithi064.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.291752.log.gz 2023-10-14T22:49:09.289 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.233993.log.gz 2023-10-14T22:49:09.302 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.443584.log.gz 2023-10-14T22:49:09.435 INFO:teuthology.orchestra.run.smithi064.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.362006.log.gz 2023-10-14T22:49:09.441 INFO:teuthology.orchestra.run.smithi064.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.374796.log.gz 2023-10-14T22:49:09.453 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.216358.log.gz 2023-10-14T22:49:09.458 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.170689.log.gz 2023-10-14T22:49:09.461 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.257641.log.gz 2023-10-14T22:49:09.473 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.228215.log.gz 2023-10-14T22:49:09.550 INFO:teuthology.orchestra.run.smithi064.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.191699.log.gz 2023-10-14T22:49:09.671 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.506414.log.gz 2023-10-14T22:49:09.681 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.441596.log.gz 2023-10-14T22:49:09.684 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.363276.log.gz 2023-10-14T22:49:09.688 INFO:teuthology.orchestra.run.smithi064.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.274974.log.gz 2023-10-14T22:49:09.690 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.430296.log.gz 2023-10-14T22:49:09.696 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.359078.log.gz 2023-10-14T22:49:09.766 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175080.log.gz 2023-10-14T22:49:09.796 INFO:teuthology.orchestra.run.smithi064.stderr: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.237561.log.gz 2023-10-14T22:49:09.992 INFO:teuthology.orchestra.run.smithi064.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.165652.log.gz 2023-10-14T22:49:10.053 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.514855.log.gz 2023-10-14T22:49:10.057 INFO:teuthology.orchestra.run.smithi064.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.235328.log.gz 2023-10-14T22:49:10.138 INFO:teuthology.orchestra.run.smithi064.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.312949.log.gz 2023-10-14T22:49:10.172 INFO:teuthology.orchestra.run.smithi064.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.456617.log.gz 2023-10-14T22:49:10.436 INFO:teuthology.orchestra.run.smithi064.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.299955.log.gz 2023-10-14T22:49:10.758 INFO:teuthology.orchestra.run.smithi064.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.310185.log.gz 2023-10-14T22:49:10.775 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.443680.log.gz 2023-10-14T22:49:10.812 INFO:teuthology.orchestra.run.smithi064.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.401013.log.gz 2023-10-14T22:49:10.971 INFO:teuthology.orchestra.run.smithi064.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.186426.log.gz 2023-10-14T22:49:11.020 INFO:teuthology.orchestra.run.smithi064.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.511544.log.gz 2023-10-14T22:49:11.030 INFO:teuthology.orchestra.run.smithi064.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.271319.log.gz 2023-10-14T22:49:11.169 INFO:teuthology.orchestra.run.smithi064.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.443960.log.gz 2023-10-14T22:49:11.194 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.401521.log.gz 2023-10-14T22:49:11.363 INFO:teuthology.orchestra.run.smithi064.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.524871.log.gz 2023-10-14T22:49:11.483 INFO:teuthology.orchestra.run.smithi064.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.509834.log.gz 2023-10-14T22:49:11.551 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.502542.log.gz 2023-10-14T22:49:11.694 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.231766.log.gz 2023-10-14T22:49:12.174 INFO:teuthology.orchestra.run.smithi064.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.516690.log.gz 2023-10-14T22:49:12.320 INFO:teuthology.orchestra.run.smithi064.stderr: 92.8% -- replaced with /var/log/ceph/ceph-client.admin.448565.log.gz 2023-10-14T22:49:12.341 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-14T22:49:12.451 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.450251.log.gz 2023-10-14T22:49:13.329 INFO:teuthology.orchestra.run.smithi064.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.488529.log.gz 2023-10-14T22:49:13.332 INFO:teuthology.orchestra.run.smithi064.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101655.log.gz 2023-10-14T22:49:13.349 INFO:teuthology.orchestra.run.smithi064.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.530009.log.gz 2023-10-14T22:49:13.961 INFO:teuthology.orchestra.run.smithi064.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.221271.log.gz 2023-10-14T22:49:15.708 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.428998.log.gz 2023-10-14T22:49:15.709 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.403990.log.gz 2023-10-14T22:49:15.711 INFO:teuthology.orchestra.run.smithi064.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.140199.log.gz 2023-10-14T22:49:15.713 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.141649.log.gz 2023-10-14T22:49:16.135 INFO:teuthology.orchestra.run.smithi064.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-14T22:49:17.688 INFO:teuthology.orchestra.run.smithi064.stderr: 95.8% -- replaced with /var/log/ceph/ceph-client.admin.254250.log.gz 2023-10-14T22:49:20.104 INFO:teuthology.orchestra.run.smithi064.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.155955.log.gz 2023-10-14T22:49:22.785 INFO:teuthology.orchestra.run.smithi064.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.438822.log.gz 2023-10-14T22:49:29.525 INFO:teuthology.orchestra.run.smithi064.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.294307.log.gz 2023-10-14T22:49:33.076 INFO:teuthology.orchestra.run.smithi064.stderr: 94.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-14T22:49:33.106 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.431162.log.gz 2023-10-14T22:49:40.024 INFO:teuthology.orchestra.run.smithi064.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.259138.log.gz 2023-10-14T22:49:40.026 INFO:teuthology.orchestra.run.smithi064.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.admin.282177.log.gz 2023-10-14T22:49:40.163 INFO:teuthology.orchestra.run.smithi064.stderr: 94.6% -- replaced with /var/log/ceph/ceph-client.admin.158422.log.gz 2023-10-14T22:49:41.661 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.171111.log.gz 2023-10-14T22:49:41.974 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.144984.log.gz 2023-10-14T22:49:45.064 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.171995.log.gz 2023-10-14T22:49:45.131 INFO:teuthology.orchestra.run.smithi064.stderr: 95.5% -- replaced with /var/log/ceph/ceph-client.admin.437702.log.gz 2023-10-14T22:49:45.439 INFO:teuthology.orchestra.run.smithi064.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.396432.log.gz 2023-10-14T22:49:45.682 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.281269.log.gz 2023-10-14T22:49:45.778 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.149738.log.gz 2023-10-14T22:49:46.032 INFO:teuthology.orchestra.run.smithi064.stderr: 95.2% -- replaced with /var/log/ceph/ceph-client.admin.509271.log.gz 2023-10-14T22:49:46.085 INFO:teuthology.orchestra.run.smithi064.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.261961.log.gz 2023-10-14T22:49:49.549 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.281738.log.gz 2023-10-14T22:49:51.631 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.364639.log.gz 2023-10-14T22:49:51.632 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.155486.log.gz 2023-10-14T22:49:51.642 INFO:teuthology.orchestra.run.smithi064.stderr: 96.3% -- replaced with /var/log/ceph/ceph-client.admin.488538.log.gz 2023-10-14T22:49:53.027 INFO:teuthology.orchestra.run.smithi064.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.448112.log.gz 2023-10-14T22:49:53.028 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.173338.log.gz 2023-10-14T22:49:53.168 INFO:teuthology.orchestra.run.smithi064.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.172457.log.gz 2023-10-14T22:49:53.288 INFO:teuthology.orchestra.run.smithi064.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.143636.log.gz 2023-10-14T22:49:54.183 INFO:teuthology.orchestra.run.smithi064.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.364131.log.gz 2023-10-14T22:49:54.892 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.177319.log.gz 2023-10-14T22:49:56.892 INFO:teuthology.orchestra.run.smithi064.stderr: 96.7% -- replaced with /var/log/ceph/ceph-client.admin.155017.log.gz 2023-10-14T22:49:57.475 INFO:teuthology.orchestra.run.smithi064.stderr: 96.8% -- replaced with /var/log/ceph/ceph-client.admin.312084.log.gz 2023-10-14T22:49:58.364 INFO:teuthology.orchestra.run.smithi064.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.272183.log.gz 2023-10-14T22:49:58.432 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.363698.log.gz 2023-10-14T22:49:59.122 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.143208.log.gz 2023-10-14T22:49:59.393 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.389518.log.gz 2023-10-14T22:50:10.113 INFO:teuthology.orchestra.run.smithi064.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.151460.log.gz 2023-10-14T22:50:14.003 INFO:teuthology.orchestra.run.smithi064.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.admin.258058.log.gz 2023-10-14T22:50:15.673 INFO:teuthology.orchestra.run.smithi064.stderr: 96.6% -- replaced with /var/log/ceph/ceph-client.admin.278720.log.gz 2023-10-14T22:50:16.265 INFO:teuthology.orchestra.run.smithi064.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-14T22:50:17.921 INFO:teuthology.orchestra.run.smithi064.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.531716.log.gz 2023-10-14T22:50:18.642 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-14T22:50:21.798 INFO:teuthology.orchestra.run.smithi064.stderr: 96.5% -- replaced with /var/log/ceph/ceph-client.admin.439746.log.gz 2023-10-14T22:50:32.407 INFO:teuthology.orchestra.run.smithi064.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.276289.log.gz 2023-10-14T22:50:36.803 INFO:teuthology.orchestra.run.smithi064.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.admin.161847.log.gz 2023-10-14T22:50:47.687 INFO:teuthology.orchestra.run.smithi177.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-14T22:50:49.505 INFO:teuthology.orchestra.run.smithi064.stderr: 97.0% -- replaced with /var/log/ceph/ceph-client.admin.529555.log.gz 2023-10-14T22:50:53.144 INFO:teuthology.orchestra.run.smithi177.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-14T22:51:20.331 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.284925.log.gz 2023-10-14T22:51:40.801 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.214392.log.gz 2023-10-14T22:51:42.835 INFO:teuthology.orchestra.run.smithi064.stderr: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.148537.log.gz 2023-10-14T22:51:54.370 INFO:teuthology.orchestra.run.smithi064.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.258558.log.gz 2023-10-14T22:52:09.164 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.181239.log.gz 2023-10-14T22:52:14.734 INFO:teuthology.orchestra.run.smithi064.stderr: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.381607.log.gz 2023-10-14T22:53:10.652 INFO:teuthology.orchestra.run.smithi064.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.214960.log.gz 2023-10-14T22:54:13.906 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.191083.log.gz 2023-10-14T22:54:50.244 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.148787.log.gz 2023-10-14T22:55:02.141 INFO:teuthology.orchestra.run.smithi064.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.399144.log.gz 2023-10-14T22:55:40.315 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.176347.log.gz 2023-10-14T22:57:00.145 INFO:teuthology.orchestra.run.smithi064.stderr: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.195364.log.gz 2023-10-14T22:57:31.537 INFO:teuthology.orchestra.run.smithi064.stderr: 94.9% -- replaced with /var/log/ceph/ceph-client.admin.142152.log.gz 2023-10-14T22:57:42.397 INFO:teuthology.orchestra.run.smithi064.stderr: 96.0% -- replaced with /var/log/ceph/ceph-client.admin.225548.log.gz 2023-10-14T22:59:07.873 INFO:teuthology.orchestra.run.smithi064.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.admin.440638.log.gz 2023-10-14T23:00:09.717 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.144482.log.gz 2023-10-14T23:03:39.741 INFO:teuthology.orchestra.run.smithi064.stderr: 96.4% -- replaced with /var/log/ceph/ceph-client.admin.294757.log.gz 2023-10-14T23:05:14.552 INFO:teuthology.orchestra.run.smithi064.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.admin.549835.log.gz 2023-10-14T23:06:04.688 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-14T23:06:35.204 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-14T23:06:54.156 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-14T23:07:15.646 INFO:teuthology.orchestra.run.smithi064.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.273672.log.gz 2023-10-14T23:07:26.183 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-14T23:07:26.189 INFO:teuthology.orchestra.run.smithi177.stderr: 2023-10-14T23:07:26.189 INFO:teuthology.orchestra.run.smithi177.stderr:real 18m24.895s 2023-10-14T23:07:26.190 INFO:teuthology.orchestra.run.smithi177.stderr:user 18m51.005s 2023-10-14T23:07:26.190 INFO:teuthology.orchestra.run.smithi177.stderr:sys 2m28.308s 2023-10-14T23:08:09.306 INFO:teuthology.orchestra.run.smithi064.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.142652.log.gz 2023-10-14T23:08:22.289 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.145453.log.gz 2023-10-14T23:08:47.661 INFO:teuthology.orchestra.run.smithi064.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.405895.log.gz 2023-10-14T23:10:25.255 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.548656.log.gz 2023-10-14T23:11:01.407 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.547444.log.gz 2023-10-14T23:11:36.302 INFO:teuthology.orchestra.run.smithi064.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-14T23:12:23.812 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.546234.log.gz 2023-10-14T23:12:48.795 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.540058.log.gz 2023-10-14T23:13:42.222 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.542422.log.gz 2023-10-14T23:14:08.593 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.538885.log.gz 2023-10-14T23:14:28.524 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.537461.log.gz 2023-10-14T23:14:29.260 INFO:teuthology.orchestra.run.smithi064.stderr: 92.1% -- replaced with /var/log/ceph/ceph-client.admin.541266.log.gz 2023-10-14T23:14:59.170 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.544888.log.gz 2023-10-14T23:15:22.329 INFO:teuthology.orchestra.run.smithi064.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.543654.log.gz 2023-10-14T23:17:37.843 INFO:teuthology.orchestra.run.smithi064.stderr: 95.3% -- replaced with /var/log/ceph/ceph-client.admin.315059.log.gz 2023-10-14T23:21:08.929 INFO:teuthology.orchestra.run.smithi064.stderr: 94.5% -- replaced with /var/log/ceph/ceph-client.admin.221775.log.gz 2023-10-14T23:22:51.692 INFO:teuthology.orchestra.run.smithi064.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.478478.log.gz 2023-10-14T23:23:02.459 INFO:teuthology.orchestra.run.smithi064.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.305103.log.gz 2023-10-14T23:31:36.745 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.468091.log.gz 2023-10-14T23:32:13.857 INFO:teuthology.orchestra.run.smithi064.stderr: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.463366.log.gz 2023-10-14T23:41:31.691 INFO:teuthology.orchestra.run.smithi064.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-14T23:42:29.862 INFO:teuthology.orchestra.run.smithi064.stderr: 91.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-14T23:45:09.561 INFO:teuthology.orchestra.run.smithi064.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.187339.log.gz 2023-10-14T23:55:30.237 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-15T00:06:00.090 INFO:teuthology.orchestra.run.smithi064.stderr: 95.6% -- replaced with /var/log/ceph/ceph-client.admin.178177.log.gz 2023-10-15T00:11:56.090 INFO:teuthology.orchestra.run.smithi064.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.560598.log.gz 2023-10-15T00:11:56.095 INFO:teuthology.orchestra.run.smithi064.stderr: 2023-10-15T00:11:56.095 INFO:teuthology.orchestra.run.smithi064.stderr:real 82m54.803s 2023-10-15T00:11:56.095 INFO:teuthology.orchestra.run.smithi064.stderr:user 71m39.098s 2023-10-15T00:11:56.096 INFO:teuthology.orchestra.run.smithi064.stderr:sys 10m6.399s 2023-10-15T00:11:56.097 INFO:tasks.ceph:Archiving logs... 2023-10-15T00:11:56.183 DEBUG:teuthology.misc:Transferring archived files from smithi064:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-10-13_18:04:14-fs-rishabh-2023oct13-testing-default-smithi/7425313/remote/smithi064/log 2023-10-15T00:11:56.184 DEBUG:teuthology.orchestra.run.smithi064:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-15T00:12:39.343 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-10-15T00:12:39.462 DEBUG:teuthology.task.console_log:Killing console logger for smithi064 2023-10-15T00:12:39.463 DEBUG:teuthology.task.console_log:Killing console logger for smithi177 2023-10-15T00:12:39.464 DEBUG:teuthology.exit:Finished running handlers